A Survey on Image Restoration in the Foundation Model Era
Foundation models provide transferable representations, generative priors, and multimodal understanding, offering new ways to address diverse image degradations and restoration requirements. This survey reviews three complementary directions: leveraging existing foundation models for image restoration, developing restoration-oriented foundation models, and coordinating restoration models and tools through agents. We examine how pretrained representations, generative priors, and additional supervision support image restoration. For restoration-oriented foundation models, we compare pretraining, unified modeling, and adaptation strategies across tasks and domains. For agentic image restoration, we examine how agents coordinate restoration models and tools within a unified framework for diverse tasks through task planning, tool selection, feedback-driven refinement, and experience retrieval. We summarize reported benchmark results and model budgets to examine the strengths and limitations of existing methods, taking into account differences in training coverage, adaptation, and evaluation settings. Finally, we discuss challenges and future directions in generalization and adaptation to real-world degradations, faithful and user-controllable restoration, reliable assessment for agents, and efficient and reproducible deployment. A curated list of works reviewed in this survey is available at https://github.com/mrluin/Awesome-IR-in-FM-era.
Authors
- Jingbo Lin (ORCID: https://orcid.org/0000-0001-7097-4386)
- Renlong Wu
- Yichi Tang
- Wangmeng Zuo
- Huangyao Zhang
Publication Details
- Journal
- Preprints.org
- Published
- 2026-11-18
- DOI
- https://doi.org/10.20944/preprints202611.1901.v1
- Primary Topic
- Advanced Image Processing Techniques
- Type
- preprint