Multimodal large language models meet self-supervised diffusion for real-world aerial image super-resolution
Real-world aerial image super-resolution (SR) remains particularly challenging because degradations in remote-sensing imagery involve random combinations of anisotropic blur, signal-dependent noise, and unknown downsampling kernels. Most existing SR methods either rely on simplified degradation assumptions or lack semantic perception of degradation, resulting in limited generalization to real-world conditions. To address these gaps, we propose a novel diffusion-based SR framework that integrates Multi-modal Large Language Models (MLLMs) and self-supervised contrastive learning for extracting degradation-insensitive representation. Specifically, we introduce a contrastive learning strategy into a ControlNet module, where the HR and LR counterparts of the same image are regarded as positive pairs, while representations from different images serve as negative pairs, enabling the network to learn degradation-insensitive structural features. To further enhance semantic awareness of degradation, an MLLM-generated change caption is incorporated into the diffusion process as textual guidance, allowing the model to explicitly perceive and reconstruct different degradation types. Moreover, a classifier-free guidance (CFG) distillation strategy compresses the original dual-branch diffusion model into a single lightweight network, substantially improving inference efficiency while maintaining high reconstruction fidelity. Extensive experiments conducted on various datasets have showcased the superior performance of our proposed model compared to existing state-of-the-art methods. Furthermore, our distillation algorithm achieves a twofold reduction in inference time compared to its non-distilled counterpart, making it more feasible for real-time and resource-limited applications. • First-time integration of contrastive learning in ControlNet for feature extraction. • MLLM and dropout strategy improve degradation perception in low-resolution images. • Classifier-free guidance distillation creates a single high-performance SR model. • Achieve superior clarity and fidelity in aerial image restoration. • Experiments validate effectiveness across diverse datasets and degradations.
Authors
- Yi Wang Bao (ORCID: https://orcid.org/0000-0002-6854-2645)
- Zhihang Li
- Lin Wan
- Lijing Lu
- Zhou Huang
Institutions
- Chinese Academy of Sciences (CN)
- Peking University (CN)
- China University of Geosciences (CN)
- Shandong Institute of Automation (CN)
- Institute of Navigation (US)
- Nanjing University (CN)
Publication Details
- Journal
- International Journal of Applied Earth Observation and Geoinformation
- Published
- 2026-02-01
- DOI
- https://doi.org/10.1016/j.jag.2026.105136
- Primary Topic
- Advanced Image Processing Techniques
- Type
- article
- Field-Weighted Citation Impact
- 0.00