Multimodal large language models meet self-supervised diffusion for real-world aerial image super-resolution

Real-world aerial image super-resolution (SR) remains particularly challenging because degradations in remote-sensing imagery involve random combinations of anisotropic blur, signal-dependent noise, and unknown downsampling kernels. Most existing SR methods either rely on simplified degradation assumptions or lack semantic perception of degradation, resulting in limited generalization to real-world conditions. To address these gaps, we propose a novel diffusion-based SR framework that integrates Multi-modal Large Language Models (MLLMs) and self-supervised contrastive learning for extracting degradation-insensitive representation. Specifically, we introduce a contrastive learning strategy into a ControlNet module, where the HR and LR counterparts of the same image are regarded as positive pairs, while representations from different images serve as negative pairs, enabling the network to learn degradation-insensitive structural features. To further enhance semantic awareness of degradation, an MLLM-generated change caption is incorporated into the diffusion process as textual guidance, allowing the model to explicitly perceive and reconstruct different degradation types. Moreover, a classifier-free guidance (CFG) distillation strategy compresses the original dual-branch diffusion model into a single lightweight network, substantially improving inference efficiency while maintaining high reconstruction fidelity. Extensive experiments conducted on various datasets have showcased the superior performance of our proposed model compared to existing state-of-the-art methods. Furthermore, our distillation algorithm achieves a twofold reduction in inference time compared to its non-distilled counterpart, making it more feasible for real-time and resource-limited applications. • First-time integration of contrastive learning in ControlNet for feature extraction. • MLLM and dropout strategy improve degradation perception in low-resolution images. • Classifier-free guidance distillation creates a single high-performance SR model. • Achieve superior clarity and fidelity in aerial image restoration. • Experiments validate effectiveness across diverse datasets and degradations.

Authors

Institutions

Publication Details

Journal
International Journal of Applied Earth Observation and Geoinformation
Published
2026-02-01
DOI
https://doi.org/10.1016/j.jag.2026.105136
Primary Topic
Advanced Image Processing Techniques
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Multimodal large language models meet self-supervised diffusion for real-world aerial image super-resolution

Yi Wang Bao, Zhihang Li, Lin Wan, Lijing Lu et al.
International Journal of Applied Earth Observation and Geoinformation
Advanced Image Processing Techniques
article

Multimodal large language models meet self-supervised diffusion for real-world aerial image super-resolution

Yi Wang Bao, Zhihang Li, Lin Wan, Lijing Lu, Zhou Huang
article en

Abstract

Real-world aerial image super-resolution (SR) remains particularly challenging because degradations in remote-sensing imagery involve random combinations of anisotropic blur, signal-dependent noise, and unknown downsampling kernels. Most existing SR methods either rely on simplified degradation assumptions or lack semantic perception of degradation, resulting in limited generalization to real-world conditions. To address these gaps, we propose a novel diffusion-based SR framework that integrates Multi-modal Large Language Models (MLLMs) and self-supervised contrastive learning for extracting degradation-insensitive representation. Specifically, we introduce a contrastive learning strategy into a ControlNet module, where the HR and LR counterparts of the same image are regarded as positive pairs, while representations from different images serve as negative pairs, enabling the network to learn degradation-insensitive structural features. To further enhance semantic awareness of degradation, an MLLM-generated change caption is incorporated into the diffusion process as textual guidance, allowing the model to explicitly perceive and reconstruct different degradation types. Moreover, a classifier-free guidance (CFG) distillation strategy compresses the original dual-branch diffusion model into a single lightweight network, substantially improving inference efficiency while maintaining high reconstruction fidelity. Extensive experiments conducted on various datasets have showcased the superior performance of our proposed model compared to existing state-of-the-art methods. Furthermore, our distillation algorithm achieves a twofold reduction in inference time compared to its non-distilled counterpart, making it more feasible for real-time and resource-limited applications. • First-time integration of contrastive learning in ControlNet for feature extraction. • MLLM and dropout strategy improve degradation perception in low-resolution images. • Classifier-free guidance distillation creates a single high-performance SR model. • Achieve superior clarity and fidelity in aerial image restoration. • Experiments validate effectiveness across diverse datasets and degradations.

International Journal of Applied Earth Observation and GeoinformationVol. 146
Chinese Academy of Sciences (CN), Peking University (CN), China University of Geosciences (CN), Shandong Institute of Automation (CN), Institute of Navigation (US), Nanjing University (CN)
Openalex Percentile: Top 71%
Advanced Image Processing Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.