HCA-Mamba: a hierarchical cross-attention framework combining Vision Mamba and CNN for night-time image quality assessment

Night-time image quality assessment (NTIQA) requires jointly modeling global illumination consistency and spatially localized distortions, such as noise, glare, and halo artifacts. Existing CNN-based methods are effective at capturing local degradations but are limited in modeling long-range contextual dependencies, whereas Transformer-based approaches improve global perception at the cost of higher computational complexity. To address this challenge, we propose HCA-Mamba, a hybrid framework that combines Vision Mamba (ViM)-based global context modeling with CNN-based local distortion perception for NTIQA. Specifically, a ViM backbone is employed to capture long-range dependencies and global luminance structure, while a parallel CNN branch extracts multi-scale local degradation cues and compacts them into distortion-aware tokens through a multi-scale distortion extractor (MSDE). These tokens are then progressively injected into successive ViM layers via a local distortion injection module (LDIM), which performs gated cross-attention to enable stable interaction between global and local representations across network depths. The fused representation is finally mapped to a perceptual quality score by a regression head. Experiments on the NNID and EHNQ benchmarks, together with additional cross-dataset evaluation on NPHD, including both intra-dataset evaluation and cross-dataset generalization settings, demonstrate the effectiveness and generalization potential of the proposed method. A controlled synthetic distortion severity study further evaluates the model response to progressively intensified night-time degradations. Extensive ablation studies further verify the effectiveness of MSDE and LDIM in enhancing sensitivity to night-time distortions.

Authors

Institutions

Publication Details

Journal
Scientific Reports
Published
2026-05-23
DOI
https://doi.org/10.1038/s41598-026-54065-3
Primary Topic
Image and Video Quality Assessment
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

HCA-Mamba: a hierarchical cross-attention framework combining Vision Mamba and CNN for night-time image quality assessment

Likun Lu, Weipeng Niu, Wu Dong, Tianqi Zhang et al.
Scientific Reports
Image and Video Quality Assessment
article

HCA-Mamba: a hierarchical cross-attention framework combining Vision Mamba and CNN for night-time image quality assessment

Likun Lu, Weipeng Niu, Wu Dong, Tianqi Zhang, Rui Zhang
article en

Abstract

Night-time image quality assessment (NTIQA) requires jointly modeling global illumination consistency and spatially localized distortions, such as noise, glare, and halo artifacts. Existing CNN-based methods are effective at capturing local degradations but are limited in modeling long-range contextual dependencies, whereas Transformer-based approaches improve global perception at the cost of higher computational complexity. To address this challenge, we propose HCA-Mamba, a hybrid framework that combines Vision Mamba (ViM)-based global context modeling with CNN-based local distortion perception for NTIQA. Specifically, a ViM backbone is employed to capture long-range dependencies and global luminance structure, while a parallel CNN branch extracts multi-scale local degradation cues and compacts them into distortion-aware tokens through a multi-scale distortion extractor (MSDE). These tokens are then progressively injected into successive ViM layers via a local distortion injection module (LDIM), which performs gated cross-attention to enable stable interaction between global and local representations across network depths. The fused representation is finally mapped to a perceptual quality score by a regression head. Experiments on the NNID and EHNQ benchmarks, together with additional cross-dataset evaluation on NPHD, including both intra-dataset evaluation and cross-dataset generalization settings, demonstrate the effectiveness and generalization potential of the proposed method. A controlled synthetic distortion severity study further evaluates the model response to progressively intensified night-time degradations. Extensive ablation studies further verify the effectiveness of MSDE and LDIM in enhancing sensitivity to night-time distortions.

Scientific Reports
Beijing Institute of Graphic Communication (CN)
Openalex Percentile: Top 4%
Image and Video Quality Assessment
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.