RAWVAR: Visual Autoregressive Modeling for Color-Faithful Low-Light RAW Image Restoration

Visual autoregressive (VAR) modeling provides a promising generative solution for RGB image restoration, owing to its strong ability to generate realistic details and recover rich scene information. Nevertheless, directly applying VAR to low-light RAW image restoration still presents two main challenges. First, RGB-pretrained VAE tokenizers are mismatched with RAW sensor statistics, causing color bias after domain transfer. Second, VAR requires tiled inference for high-resolution RAW images, where independent token prediction across tiles may introduce color discrepancies that are further amplified by the Image Signal Processing (ISP) pipeline. To address these issues, we propose RAWVAR, the first visual autoregressive framework for low-light RAW image restoration. For effective domain transfer, we design a Cross-Domain Codebook (CDC), which freezes the RGB-pretrained encoder and original codebook while appending a trainable RAW-domain codebook, forming a cross-domain latent space for texture-preserving and color-faithful RAW representation. To mitigate color inconsistency during tiled inference, we further design a Position-aware Token Alignment (PTA) strategy. During coarse-to-fine prediction, PTA aligns the token logits of semantically corresponding regions across tiles, ensuring consistent predictions for shared content. Furthermore, a Global Color Refinement (GCR) module globally refines the discrete latents to enhance image-wise color consistency. Compared with diffusion-based methods, RAWVAR provides a more efficient generative restoration pipeline by avoiding iterative denoising. Extensive experiments show that RAWVAR produces color-faithful and perceptually superior results, outperforming existing generative restoration methods.

Authors

Institutions

Publication Details

Journal
ACM Transactions on Graphics
Published
2026-11-09
DOI
https://doi.org/10.1145/3842554
Primary Topic
Image Enhancement Techniques
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

RAWVAR: Visual Autoregressive Modeling for Color-Faithful Low-Light RAW Image Restoration

Zheng-Jun Zha, Zhiwei Xiong, Ruikang Xu, Xiongchao Chen et al.
ACM Transactions on Graphics
Image Enhancement Techniques
article

RAWVAR: Visual Autoregressive Modeling for Color-Faithful Low-Light RAW Image Restoration

Zheng-Jun Zha, Zhiwei Xiong, Ruikang Xu, Xiongchao Chen, Yuanshen Guan, Zhiqiang Lang, Yong Li, Chang Chen, Jiyuan Xia, Panjun Liu, Fenglong Song, Yinglong Li
article en

Abstract

Visual autoregressive (VAR) modeling provides a promising generative solution for RGB image restoration, owing to its strong ability to generate realistic details and recover rich scene information. Nevertheless, directly applying VAR to low-light RAW image restoration still presents two main challenges. First, RGB-pretrained VAE tokenizers are mismatched with RAW sensor statistics, causing color bias after domain transfer. Second, VAR requires tiled inference for high-resolution RAW images, where independent token prediction across tiles may introduce color discrepancies that are further amplified by the Image Signal Processing (ISP) pipeline. To address these issues, we propose RAWVAR, the first visual autoregressive framework for low-light RAW image restoration. For effective domain transfer, we design a Cross-Domain Codebook (CDC), which freezes the RGB-pretrained encoder and original codebook while appending a trainable RAW-domain codebook, forming a cross-domain latent space for texture-preserving and color-faithful RAW representation. To mitigate color inconsistency during tiled inference, we further design a Position-aware Token Alignment (PTA) strategy. During coarse-to-fine prediction, PTA aligns the token logits of semantically corresponding regions across tiles, ensuring consistent predictions for shared content. Furthermore, a Global Color Refinement (GCR) module globally refines the discrete latents to enhance image-wise color consistency. Compared with diffusion-based methods, RAWVAR provides a more efficient generative restoration pipeline by avoiding iterative denoising. Extensive experiments show that RAWVAR produces color-faithful and perceptually superior results, outperforming existing generative restoration methods.

ACM Transactions on GraphicsVol. 45(6)
University of Science and Technology of China (CN), Huawei Technologies (China) (CN)
Image Enhancement Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon