UbiEnlight: User-Perception-Aware Real-Time Low-Light Video Enhancement on Mobile Devices and Smartglasses
Low-light video capture is now common on smartphones and wearables, yet dynamic illumination coupled with mobile/werable user motion causes noise, blur, and flicker that make videos hard to perceive and use , especially for users with night blindness and near-eye displays. Prior work enhances frames with post-hoc temporal constraints or optimizes videos directly; however, low-light and motion degradations are spatiotemporally coupled , so post-hoc consistency after per-frame restoration often leaves flicker and motion artifacts. We present UbiEnlight, the first diffusion-transformer-based on-device system for real-time, temporally stable low-light video enhancement. UbiEnlight builds on two insights: (1) illumination and structure separate more robustly in the frequency domain, enabling a spectrum-guided diffusion transformer that injects Fourier amplitude/phase priors to correct illumination while anchoring structure without optical flow; and (2) user perceptual tolerance varies by context, motivating a perception-aware controller that adapts sampling depth, attention reuse, and frame caching at runtime. We implement UbiEnlight on smartphones and smartglasses, and evaluate it against state-of-the-art baselines. UbiEnlight improves temporal stability by up to 54.76% under dynamic/extreme conditions while sustaining real-time on-device performance.
Authors
- Minfan Wang (ORCID: https://orcid.org/0009-0002-0046-4828)
- Zimu Zhou (ORCID: https://orcid.org/0000-0002-5457-6967)
- Bin Guo (ORCID: https://orcid.org/0000-0001-6097-2467)
- Sicong Liu (ORCID: https://orcid.org/0000-0003-4402-1260)
- Zhiwen Yu (ORCID: https://orcid.org/0000-0002-9905-3238)
- Junzhao Du (ORCID: https://orcid.org/0000-0001-8105-3224)
- Teng Li
- Sixun He (ORCID: https://orcid.org/0009-0003-9823-9772)
Institutions
- Xidian University (CN)
- City University of Hong Kong (HK)
- Northwestern Polytechnical University (CN)
Publication Details
- Journal
- Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies
- Published
- 2026-09-30
- DOI
- https://doi.org/10.1145/3832024
- Primary Topic
- Image and Video Quality Assessment
- Type
- article
- Field-Weighted Citation Impact
- 0.00