A Robust Self‐Supervised Spectral Vision Sensor

ABSTRACT Computational imaging simplifies hardware complexity by shifting the burden to algorithms, unlocking the potential for compact, high‐dimensional visual perception. Self‐supervised learning eliminates the reliance on large‐scale datasets, but is typically constrained in high‐dimensional recovery by the severely underdetermined inverse problem. Here, we present a generalized hardware‐algorithm co‐design paradigm for high‐dimensional visual perception that integrates hybrid spatiotemporal encoding with physics‐driven self‐supervision, and develop a robust self‐supervised spectral vision sensor. The core reconstruction engine, Motion‐Aware Untrained Neural Network (MAUNN), performs scene‐specific offline reconstruction in a zero‐shot manner, combining a cascaded physics‐informed module for spectral recovery with a coordinate‐based implicit estimator for motion modeling. Under an exposure‐matched evaluation, MAUNN achieves a PSNR of 44.21 dB and an SSIM of 0.992 using 16 hybrid‐encoded measurements, reaching a reconstruction accuracy comparable to the state‐of‐the‐art supervised baselines without requiring paired training data. Extensive experimental evaluations on complex dynamic scenes demonstrate robust spatio‐temporal‐spectral reconstruction with an average spectral fidelity of 0.997, an MSE of 7.11 × 10 −3 , and minimal frame‐to‐frame fluctuations with a standard deviation of 1.02 × 10 −4 . Furthermore, we validate the scalability in high‐throughput biomedical microscopy across large‐scale megapixel fields, where it maintains this high accuracy to enable precise pixel‐level semantic segmentation for pathological diagnosis.