Non-pixelated in-materia retinomorphic sensor via photocarrier dynamics for precise spatiotemporal perception
Real-time perception of dynamic visual scenes requires efficient extraction of spatiotemporal features. However, conventional image sensors fail to capture inter-pixel correlations, leading to redundant data transfer, high power consumption and latency. Here, we present a non-pixelated in-materia retinomorphic sensor (IMRS) that exploits the intrinsic spatiotemporal dynamics and correlated distributions of photocarriers for visual information processing. Built on a large-area graphene/silicon heterostructure, the IMRS integrates circumferentially arranged sampling electrodes that harness the lateral photovoltaic effect to convert incident optical patterns into spatial carrier distributions, which are further encoded as object-shape-dependent photovoltages. Mimicking the lateral inhibition of biological retinas, this sensor enables in-sensor spatiotemporal perception without image reconstruction. We demonstrate human motion recognition with over 98% accuracy while compressing raw visual data from 10,000 to 48 bytes, reducing postprocessing networks parameters by two orders of magnitude. These results establish spatiotemporal photocarrier dynamics in low-dimensional heterostructures as a computational primitive for energy-efficient, ultralow-latency processing of high-dimensional spatiotemporal information.
Authors
- Wenhui Wang (ORCID: https://orcid.org/0000-0003-3513-1361)
- Feng Miao (ORCID: https://orcid.org/0000-0002-0962-5424)
- Zhenhua Ni (ORCID: https://orcid.org/0000-0002-6316-2256)
- Dongyang Wan (ORCID: https://orcid.org/0000-0001-6810-2183)
- Chen Pan (ORCID: https://orcid.org/0000-0003-1739-7254)
- Junpeng Lü (ORCID: https://orcid.org/0000-0002-7099-3162)
- Ting Zheng (ORCID: https://orcid.org/0000-0002-8371-963X)
- S. Liang (ORCID: https://orcid.org/0000-0003-3235-7621)
- Kaiyang Liu
- Xinlei Zhang
- Dingli Guo
- Tao Zhou (ORCID: https://orcid.org/0009-0003-6844-648X)
- Pengfei Wang (ORCID: https://orcid.org/0000-0002-8827-0309)
- Peiyu Zeng
- Yao Zhang
Institutions
- Nanjing University of Science and Technology (CN)
- Center For Remote Sensing (United States) (US)
- Collaborative Innovation Center of Advanced Microstructures (CN)
- Ministry of Education (BD)
- Southeast University (CN)
Publication Details
- Journal
- Nature Communications
- Published
- 2026-04-22
- DOI
- https://doi.org/10.1038/s41467-026-72104-5
- Primary Topic
- Advanced Memory and Neural Computing
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- National Natural Science Foundation of China
- China Postdoctoral Science Foundation
- Government of Jiangsu Province
- Natural Science Foundation of Jiangsu Province
- Basic Research Program of Jiangsu Province
- National Key Research and Development Program of China