Non-pixelated in-materia retinomorphic sensor via photocarrier dynamics for precise spatiotemporal perception

Real-time perception of dynamic visual scenes requires efficient extraction of spatiotemporal features. However, conventional image sensors fail to capture inter-pixel correlations, leading to redundant data transfer, high power consumption and latency. Here, we present a non-pixelated in-materia retinomorphic sensor (IMRS) that exploits the intrinsic spatiotemporal dynamics and correlated distributions of photocarriers for visual information processing. Built on a large-area graphene/silicon heterostructure, the IMRS integrates circumferentially arranged sampling electrodes that harness the lateral photovoltaic effect to convert incident optical patterns into spatial carrier distributions, which are further encoded as object-shape-dependent photovoltages. Mimicking the lateral inhibition of biological retinas, this sensor enables in-sensor spatiotemporal perception without image reconstruction. We demonstrate human motion recognition with over 98% accuracy while compressing raw visual data from 10,000 to 48 bytes, reducing postprocessing networks parameters by two orders of magnitude. These results establish spatiotemporal photocarrier dynamics in low-dimensional heterostructures as a computational primitive for energy-efficient, ultralow-latency processing of high-dimensional spatiotemporal information.

Authors

Institutions

Publication Details

Journal
Nature Communications
Published
2026-04-22
DOI
https://doi.org/10.1038/s41467-026-72104-5
Primary Topic
Advanced Memory and Neural Computing
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Non-pixelated in-materia retinomorphic sensor via photocarrier dynamics for precise spatiotemporal perception

Wenhui Wang, Feng Miao, Zhenhua Ni, Dongyang Wan et al.
Nature Communications
Advanced Memory and Neural Computing
article

Non-pixelated in-materia retinomorphic sensor via photocarrier dynamics for precise spatiotemporal perception

Wenhui Wang, Feng Miao, Zhenhua Ni, Dongyang Wan, Chen Pan, Junpeng Lü, Ting Zheng, S. Liang, Kaiyang Liu, Xinlei Zhang, Dingli Guo, Tao Zhou, Pengfei Wang, Peiyu Zeng, Yao Zhang
article en

Abstract

Real-time perception of dynamic visual scenes requires efficient extraction of spatiotemporal features. However, conventional image sensors fail to capture inter-pixel correlations, leading to redundant data transfer, high power consumption and latency. Here, we present a non-pixelated in-materia retinomorphic sensor (IMRS) that exploits the intrinsic spatiotemporal dynamics and correlated distributions of photocarriers for visual information processing. Built on a large-area graphene/silicon heterostructure, the IMRS integrates circumferentially arranged sampling electrodes that harness the lateral photovoltaic effect to convert incident optical patterns into spatial carrier distributions, which are further encoded as object-shape-dependent photovoltages. Mimicking the lateral inhibition of biological retinas, this sensor enables in-sensor spatiotemporal perception without image reconstruction. We demonstrate human motion recognition with over 98% accuracy while compressing raw visual data from 10,000 to 48 bytes, reducing postprocessing networks parameters by two orders of magnitude. These results establish spatiotemporal photocarrier dynamics in low-dimensional heterostructures as a computational primitive for energy-efficient, ultralow-latency processing of high-dimensional spatiotemporal information.

Nature Communications
Nanjing University of Science and Technology (CN), Center For Remote Sensing (United States) (US), Collaborative Innovation Center of Advanced Microstructures (CN), Ministry of Education (BD), Southeast University (CN)
National Natural Science Foundation of China, China Postdoctoral Science Foundation, Government of Jiangsu Province, Natural Science Foundation of Jiangsu Province, Basic Research Program of Jiangsu Province, National Key Research and Development Program of China
Openalex Percentile: Top 12%
Advanced Memory and Neural Computing
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.