Reconfigurable Retina-Inspired Looming Detection
Recent advances in retinal neuroscience inspired the development of hardware and software systems that leverage evolutionarily derived retinal computations for real-world computer vision applications. In this work, we propose a novel, reconfigurable CMOS circuit designed specifically for Looming Detection (LD), a key retinal computation associated with detecting rapidly approaching objects and potential threats. We analyze the circuit's performance using real-world data from controlled laboratory environments and hardware-aware algorithmic simulations, demonstrating its accuracy in identifying potential collisions and avoiding false-positives from mundane object movements. Furthermore, we evaluate the CMOS hardware characteristics using GlobalFoundries' 22nm FD-SOI technology, exhibiting a 0.36 pJ energy consumption per looming spike for a unit kernel size of 5 × 5 pixels. This work contributes a foundational approach to adaptive hardware-software co-design by integrating advances in retinal neuroscience with modern CMOS technology to address real-time LD with in-sensor computations.
Authors
- Akhilesh Jaiswal (ORCID: https://orcid.org/0000-0001-9911-2624)
- Md Abdullah-Al Kaiser (ORCID: https://orcid.org/0000-0002-6041-4075)
- Shay Snyder (ORCID: https://orcid.org/0000-0002-3369-3478)
- Gregory G. Schwartz (ORCID: https://orcid.org/0000-0003-2954-0695)
- Maryam Parsa (ORCID: https://orcid.org/0000-0002-4855-4593)
- Jason Sinaga
- Dan Jinoy
Institutions
- Northwestern University (US)
- University of Wisconsin–Madison (US)
- George Mason University (US)
Publication Details
- Published
- 2025-05-04
- DOI
- https://doi.org/10.1109/fccm62733.2025.00013
- Citations
- 1
- Primary Topic
- Gaze Tracking and Assistive Technology
- Type
- article
- Field-Weighted Citation Impact
- 1.94