CogniVision: A mW Power envelope SoC for Always-on Smart Vision in 40nm
A full vision system on chip with hierarchical execution from sensor to AI and communications is presented. Always-on system power is aggressively reduced to the mW level through activity reduction, gating any subsequent vision pipeline stage starting from the lowest semantic level of the scene. The system comprises an imager with dual-architecture in/near-sensor saliency detection, on the-fly novelty detection, DNN accelerator with on-chip scheduler for weight memory reduction, WiFi transmitter, wake-up receiver for cloud pushed DNN model update and software programmable orchestration via RISC-V. Average 2.1-mW power at 30 fps is achieved with a SqueezeNet V1.0 model running entirely on chip.
Authors
- Massimo Alioto (ORCID: https://orcid.org/0000-0002-4127-8258)
- Japesh Vohra (ORCID: https://orcid.org/0009-0003-1875-1822)
- Animesh Gupta (ORCID: https://orcid.org/0000-0003-4374-335X)
Institutions
- National University of Singapore (SG)
Publication Details
- Published
- 2024-08-25
- DOI
- https://doi.org/10.1109/hcs61935.2024.10664990
- Primary Topic
- CCD and CMOS Imaging Sensors
- Type
- article
- Field-Weighted Citation Impact
- 0.00