Real-time Image Recognition System based on Ultra-Low-Latency Spiking Neural Networks

Remote sensing technology plays an important role in many tasks such as natural disaster detection, weather and climate monitoring and military defense. Currently, remote sensing image processing predominantly relies on Convolutional Neural Networks (CNNs) and Transformers, which require a huge amount of multiplication and addition operations, bringing pressure to the deployment of satellite platforms with strict power consumption and computing power constraints. Spiking neural network (SNN), where the signal is encoded as a spike train instead of analog values, significantly reduces energy consumption compared to traditional artificial neural network. This paper proposes an all-input parallel deployment approach that minimizes or eliminates interactions with off-chip memory, thereby accelerating inference speed and reducing power consumption. We deployed LeNet ultra-low latency SNN on the Xilinx VC709 Board. Experimental results demonstrate that the proposed accelerator achieves a processing speed of 1240 frames per second, an accuracy rate of 98.14%, and a power consumption of only 0.745 Watts, making it well-suited for the low power and real-time requirements of remote sensing tasks.