An Approach for Implementing Electronic ImageStabilization Using an FPGA System

This paper proposes an approach for the implementation of a low-power electronic (digital) image stabilization using an AMD/Xilinx Zynq UltraScale+ ZU7EV device (CPU+FPGA) with a custom Linux OS. The stabilization method is based on frame-to-frame motion detection (Harris Corner Detector, an iterative optical flow calculator combined with a 4:2:1 down-sampler an 1:2:4 up-sampler) and an affine transformation that applies the stabilization. The scientific contribution of this paper resides in a combination of the most recent software algorithms presented in literature and porting that new resulting algorithm into hardware with the achieved performance of more than 2.5x current state of the art, thus enabling stabilization at 4K-UHD resolution.