IMU-aided adaptive mesh-grid based video motion deblurring

Motion blur is a problem that degrades the visual quality of images for human perception and also challenges computer vision tasks. While existing studies mostly focus on deblurring algorithms to remove uniform blur due to their computational efficiency, such approaches fail when faced with non-uniform blur. In this study, we propose a novel algorithm for motion deblurring that utilizes an adaptive mesh-grid approach to manage non-uniform motion blur with a focus on reducing the computational cost. The proposed method divides the image into a mesh-grid and estimates the blur point spread function (PSF) using an inertial sensor. For each video frame, the size of the grid cells is determined adaptively according to the in-frame spatial variance of blur magnitude which is a proposed metric for the blur non-uniformity in the video frame. The adaptive mesh-size takes smaller values for higher variances, increasing the spatial accuracy of the PSF estimation. Two versions of the adaptive mesh-size algorithm are studied, optimized for either best quality or balanced performance and computation cost. Also, a trade-off parameter is defined for changing the mesh-size according to application requirements. The experiments, using real-life motion data combined with simulated motion blur demonstrate that the proposed adaptive mesh-size algorithm can achieve 5% increase in PSNR quality gain together with a 19% decrease in computation time on the average when compared to the constant mesh-size method.