Computationally Efficient Kalman Filter Framework for Intra-Frame Image Reconstruction with a Rolling Shutter Camera

This paper addresses the problem of reconstructing image sequences from a rolling shutter camera-based thermal image acquisition system that integrates the image field over an exposure time. It proposes a novel approach to extend the distributed Kalman filtering framework for intra-frame reconstruction. This accounts for the exposure effect through a state-augmentation model, while respecting the row-byrow image acquisition process. Additionally, two alternative rolling shutter scan strategies: interlaced-x and random, are explored to mitigate delays in observing abrupt changes inherent in sequential rolling shutter scans. Simulation results demonstrate that the proposed approach effectively accommodates exposure and achieves reliable intra-frame reconstruction quality. The interlaced-x scan strategy, with x equal to the size of the image partition block, emerges as the preferred choice, highlighting improved performance in recovering from sudden events. The augmented distributed Kalman filter offers a scalable solution to enhance temporal resolution and overall reliability of thermal imaging of dynamic thermal processes.