Camera pose estimation based on reflection analysis for multi-view video acquisition using a mirror array

We previously implemented an inexpensive imaging system that combines a single real camera with a mirror array located along a paraboloid. It allows us to robustly acquire dynamic light fields composed of multi-view videos by providing a virtual camera array, where its viewpoints exist in the mirrors. Actually, as moving the real camera to the focus of the paraboloid, virtual viewpoints get equally-spaced to achieve multi-view imaging with structured disparity. In this paper, for such better multi-view imaging, we discuss two methods for pose estimation of the real camera, where reflections of a checkerboard on the mirrors are analyzed. Both methods determine virtual viewpoints by Zhang’s method to utilize them for estimating poses of our real camera and mirror array. Experimental results of simple simulations demonstrate that we can enjoy more ideal multi-view imaging of 3D scenes after rectifying their poses based on the estimation.