Research on lidar and camera technology based on joint calibration and data fusion

Aiming at the limitations of a single sensor in complex environments, this paper utilizes the joint calibration and data fusion techniques of LIDAR and camera to make up for the shortcomings of a single sensor. The physical points of LiDAR in the 3D coordinate system are associated with the image points under the pixel coordinate system of the camera through the checkerboard grid calibration method, and then based on the parameters of the joint calibration, the 3D point cloud is projected to the 2D plane and the coordinate mapping is established with the image data of the camera to obtain the point cloud with color information. Finally, the experimental validation of projecting the point cloud data onto the imaging plane confirms the remarkable feasibility and accuracy of the data fusion method for LiDAR and optical imaging sensors.