Automatic Extrinsic Calibration of Low-FOV LiDAR and Camera for Urban Rail Applications

In urban rail transit, integrating non-repetitive scanning solid-state LiDAR with cameras significantly enhances situational awareness for tasks like autonomous driving, train positioning, and obstacle detection. However, the limited field of view (FOV) of LiDAR results in sparse feature distributions, creating substantial calibration challenges. To address these, we propose an end-to-end extrinsic calibration method for RGB cameras and low-FOV LiDAR, specifically designed for urban rail environments. Our approach integrates a feature extraction module utilizing a pre-trained ResNet-18, multi-feature fusion of depth, intensity, and density to enrich feature representations, and a stereo matching module using multi-peak disparity matching and GRU-based iterative refinement. These components collectively improve alignment accuracy and calibration robustness under challenging conditions. Validation on urban rail and KITTI-odometry datasets shows our method achieves translation and rotation errors of 1.89 cm and <tex xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">$\mathbf{0.36}^{\circ}$</tex>, respectively, outperforming state-of-the-art methods and demonstrating its effectiveness for real-world urban rail applications.

Authors

Institutions

Publication Details

Published
2024-12-27
DOI
https://doi.org/10.1109/icvisp64524.2024.10959515
Primary Topic
Remote Sensing and LiDAR Applications
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Automatic Extrinsic Calibration of Low-FOV LiDAR and Camera for Urban Rail Applications

Zhiwei Hu, Ziping Ma, Zhe Fu, Yiqing Liu
Remote Sensing and LiDAR Applications
article

Automatic Extrinsic Calibration of Low-FOV LiDAR and Camera for Urban Rail Applications

Zhiwei Hu, Ziping Ma, Zhe Fu, Yiqing Liu
article en

Abstract

In urban rail transit, integrating non-repetitive scanning solid-state LiDAR with cameras significantly enhances situational awareness for tasks like autonomous driving, train positioning, and obstacle detection. However, the limited field of view (FOV) of LiDAR results in sparse feature distributions, creating substantial calibration challenges. To address these, we propose an end-to-end extrinsic calibration method for RGB cameras and low-FOV LiDAR, specifically designed for urban rail environments. Our approach integrates a feature extraction module utilizing a pre-trained ResNet-18, multi-feature fusion of depth, intensity, and density to enrich feature representations, and a stereo matching module using multi-peak disparity matching and GRU-based iterative refinement. These components collectively improve alignment accuracy and calibration robustness under challenging conditions. Validation on urban rail and KITTI-odometry datasets shows our method achieves translation and rotation errors of 1.89 cm and <tex xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">$\mathbf{0.36}^{\circ}$</tex>, respectively, outperforming state-of-the-art methods and demonstrating its effectiveness for real-world urban rail applications.

Beijing Jiaotong University (CN)
Sustainable cities and communities
Openalex Percentile: Top 76%
Remote Sensing and LiDAR Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Automatic Extrinsic Calibration of Low-FOV LiDAR and Camera for Urban Rail Applications — Zhiwei Hu, Ziping Ma, et al. · (2024) | TGRS Research Map | TGRS