Distance-Adaptive Depth Camera–LiDAR Fusion for Object Distance Estimation on a Moving Tractor: A Field Evaluation Against RTK-GNSS
Agricultural machinery has extensive blind zones, and reliable proximity alerts need distance information that no single sensor provides across the working range. We fused a depth camera and a 16-channel LiDAR by distance-adaptive inverse-variance weighting, with weights derived from nominal, specification-based error models that cross at 3.87 m. YOLO11m, trained on five classes, detected objects, and the pipeline ran at 26 frames per second on an edge computing platform. Distances to Person and Tractor targets were evaluated against real-time kinematic GNSS in 2521 samples from front and rear tractor approaches at nominal speeds of 3, 5, and 7 km/h. Fusion reduced the root mean square error (RMSE) to 0.211 m, 30.9% below that of the depth camera alone, with the largest reduction (35.8%) at 7–12 m and no change within 7 m. The LiDAR alone was more accurate (0.167 m) but valid in only 82.7% of frames. With both sensors valid, the fused RMSE (0.141 m) was lower than that of either sensor. For detected targets, alert levels agreed with the reference in 99.0% of frames, but a Person recall of 0.72 limits overall reliability. Target geometry and LiDAR resolution strongly affect the benefit of fusion, which may guide sensor selection for other agricultural machines.
Authors
- Ryu-Gap Lim (ORCID: https://orcid.org/0000-0001-7825-7293)
- Seung-Min Baek (ORCID: https://orcid.org/0000-0002-4627-191X)
- Deok-Hyeon Ko
- Jin-Yeong Lee
- Min-Young Hwang
- Seung-Yong Seo
- Ki-Dong Park
- Jae-Min Lee
- Md Rayhan Mahmud (ORCID: https://orcid.org/0009-0008-8719-1626)
Institutions
- Kyung Hee Cyber University (KR)
- Chungnam National University (KR)
- Sunchon National University (KR)
Publication Details
- Journal
- Agriculture
- Published
- 2026-11-12
- DOI
- https://doi.org/10.3390/agriculture16222484
- Primary Topic
- Autonomous Vehicle Technology and Safety
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- Korea Institute of Planning and Evaluation for Technology in Food, Agriculture, Forestry and Fisheries