Benchmarking of monocular camera UAV-based localization and mapping methods in vineyards
• UAV-based localization and mapping methods have been benchmarked in vineyards. • Five evaluation metrics were developed for agricultural scenarios. • Lighting variation impacts point cloud resolution. • Deep learning enhances SLAM for efficient plant phenotyping. UAVs equipped with various sensors offer a promising approach for enhancing orchard management efficiency. Up-close sensing enables precise crop localization and mapping, providing valuable a priori information for informed decision-making. Current research on localization and mapping methods can be broadly classified into SfM, traditional feature-based SLAM, and deep learning-integrated SLAM. While previous studies have evaluated these methods on public datasets, real-world agricultural environments, particularly vineyards, present unique challenges due to their complexity, dynamism, and unstructured nature. To bridge this gap, we conducted a comprehensive study in vineyards, collecting data under diverse conditions (flight modes, illumination conditions, and shooting angles) using a UAV equipped with high-resolution camera. To assess the performance of different methods, we proposed five evaluation metrics: efficiency, point cloud completeness, localization accuracy, parameter sensitivity, and plant-level spatial accuracy. We compared two SLAM approaches against SfM as a benchmark. Our findings reveal that deep learning-based SLAM outperforms SfM and feature-based SLAM in terms of position accuracy and point cloud resolution. Deep learning-based SLAM reduced average position error by 87% and increased point cloud resolution by 571%. However, feature-based SLAM demonstrated superior efficiency, making it a more suitable choice for real-time applications. These results offer valuable insights for selecting appropriate methods, considering illumination conditions, and optimizing parameters to balance accuracy and computational efficiency in orchard management activities.
Authors
- Sergio Vélez (ORCID: https://orcid.org/0000-0001-9004-2877)
- Lammert Kooistra (ORCID: https://orcid.org/0000-0001-5549-5993)
- João Valente (ORCID: https://orcid.org/0000-0002-6241-4124)
- Yaowu Wang (ORCID: https://orcid.org/0000-0001-8853-8988)
- Wensheng Wang (ORCID: https://orcid.org/0000-0002-8842-3432)
- Kaiwen Wang (ORCID: https://orcid.org/0000-0002-1082-1262)
Institutions
- Agricultural Information Institute (CN)
- Fraunhofer Institute for Solar Energy Systems (DE)
- Centre for Automation and Robotics (ES)
- Wageningen University & Research (NL)
Publication Details
- Journal
- Computers and Electronics in Agriculture
- Published
- 2024-11-15
- DOI
- https://doi.org/10.1016/j.compag.2024.109661
- Citations
- 10
- Primary Topic
- Remote Sensing and LiDAR Applications
- Type
- article
- Field-Weighted Citation Impact
- 2.06
Funders
- Wageningen University and Research Centre
- Chinese Academy of Agricultural Sciences
- Wageningen University and Research