Vision-based Fruit Recognition and Three-dimensional Localization for Tomato Harvesting Robots: A Review

Tomato harvesting is a labour-intensive, costly step in agricultural production, and machine-vision-based harvesting robots have become an important approach to automated harvesting. This review systematically synthesises advances in fruit recognition and localisation for tomato-harvesting robots recent advances along the technical chain of recognition, three-dimensional (3D) localisation, and system integration. For recognition, traditional colour-threshold methods are strongly affected by illumination; deep-learning methods represented by the YOLO family have reported markedly higher accuracy and speed than traditional methods on their respective datasets and have further evolved toward instance segmentation and picking-keypoint detection, although high accuracy, lightweight design, and occlusion robustness are difficult to achieve simultaneously. For localisation, binocular stereo vision is cost-effective but sensitive to lighting and texture; RGB-D depth cameras provide reliable depth and are easy to integrate but recover 3D coordinates less reliably under occlusion; multi-view and point-cloud fusion are robust but computationally complex. For system integration, hand-eye calibration links visual coordinates to arm coordinates, and reported end-to-end greenhouse trials have reached harvesting success of roughly 80-87% alongside ~85% reachability in dense scenes, yet they remain limited by long cycle times, difficult damage control, and limited commercial adoption. On this basis, this review identifies three key research gaps: robust perception under occlusion, dataset scale and cross-region generalisation, and end-to-end integration of recognition, localisation, and harvesting; future directions are outlined to guide the development of tomato harvesting robots. Commercial adoption, however, also depends on economics: the reviewed studies rarely report cost per harvested fruit, payback period or comparison with manual picking, so the approaches therefore cannot yet be ranked by cost.

Authors

Institutions

Publication Details

Journal
Journal of Engineering Research and Reports
Published
2026-11-21
DOI
https://doi.org/10.9734/jerr/2026/v28i112053
Primary Topic
Smart Agriculture and AI
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

Vision-based Fruit Recognition and Three-dimensional Localization for Tomato Harvesting Robots: A Review

Zongxi Xu
Journal of Engineering Research and Reports
Smart Agriculture and AI
article

Vision-based Fruit Recognition and Three-dimensional Localization for Tomato Harvesting Robots: A Review

Zongxi Xu
article en

Abstract

Tomato harvesting is a labour-intensive, costly step in agricultural production, and machine-vision-based harvesting robots have become an important approach to automated harvesting. This review systematically synthesises advances in fruit recognition and localisation for tomato-harvesting robots recent advances along the technical chain of recognition, three-dimensional (3D) localisation, and system integration. For recognition, traditional colour-threshold methods are strongly affected by illumination; deep-learning methods represented by the YOLO family have reported markedly higher accuracy and speed than traditional methods on their respective datasets and have further evolved toward instance segmentation and picking-keypoint detection, although high accuracy, lightweight design, and occlusion robustness are difficult to achieve simultaneously. For localisation, binocular stereo vision is cost-effective but sensitive to lighting and texture; RGB-D depth cameras provide reliable depth and are easy to integrate but recover 3D coordinates less reliably under occlusion; multi-view and point-cloud fusion are robust but computationally complex. For system integration, hand-eye calibration links visual coordinates to arm coordinates, and reported end-to-end greenhouse trials have reached harvesting success of roughly 80-87% alongside ~85% reachability in dense scenes, yet they remain limited by long cycle times, difficult damage control, and limited commercial adoption. On this basis, this review identifies three key research gaps: robust perception under occlusion, dataset scale and cross-region generalisation, and end-to-end integration of recognition, localisation, and harvesting; future directions are outlined to guide the development of tomato harvesting robots. Commercial adoption, however, also depends on economics: the reviewed studies rarely report cost per harvested fruit, payback period or comparison with manual picking, so the approaches therefore cannot yet be ranked by cost.

Journal of Engineering Research and ReportsVol. 28(11)
North China University of Water Resources and Electric Power (CN)
Smart Agriculture and AI
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon
Vision-based Fruit Recognition and Three-dimensional Localization for Tomato Harvesting Robots: A Review — Zongxi Xu · Journal of Engineering Research and Reports (2026) | TGRS Research Map | TGRS