A digital twin–driven deep learning framework for online quality inspection in tobacco transplanting

Tobacco transplanting quality inspection is crucial for tobacco production, as it directly affects crop yield and quality of tobacco leaves. Accurate transplanting status detection and assessment provide essential support for replanting decisions and transplanting machine optimization. Traditional methods rely on manual inspection, which suffer from high cost, low efficiency, and unstable results. To tackle the aforementioned issues, this paper proposes a Deep Learning and Digital Twin driven Online Quality Inspection Method for Tobacco Transplanting, which consists of four core modules: Transplanting Status Detection, Multi-sensor Data Fusion, Digital Twin Visualization, and Operational Optimization Feedback. This paper proposes a lightweight improved YAN-YOLO11 algorithm capable of assessing normal, exposed-root, and buried seedlings. By fusing GNSS positioning data with visual detection results, the system estimates in-row spacing and performs status assessment for missed planting and double planting. The system establishes a virtual-real interactive closed-loop of "collection-detection-mapping-feedback" via the digital twin. By visualizing operational status in real-time and generating replanting path suggestions, it provides guidance for operation management and significantly improves inspection efficiency. Field experiments demonstrate that, compared with YOLO11n, YAN-YOLO11 improves precision and recall by 2.4% and 2.5%, respectively; mAP@50 increased by 3% to 80.9% ± 1.4%, and [email protected]:0.95 increased by 5.8% to 54.2% ± 1.0%, while significantly reducing model complexity. The system achieves a real-time performance of 30 FPS in the field, with an overall recognition accuracy of 90.74%, meeting practical application requirements. This study effectively enhances the digitalization, automation, and refined management of tobacco transplanting operations, providing a theoretical foundation and practical solution for the intelligent transformation of transplanting machinery and precision crop management.