A Deep Learning-Based Approach to Apple Tree Pruning and Evaluation with Multi-Modal Data for Enhanced Accuracy in Agricultural Practices

A deep learning-based tree pruning evaluation system is proposed in this study, which integrates hyperspectral images, sensor data, and expert system rules. The system aims to enhance the accuracy and robustness of tree pruning tasks through multimodal data fusion and online learning strategies. Various models, including Mask R-CNN, SegNet, Tiny-Segformer, Box2Mask, CS-Net, SVM, MLP, and Random Forest, were used in the experiments to perform tree segmentation and pruning evaluation, with comprehensive performance assessments conducted. The experimental results demonstrate that the proposed model excels in the tree segmentation task, achieving a precision of 0.94, recall of 0.90, F1 score of 0.92, and mAP@50 and mAP@75 of 0.91 and 0.90, respectively, outperforming other comparative models. These results confirm the effectiveness of multimodal data fusion and dynamic optimization strategies in improving the accuracy of tree pruning evaluation. The experiments also highlight the critical role of sensor data in pruning evaluation, particularly when combined with the online learning strategy, as the model can progressively optimize pruning decisions and adapt to environmental changes. Through this work, the potential and prospects of the deep learning-based tree pruning evaluation system in practical applications are demonstrated.