VGDS-PointNet++ for organ segmentation and phenotypic trait estimation in greenhouse tomato seedlings

Introduction: To accurately segment point clouds and quickly calculate leaf length and stem diameter, thereby enabling phenotypic analysis and variety selection of greenhouse tomato plants, this paper proposes a voxel grid downsampling (VGDS)-PointNet++-based model for point cloud segmentation and trait calculation. Methods: The point clouds of the tomato canopy were acquired using a depth camera. After labeling, point cloud augmentation was performed, and the tomato point cloud dataset (TPCD) containing 1,552 sets of data was rebuilt. Voxel grid downsampling was applied to replace the original sampling strategy of PointNet++. Models of PointNet, PointNet++, VGDS-PointNet++, and Point Transformer were trained with the TPCD and compared on segmentation quality with accuracy and mean Intersection over Union (mIoU). After segmentation, skeletal morphology was fitted for non-occluded leaves by applying a series of surface fitting techniques. The leaf lengths and stem diameters were automatically calculated and compared with the manually measured values. Results: between the automatic calculation and manual measurement values of leaf length and stem diameter was 0.93 and 0.87, respectively. Discussion: This can help extract phenotypic traits of tomatoes using depth cameras.