BallastAttN: Occlusion-Robust 3D Railway Ballast Characterization using Data Synthesis and Deep Learning

Accurate characterization of railway ballast is critical for track safety and maintenance; however, traditional field sampling/sieving or two-dimensional images captured are often labor-intensive and limited for a representative analysis. Three-dimensional (3D) point cloud analysis may offer a more comprehensive approach; the dense packing and heavy occlusion of ballast particles restrict image segmentation. This study introduces a novel deep learning pipeline designed for robust 3D railway ballast characterization, BallastAttN. Its core contributions include a comprehensive synthetic training data set from high-fidelity 3D scans of new and degraded ballast particles, an enhanced point cloud segmentation model upgraded with edge-aware voxelization and curriculum learning, and the novel BallastAttN partial point cloud completion model architected to reconstruct complete particle shapes from the highly incomplete views typical of field conditions. The proposed pipeline was comprehensively validated using controlled laboratory experiments with isolated and clustered configurations of real ballast particles in new and degraded conditions. The results show that BallastAttN consistently outperforms the baseline completion framework that utilizes an encoder–decoder architecture mechanism built on attention mechanisms across commonly used size and morphological properties. The performance gap widened substantially in clustered scenarios that are close to the field ballast appearance, demonstrating the model’s enhanced ability to handle occlusion. The predictions were precise in differentiating between new and degraded ballast based on morphological properties, such as 3D sphericity, the Flat and Elongated Ratio, and the Angularity Index. This study establishes a practical framework for automated ballast inspection, for example, with the use of an innovative ballast scanning vehicle developed, paving the way for more efficient and reliable railway ballast maintenance.