Large language model-based uncertainty-adjusted label extraction for artificial intelligence model development in upper extremity radiography

Question Can GPT-4o automatically extract high-accuracy, uncertainty-aware diagnostic labels from routine radiologic reports of the clavicle, elbow, and thumb for use in training multi-label image classifiers? Findings GPT-4o extracted labels with > 98% accuracy, and multi-label classifiers for clavicle, elbow, and thumb radiographs performed consistently regardless of how uncertainty was handled. Clinical relevance Automated GPT-4o-based labeling of routine clavicle, elbow, and thumb radiologic reports enables the rapid conversion of radiologic reports into structured multi-label training datasets, supporting scalable development of dedicated image classification models.