Explainable AI for automated respiratory misalignment detection in PET/CT imaging

Purpose : Positron emission tomography (PET) image quality can be affected by artifacts emanating from PET, CT, or artifacts due to misalignment between PET and CT images. Automated detection of misalignment artifacts can be helpful both in data curation and in facilitating clinical workflow. This study aimed to develop an explainable machine learning approach to detect misalignment artifacts in PET/CT imaging. Approach : This study included 1216 PET/CT images. All images were visualized and images with respiratory misalignment artifact (RMA) detected. Using previously trained models, four organs including the lungs, liver, spleen, and heart were delineated on PET and CT images separately. Data were randomly split into cross-validation (80%) and test set (20%), then two segmentations performed on PET and CT images were compared and the comparison metrics used as predictors for a random forest framework in a 10-fold scheme on cross-validation data. The trained models were tested on 20% test set data. The model’s performance was calculated in terms of specificity, sensitivity, F1-Score and area under the curve (AUC). Main Results : Sensitivity, specificity, and AUC of 0.82, 0.85, and 0.91 were achieved in ten-fold data split. F1_score, sensitivity, specificity, and AUC of 84.5 vs 82.3, 83.9 vs 83.8, 87.7 vs 83.5, and 93.2 vs 90.1 were achieved for cross-validation vs test set, respectively. The liver and lung were the most important organs selected after feature selection.
Significance. We developed an automated pipeline to segment four organs from PET and CT images separately and used the match between these segmentations to decide about the presence of misalignment artifact. This methodology may follow the same logic as a reader detecting misalignment through comparing the contours of organs on PET and CT images. The proposed method can be used to clean large datasets or integrated into a clinical scanner to indicate artifactual cases.