Liver Segment and Lesion Segmentation on CT and MRI: An Open-Source Contribution to TotalSegmentator

This study aims to develop a tool based on deep learning algorithms for automatic liver segment and liver lesion segmentation on Computed Tomography (CT) and Magnetic Resonance Imaging (MRI). We demonstrate its clinical utility using a qualitative example of hepatocellular carcinoma (HCC) response to transarterial chemoembolization (TACE). The models are provided as open-source software to update and improve the capabilities of TotalSegmentator. Liver segmentation was performed on 193 CTs and 120 MRIs, using fivefold cross-validation for training/testing. 429 CTs and 321 MRIs with liver lesions and 15 CTs and 13 MRIs without liver lesions were collected. Of these 414 CTs and 308 MRIs were manually segmented and a nnU-Net was trained on 750 images and tested on 80. Inter-rater variability was examined on 20 CTs and 20 MRIs by two independent readers. We analyzed its potential clinical utility on 172 TACE-treated HCC on CT. Performance was evaluated using sensitivity, false positives, and volume. Voxel-wise segmentation was evaluated using the Dice coefficient. Our model's liver segmentation achieved Dice coefficients of 0.897 for CT and 0.847 for MRI. Liver lesion detection on CT achieved 75.8% sensitivity, 0.522 false positives per case (FP/c), and 0.658 Dice; on MRI, 62.7% sensitivity, 1.029 FP/c, and 0.337 Dice. Following TACE, median HCC attenuation significantly decreased from 51.33 HU to 38.5 HU. Human readers showed higher agreement (sensitivity: 64.7%, Dice: 0.464) than Lesion model (LM)-reader comparisons (sensitivity: 53.2%, Dice: 0.432) and the LM had a slightly higher FP/c (0.825 vs. 0.775). Overall, our algorithms reliably detect and segment liver segments and lesions on both CT and MRI and the qualitative assessment of HCC response to TACE illustrates the model's potential value for clinical and research applications.