Training-free generation of 4D CT and other rare acquisitions improves segmentation across modalities
Rationale: Routine clinical imaging captures anatomy under a limited set of physiologic and acquisition conditions, leaving segmentation models with sparse examples of how lesions and surrounding tissues deform with compression, respiration, or vascular pulsation. Standard image augmentation expands training datasets but does not explicitly model the mechanics underlying these changes. Patient-specific biomechanical simulation offers an approach to generate anatomically consistent images and corresponding segmentation masks under conditions absent from the original scan, without additional imaging or training a generative model. We hypothesized that incorporating this mechanistically grounded variability into training improves segmentation across imaging modalities. Methods: We evaluate across three segmentation tasks: breast cancer on 3D digital breast tomosynthesis, lung tumors on chest CT, and carotid plaque on ultrasound. From each routine scan, patient-specific biomechanical models generate acquisitions absent from the original study—a range of breast compressions, the respiratory cycle, and arterial wall distension across the cardiac cycle. The resulting displacement fields deform both images and masks. Segmentation models were trained with and without the generated data across a range of standard image augmentation techniques, evaluated via cross-validation and held-out test sets. Realism was assessed through blinded reader studies, and generated respiratory motion was validated against real 4D CT. Results: Training on the generated acquisitions improved segmentation across modalities, increasing Dice scores by 6.6% for breast (p<0.05), 10.1% for lung (p<0.05), and 4.5% for carotid plaque (p>0.05) relative to the routine scans alone. Generated respiratory motion closely matched real gated 4D CT, with Dice of 0.94 ± 0.02 for lung volume overlap. Blinded readers discriminated generated from real images at near chance (AUC: breast 0.61, lung 0.41, carotid 0.46). Conclusions: Mechanistic simulation generates imaging acquisitions that clinical systems do not supply, without training data or additional scanning, and improves AI-based disease detection across modalities.
Authors
- Brittany Zadek Dashevsky (ORCID: https://orcid.org/0000-0002-0545-5165)
- Wenhui Zhou (ORCID: https://orcid.org/0009-0007-1236-5970)
- Ifeoma Joy Okoye (ORCID: https://orcid.org/0000-0002-7762-4562)
- Marc Hirschvogel (ORCID: https://orcid.org/0000-0002-4575-9120)
- Wim Van Criekinge (ORCID: https://orcid.org/0000-0003-2971-5539)
- David L. Levin (ORCID: https://orcid.org/0000-0001-5915-6745)
- Ianto Lin Xi
- Michał Seweryn (ORCID: https://orcid.org/0000-0001-7196-0015)
- Nneka Ifeyinwa Iloanusi (ORCID: https://orcid.org/0000-0002-4389-7706)
- Steven P. Poplack (ORCID: https://orcid.org/0000-0002-5026-371X)
- Elizabeth S. McDonald (ORCID: https://orcid.org/0000-0002-7209-4216)
- Ahmet Görkem Er (ORCID: https://orcid.org/0000-0001-6638-7955)
- Luyao Shen (ORCID: https://orcid.org/0000-0001-7899-7486)
- Olivier Gevaert (ORCID: https://orcid.org/0000-0002-9965-5466)
- Katherine E. Hartmann (ORCID: https://orcid.org/0000-0002-7051-8185)
- Tarak Nandi (ORCID: https://orcid.org/0000-0002-7050-6619)
- Scott M. Damrauer (ORCID: https://orcid.org/0000-0001-8009-1632)
- Vineeth Gangaram
- Christoph Sadée (ORCID: https://orcid.org/0000-0001-7416-1470)
- Preya Shah (ORCID: https://orcid.org/0000-0001-8360-6400)
- Abhay Shukla (ORCID: https://orcid.org/0000-0001-6600-5697)
- Adaobi Chikasi Ilo
- Alex Dils
- Meng Hao
- Kyle Wan
- Cally Lin
- Max Van Puyvelde
- Audrey Chun (ORCID: https://orcid.org/0009-0004-9350-5207)
- Joel Ifenna Aniegbe
- Nkechinyere Carina Achilefu
- Navjeet Singh Hundal
- Felix Immel-Sadée
- Amaka Obiageli Nnamani
Institutions
- University of Nigeria (NG)
- Argonne National Laboratory (US)
- Federal Institute For Materials Research and Testing (DE)
- University of Wisconsin–Madison (US)
- Centre Hospitalier de Luxembourg (LU)
- Middle East Technical University (TR)
- Hospital of the University of Pennsylvania (US)
- Ghent University (BE)
- University of Łódź (PL)
- National Hospital Abuja (NG)
- Stanford Health Care (US)
- Copernicus Memorial Hospital (PL)
- Philadelphia VA Medical Center (US)
- Stanford Medicine (US)
- University of Nigeria Teaching Hospital (NG)
- David Umahi Federal University of Health Sciences Uburu (NG)
- The Ohio State University (US)
- University of Pennsylvania (US)
- University of California, Berkeley (US)
- Stanford University (US)
Publication Details
- Journal
- medRxiv
- Published
- 2026-10-26
- DOI
- https://doi.org/10.64898/2026.10.22.26365566
- Primary Topic
- Medical Image Segmentation Techniques
- Type
- preprint