Transformer-encoded nnU-Net with local region perceptron and contrastive learning (TLC-nnUNet) for multiple brain metastasis detection and delineation

Accurate detection and segmentation of multiple brain metastases (BMs) on magnetic resonance image remain challenging, particularly for those involving small lesions (longest axis length <3 mm), due to limitations in sensitivity, precision, and feature representation in existing deep learning frameworks. To address this challenge, we develop TLC-nnUNet, a novel integration of two advancements into transformer-enhanced nnU-Net (T-nnUNet) architecture: (1) local region perceptron (LRP), a loss constraint prioritizing small BM detection by up-weighting underrepresented voxels; and (2) contrastive learning pretraining (CLP), a supervised model pre-training strategy to amplify latent-space divergence between BM and non-BM regions, reducing false positives (FPs). The developed TLC-nnUNet is trained and evaluated on a multi-institutional dataset and achieves state-of-the-art performance, with 89.70% sensitivity, 97.34% precision, and a Dice coefficient of 0.92 at patient level. Further ablation studies confirm the synergistic contributions of each component: LRP enhances small BM detection, while CLP refines feature contrast, reducing FPs. Visualization via t-distributed stochastic neighbor embedding underscores CLP's role in disentangling BM and non-BM latent representations. Compared to existing methods, TLC-nnUNet demonstrates consistent accuracy of detection and segmentation cross lesion sizes. This framework holds significant promise for clinical workflows, enabling precise BM detection and segmentation in stereotactic radiosurgery and reducing manual contouring time.

Authors

Institutions

Publication Details

Journal
Physics in Medicine and Biology
Published
2026-03-03
DOI
https://doi.org/10.1088/1361-6560/ae4ced
Primary Topic
Brain Metastases and Treatment
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Transformer-encoded nnU-Net with local region perceptron and contrastive learning (TLC-nnUNet) for multiple brain metastasis detection and delineation

Gregory Szalkowski, Scott Gerard Soltys, Zabi Wardak, Lili He et al.
Physics in Medicine and Biology
Brain Metastases and Treatment
article

Transformer-encoded nnU-Net with local region perceptron and contrastive learning (TLC-nnUNet) for multiple brain metastasis detection and delineation

Gregory Szalkowski, Scott Gerard Soltys, Zabi Wardak, Lili He, Xuejun Gu, Weiguo Lu, Hao Jiang, Kangning Zhang, Qingying Wang, Mingli Chen
article en

Abstract

Accurate detection and segmentation of multiple brain metastases (BMs) on magnetic resonance image remain challenging, particularly for those involving small lesions (longest axis length <3 mm), due to limitations in sensitivity, precision, and feature representation in existing deep learning frameworks. To address this challenge, we develop TLC-nnUNet, a novel integration of two advancements into transformer-enhanced nnU-Net (T-nnUNet) architecture: (1) local region perceptron (LRP), a loss constraint prioritizing small BM detection by up-weighting underrepresented voxels; and (2) contrastive learning pretraining (CLP), a supervised model pre-training strategy to amplify latent-space divergence between BM and non-BM regions, reducing false positives (FPs). The developed TLC-nnUNet is trained and evaluated on a multi-institutional dataset and achieves state-of-the-art performance, with 89.70% sensitivity, 97.34% precision, and a Dice coefficient of 0.92 at patient level. Further ablation studies confirm the synergistic contributions of each component: LRP enhances small BM detection, while CLP refines feature contrast, reducing FPs. Visualization via t-distributed stochastic neighbor embedding underscores CLP's role in disentangling BM and non-BM latent representations. Compared to existing methods, TLC-nnUNet demonstrates consistent accuracy of detection and segmentation cross lesion sizes. This framework holds significant promise for clinical workflows, enabling precise BM detection and segmentation in stereotactic radiosurgery and reducing manual contouring time.

Physics in Medicine and BiologyVol. 71(5)
Cincinnati Children's Hospital Medical Center (US), The University of Texas Southwestern Medical Center (US), Stanford University (US)
Openalex Percentile: Top 34%
Brain Metastases and Treatment
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.