Effects of Target Images on Outputs of Style-Transfer Generative Models for Brain MRI Harmonization

Multi-site neuroimaging studies allow for increased sample sizes and improved statistical power for robustness and generalizability of findings. However, image acquisition protocols and scanner properties can contribute to site-specific effects, which may lead to biased results. Data harmonization can help mitigate scanner-induced biases, and recent generative approaches for transfering the style of images from one scanner to images from other scanners have been proposed. However, these approaches usually require a single representative image to serve as the target style, and the extent to which specific anatomical content in the image, such as abnormal pathology, may drive harmonization “style” has yet to be evaluated. Here, we compare MRI harmonization results from three style-transfer deep learning models: StarGANv2, ArtFlow and StyTr<sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">2</sup> to assess harmonization performance using a traveling subjects dataset and variability due to target selection using a dataset with varying levels of individual pathology in terms of white matter hyperintensities. We found StyTr<sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">2</sup> produced images where the harmonized results were less variant to white matter hyperintensity pathologies introduced in style. Our work suggests future harmonization methods may want to consider transformers such as StyTr<sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">2</sup> for more repeatable generated images.

Authors

Institutions

Publication Details

Published
2024-11-13
DOI
https://doi.org/10.1109/sipaim62974.2024.10783646
Primary Topic
Speech Recognition and Synthesis
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Effects of Target Images on Outputs of Style-Transfer Generative Models for Brain MRI Harmonization

Siddharth Narula, Neda Jahanshad, Shruti P. Gadewar, Elizabeth Haddad et al.
Speech Recognition and Synthesis
article

Effects of Target Images on Outputs of Style-Transfer Generative Models for Brain MRI Harmonization

Siddharth Narula, Neda Jahanshad, Shruti P. Gadewar, Elizabeth Haddad, Iyad Ba Gari, Alyssa H. Zhu, Sunanda Somu
article en

Abstract

Multi-site neuroimaging studies allow for increased sample sizes and improved statistical power for robustness and generalizability of findings. However, image acquisition protocols and scanner properties can contribute to site-specific effects, which may lead to biased results. Data harmonization can help mitigate scanner-induced biases, and recent generative approaches for transfering the style of images from one scanner to images from other scanners have been proposed. However, these approaches usually require a single representative image to serve as the target style, and the extent to which specific anatomical content in the image, such as abnormal pathology, may drive harmonization “style” has yet to be evaluated. Here, we compare MRI harmonization results from three style-transfer deep learning models: StarGANv2, ArtFlow and StyTr<sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">2</sup> to assess harmonization performance using a traveling subjects dataset and variability due to target selection using a dataset with varying levels of individual pathology in terms of white matter hyperintensities. We found StyTr<sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">2</sup> produced images where the harmonized results were less variant to white matter hyperintensity pathologies introduced in style. Our work suggests future harmonization methods may want to consider transformers such as StyTr<sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">2</sup> for more repeatable generated images.

University of Southern California (US)
National Institutes of Health
Openalex Percentile: Top 79%
Speech Recognition and Synthesis
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.