Converter Networks for Multi-Scale Tokens-Aware Multi-Region and Multi-Sequence MR-to-CT Synthesis in a Single Model

Synthetic computed tomography (sCT) based on magnetic resonance imaging (MRI) streamlines the planning of radiation therapy treatments by doing away with CT simulation and error-prone picture registration, which in turn reduces radiation dosage for patients and setup uncertainty. To create sCT images that matched the MRI anatomy, an optimally trained MultiHead Attention was used in conjunction with the reverse diffusion process. We generated sCT using MRI on two datasets—one for the brain and one for the prostate—to test the suggested strategy. The following metrics were used for qualitative evaluation: ground truth CTs and sCTs normalized cross correlation (NCC) indices, multi-scale Structure Similarity index (MS-SSIM), peak signal-to-noise ratio (PSNR), and mean absolute error (MAE) of Hounsfield unit (HU). A new method for creating CT images from standard MRIs utilizing a transformer-based convolutional neural network (CNN) has been designed and verified by us. Synthetic CT (sCT) pictures of excellent quality and robustness may be produced in a few minutes using this model, which successfully depicts the intricate interaction among CT and MRI images. By cutting down on patient time spent on treatment planning, improving accuracy of treatment delivery, and doing away with the necessity for extra CT scans, this method may considerably streamline radiation treatment planning.