Multi-Scale Cascaded With Cross-Attention Network-Based Deformation Vector Field Estimation for Motion-Compensated 4D-CBCT Reconstruction
Four-Dimensional Cone Beam Computed Tomography (4D-CBCT) imaging technology offers enhanced image quality and spatial resolution for intraoperative guidance, facilitating real-time tracking of tumor position changes during radiotherapy. However, this is still a task of great challenges due to insufficient projections at each respiratory phase after phase-sorting, and the image phases reconstructed directly from phase-sorted data are discrete and discontinuous. To generate high-quality 4D-CBCT deformation vector fields (DVFs), this paper leverages the preoperative static prior image to guide intraoperative dynamic sparse-view reconstruction images for reducing anatomical structure differences, ultimately achieving continuous and dynamic 4D-CBCT imaging. In this paper, we propose a Multi-scale Cascaded residual deformable vector field estimation framework based on Cross-attention in Motioncompensated 4D-CBCT reconstruction (MCCM), which combines Multi-Scale Cascaded residual registration network (MSCNet), Cross-Attention Enhanced feature Fusion (CAEF) module and Structure-Enhanced Motion-Compensated (SEMC) module: 1) the MCCM employs a multi-scale cascaded residual network strategy, merging multi-receptive fields and multi-resolution feature maps for large-scale internal changes. 2) the CAEF is embedded into MSC-Net to facilitate effective communication and learning between features and promote the flow of information. 3) the SEMC is developed to reduce artifacts after intraoperative CBCT sparse-view reconstruction, restore global lung motion changes and local details, and enhance structural information through image fusion. The proposed method has been evaluated using simulated and clinical datasets and has shown promising results by comparative experiment. Our approach exhibits significant improvements across various evaluation metrics.
Authors
- Chunfeng Yang (ORCID: https://orcid.org/0000-0003-1104-3076)
- Wei Zhao (ORCID: https://orcid.org/0000-0002-1902-3144)
- Tianling Lyu (ORCID: https://orcid.org/0000-0002-5851-6363)
- Zhiqiang Gao (ORCID: https://orcid.org/0000-0001-7381-9349)
- Dianlin Hu (ORCID: https://orcid.org/0000-0003-4857-9878)
- Fei Lyu (ORCID: https://orcid.org/0000-0001-8858-8950)
- Yang Chen (ORCID: https://orcid.org/0000-0002-5660-6349)
- Zhan Wu (ORCID: https://orcid.org/0000-0001-9406-7254)
- Jian Zhu (ORCID: https://orcid.org/0000-0002-1261-5673)
- Peng Yuan (ORCID: https://orcid.org/0000-0003-3751-8850)
- Jianmin Dong
Institutions
- Ministry of Education of the People's Republic of China (CN)
- Hong Kong Baptist University (HK)
- Xizang Minzu University (CN)
- Shandong Tumor Hospital (CN)
- Shandong First Medical University (CN)
- Zhejiang University of Technology (CN)
- Southeast University (CN)
- Beihang University (CN)
Publication Details
- Journal
- IEEE Transactions on Computational Imaging
- Published
- 2025-01-01
- DOI
- https://doi.org/10.1109/tci.2025.3561660
- Citations
- 1
- Primary Topic
- Medical Imaging Techniques and Applications
- Type
- article
- Field-Weighted Citation Impact
- 1.36
Funders
- National Natural Science Foundation of China
- Natural Science Foundation of Zhejiang Province