PAH2T-Former: Paired-Attention Hybrid Hierarchical Transformer for Synergistically Enhanced FMT Reconstruction Quality and Efficiency
Fluorescence molecular tomography (FMT) is a sensitive optical imaging technique that can achieve threedimensional (3D) tomographic images at the molecular and cellular levels. However, reconstructing the internal 3D distribution of fluorescent targets from surface two-dimensional (2D) fluorescence projection data remains a challenging task. In recent years, deep learning-based FMT reconstruction has received considerable attention, demonstrating superior performance compared to conventional methods, particularly combined with Transformers. Unlike convolutional architectures that emphasize local context, Transformers leverage selfattention mechanisms to excel at capturing long-range dependencies, thereby enhancing FMT reconstruction accuracy. Nevertheless, the quadratic computational complexity of selfattention poses a bottleneck, particularly pertinent in 3D FMT reconstructions. This paper aims to propose a novel Transformer-based FMT reconstruction algorithm that not only delivers high-quality reconstruction accuracy but also maintains excellent performance in efficiency and inference speed. The key design involves introducing a novel Spatial-Channel Paired Attention Module (SC-PAM), which employs a pair of interdependent branches based on spatial and channel attention, thus effectively learn discriminative features in both spatial and channel domains, meanwhile exhibiting linear complexity relative to the input projection size. Furthermore, to facilitate data transmission between the spatial and channel branches, we share the weights of the query and key mapping functions, which provides a complementary paired attention without elevating complexity. Extensive evaluations through numerical simulations and in vivo experiments were performed to validate effectiveness of the proposed model. The results show that our PAH2T-Former method achieves the highest Dice while reducing model parameters and complexity.
Authors
- Yu Shang (ORCID: https://orcid.org/0000-0002-2615-8944)
- Honglei Gao
- Guanglei Zhang (ORCID: https://orcid.org/0000-0002-2617-9673)
- Peng Zhang (ORCID: https://orcid.org/0000-0002-3879-5860)
- Xingyu Liu (ORCID: https://orcid.org/0000-0001-9736-3948)
- Qianqian Xue (ORCID: https://orcid.org/0000-0002-3803-4922)
- Ruidun Chen
- Chen Liu (ORCID: https://orcid.org/0000-0001-8296-8223)
- Jiye Liang (ORCID: https://orcid.org/0000-0001-5887-9327)
- Wenjian Wang
Institutions
- Shanxi University (CN)
- Dongguan University of Technology (CN)
- Beihang University (CN)
Publication Details
- Journal
- IEEE Transactions on Computational Imaging
- Published
- 2025-01-01
- DOI
- https://doi.org/10.1109/tci.2025.3559431
- Citations
- 1
- Primary Topic
- Advanced X-ray and CT Imaging
- Type
- article
- Field-Weighted Citation Impact
- 0.67
Funders
- National Natural Science Foundation of China
- Natural Science Foundation of Shanxi Province