MambaFormer3D: A Hybrid Transformer-Mamba Network for 3D Brain Tumor Segmentation

In recent years, Vision Transformers (ViTs) have demonstrated strong performance in 3D medical image segmentation, particularly in capturing global features and modeling long-range dependencies. However, the self-attention mechanism in ViTs faces significant computational challenges due to its quadratic complexity, especially when applied to three-dimensional medical images, resulting in a high number of parameters and increased computational overhead. This limitation hampers their deployment on resource-constrained devices. To address this challenge, this paper proposes a lightweight MambaFormer architecture, which leverages the efficient representation learning capability of the Mamba SSM and the global feature extraction strength of Transformers, achieving linear computational complexity. The synergy between the MALR and LMA modules ensures computational efficiency while significantly enhancing segmentation performance, particularly in brain tumor segmentation tasks. Experimental results demonstrate that MambaFormer3D exhibits superior performance in processing multi-modal BraTS data, showing great potential in computationally constrained environments.

Authors

Publication Details

Journal
Academic Journal of Science and Technology
Published
2025-03-26
DOI
https://doi.org/10.54097/a5v4aj58
Primary Topic
Brain Tumor Detection and Classification
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

MambaFormer3D: A Hybrid Transformer-Mamba Network for 3D Brain Tumor Segmentation

Beibei Hou, Suijing Guan
Academic Journal of Science and Technology
Brain Tumor Detection and Classification
article

MambaFormer3D: A Hybrid Transformer-Mamba Network for 3D Brain Tumor Segmentation

Beibei Hou, Suijing Guan
article en

Abstract

In recent years, Vision Transformers (ViTs) have demonstrated strong performance in 3D medical image segmentation, particularly in capturing global features and modeling long-range dependencies. However, the self-attention mechanism in ViTs faces significant computational challenges due to its quadratic complexity, especially when applied to three-dimensional medical images, resulting in a high number of parameters and increased computational overhead. This limitation hampers their deployment on resource-constrained devices. To address this challenge, this paper proposes a lightweight MambaFormer architecture, which leverages the efficient representation learning capability of the Mamba SSM and the global feature extraction strength of Transformers, achieving linear computational complexity. The synergy between the MALR and LMA modules ensures computational efficiency while significantly enhancing segmentation performance, particularly in brain tumor segmentation tasks. Experimental results demonstrate that MambaFormer3D exhibits superior performance in processing multi-modal BraTS data, showing great potential in computationally constrained environments.

Academic Journal of Science and TechnologyVol. 14(3)
Openalex Percentile: Top 92%
Brain Tumor Detection and Classification
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.