AME-Net++: adaptive mixture-of-experts for intelligent intraoperative 3D reconstruction
In minimally invasive vascular interventions, intraoperative 3D vascular reconstruction and accurate spatial characterization are crucial for safe and precise robotic surgical navigation. However, unlike conventional supervised learning tasks that rely on a fixed training/testing split, projection-based neural reconstruction aims to establish a patient-specific mapping between sparse X-ray observations and the corresponding 3D spatial representation. In this paper, we propose AME-Net++, an Adaptive Mixture-of-Experts Network that integrates feature perception, adaptive expert collaboration, and multi-scale optimization for 3D structural reconstruction from intraoperative multi-view X-ray projections. Specifically, AME-Net++ employs an adaptive feature-preservation strategy to suppress projection noise while preserving the geometric continuity of vascular structures. To address heterogeneous tissue attenuation and region-dependent structural variations, we design a parallel mixture-of-experts architecture with a learnable routing mechanism that dynamically assigns local features to appropriate expert subnetworks for region-adaptive, fine-grained representation learning. In addition, we propose a multi-scale information-aware composite loss function to jointly optimize global structural fidelity, local density consistency, and edge-detail preservation. Experimental results on both public datasets and our self-built animal interventional vascular dataset demonstrate that AME-Net++ achieves strong performance in both 2D projection synthesis and 3D voxel reconstruction tasks. Additional validation on this dataset shows that the reconstructed vascular centerline has an average error of 1.5 ± 0.67 mm, indicating that the proposed method can preserve the major vascular trajectory with clinically meaningful spatial accuracy. These results validate the effectiveness of the proposed reconstruction method and indicate its potential for 3D navigation in vascular interventional procedures.
Authors
- Linsen Zhang (ORCID: https://orcid.org/0000-0001-8954-3498)
- Zhang You-jun (ORCID: https://orcid.org/0000-0003-3796-7170)
- Xinkai Qu (ORCID: https://orcid.org/0000-0002-5000-6721)
- Xiyao Ma (ORCID: https://orcid.org/0000-0002-5411-4527)
- Zeng‐Guang Hou (ORCID: https://orcid.org/0000-0002-1534-5840)
- Shiqi Liu (ORCID: https://orcid.org/0009-0008-5612-3989)
- Xiao-Hu Zhou
- Xiao-Liang Xie
Institutions
- Chinese Academy of Sciences (CN)
- Fudan University (CN)
- Huadong Hospital (CN)
- Institute of Automation (CN)
Publication Details
- Journal
- Intelligence & Robotics
- Published
- 2026-11-05
- DOI
- https://doi.org/10.20517/ir.2026.39
- Primary Topic
- 3D Shape Modeling and Analysis
- Type
- article
- Field-Weighted Citation Impact
- 0.00