Endo4DGSLAM: Multi-level deformable modeling with redundancy reduction for endoscopic non-rigid SLAM
Medical endoscopic SLAM enables real-time pose estimation and 3D mapping inside the human body, holding significant value for surgical navigation. Although emerging 3DGS improves SLAM through fast, high-quality rendering, mainstream methods remain constrained by the static-scene assumption. Recent dynamic GS-SLAM methods struggle with irregular tissue motion and suffer from high computational and deformation modeling overhead, hindering real-time online optimization. To address these challenges, we present a dynamic GS-SLAM framework specifically tailored for endoscopic environments. To handle complex tissue deformation in endoscopic scenes, we adopt a multi-scale motion representation with timestamp-aware encoding, which captures tissue motion and viewpoint variations across different temporal scales in continuous observations. In addition, we incorporate several acceleration strategies to reduce the computational overhead of the GS-SLAM pipeline. Specifically, the method reuses deformation information to construct a motion mask, which mitigates the influence of locally dynamic tissues on camera tracking and reduces unnecessary backpropagation during optimization. Meanwhile, the dynamic resolution downsampling and history-aware pruning strategies adaptively adjust the resolution and evaluate Gaussian importance across frames, effectively removing redundant pixels and Gaussian primitives while preserving spatiotemporal consistency. We evaluate our method on four public endoscopic datasets and achieve competitive results, with consistent improvements observed in several pose estimation and novel view synthesis metrics. In addition, our system achieves an end-to-end throughput of 26.3 FPS. At the algorithmic level, our method delivers approximately a 5 × reduction in per-iteration tracking time compared to the leading dynamic SLAM approach.
Authors
- Weixiong Liao
- Zhijian Hao (ORCID: https://orcid.org/0000-0002-7892-5973)
- Yunfeng Nie (ORCID: https://orcid.org/0000-0001-6807-0433)
- Yanpeng Zhao (ORCID: https://orcid.org/0000-0002-2117-630X)
- Zhiliang Yan
- Jingang Zhang
- Rongqi Wang
- Zhijiang Li
Institutions
- Vrije Universiteit Brussel (BE)
- Xidian University (CN)
- Chinese PLA General Hospital (CN)
- Flanders Make (Belgium) (BE)
- University of Chinese Academy of Sciences (CN)
Publication Details
- Journal
- Medical Image Analysis
- Published
- 2026-08-20
- DOI
- https://doi.org/10.1016/j.media.2026.104270
- Primary Topic
- Robotics and Sensor-Based Localization
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- Chinese Academy of Sciences
- China Postdoctoral Science Foundation
- Fonds Wetenschappelijk Onderzoek
- Natural Science Foundation of Beijing Municipality