Transferable Deep Reinforcement Learning With Edge‐Contour‐Depth Fusion for Autonomous Wireless Capsule Endoscopy Navigation
Wireless capsule endoscopy (WCE) enables painless, minimally invasive visualization of the gastrointestinal tract. Still, its diagnostic potential is limited by incomplete mucosal coverage and poor transferability of existing navigation methods across patient anatomies. We propose a transferable, anatomical landmark-guided deep reinforcement learning framework for robust autonomous gastric navigation. Leveraging a lightweight edge-contour-depth fusion module, our policy operates on stable, low-dimensional landmark coordinates rather than high-dimensional video streams. This design effectively bridges the sim-to-real visual gap and ensures robustness across diverse anatomies, enabling low-cost deployment by reducing computational overhead. In simulations across eight patient-derived models, the method achieves >97% coverage within 50 s, significantly outperforming vanilla Proximal Policy Optimization, Soft Actor-Critic, and Deep Q-Network agents by enhancing coverage and minimizing variance. To ensure deployment reliability, a two-stage sim-to-real pipeline supported by an adaptive dynamic programming controller actively mitigates physical disturbances, including actuator latency and peristalsis. Ex vivo experiments across five independent scans demonstrate high coverage stability, achieving a mean coverage of 87% and a 53% reduction in procedure time compared with expert manual control. This study establishes a scalable paradigm for autonomous, high‑coverage endoscopic navigation, advancing the clinical deployment of intelligent WCE systems for GI diagnostics.
Authors
- Hongliang Ren (ORCID: https://orcid.org/0000-0002-6488-1551)
- Haitao Gao (ORCID: https://orcid.org/0000-0002-3192-5183)
- Sishen Yuan (ORCID: https://orcid.org/0000-0001-5095-5372)
- Haiyang Fang (ORCID: https://orcid.org/0000-0002-6587-2737)
- Qingyang Liu (ORCID: https://orcid.org/0000-0002-7811-2681)
- Baijia Liang
- Yongzun Yang (ORCID: https://orcid.org/0009-0004-6353-8315)
- Wenzhen Dong
- Shijian Su (ORCID: https://orcid.org/0000-0001-7155-2660)
- SW Cheng
- Dihong Xie
- Zhen LI
- Xiuli Zuo
- J C T Lai
- Mingwu Su
- Haoxuan Wu (ORCID: https://orcid.org/0000-0002-4555-1020)
- Long Bai
Institutions
- Chinese University of Hong Kong (HK)
- UNSW Sydney (AU)
- Qilu Hospital of Shandong University (CN)
Publication Details
- Journal
- Advanced Science
- Published
- 2026-06-12
- DOI
- https://doi.org/10.1002/advs.202600008
- Primary Topic
- Gastrointestinal Bleeding Diagnosis and Treatment
- Type
- article
- Field-Weighted Citation Impact
- 0.00