Depth-enabled fiber-bundle endoscopy for in situ intraluminal robotic navigation
Three-dimensional perception is essential for intraluminal robotic navigation, where depth estimation provides geometric feedback for safe advancement. Fiber-bundle endoscopy provides sub-millimeter, flexible imaging for miniature probes but lacks reliable depth recovery due to artifacts and missing ground truth. We present a weakly supervised framework that augments fiber-bundle imaging with depth by combining domain translation, pseudo-depth supervision, and structure-aware constraints. Trained without paired labels or external sensors, the network infers depth directly from raw images and reconstructs lumen topology for inclination-angle guidance. Integrated with magnetic actuation, the method enables efficient closed-loop navigation in curved luminal phantoms, demonstrating depth-enabled fiber-bundle endoscopy for in situ robotic control.
Authors
- X. X. Shen (ORCID: https://orcid.org/0000-0002-4192-8716)
- Jianlong Yang (ORCID: https://orcid.org/0000-0001-7450-1260)
- Haoran Zhang (ORCID: https://orcid.org/0000-0003-4981-7065)
- Wen‐Tao Yu (ORCID: https://orcid.org/0000-0003-3985-4006)
- Qi Lan
- Weiyi Zhang (ORCID: https://orcid.org/0000-0003-4178-7084)
Institutions
- Shanghai Jiao Tong University (CN)
Publication Details
- Journal
- Optics Letters
- Published
- 2025-10-15
- DOI
- https://doi.org/10.1364/ol.574598
- Primary Topic
- Robotics and Sensor-Based Localization
- Type
- article
- Field-Weighted Citation Impact
- 0.00