ConVibNet: needle detection during continuous insertion via frequency-inspired features
PURPOSE: Ultrasound-guided needle interventions are widely used in clinical practice, but their success critically depends on accurate needle placement, which is frequently hindered by the poor and intermittent visibility of needles in ultrasound images. Existing approaches remain limited by artifacts, occlusions, and low contrast, and often fail to support real-time continuous insertion. To overcome these challenges, this study introduces a robust real-time framework for continuous needle detection. METHODS: We present ConVibNet, an extension of VibNet for detecting needles with significantly reduced visibility, addressing real-time, continuous needle tracking during insertion. ConVibNet leverages temporal dependencies across successive ultrasound frames to enable continuous estimation of both needle tip position and shaft angle in dynamic scenarios. To strengthen temporal awareness of needle tip motion, we introduce a novel intersection and difference loss that explicitly leverages motion correlations across consecutive frames. In addition, we curated a dedicated dataset for model development and evaluation. RESULTS: . These results represent a 0.75 mm improvement in tip localization accuracy over the best-performing baseline, while preserving real-time inference capability. CONCLUSION: ConVibNet advances real-time needle detection in ultrasound-guided interventions by integrating temporal correlation modeling with a novel intersection and difference loss, thereby improving accuracy and robustness and demonstrating high potential for integration into autonomous insertion systems.
Authors
- Dianye Huang (ORCID: https://orcid.org/0000-0001-7719-6505)
- Zhehao Duan
- Jiamei Guo
- Maria Neiiendam
- Nassir Navab
- Zhongliang Jiang
Institutions
- BMW (Germany) (DE)
- Munich Center for Machine Learning
- Technical University of Munich (DE)
- University of Hong Kong (HK)
- Technical University of Denmark (DK)
Publication Details
- Journal
- International Journal of Computer Assisted Radiology and Surgery
- Published
- 2026-04-27
- DOI
- https://doi.org/10.1007/s11548-026-03649-5
- Primary Topic
- Soft Robotics and Applications
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- Technische Universität München