Off-the-Shelf Deep Learning Models for Visual Perception in Robotic ICSI: A Single-Center Feasibility Study of Detection and Segmentation
The success of in vitro fertilization (IVF) depends on the manual skill of embryologists, which introduces operator variability and limits standardization across laboratories. Automating IVF laboratory procedures could improve consistency. A prerequisite for such automation is the reliable detection and segmentation of gametes and instruments in microscopy images. In this single-center feasibility study, we fine-tuned off-the-shelf deep learning models by transfer learning and evaluated them on three computer vision tasks in intracytoplasmic sperm injection (ICSI): detection of the oocyte and instrument tips (RT-DETR-L), detection of the sperm inside the injection needle (RT-DETR-L), and instance segmentation of the sperm head and tail (YOLO11-L-seg). Images were extracted from videos of clinical ICSI procedures recorded with a custom inverted microscope, and the data were partitioned at the patient level, so that no patient contributed to more than one subset. On the held-out test sets, the three models reached an [email protected] of 0.988, 0.962, and 0.990, respectively, with model inference latencies of 7.0–11.6 ms per image on a single GPU. These results suggest that off-the-shelf models, adapted with modest clinical datasets, are a feasible starting point for the perception layer of robotic ICSI.
Authors
- Giuseppe Silvestri (ORCID: https://orcid.org/0000-0002-5496-2470)
- Gerardo Mendizabal‐Ruiz (ORCID: https://orcid.org/0000-0002-3757-4409)
- Vladimir Ocegueda-Hernández (ORCID: https://orcid.org/0000-0002-1942-452X)
- Jacques Cohen (ORCID: https://orcid.org/0000-0002-7585-1489)
- Alejandro Chávez-Badiola (ORCID: https://orcid.org/0000-0002-7977-3174)
- Celina Mendez-Zavala
- Diana Mancera-Zapata
- Mario Reyes-Llamas
Institutions
- Universidad de Guadalajara (MX)
Publication Details
- Journal
- Bioengineering
- Published
- 2026-11-20
- DOI
- https://doi.org/10.3390/bioengineering13111397
- Primary Topic
- Advanced Neural Network Applications
- Type
- article
- Field-Weighted Citation Impact
- 0.00