Off-the-Shelf Deep Learning Models for Visual Perception in Robotic ICSI: A Single-Center Feasibility Study of Detection and Segmentation

The success of in vitro fertilization (IVF) depends on the manual skill of embryologists, which introduces operator variability and limits standardization across laboratories. Automating IVF laboratory procedures could improve consistency. A prerequisite for such automation is the reliable detection and segmentation of gametes and instruments in microscopy images. In this single-center feasibility study, we fine-tuned off-the-shelf deep learning models by transfer learning and evaluated them on three computer vision tasks in intracytoplasmic sperm injection (ICSI): detection of the oocyte and instrument tips (RT-DETR-L), detection of the sperm inside the injection needle (RT-DETR-L), and instance segmentation of the sperm head and tail (YOLO11-L-seg). Images were extracted from videos of clinical ICSI procedures recorded with a custom inverted microscope, and the data were partitioned at the patient level, so that no patient contributed to more than one subset. On the held-out test sets, the three models reached an [email protected] of 0.988, 0.962, and 0.990, respectively, with model inference latencies of 7.0–11.6 ms per image on a single GPU. These results suggest that off-the-shelf models, adapted with modest clinical datasets, are a feasible starting point for the perception layer of robotic ICSI.

Authors

Institutions

Publication Details

Journal
Bioengineering
Published
2026-11-20
DOI
https://doi.org/10.3390/bioengineering13111397
Primary Topic
Advanced Neural Network Applications
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

Off-the-Shelf Deep Learning Models for Visual Perception in Robotic ICSI: A Single-Center Feasibility Study of Detection and Segmentation

Giuseppe Silvestri, Gerardo Mendizabal‐Ruiz, Vladimir Ocegueda-Hernández, Jacques Cohen et al.
Bioengineering
Advanced Neural Network Applications
article

Off-the-Shelf Deep Learning Models for Visual Perception in Robotic ICSI: A Single-Center Feasibility Study of Detection and Segmentation

Giuseppe Silvestri, Gerardo Mendizabal‐Ruiz, Vladimir Ocegueda-Hernández, Jacques Cohen, Alejandro Chávez-Badiola, Celina Mendez-Zavala, Diana Mancera-Zapata, Mario Reyes-Llamas
article en

Abstract

The success of in vitro fertilization (IVF) depends on the manual skill of embryologists, which introduces operator variability and limits standardization across laboratories. Automating IVF laboratory procedures could improve consistency. A prerequisite for such automation is the reliable detection and segmentation of gametes and instruments in microscopy images. In this single-center feasibility study, we fine-tuned off-the-shelf deep learning models by transfer learning and evaluated them on three computer vision tasks in intracytoplasmic sperm injection (ICSI): detection of the oocyte and instrument tips (RT-DETR-L), detection of the sperm inside the injection needle (RT-DETR-L), and instance segmentation of the sperm head and tail (YOLO11-L-seg). Images were extracted from videos of clinical ICSI procedures recorded with a custom inverted microscope, and the data were partitioned at the patient level, so that no patient contributed to more than one subset. On the held-out test sets, the three models reached an [email protected] of 0.988, 0.962, and 0.990, respectively, with model inference latencies of 7.0–11.6 ms per image on a single GPU. These results suggest that off-the-shelf models, adapted with modest clinical datasets, are a feasible starting point for the perception layer of robotic ICSI.

BioengineeringVol. 13(11)
Universidad de Guadalajara (MX)
Advanced Neural Network Applications
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon