Decoding the surgical scene: A scoping review of scene graphs in surgery
As surgical AI transitions from pixel-level detection to complex reasoning, Scene Graphs (SGs) offer the structured, relational representations necessary to decode dynamic surgical environments. This PRISMA-ScR-guided scoping review systematically maps the evolving landscape of SG research in surgery, analyzing 52 primary studies to chart applications and methodological shifts. Our analysis reveals rapid growth, yet uncovers a critical 'data divide': internal-view research (e.g., triplet recognition from endoscopic video) accounts for 79% of studies and predominantly uses real-world 2D video, while external-view operating room modeling relies heavily on simulated data. Methodologically, we identify a decisive shift from foundational graph neural networks to specialized foundation models and generative AI, which together now account for approximately 50% of research in 2025. Crucially, our synthesis suggests that Scene Graphs are evolving from simple descriptors into essential 'neuro-symbolic guardrails', providing the structured, verifiable intermediate representation needed to prevent hallucinations in increasingly autonomous Surgical Foundation Models. Despite this promise, a major translational gap remains: none (0/52) of the reviewed studies have proceeded to prospective clinical validation. We conclude that bridging this gap requires moving beyond standard computer vision metrics; we therefore propose the 'Validation Trinity' - prioritizing Semantic Query Success, Latency-Aware Accuracy, and Safety-Critical Recall - as the necessary evaluation framework to bring graph-based surgical AI into clinical practice.
Authors
- M. Ali Nasseri (ORCID: https://orcid.org/0000-0002-9764-5731)
- Nassir Navab (ORCID: https://orcid.org/0000-0002-6032-5611)
- Peter Charbel Issa (ORCID: https://orcid.org/0000-0002-0351-6673)
- Daniel Zapp (ORCID: https://orcid.org/0000-0001-7489-958X)
- Korab Hoxha
Institutions
- Klinik und Poliklinik für Augenheilkunde Universitätsklinikum Regensburg (DE)
- Technical University of Munich (DE)
Publication Details
- Journal
- Medical Image Analysis
- Published
- 2026-04-25
- DOI
- https://doi.org/10.1016/j.media.2026.104083
- Primary Topic
- Colorectal Cancer Screening and Detection
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- Bayerische Forschungsstiftung