Large language models in artificial intelligence to answer patient questions in spine surgery: an evaluation of current evidence

INTRODUCTION: Large language models (LLMs) are increasingly being explored in healthcare, particularly for enhancing patient education. In spine surgery, LLMs have the potential to enhance communication and support patients through perioperative care. However, concerns remain regarding the accuracy, readability, and overall reliability of these tools in delivering patient-facing information. This review aimed to understand the current use of LLMs in answering patient questions in spine surgery. EVIDENCE ACQUISITION: A structured search of PubMed and Google Scholar was conducted using terms focused on LLMs and neurosurgery. Studies were only included if they tested LLMs' ability in answering patient questions related to spine surgery. Exclusion criteria included non-peer-reviewed articles, studies that did not evaluate chatbot performance, or those using LLMs for non-educational purposes. EVIDENCE SYNTHESIS: LLMs were tested across a variety of spine-related topics, including scoliosis, lumbar and cervical fusion, endoscopic procedures, and spinal cord stimulation. Studies consistently reported moderate to high accuracy ratings. Readability scores remained a limitation, with most responses written at a college reading level. Empathy and clarity varied by model and condition, with some studies showing improved ratings when assessed by non-medical reviewers. Methodological variability across studies introduced inconsistencies and limited comparability. CONCLUSIONS: LLMs show promising utility for patient education in spine surgery for addressing frequently asked questions. However, challenges in readability, accuracy, and standardization limit their current clinical adoption. Moving forward, studies must incorporate standardized evaluation tools, address high rate of content hallucination, and focus on chatbot performance in personalized scenarios. Cross-disciplinary collaboration is essential to ensure safe, accessible integration into neurosurgical care pathways.

Authors

Institutions

Publication Details

Journal
Journal of Neurosurgical Sciences
Published
2026-04-01
DOI
https://doi.org/10.23736/s0390-5616.26.06678-6
Primary Topic
Artificial Intelligence in Healthcare and Education
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Large language models in artificial intelligence to answer patient questions in spine surgery: an evaluation of current evidence

Qazi Zeeshan, Aimé Parra Legarreta, Najib Muhammad, Avi A. Gajjar et al.
Journal of Neurosurgical Sciences
Artificial Intelligence in Healthcare and Education
article

Large language models in artificial intelligence to answer patient questions in spine surgery: an evaluation of current evidence

Qazi Zeeshan, Aimé Parra Legarreta, Najib Muhammad, Avi A. Gajjar, Hansen Deng, Nitin Agarwal, Zayaan Tirmizi, Ayesha Akbar Waheed, Serhat Aydin, D. Kojo HAMILTON
article en

Abstract

INTRODUCTION: Large language models (LLMs) are increasingly being explored in healthcare, particularly for enhancing patient education. In spine surgery, LLMs have the potential to enhance communication and support patients through perioperative care. However, concerns remain regarding the accuracy, readability, and overall reliability of these tools in delivering patient-facing information. This review aimed to understand the current use of LLMs in answering patient questions in spine surgery. EVIDENCE ACQUISITION: A structured search of PubMed and Google Scholar was conducted using terms focused on LLMs and neurosurgery. Studies were only included if they tested LLMs' ability in answering patient questions related to spine surgery. Exclusion criteria included non-peer-reviewed articles, studies that did not evaluate chatbot performance, or those using LLMs for non-educational purposes. EVIDENCE SYNTHESIS: LLMs were tested across a variety of spine-related topics, including scoliosis, lumbar and cervical fusion, endoscopic procedures, and spinal cord stimulation. Studies consistently reported moderate to high accuracy ratings. Readability scores remained a limitation, with most responses written at a college reading level. Empathy and clarity varied by model and condition, with some studies showing improved ratings when assessed by non-medical reviewers. Methodological variability across studies introduced inconsistencies and limited comparability. CONCLUSIONS: LLMs show promising utility for patient education in spine surgery for addressing frequently asked questions. However, challenges in readability, accuracy, and standardization limit their current clinical adoption. Moving forward, studies must incorporate standardized evaluation tools, address high rate of content hallucination, and focus on chatbot performance in personalized scenarios. Cross-disciplinary collaboration is essential to ensure safe, accessible integration into neurosurgical care pathways.

Journal of Neurosurgical Sciences
University of Pittsburgh (US), Albany College of Pharmacy and Health Sciences (US), VA Pittsburgh Healthcare System (US), University of Pittsburgh Medical Center (US), Neurological Surgery (US), Albany Medical Center Hospital (US)
Quality Education
Openalex Percentile: Top 30%
Artificial Intelligence in Healthcare and Education
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.