Evaluation of ChatGPT-5 responses to patient-centered questions on stromal vascular fraction for knee osteoarthritis: fair to good quality and content

The global burden of symptomatic knee osteoarthritis (KOA) continues to grow, driving clinical interest in biological treatment options. Stromal vascular fraction (SVF), derived from adipose tissue, has gained attention as a potential therapy for KOA. As patients increasingly utilize large language models (LLMs) like ChatGPT for health information, this study aimed to evaluate the patient-information quality and readability of AI-generated responses to a curated set of patient-centered questions on SVF therapy for KOA. Thirty patient-centered questions were developed through literature review by two experts and then posed to ChatGPT-5 after asking it to answer from an orthopaedic specialist perspective. Responses from ChatGPT-5 were evaluated by four orthopaedic specialists using three quality instruments: DISCERN, NLAT-AI (assessing five domains: Accuracy, Safety, Appropriateness, Actionability, and Effectiveness), and the Mika et al. scoring system. Readability was assessed using five standard metrics. Mean scores were as follows: DISCERN 44.61 ± 4.94 (Fair); for NLAT-AI domains, Accuracy 3.92 ± 0.50 (Good), Safety 3.23 ± 0.78 (Fair), Appropriateness 4.14 ± 0.32 (Good), Actionability 3.20 ± 0.67 (Fair), and Effectiveness 4.46 ± 0.35 (Excellent); NLAT-AI (Total/ sum of five domains) 18.95 ± 1.93 (Good); Mika et al. 2.45 ± 0.49 (Fair). Readability metrics indicated an 11th to 12th grade reading level. ChatGPT-5 provides fair-to-good quality responses to patient-centered questions about SVF in KOA. The answers are generally effective and clinically appropriate, with good accuracy, and often require only limited additional clarification. However, safety cautions and practical guidance are less consistently covered, and the reading level is relatively high. Further research is needed to clarify its role as an adjunct tool for patient education in this setting.

Authors

Institutions

Publication Details

Journal
BMC Musculoskeletal Disorders
Published
2026-03-14
DOI
https://doi.org/10.1186/s12891-026-09731-y
Primary Topic
Artificial Intelligence in Healthcare and Education
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Evaluation of ChatGPT-5 responses to patient-centered questions on stromal vascular fraction for knee osteoarthritis: fair to good quality and content

Sadettin Çiftçi, Numan Mercan, Ebubekir Eravşar, Tevfik Çatal et al.
BMC Musculoskeletal Disorders
Artificial Intelligence in Healthcare and Education
article

Evaluation of ChatGPT-5 responses to patient-centered questions on stromal vascular fraction for knee osteoarthritis: fair to good quality and content

Sadettin Çiftçi, Numan Mercan, Ebubekir Eravşar, Tevfik Çatal, Musa Ergin, Mustafa Akkaya
article en

Abstract

The global burden of symptomatic knee osteoarthritis (KOA) continues to grow, driving clinical interest in biological treatment options. Stromal vascular fraction (SVF), derived from adipose tissue, has gained attention as a potential therapy for KOA. As patients increasingly utilize large language models (LLMs) like ChatGPT for health information, this study aimed to evaluate the patient-information quality and readability of AI-generated responses to a curated set of patient-centered questions on SVF therapy for KOA. Thirty patient-centered questions were developed through literature review by two experts and then posed to ChatGPT-5 after asking it to answer from an orthopaedic specialist perspective. Responses from ChatGPT-5 were evaluated by four orthopaedic specialists using three quality instruments: DISCERN, NLAT-AI (assessing five domains: Accuracy, Safety, Appropriateness, Actionability, and Effectiveness), and the Mika et al. scoring system. Readability was assessed using five standard metrics. Mean scores were as follows: DISCERN 44.61 ± 4.94 (Fair); for NLAT-AI domains, Accuracy 3.92 ± 0.50 (Good), Safety 3.23 ± 0.78 (Fair), Appropriateness 4.14 ± 0.32 (Good), Actionability 3.20 ± 0.67 (Fair), and Effectiveness 4.46 ± 0.35 (Excellent); NLAT-AI (Total/ sum of five domains) 18.95 ± 1.93 (Good); Mika et al. 2.45 ± 0.49 (Fair). Readability metrics indicated an 11th to 12th grade reading level. ChatGPT-5 provides fair-to-good quality responses to patient-centered questions about SVF in KOA. The answers are generally effective and clinically appropriate, with good accuracy, and often require only limited additional clarification. However, safety cautions and practical guidance are less consistently covered, and the reading level is relatively high. Further research is needed to clarify its role as an adjunct tool for patient education in this setting.

BMC Musculoskeletal Disorders
Selçuk University (TR), State Hospital (GB), Memorial Ankara Hospital (TR), Sivas State Hospital (TR), Yüksek İhtisas Üniversitesi (TR), Kahramanmaraş Sütçü İmam University (TR)
Quality Education
Openalex Percentile: Top 24%
Artificial Intelligence in Healthcare and Education
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.