Artificial intelligence chatbots provide inadequately transparent and readable patient information on triangular fibrocartilage complex injuries: a cross-sectional study

Background Patients increasingly use consumer artificial intelligence (AI) chatbots to obtain health information, yet the quality and readability of their musculoskeletal advice remain uncertain. Communicating triangular fibrocartilage complex (TFCC) injuries is particularly difficult because magnetic resonance imaging abnormalities may be incidental and their clinical relevance depends on history and targeted physical examination. Methods In this cross-sectional online study, 11 unmodified English-language TFCC-related queries selected from worldwide Google Trends data were submitted once to ChatGPT 5.5, Microsoft Copilot, Gemini 3.5 Flash, and Perplexity on August 3, 2026, yielding 44 responses. Two orthopedic physicians scored coded responses with platform names removed using DISCERN, a 20-item binary EQIP rubric, the Global Quality Score, and Journal of the American Medical Association transparency criteria; a response-level clinical content assessment also evaluated clinically inaccurate or misleading information and potentially harmful advice. Six readability indices were calculated. Model comparisons used matched Friedman tests with Kendall’s W, within-query permutation checks, paired Wilcoxon tests when indicated, and Holm adjustment. Results Independent pre-consensus reliability was good for DISCERN [ICC(2, 1) = 0.857] and EQIP [ICC(2, 1) = 0.793], with weighted kappa values of 0.756 for GQS and 0.954 for JAMA. JAMA transparency scores differed among models (Holm-adjusted p < 0.001); DISCERN did not reach significance in the asymptotic family-adjusted analysis ( p = 0.056) but did in the permutation sensitivity analysis ( p = 0.045), whereas EQIP and GQS showed no overall differences. Perplexity had higher JAMA scores than ChatGPT 5.5 and Gemini 3.5 Flash in paired comparisons. Eight of 44 responses (18.2%) contained clinically inaccurate or misleading statements, while none met the criterion for potentially harmful advice. All six readability indices differed among models after Holm correction (adjusted P ≤ 0.002); every response scored above 6 on all five grade-level indices and below 80 on FRES. Conclusion Chatbot-generated TFCC information showed limitations in treatment-related information quality, source transparency, readability, and some claim-level clinical content. Although chatbots may provide useful introductory information, their responses should complement rather than replace individualized clinical assessment, particularly when interpreting imaging findings or considering treatment options.

Authors

Institutions

Publication Details

Journal
Frontiers in Public Health
Published
2026-11-03
DOI
https://doi.org/10.3389/fpubh.2026.1986047
Primary Topic
Artificial Intelligence in Healthcare and Education
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Artificial intelligence chatbots provide inadequately transparent and readable patient information on triangular fibrocartilage complex injuries: a cross-sectional study

Dawen Ying, Jiongbiao Zhong, Minzheng Ying, Qifang Zeng et al.
Frontiers in Public Health
Artificial Intelligence in Healthcare and Education
article

Artificial intelligence chatbots provide inadequately transparent and readable patient information on triangular fibrocartilage complex injuries: a cross-sectional study

Dawen Ying, Jiongbiao Zhong, Minzheng Ying, Qifang Zeng, YI Min
article en

Abstract

Background Patients increasingly use consumer artificial intelligence (AI) chatbots to obtain health information, yet the quality and readability of their musculoskeletal advice remain uncertain. Communicating triangular fibrocartilage complex (TFCC) injuries is particularly difficult because magnetic resonance imaging abnormalities may be incidental and their clinical relevance depends on history and targeted physical examination. Methods In this cross-sectional online study, 11 unmodified English-language TFCC-related queries selected from worldwide Google Trends data were submitted once to ChatGPT 5.5, Microsoft Copilot, Gemini 3.5 Flash, and Perplexity on August 3, 2026, yielding 44 responses. Two orthopedic physicians scored coded responses with platform names removed using DISCERN, a 20-item binary EQIP rubric, the Global Quality Score, and Journal of the American Medical Association transparency criteria; a response-level clinical content assessment also evaluated clinically inaccurate or misleading information and potentially harmful advice. Six readability indices were calculated. Model comparisons used matched Friedman tests with Kendall’s W, within-query permutation checks, paired Wilcoxon tests when indicated, and Holm adjustment. Results Independent pre-consensus reliability was good for DISCERN [ICC(2, 1) = 0.857] and EQIP [ICC(2, 1) = 0.793], with weighted kappa values of 0.756 for GQS and 0.954 for JAMA. JAMA transparency scores differed among models (Holm-adjusted p < 0.001); DISCERN did not reach significance in the asymptotic family-adjusted analysis ( p = 0.056) but did in the permutation sensitivity analysis ( p = 0.045), whereas EQIP and GQS showed no overall differences. Perplexity had higher JAMA scores than ChatGPT 5.5 and Gemini 3.5 Flash in paired comparisons. Eight of 44 responses (18.2%) contained clinically inaccurate or misleading statements, while none met the criterion for potentially harmful advice. All six readability indices differed among models after Holm correction (adjusted P ≤ 0.002); every response scored above 6 on all five grade-level indices and below 80 on FRES. Conclusion Chatbot-generated TFCC information showed limitations in treatment-related information quality, source transparency, readability, and some claim-level clinical content. Although chatbots may provide useful introductory information, their responses should complement rather than replace individualized clinical assessment, particularly when interpreting imaging findings or considering treatment options.

Frontiers in Public HealthVol. 14
Hunan Normal University (CN), Yueyang Hospital (CN)
Openalex Percentile: Top 22%
Artificial Intelligence in Healthcare and Education
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon