Critical Appraisal Tools for Evaluating Artificial Intelligence in Clinical Studies: Scoping Review

The results picture a landscape of evidence tools where reporting tools predominate, followed by critical appraisal, and a few tools for risk of bias. The mismatch of bias in AI and epidemiology should be considered for critical appraisal, especially regarding fairness and bias mitigation in AI. Finally, chatbot assessment studies represent a vast and evolving field in which progress in design, reporting, and critical appraisal is necessary and urgent.

Authors

Institutions

Publication Details

Journal
Journal of Medical Internet Research
Published
2025-10-14
DOI
https://doi.org/10.2196/77110
Primary Topic
Artificial Intelligence in Healthcare and Education
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Critical Appraisal Tools for Evaluating Artificial Intelligence in Clinical Studies: Scoping Review

José Ignacio Pijoán, Marimar Ubeda, Iratxe Urreta, Amanda Burls et al.
Journal of Medical Internet Research
Artificial Intelligence in Healthcare and Education
article

Critical Appraisal Tools for Evaluating Artificial Intelligence in Clinical Studies: Scoping Review

José Ignacio Pijoán, Marimar Ubeda, Iratxe Urreta, Amanda Burls, Juan B Cabello, Miguel Torralba, Vicente Ruiz García, Eukene Ansuategi, María Teresa Iglesias, Miguel Maldonado Fernandez, José Ignacio Emparanza, Luis Ramos-Ruperto
article en

Abstract

The results picture a landscape of evidence tools where reporting tools predominate, followed by critical appraisal, and a few tools for risk of bias. The mismatch of bias in AI and epidemiology should be considered for critical appraisal, especially regarding fairness and bias mitigation in AI. Finally, chatbot assessment studies represent a vast and evolving field in which progress in design, reporting, and critical appraisal is necessary and urgent.

Journal of Medical Internet ResearchVol. 27
University of Alicante (ES), St George's, University of London (GB), Hospital Universitario La Paz (ES), Hospital Universitari i Politècnic La Fe (ES), BioCruces Health research Institute (ES), Argyll and Bute Hospital (GB), Hospital Universitario de Guadalajara (ES), Biogipuzkoa Health Research Institute (ES), Biblioteca Nacional de España (ES), Hospital de Cruces (ES), Donostiako Unibertsitate Ospitalea (ES), Fundación Renal Española (ES), City St George's, University of London (GB)
Openalex Percentile: Top 79%
Artificial Intelligence in Healthcare and Education
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Critical Appraisal Tools for Evaluating Artificial Intelligence in Clinical Studies: Scoping Review — José Ignacio Pijoán, Marimar Ubeda, et al. · Journal of Medical Internet Research (2025) | TGRS Research Map | TGRS