Evaluating AI Competence in Specialized Medicine: Comparative Analysis of ChatGPT and Neurologists in a Neurology Specialist Examination in Spain

This study underscores the evolving capabilities of AI in medical knowledge assessment, particularly in specialized fields. ChatGPT-4's performance, outperforming the median score of human participants in a rigorous neurology examination, represents a significant milestone in AI development, suggesting its potential as an effective tool in specialized medical education and assessment.

Authors

Institutions

Publication Details

Journal
JMIR Medical Education
Published
2024-10-07
DOI
https://doi.org/10.2196/56762
Citations
9
Primary Topic
Artificial Intelligence in Healthcare and Education
Type
article
Field-Weighted Citation Impact
1.08
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Evaluating AI Competence in Specialized Medicine: Comparative Analysis of ChatGPT and Neurologists in a Neurology Specialist Examination in Spain

Pablo Ros‐Arlanzón, Ángel Pérez Sempere
9 citations
JMIR Medical Education
Artificial Intelligence in Healthcare and Education
1.08
article

Evaluating AI Competence in Specialized Medicine: Comparative Analysis of ChatGPT and Neurologists in a Neurology Specialist Examination in Spain

Pablo Ros‐Arlanzón, Ángel Pérez Sempere
article en
9 citations

Abstract

This study underscores the evolving capabilities of AI in medical knowledge assessment, particularly in specialized fields. ChatGPT-4's performance, outperforming the median score of human participants in a rigorous neurology examination, represents a significant milestone in AI development, suggesting its potential as an effective tool in specialized medical education and assessment.

JMIR Medical EducationVol. 10
Universitat de Miguel Hernández d'Elx (ES), University of Alicante (ES), Instituto de Neurociencias (ES), Hospital General Universitario de Alicante Doctor Balmis (ES)
Quality Education
Openalex Percentile: Top 21%
Artificial Intelligence in Healthcare and Education
1.08
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Evaluating AI Competence in Specialized Medicine: Comparative Analysis of ChatGPT and Neurologists in a Neurology Specialist Examination in Spain — Pablo Ros‐Arlanzón, Ángel Pérez Sempere · JMIR Medical Education (2024) | TGRS Research Map | TGRS