Diagnostic performance of AI-based EEG interpretation versus human clinical experts for epilepsy detection: systematic review and meta-analysis

BACKGROUND: Electroencephalography (EEG) interpretation for epilepsy diagnosis faces persistent challenges including specialist shortages, variable interpretation accuracy, and limited accessibility. Artificial intelligence (AI)-based automated interpretation systems promise to address these limitations, yet their diagnostic performance compared to clinical experts remains incompletely characterized. OBJECTIVE: To systematically evaluate and meta-analyze the diagnostic accuracy of AI-enabled EEG interpretation compared with human clinical experts for epilepsy detection. METHODS: We conducted a systematic review following PRISMA-DTA and Cochrane MECIR standards, searching PubMed, Scopus, IEEE Xplore, and Google Scholar through June 2025. Studies directly comparing AI algorithms with human expert interpretation using identical EEG datasets were included. Quality assessment employed QUADAS-AI criteria. Bivariate meta-analysis was performed to estimate pooled sensitivity, specificity, diagnostic odds ratios, and likelihood ratios. It is important to note that AI algorithms evaluated in these studies were trained using expert-labeled EEG data through supervised learning approaches; our comparison focuses on diagnostic accuracy outcomes rather than algorithmic independence from expert knowledge. RESULTS: > 75%) and methodological limitations were identified across studies. CONCLUSIONS: AI-based EEG interpretation demonstrates diagnostic performance equal or superior to human experts with enhanced consistency, supporting potential implementation as clinical triage tools. However, limited transparency, patient selection bias, and deployment feasibility constraints warrant further investigation before widespread clinical adoption. Multiple sources of uncertainty affect AI-based diagnostic systems in clinical applications. Internal uncertainties include model parameter uncertainty, threshold selection variability, and training data limitations. External uncertainties encompass population heterogeneity, EEG acquisition variability, and clinical context differences. Parametric uncertainties arise from model architecture choices, while non-parametric uncertainties reflect distribution-free variations in real-world data. The amounts and structures of these uncertainties are often unknown in operational settings, necessitating robust uncertainty quantification methods for safe clinical deployment.

Authors

Institutions

Publication Details

Journal
Journal of Biomedical Informatics
Published
2026-04-07
DOI
https://doi.org/10.1016/j.jbi.2026.105041
Primary Topic
EEG and Brain-Computer Interfaces
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Diagnostic performance of AI-based EEG interpretation versus human clinical experts for epilepsy detection: systematic review and meta-analysis

Thiago Carneiro, Luís Otávio Sales Ferreira Caboclo, Sarah N. Carvalho, Vanessa Cristina Colares Lessa et al.
Journal of Biomedical Informatics
EEG and Brain-Computer Interfaces
article

Diagnostic performance of AI-based EEG interpretation versus human clinical experts for epilepsy detection: systematic review and meta-analysis

Thiago Carneiro, Luís Otávio Sales Ferreira Caboclo, Sarah N. Carvalho, Vanessa Cristina Colares Lessa, Felipe de Araújo Santana Merique, Richard Aldib, Marcos Zanetich Filho, Dimas Iron Alves, Vinicius Moreira Almeida, João Brainer Clares de Andrade, Fábio Augusto Dos Reis
article en

Abstract

BACKGROUND: Electroencephalography (EEG) interpretation for epilepsy diagnosis faces persistent challenges including specialist shortages, variable interpretation accuracy, and limited accessibility. Artificial intelligence (AI)-based automated interpretation systems promise to address these limitations, yet their diagnostic performance compared to clinical experts remains incompletely characterized. OBJECTIVE: To systematically evaluate and meta-analyze the diagnostic accuracy of AI-enabled EEG interpretation compared with human clinical experts for epilepsy detection. METHODS: We conducted a systematic review following PRISMA-DTA and Cochrane MECIR standards, searching PubMed, Scopus, IEEE Xplore, and Google Scholar through June 2025. Studies directly comparing AI algorithms with human expert interpretation using identical EEG datasets were included. Quality assessment employed QUADAS-AI criteria. Bivariate meta-analysis was performed to estimate pooled sensitivity, specificity, diagnostic odds ratios, and likelihood ratios. It is important to note that AI algorithms evaluated in these studies were trained using expert-labeled EEG data through supervised learning approaches; our comparison focuses on diagnostic accuracy outcomes rather than algorithmic independence from expert knowledge. RESULTS: > 75%) and methodological limitations were identified across studies. CONCLUSIONS: AI-based EEG interpretation demonstrates diagnostic performance equal or superior to human experts with enhanced consistency, supporting potential implementation as clinical triage tools. However, limited transparency, patient selection bias, and deployment feasibility constraints warrant further investigation before widespread clinical adoption. Multiple sources of uncertainty affect AI-based diagnostic systems in clinical applications. Internal uncertainties include model parameter uncertainty, threshold selection variability, and training data limitations. External uncertainties encompass population heterogeneity, EEG acquisition variability, and clinical context differences. Parametric uncertainties arise from model architecture choices, while non-parametric uncertainties reflect distribution-free variations in real-world data. The amounts and structures of these uncertainties are often unknown in operational settings, necessitating robust uncertainty quantification methods for safe clinical deployment.

Journal of Biomedical InformaticsVol. 179
Instituto Tecnológico de Aeronáutica (BR), Hospital Israelita Albert Einstein (BR), University of Florida (US), Centro Universitário São Camilo (BR), Hospital São Paulo (BR), Universidade Federal de São Paulo (BR)
Openalex Percentile: Top 25%
EEG and Brain-Computer Interfaces
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.