NAVIGATING THE COMPLEXITY OF EVALUATING ARTIFICIAL INTELLIGENCE IN HEALTHCARE

The integration of artificial intelligence (AI) in healthcare offers significant opportunities to improve patient outcomes, reduce costs, and streamline processes. However, the successful adoption of AI depends on robust evaluation to address challenges such as regulatory compliance and ethical considerations. Despite numerous existing frameworks, the evaluation landscape remains fragmented, lacking consistency in scope, methodology, and practical applicability. Recent regulatory developments, including the EU AI Act, further underscore the need for structured and transparent evaluation processes. This study addresses these challenges by systematically analyzing existing AI evaluation frameworks in healthcare to identify key components, thematic gaps, and target audiences. Using Jabareen’s (2009) framework-building approach, we synthesize these findings into a comprehensive meta-framework that structures evaluation along an AI lifecycle. We also propose recommendations to support evaluators in selecting and applying suitable frameworks. This research contributes to the development of more consistent, actionable, and context-sensitive evaluation practices for AI in healthcare.

Publication Details

Journal
Journal of the Association for Information Systems
Published
2025-06-18
Citations
1
Primary Topic
Artificial Intelligence in Healthcare and Education
Type
article
Field-Weighted Citation Impact
0.65

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

NAVIGATING THE COMPLEXITY OF EVALUATING ARTIFICIAL INTELLIGENCE IN HEALTHCARE

1 citations
Journal of the Association for Information Systems
Artificial Intelligence in Healthcare and Education
0.65
article

NAVIGATING THE COMPLEXITY OF EVALUATING ARTIFICIAL INTELLIGENCE IN HEALTHCARE

article en
1 citations

Abstract

The integration of artificial intelligence (AI) in healthcare offers significant opportunities to improve patient outcomes, reduce costs, and streamline processes. However, the successful adoption of AI depends on robust evaluation to address challenges such as regulatory compliance and ethical considerations. Despite numerous existing frameworks, the evaluation landscape remains fragmented, lacking consistency in scope, methodology, and practical applicability. Recent regulatory developments, including the EU AI Act, further underscore the need for structured and transparent evaluation processes. This study addresses these challenges by systematically analyzing existing AI evaluation frameworks in healthcare to identify key components, thematic gaps, and target audiences. Using Jabareen’s (2009) framework-building approach, we synthesize these findings into a comprehensive meta-framework that structures evaluation along an AI lifecycle. We also propose recommendations to support evaluators in selecting and applying suitable frameworks. This research contributes to the development of more consistent, actionable, and context-sensitive evaluation practices for AI in healthcare.

Journal of the Association for Information Systems
Bundesministerium für Bildung und Forschung
Partnerships for the goals
Openalex Percentile: Top 18%
Artificial Intelligence in Healthcare and Education
0.65
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

NAVIGATING THE COMPLEXITY OF EVALUATING ARTIFICIAL INTELLIGENCE IN HEALTHCARE · Journal of the Association for Information Systems (2025) | TGRS Research Map | TGRS