Balancing Automation and Human Oversight in Healthcare AI

AI has influenced the healthcare domain significantly, improving diagnostic precision and predictive modeling. However, to ensure safety, trust, and reliability in AI-driven decision-making, there needs to be a balance between automation and human oversight. This review will discuss how simulated human feedback can be utilized to improve model performance by identifying and correcting low-confidence predictions. We train baseline models, Logistic Regression and ResNet-50, on MIMIC-IV and CheXpert datasets, respectively, while introducing mechanisms of oversight for refining the predictions. This reflects in various evaluation metrics used here, like AUC-ROC, precision, and recall. Our results underline the necessity of adaptive control mechanisms in AI for healthcare applications.

Authors

Institutions

Publication Details

Published
2025-06-24
DOI
https://doi.org/10.1109/icad65464.2025.11114046
Primary Topic
Artificial Intelligence in Healthcare and Education
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Balancing Automation and Human Oversight in Healthcare AI

Meetu Malhotra, Divya Karthikeyan, SJ Agarwal, Brinda Gurusamy et al.
Artificial Intelligence in Healthcare and Education
article

Balancing Automation and Human Oversight in Healthcare AI

Meetu Malhotra, Divya Karthikeyan, SJ Agarwal, Brinda Gurusamy, Swagata Ashwani
article en

Abstract

AI has influenced the healthcare domain significantly, improving diagnostic precision and predictive modeling. However, to ensure safety, trust, and reliability in AI-driven decision-making, there needs to be a balance between automation and human oversight. This review will discuss how simulated human feedback can be utilized to improve model performance by identifying and correcting low-confidence predictions. We train baseline models, Logistic Regression and ResNet-50, on MIMIC-IV and CheXpert datasets, respectively, while introducing mechanisms of oversight for refining the predictions. This reflects in various evaluation metrics used here, like AUC-ROC, precision, and recall. Our results underline the necessity of adaptive control mechanisms in AI for healthcare applications.

Harrisburg University of Science and Technology (US), Montclair State University (US), University of the Cumberlands (US), Carnegie Mellon University (US), University of California, Berkeley (US)
Openalex Percentile: Top 85%
Artificial Intelligence in Healthcare and Education
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.