Preserving clinical judgment in the age of generative AI

Abstract As generative artificial intelligence (AI) moves toward large-scale healthcare deployment, a central challenge is how to harness its benefits without eroding clinical expertise or accountability. This commentary, written from clinician and technologist perspectives, argues that responsible AI adoption must rest on two foundations: preserving human accountability for medical decisions and integrating machine learning with structured, explainable reasoning. AI offers significant promise in diagnostics, personalized therapeutics, workflow automation, and burnout reduction. Data-driven discovery and biotechnology advances further expand therapeutic possibilities. However, risks include hallucinations, automation bias, and progressive deskilling. Emerging evidence suggests sustained AI assistance may diminish unaided diagnostic reasoning, underscoring the need for safeguards that maintain core clinical skills. From an implementation standpoint, success depends less on technical novelty than on integration within established care pathways, regulatory clarity, and demonstrable safety. Governments and large health systems are well positioned to scale validated solutions. The most sustainable path forward is hybrid “neuro-symbolic” systems that combine generative AI’s conversational capabilities with transparent, probabilistic clinical reasoning. Trustworthy healthcare AI must remain explainable, auditable, and decisively human-led.

Authors

Institutions

Publication Details

Journal
Research Connections
Published
2025-11-24
DOI
https://doi.org/10.1093/rescon/vmaf006
Primary Topic
Artificial Intelligence in Healthcare and Education
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Preserving clinical judgment in the age of generative AI

Piotr Orzechowski, Irving Kent Loh
Research Connections
Artificial Intelligence in Healthcare and Education
article

Preserving clinical judgment in the age of generative AI

Piotr Orzechowski, Irving Kent Loh
article en

Abstract

Abstract As generative artificial intelligence (AI) moves toward large-scale healthcare deployment, a central challenge is how to harness its benefits without eroding clinical expertise or accountability. This commentary, written from clinician and technologist perspectives, argues that responsible AI adoption must rest on two foundations: preserving human accountability for medical decisions and integrating machine learning with structured, explainable reasoning. AI offers significant promise in diagnostics, personalized therapeutics, workflow automation, and burnout reduction. Data-driven discovery and biotechnology advances further expand therapeutic possibilities. However, risks include hallucinations, automation bias, and progressive deskilling. Emerging evidence suggests sustained AI assistance may diminish unaided diagnostic reasoning, underscoring the need for safeguards that maintain core clinical skills. From an implementation standpoint, success depends less on technical novelty than on integration within established care pathways, regulatory clarity, and demonstrable safety. Governments and large health systems are well positioned to scale validated solutions. The most sustainable path forward is hybrid “neuro-symbolic” systems that combine generative AI’s conversational capabilities with transparent, probabilistic clinical reasoning. Trustworthy healthcare AI must remain explainable, auditable, and decisively human-led.

Research ConnectionsVol. 1(1)
Government Ayurvedic College and Hospital (IN)
Openalex Percentile: Top 69%
Artificial Intelligence in Healthcare and Education
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.