Keeping AI in medicine and radiology within the framework of scientific method: measuring to close the epistemic gap

The classical scientific method-systematic observation, question formulation, hypothesis construction, experimental testing, analysis (including rejection or refinement), conclusion, and transparent communicationstructures reliable inference in medicine, based on the long way of development of modern science.Contemporary artificial intelligence (AI) and, in particular, foundation/large language models, seem to be inverting this logical one-way order by proposing "end-to-end" systems and supplying post hoc rationales.We argue that this "black-box acceleration" risks erasing intermediate epistemic steps unless development and evaluation are explicitly re-embedded in the workflow."Explainable" AI does not guarantee recovery of reasoning because of an epistemic gap: explanations are constrained to human clinical concepts even when a model's decision basis may be non-human yet causally valid, non-human and spurious, or human-readable but only post hoc.Of note, medical imaging AI studies show saliency instability, shortcut learning, and distributional fragility, especially when a system is translated to new/unknown contexts.Training and validating systems on the deployment population within a defined technical context reduces domain mismatch and improves calibration but can entrench local biases and impair portability to other populations or different technology systems.We herein propose a model of institutional AI program-hospital-embedded pipelines with auditable provenance, preregistered evaluations, task-grounded tests of causal alignment and invariance, publication of failures, and local-plus-external validation-to preserve the stepwise logic of science while accepting practical opacity.Finally, the detection of failures of AI systems is not only an ethical duty but also a way to improve the systems' performance and be considered for negotiations between AI developers and medical centers.The described canonical sequence of the scientific method remains the core scaffold of biomedical investigation.Its historical lineage is well established: Galileo Galilei integrated measurement with controlled experiment and mathematical analysis [1]; Francis Bacon formalized inductive empiricism [2]; Ren Descartes emphasized methodological doubt and structured reasoning [3]; Isaac Newton operationalized a hypothetic-deductive program with testable predictions grounded in mathematical laws [4].In the nineteenth and twentieth centuries, medical science assimilated statistical design and causal inference through Pierre-Charles A. Louis's "numerical method" [5], Ronald A. Fisher's experimental design [6], Austin Bradford Hill's randomized trials and causality criteria [7], and Archibald L. Cochrane's insistence on effectiveness and efficiency in health services research [8].Karl R. Popper's falsificationism reframed scientific progress as the survival of hypotheses under attempted refutation [9].The theoryleadenness of observation-as emphasized by Norwood R. Hanson [10] and later by Thomas S. Kuhn [11]-shows that data are interpreted through conceptual lenses.This insight does not entail epistemic relativism, but it does demand explicit models and reproducible tests that can be scrutinized and challenged across competing paradigms.

Authors

Institutions

Publication Details

Journal
Insights into Imaging
Published
2025-12-22
DOI
https://doi.org/10.1186/s13244-025-02171-7
Citations
1
Primary Topic
Artificial Intelligence in Healthcare and Education
Type
article
Field-Weighted Citation Impact
0.65
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Keeping AI in medicine and radiology within the framework of scientific method: measuring to close the epistemic gap

Francesco Sardanelli, Filippo Pesapane
1 citations
Insights into Imaging
Artificial Intelligence in Healthcare and Education
0.65
article

Keeping AI in medicine and radiology within the framework of scientific method: measuring to close the epistemic gap

Francesco Sardanelli, Filippo Pesapane
article en
1 citations

Abstract

The classical scientific method-systematic observation, question formulation, hypothesis construction, experimental testing, analysis (including rejection or refinement), conclusion, and transparent communicationstructures reliable inference in medicine, based on the long way of development of modern science.Contemporary artificial intelligence (AI) and, in particular, foundation/large language models, seem to be inverting this logical one-way order by proposing "end-to-end" systems and supplying post hoc rationales.We argue that this "black-box acceleration" risks erasing intermediate epistemic steps unless development and evaluation are explicitly re-embedded in the workflow."Explainable" AI does not guarantee recovery of reasoning because of an epistemic gap: explanations are constrained to human clinical concepts even when a model's decision basis may be non-human yet causally valid, non-human and spurious, or human-readable but only post hoc.Of note, medical imaging AI studies show saliency instability, shortcut learning, and distributional fragility, especially when a system is translated to new/unknown contexts.Training and validating systems on the deployment population within a defined technical context reduces domain mismatch and improves calibration but can entrench local biases and impair portability to other populations or different technology systems.We herein propose a model of institutional AI program-hospital-embedded pipelines with auditable provenance, preregistered evaluations, task-grounded tests of causal alignment and invariance, publication of failures, and local-plus-external validation-to preserve the stepwise logic of science while accepting practical opacity.Finally, the detection of failures of AI systems is not only an ethical duty but also a way to improve the systems' performance and be considered for negotiations between AI developers and medical centers.The described canonical sequence of the scientific method remains the core scaffold of biomedical investigation.Its historical lineage is well established: Galileo Galilei integrated measurement with controlled experiment and mathematical analysis [1]; Francis Bacon formalized inductive empiricism [2]; Ren Descartes emphasized methodological doubt and structured reasoning [3]; Isaac Newton operationalized a hypothetic-deductive program with testable predictions grounded in mathematical laws [4].In the nineteenth and twentieth centuries, medical science assimilated statistical design and causal inference through Pierre-Charles A. Louis's "numerical method" [5], Ronald A. Fisher's experimental design [6], Austin Bradford Hill's randomized trials and causality criteria [7], and Archibald L. Cochrane's insistence on effectiveness and efficiency in health services research [8].Karl R. Popper's falsificationism reframed scientific progress as the survival of hypotheses under attempted refutation [9].The theoryleadenness of observation-as emphasized by Norwood R. Hanson [10] and later by Thomas S. Kuhn [11]-shows that data are interpreted through conceptual lenses.This insight does not entail epistemic relativism, but it does demand explicit models and reproducible tests that can be scrutinized and challenged across competing paradigms.

Insights into ImagingVol. 16(1)
Lega Italiana per la Lotta ai Tumori (IT), European Institute of Oncology (IT)
Openalex Percentile: Top 18%
Artificial Intelligence in Healthcare and Education
0.65
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.