An Engineering Framework for Curiosity-Driven and Humble AI in Clinical Decision Support

Background: We present BODHI (Balanced, Open-minded, Diagnostic, Humble, and Inquisitive), an engineering framework for curiosity-driven and humble clinical decision support AI. Despite growing capabilities, large language models (LLMs) often express inappropriate confidence, conflating statistical pattern recognition with genuine medical understanding. BODHI addresses this through a dual-reflective architecture that: (1) decomposes epistemic uncertainty into task-specific dimensions, and (2) constrains model responses using virtue-based stance rules derived from a Virtue Activation Matrix. Methods: We validate the framework through controlled evaluation on 200 clinical vignettes from HealthBench Hard, assessing GPT-4o-mini and GPT-4.1-mini across 5 random seeds (1,800 total observations). Statistical analysis included bootstrap resampling, paired t-tests, and effect size computation (Supplementary Materials S3) Findings: BODHI significantly improved overall clinical response quality (GPT-4.1-mini: +17.3pp, p < 0.0001, Cohen's d = 0.50; GPT-4o-mini: +7.4pp, p < 0.0001, Cohen's d = 0.22) while achieving very large effect sizes on curiosity (context-seeking rate: Cohen's d = 16.38 and 19.54) and humility (hedging: d = 5.80 for GPT-4.1-mini) metrics. Crucially, 97.3% of GPT-4.1-mini responses and 73.5% of GPT-4o-mini responses included appropriate clarifying questions, compared to 7.8% and 0.0% at baseline, demonstrating the framework's effectiveness in eliciting information-gathering behavior. Interpretation: These findings suggest LLMs can be reliably constrained to operate within epistemic boundaries when provided with structured uncertainty decomposition and virtue-aligned response rules, offering a pathway toward safer clinical AI deployment.

Authors

Publication Details

Journal
Apollo (University of Cambridge)
Published
2026-03-12
DOI
https://doi.org/10.17863/cam.128181
Primary Topic
Artificial Intelligence in Healthcare and Education
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

An Engineering Framework for Curiosity-Driven and Humble AI in Clinical Decision Support

Mahima Kalla, Janan Arslan, Justin Engelmann, Jana Sedláková et al.
Apollo (University of Cambridge)
Artificial Intelligence in Healthcare and Education
article

An Engineering Framework for Curiosity-Driven and Humble AI in Clinical Decision Support

Mahima Kalla, Janan Arslan, Justin Engelmann, Jana Sedláková, Kurt K. Benke, Roben Delos Reyes, Leo Kinyera, Almog Hilel, Rowell Castro, Ari Ercole, Pritika Vig, Leo Anthony Celi, Anna E Premo, Gustavo Adolfo Cruz-Suarez, Maximin Lange, Mackenzie J Meni, Torleif Markussen Lunde, Felipe Ocampo Osorio, Sebastián Andrés Cajas Ordoñez
article en

Abstract

Background: We present BODHI (Balanced, Open-minded, Diagnostic, Humble, and Inquisitive), an engineering framework for curiosity-driven and humble clinical decision support AI. Despite growing capabilities, large language models (LLMs) often express inappropriate confidence, conflating statistical pattern recognition with genuine medical understanding. BODHI addresses this through a dual-reflective architecture that: (1) decomposes epistemic uncertainty into task-specific dimensions, and (2) constrains model responses using virtue-based stance rules derived from a Virtue Activation Matrix. Methods: We validate the framework through controlled evaluation on 200 clinical vignettes from HealthBench Hard, assessing GPT-4o-mini and GPT-4.1-mini across 5 random seeds (1,800 total observations). Statistical analysis included bootstrap resampling, paired t-tests, and effect size computation (Supplementary Materials S3) Findings: BODHI significantly improved overall clinical response quality (GPT-4.1-mini: +17.3pp, p < 0.0001, Cohen's d = 0.50; GPT-4o-mini: +7.4pp, p < 0.0001, Cohen's d = 0.22) while achieving very large effect sizes on curiosity (context-seeking rate: Cohen's d = 16.38 and 19.54) and humility (hedging: d = 5.80 for GPT-4.1-mini) metrics. Crucially, 97.3% of GPT-4.1-mini responses and 73.5% of GPT-4o-mini responses included appropriate clarifying questions, compared to 7.8% and 0.0% at baseline, demonstrating the framework's effectiveness in eliciting information-gathering behavior. Interpretation: These findings suggest LLMs can be reliably constrained to operate within epistemic boundaries when provided with structured uncertainty decomposition and virtue-aligned response rules, offering a pathway toward safer clinical AI deployment.

Apollo (University of Cambridge)
Peace, Justice and strong institutions
Openalex Percentile: Top 26%
Artificial Intelligence in Healthcare and Education
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.