Performance of Large Language Models Under Input Variability in Health Care Applications: Dataset Development and Experimental Evaluation

Our findings highlight the need for health care applications powered by LLMs to be designed with input variability in mind. Robustness to noisy or imperfect inputs is essential for maintaining reliability in real-world clinical settings, where data quality can vary widely. By identifying specific vulnerabilities and strengths, this study provides actionable insights for improving model resilience and guiding the development of safer, more effective artificial intelligence tools in health care. The accompanying dataset offers a valuable resource for further research into LLM performance under diverse conditions.

Authors

Institutions

Publication Details

Journal
JMIR AI
Published
2026-01-05
DOI
https://doi.org/10.2196/83640
Citations
1
Primary Topic
Artificial Intelligence in Healthcare and Education
Type
article
Field-Weighted Citation Impact
17.70
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Performance of Large Language Models Under Input Variability in Health Care Applications: Dataset Development and Experimental Evaluation

Sarjak Maniar, Mengqian Wang, Saubhagya Joshi, Monjil Mehta et al.
1 citations
JMIR AI
Artificial Intelligence in Healthcare and Education
17.70
article

Performance of Large Language Models Under Input Variability in Health Care Applications: Dataset Development and Experimental Evaluation

Sarjak Maniar, Mengqian Wang, Saubhagya Joshi, Monjil Mehta, Vivek Kumar Singh
article en
1 citations

Abstract

Our findings highlight the need for health care applications powered by LLMs to be designed with input variability in mind. Robustness to noisy or imperfect inputs is essential for maintaining reliability in real-world clinical settings, where data quality can vary widely. By identifying specific vulnerabilities and strengths, this study provides actionable insights for improving model resilience and guiding the development of safer, more effective artificial intelligence tools in health care. The accompanying dataset offers a valuable resource for further research into LLM performance under diverse conditions.

JMIR AIVol. 5
Rutgers, The State University of New Jersey (US), University of North Carolina at Chapel Hill (US)
Openalex Percentile: Top 3%
Artificial Intelligence in Healthcare and Education
17.70
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.