Performance of Large Language Models Under Input Variability in Health Care Applications: Dataset Development and Experimental Evaluation
Our findings highlight the need for health care applications powered by LLMs to be designed with input variability in mind. Robustness to noisy or imperfect inputs is essential for maintaining reliability in real-world clinical settings, where data quality can vary widely. By identifying specific vulnerabilities and strengths, this study provides actionable insights for improving model resilience and guiding the development of safer, more effective artificial intelligence tools in health care. The accompanying dataset offers a valuable resource for further research into LLM performance under diverse conditions.
Authors
- Sarjak Maniar
- Mengqian Wang (ORCID: https://orcid.org/0000-0002-8931-6700)
- Saubhagya Joshi (ORCID: https://orcid.org/0009-0000-8067-6227)
- Monjil Mehta
- Vivek Kumar Singh
Institutions
- Rutgers, The State University of New Jersey (US)
- University of North Carolina at Chapel Hill (US)
Publication Details
- Journal
- JMIR AI
- Published
- 2026-01-05
- DOI
- https://doi.org/10.2196/83640
- Citations
- 1
- Primary Topic
- Artificial Intelligence in Healthcare and Education
- Type
- article
- Field-Weighted Citation Impact
- 17.70