Self-regulating the use of large language models in clinical practice: a risk-stratified approach
The rapid integration of large language models (LLMs) into clinical practice offers promising benefits, including assistance with documentation, decision support and patient communication. However, these advantages are tempered by concerns around model accuracy, data privacy, clinician trust and regulatory responsibility. In this comment, we propose a clinician-led, risk-stratified framework to guide responsible adoption of LLMs in healthcare. The framework categorises applications into four risk tiers: low risk, moderate risk, high risk and critical risk. Each tier demands tailored oversight, validation and governance, with increasing levels of statutory regulatory scrutiny (eg., European Union Artificial Intelligence Act and U.S. Food and Drug Administration) and clinical supervision. We argue that proactive self-regulation combined with ongoing quality management and clinician education is essential to safely integrate LLMs into ongoing care.
Authors
- Milan Mohammad (ORCID: https://orcid.org/0000-0003-2227-9375)
- Andreas Pihl (ORCID: https://orcid.org/0000-0003-0158-7205)
- Espen Jimenez-Solem
- Michael Hejmadi
Institutions
- University of Copenhagen (DK)
- University of Southern Denmark (DK)
- Frederiksberg Hospital (DK)
- Copenhagen University Hospital (DK)
- Rigshospitalet (DK)
- Zealand University Hospital (DK)
- Ferring Pharmaceuticals (Denmark) (DK)
- Roche (Denmark) (DK)
Publication Details
- Journal
- BMJ Health & Care Informatics
- Published
- 2026-05-01
- DOI
- https://doi.org/10.1136/bmjhci-2025-101921
- Primary Topic
- Artificial Intelligence in Healthcare and Education
- Type
- article
- Field-Weighted Citation Impact
- 0.00