A Multimodal Large Language Model as an End-to-End Classifier of Thyroid Nodule Malignancy Risk: Usability Study
The study demonstrates the comparative advantages and limitations of multimodal LLMs for thyroid nodule risk stratification. While the commercial model (o3) consistently outperformed open-source models in accuracy and consistency, even the best-performing model outputs remained suboptimal for direct clinical deployment. Prompt engineering significantly enhanced output consistency, particularly in the commercial model. These findings underline the importance of strategic model optimization techniques and highlight areas requiring further development before multimodal LLMs can be reliably used in clinical thyroid imaging workflows.
Authors
- Chiaw Ling Chng (ORCID: https://orcid.org/0000-0003-2232-5298)
- Gerald Gui Ren Sng (ORCID: https://orcid.org/0000-0002-8795-7491)
- Daniel Yan Zheng Lim (ORCID: https://orcid.org/0000-0002-9715-6970)
- Joshua Yi Min Tung (ORCID: https://orcid.org/0000-0003-4991-9790)
- Jen Hong Tan (ORCID: https://orcid.org/0000-0002-7785-2987)
- Xiang Yi
Institutions
- SingHealth (SG)
- Singapore General Hospital (SG)
Publication Details
- Journal
- JMIR Formative Research
- Published
- 2025-08-19
- DOI
- https://doi.org/10.2196/70863
- Primary Topic
- Thyroid Cancer Diagnosis and Treatment
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- Duke-NUS Medical School