A Multimodal Large Language Model as an End-to-End Classifier of Thyroid Nodule Malignancy Risk: Usability Study

The study demonstrates the comparative advantages and limitations of multimodal LLMs for thyroid nodule risk stratification. While the commercial model (o3) consistently outperformed open-source models in accuracy and consistency, even the best-performing model outputs remained suboptimal for direct clinical deployment. Prompt engineering significantly enhanced output consistency, particularly in the commercial model. These findings underline the importance of strategic model optimization techniques and highlight areas requiring further development before multimodal LLMs can be reliably used in clinical thyroid imaging workflows.

Authors

Institutions

Publication Details

Journal
JMIR Formative Research
Published
2025-08-19
DOI
https://doi.org/10.2196/70863
Primary Topic
Thyroid Cancer Diagnosis and Treatment
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A Multimodal Large Language Model as an End-to-End Classifier of Thyroid Nodule Malignancy Risk: Usability Study

Chiaw Ling Chng, Gerald Gui Ren Sng, Daniel Yan Zheng Lim, Joshua Yi Min Tung et al.
JMIR Formative Research
Thyroid Cancer Diagnosis and Treatment
article

A Multimodal Large Language Model as an End-to-End Classifier of Thyroid Nodule Malignancy Risk: Usability Study

Chiaw Ling Chng, Gerald Gui Ren Sng, Daniel Yan Zheng Lim, Joshua Yi Min Tung, Jen Hong Tan, Xiang Yi
article en

Abstract

The study demonstrates the comparative advantages and limitations of multimodal LLMs for thyroid nodule risk stratification. While the commercial model (o3) consistently outperformed open-source models in accuracy and consistency, even the best-performing model outputs remained suboptimal for direct clinical deployment. Prompt engineering significantly enhanced output consistency, particularly in the commercial model. These findings underline the importance of strategic model optimization techniques and highlight areas requiring further development before multimodal LLMs can be reliably used in clinical thyroid imaging workflows.

JMIR Formative ResearchVol. 9
SingHealth (SG), Singapore General Hospital (SG)
Duke-NUS Medical School
Good health and well-being
Openalex Percentile: Top 71%
Thyroid Cancer Diagnosis and Treatment
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

A Multimodal Large Language Model as an End-to-End Classifier of Thyroid Nodule Malignancy Risk: Usability Study — Chiaw Ling Chng, Gerald Gui Ren Sng, et al. · JMIR Formative Research (2025) | TGRS Research Map | TGRS