Peer Review of “The Performance of DeepSeek R1 and Gemini 3 in Complex Medical Scenarios: Comparative Study”
This paper [1] seeks to evaluate the accuracy of DeepSeek R1 in correctly identifying the primary medical diagnosis in the medical scenarios dataset portion of Massive Multitask Language Understanding Pro (MMLU-Pro) using an open-ended format.Some clarifications on the methods and results (especially around the roles of subject matter experts vs core team members in the publication), would be helpful in understanding how these results were derived.
Authors
- Jacqueline Guan-Ting You (ORCID: https://orcid.org/0000-0002-2562-7526)
Publication Details
- Journal
- JMIRx Med
- Published
- 2026-04-27
- DOI
- https://doi.org/10.2196/96225
- Citations
- 1
- Primary Topic
- Healthcare Technology and Patient Monitoring
- Type
- article
- Field-Weighted Citation Impact
- 25.27