A preliminary exploration of ChatGPT’s potential in medical reasoning and patient care
This preliminary study evaluates ChatGPT-4o’s potential in enhancing medical reasoning and patient care by addressing a diverse set of thirty medical-related queries. The research investigates ChatGPT’s performance in generating reliable and contextually relevant medical responses, with a focus on general health and mental health considerations. Utilizing the Revised-IDEA (rIDEA) tool, responses were assessed based on interpretive summary, differential diagnosis, explanation of lead diagnosis, and alternative diagnoses, scored on a Likert scale from 0 to 10. High-quality documentation was determined by a cut-off score of ≥6. The study reveals ChatGPT-4o’s ability to provide accurate, clear, and comprehensive information on common medical issues such as the symptoms of the common cold versus the flu, heart attack diagnostics, treatment options for typhoid fever, and natural remedies for managing blood pressure. Additionally, it highlights ChatGPT-4o’s proficiency in mental health domains, identifying key risk factors for depression and suggesting effective mitigation strategies. The findings underscore ChatGPT-4o’s potential as a valuable tool for medical reasoning and patient care, while also emphasizing the need for validating AI-generated medical responses to ensure reliability and applicability in real-world healthcare settings.
Authors
- Shahab Saquib Sohail (ORCID: https://orcid.org/0000-0002-5944-7371)
- Dag Øivind Madsen (ORCID: https://orcid.org/0000-0001-8735-3332)
- Jawed Ahmed (ORCID: https://orcid.org/0000-0002-8852-8234)
- Mohammad Anas Azeez (ORCID: https://orcid.org/0009-0000-3344-0166)
- Zohaib Hasan Siddiqui
Institutions
- Jamia Hamdard (IN)
- University of South-Eastern Norway (NO)
- Barkatullah University (IN)
Publication Details
- Journal
- Critical Public Health
- Published
- 2025-04-02
- DOI
- https://doi.org/10.1080/09581596.2025.2484344
- Citations
- 2
- Primary Topic
- Artificial Intelligence in Healthcare and Education
- Type
- article
- Field-Weighted Citation Impact
- 1.31