Concordance between humans and GPT-4 in appraising the methodological quality of case reports and case series using the Murad tool
The study demonstrates a moderate agreement between GPT-4 and human reviewers in assessing the methodological quality of case series and reports using the Murad tool. The current performance of GPT-4 seems promising but unlikely to be sufficient for the rigor of a systematic review and pairing the model with a human reviewer is required.
Authors
- Samer Saadi (ORCID: https://orcid.org/0000-0001-9225-1197)
- Mohammed Firwana (ORCID: https://orcid.org/0000-0003-4713-624X)
- Rami Basmaci
- Mohammad Hassan Murad (ORCID: https://orcid.org/0000-0001-5502-5975)
- Tamim Rajjo (ORCID: https://orcid.org/0000-0002-4880-5081)
- Bashar Hasan (ORCID: https://orcid.org/0000-0001-9531-4990)
- Zin Tarakji
- Zhen Wang (ORCID: https://orcid.org/0000-0002-7821-2252)
- Mohamed Abusalih (ORCID: https://orcid.org/0009-0006-3326-301X)
- Adel Kanaan
- Adel Kabbara Allababidi (ORCID: https://orcid.org/0009-0004-3354-4562)
Institutions
- Mayo Clinic (US)
- Mayo Clinic in Arizona (US)
- Mayo Clinic in Florida (US)
Publication Details
- Journal
- BMC Medical Research Methodology
- Published
- 2024-11-04
- DOI
- https://doi.org/10.1186/s12874-024-02372-6
- Citations
- 7
- Primary Topic
- Meta-analysis and systematic reviews
- Type
- article
- Field-Weighted Citation Impact
- 3.23