Generating credible referenced medical research: A comparative study of openAI's GPT-4 and Google's gemini

While Gemini demonstrates significantly superior performance in generating credible and accurate references for medical research introductions, both models produced fabricated evidence, limiting their reliability for reference searching. This snapshot comparison of two prominent AI models highlights the potential and limitations of AI in academic content creation. The findings underscore the critical need for verification of AI-generated academic content and call for ongoing research into evolving AI models and their applications in scientific writing.

Authors

Institutions

Publication Details

Journal
Computers in Biology and Medicine
Published
2024-12-12
DOI
https://doi.org/10.1016/j.compbiomed.2024.109545
Citations
31
Primary Topic
Artificial Intelligence in Healthcare and Education
Type
article
Field-Weighted Citation Impact
3.73
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Generating credible referenced medical research: A comparative study of openAI's GPT-4 and Google's gemini

Benjamin Scott Glicksberg, Eyal Klang, Mahmud Omar, Girish N. Nadkarni et al.
31 citations
Computers in Biology and Medicine
Artificial Intelligence in Healthcare and Education
3.73
article

Generating credible referenced medical research: A comparative study of openAI's GPT-4 and Google's gemini

Benjamin Scott Glicksberg, Eyal Klang, Mahmud Omar, Girish N. Nadkarni, Saleh Nassar, Kareem Hijazi
article en
31 citations

Abstract

While Gemini demonstrates significantly superior performance in generating credible and accurate references for medical research introductions, both models produced fabricated evidence, limiting their reliability for reference searching. This snapshot comparison of two prominent AI models highlights the potential and limitations of AI in academic content creation. The findings underscore the critical need for verification of AI-generated academic content and call for ongoing research into evolving AI models and their applications in scientific writing.

Computers in Biology and MedicineVol. 185
Wolfson Medical Center (IL), Maccabi Healthcare Services (IL), Icahn School of Medicine at Mount Sinai (US)
Openalex Percentile: Top 6%
Artificial Intelligence in Healthcare and Education
3.73
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.