A Performance of Generative Pre-Trained Transformers (GPT) in Answering Questions on Anatomy in The Turkish Dentistry Specialization Exam

Artificial intelligence based programs are used in various fields of daily life, often without our awareness. With the increasing integration of artificial intelligence applications into the educational system, accessing information has become faster. As a result, chat programs that produce text-based answers similar to those of humans are being used as educational tools. The accuracy of the content generated by these programs has always been a topic of interest. In our study, we evaluated the success of ChatGPT, Gemini, and Copilot applications in answering dental specialty exam anatomy questions from 2012-2021. In the computer environment, free versions of ChatGpt-4, Google Gemini and Microsoft Copilot were accessed. The responses were recorded as either correct or incorrect. Out of 74 anatomy questions ChatGPT, Gemini and Copilot gave 2, 10, and 1 incorrect answers, respectively. Although the evaluated programs showed sufficient success in answering anatomy questions, their use was deemed limited due to errors in the supplementary information they provided.

Authors

Institutions

Publication Details

Journal
JITSI Jurnal Ilmiah Teknologi Sistem Informasi
Published
2024-12-30
DOI
https://doi.org/10.62527/jitsi.5.4.317
Citations
4
Primary Topic
Topic Modeling
Type
article
Field-Weighted Citation Impact
1.39
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A Performance of Generative Pre-Trained Transformers (GPT) in Answering Questions on Anatomy in The Turkish Dentistry Specialization Exam

Tuba Keskin, Tayfun Aygün
4 citations
JITSI Jurnal Ilmiah Teknologi Sistem Informasi
Topic Modeling
1.39
article

A Performance of Generative Pre-Trained Transformers (GPT) in Answering Questions on Anatomy in The Turkish Dentistry Specialization Exam

Tuba Keskin, Tayfun Aygün
article en
4 citations

Abstract

Artificial intelligence based programs are used in various fields of daily life, often without our awareness. With the increasing integration of artificial intelligence applications into the educational system, accessing information has become faster. As a result, chat programs that produce text-based answers similar to those of humans are being used as educational tools. The accuracy of the content generated by these programs has always been a topic of interest. In our study, we evaluated the success of ChatGPT, Gemini, and Copilot applications in answering dental specialty exam anatomy questions from 2012-2021. In the computer environment, free versions of ChatGpt-4, Google Gemini and Microsoft Copilot were accessed. The responses were recorded as either correct or incorrect. Out of 74 anatomy questions ChatGPT, Gemini and Copilot gave 2, 10, and 1 incorrect answers, respectively. Although the evaluated programs showed sufficient success in answering anatomy questions, their use was deemed limited due to errors in the supplementary information they provided.

JITSI Jurnal Ilmiah Teknologi Sistem InformasiVol. 5(4)
Giresun University (TR)
Openalex Percentile: Top 15%
Topic Modeling
1.39
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

A Performance of Generative Pre-Trained Transformers (GPT) in Answering Questions on Anatomy in The Turkish Dentistry Specialization Exam — Tuba Keskin, Tayfun Aygün · JITSI Jurnal Ilmiah Teknologi Sistem Informasi (2024) | TGRS Research Map | TGRS