Artificial Intelligence as a Discriminator of Competence in Urological Training: Are We There?

Despite what seems to be similar performance on ChatGPT MCQs and the overall examination, ChatGPT MCQs tend not to be highly discriminating. Poorly phrased questions with potential for artificial intelligence hallucinations are ever present. Careful vetting for quality of ChatGPT questions should be undertaken before their use on assessments in urology training examinations.

Authors

Institutions

Publication Details

Journal
The Journal of Urology
Published
2025-03-07
DOI
https://doi.org/10.1097/ju.0000000000004357
Citations
4
Primary Topic
Healthcare Systems and Public Health
Type
article
Field-Weighted Citation Impact
5.42
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Artificial Intelligence as a Discriminator of Competence in Urological Training: Are We There?

Naji J. Touma, Michael Leveridge, Ruchit Patel, Thomas A. A. Skinner
4 citations
The Journal of Urology
Healthcare Systems and Public Health
5.42
article

Artificial Intelligence as a Discriminator of Competence in Urological Training: Are We There?

Naji J. Touma, Michael Leveridge, Ruchit Patel, Thomas A. A. Skinner
article en
4 citations

Abstract

Despite what seems to be similar performance on ChatGPT MCQs and the overall examination, ChatGPT MCQs tend not to be highly discriminating. Poorly phrased questions with potential for artificial intelligence hallucinations are ever present. Careful vetting for quality of ChatGPT questions should be undertaken before their use on assessments in urology training examinations.

The Journal of UrologyVol. 213(4)
Queen's University (CA)
Openalex Percentile: Top 5%
Healthcare Systems and Public Health
5.42
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.