Poster Session I - A52 THE USE OF LARGE LANGUAGE MODELS IN GASTROENTEROLOGY LITERATURE: A GROWING ARTIFICIAL INTELLIGENCE FOOTPRINT

Abstract Background The integration of Large Language Models (LLMs) into academic writing has transformed scientific literature, but the adoption within the gastrointestinal (GI) literature remains to be quantified. Aims In this study, we aim to estimate the proportion of classical LLM-related language in GI abstracts from 2010 to 2024, and to characterize its variation across impact factor (IF) quartiles, and impact on lexical patterns. Methods We conducted a retrospective, bibliometric analysis of 158,473 PubMed-indexed GI abstracts, sourced from all GI-related journals with 2024 IF ≥ 2 as found on Clarivate. A synthetic corpus of 10,000 GPT-3.5 generated abstracts was used to model AI-like linguistic distributions. The annual proportion of AI-like text (α) was estimated using a maximum-likelihood mixture model with Laplace smoothing. Journals were stratified into quartiles by their 2024 IF for sub-analysis. Lexical diversity was quantified on a yearly basis, using the type-token ratio (TTR). Results Between 2010-2019, α was negligible (<0.001%), with only a discrete inflection beginning in 2016 (α = 0.07%). A sharp rise is noted after the introduction of ChatGPT, reaching successively 0.86% (2020), 1.77% (2021), 1.35% (2022), 1.95% (2023), and finally up to 4.68% (2024). By IF quartile, α demonstrated a U-shaped curve, lowest in Q2/Q3 (4.2% and 2.97% respectively), and highest in Q1/Q4 (5.4% and 5.7%), suggesting disproportionate adoption in both high and lower-impact journals. Lexical diversity remained stable throughout a measured period of 15 years (TTR range 0.0067 to 0.0089), demonstrating that the increased AI-related language was not associated to measurable shifts in vocabulary. Conclusions The prevalence of LLM-related language in GI abstracts has increased sharply since the mass-introduction of LLMs, with a five-fold surge subsequent to the release of ChatGPT. These findings suggest a growing integration of LLMs in the GI body of knowledge, suggesting a need for clear editorial policies and standards of transparency regarding AI-assisted writing. Funding Agencies None

Authors

Institutions

Publication Details

Journal
Journal of the Canadian Association of Gastroenterology
Published
2026-02-01
DOI
https://doi.org/10.1093/jcag/gwaf042.052
Primary Topic
Artificial Intelligence in Healthcare and Education
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Poster Session I - A52 THE USE OF LARGE LANGUAGE MODELS IN GASTROENTEROLOGY LITERATURE: A GROWING ARTIFICIAL INTELLIGENCE FOOTPRINT

Adel Arezki, Talat Bessissow, Edgard Medawar, Amine Zoughlami et al.
Journal of the Canadian Association of Gastroenterology
Artificial Intelligence in Healthcare and Education
article

Poster Session I - A52 THE USE OF LARGE LANGUAGE MODELS IN GASTROENTEROLOGY LITERATURE: A GROWING ARTIFICIAL INTELLIGENCE FOOTPRINT

Adel Arezki, Talat Bessissow, Edgard Medawar, Amine Zoughlami, S Arezki
article en

Abstract

Abstract Background The integration of Large Language Models (LLMs) into academic writing has transformed scientific literature, but the adoption within the gastrointestinal (GI) literature remains to be quantified. Aims In this study, we aim to estimate the proportion of classical LLM-related language in GI abstracts from 2010 to 2024, and to characterize its variation across impact factor (IF) quartiles, and impact on lexical patterns. Methods We conducted a retrospective, bibliometric analysis of 158,473 PubMed-indexed GI abstracts, sourced from all GI-related journals with 2024 IF ≥ 2 as found on Clarivate. A synthetic corpus of 10,000 GPT-3.5 generated abstracts was used to model AI-like linguistic distributions. The annual proportion of AI-like text (α) was estimated using a maximum-likelihood mixture model with Laplace smoothing. Journals were stratified into quartiles by their 2024 IF for sub-analysis. Lexical diversity was quantified on a yearly basis, using the type-token ratio (TTR). Results Between 2010-2019, α was negligible (<0.001%), with only a discrete inflection beginning in 2016 (α = 0.07%). A sharp rise is noted after the introduction of ChatGPT, reaching successively 0.86% (2020), 1.77% (2021), 1.35% (2022), 1.95% (2023), and finally up to 4.68% (2024). By IF quartile, α demonstrated a U-shaped curve, lowest in Q2/Q3 (4.2% and 2.97% respectively), and highest in Q1/Q4 (5.4% and 5.7%), suggesting disproportionate adoption in both high and lower-impact journals. Lexical diversity remained stable throughout a measured period of 15 years (TTR range 0.0067 to 0.0089), demonstrating that the increased AI-related language was not associated to measurable shifts in vocabulary. Conclusions The prevalence of LLM-related language in GI abstracts has increased sharply since the mass-introduction of LLMs, with a five-fold surge subsequent to the release of ChatGPT. These findings suggest a growing integration of LLMs in the GI body of knowledge, suggesting a need for clear editorial policies and standards of transparency regarding AI-assisted writing. Funding Agencies None

Journal of the Canadian Association of GastroenterologyVol. 9(Supplement_1)
University of Ottawa (CA), McGill University Health Centre (CA), McGill University (CA)
Quality Education
Openalex Percentile: Top 57%
Artificial Intelligence in Healthcare and Education
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.