Guideline citation and the growth of PubMed: a pre- registered cohort study, 2008–2024

Citations from clinical practice guidelines are used as a marker of the practice relevance of research, but whether research drawn on by guidelines keeps pace with the growing biomedical literature is unknown. In a pre-registered cohort study, we linked 18.0 million PubMed research articles published from 2008 to 2024, through the National Institutes of Health Open Citation Collection, to the reference lists of 23,920 guidelines indexed in PubMed and 7,943 guidelines from 31 named national and international bodies. Research articles per year nearly doubled between 2008 and 2020 (4.7% a year), while papers cited by a guideline within five years grew 0.6% and 2.7% a year, 4.1 and 2.0 percentage points a year slower than the literature. The five-year probability of guideline citation fell from 1 in 25 papers (2008) to 1 in 43 (2019) for PubMed-indexed guidelines, and from 1 in 87 to 1 in 112 for named bodies. A decline across cohorts in the odds of citation was supported for named bodies (odds ratio 0.983 per year; 95% confidence interval 0.978 to 0.993) but inconclusive for PubMed-indexed guidelines, which a 2022–23 indexing gap affected. Guideline citation capacity grew only 0.7–2.7% a year. Restricted post hoc to articles indexed for MEDLINE, which grew 2.5% a year, guideline-cited papers still lagged the literature but the cohort trend was inconclusive, as within journals already cited by guidelines. The dilution is concentrated outside MEDLINE and outside established journals, so indicators built on PubMed totals partly reflect the database’s widening scope.

Authors

Publication Details

Journal
Research Square
Published
2026-11-18
DOI
https://doi.org/10.21203/rs.3.rs-11709754/v1
Primary Topic
scientometrics and bibliometrics research
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
preprint

Guideline citation and the growth of PubMed: a pre- registered cohort study, 2008–2024

Jordan Fulcher
Research Square
scientometrics and bibliometrics research
preprint

Guideline citation and the growth of PubMed: a pre- registered cohort study, 2008–2024

Jordan Fulcher
preprint en

Abstract

Citations from clinical practice guidelines are used as a marker of the practice relevance of research, but whether research drawn on by guidelines keeps pace with the growing biomedical literature is unknown. In a pre-registered cohort study, we linked 18.0 million PubMed research articles published from 2008 to 2024, through the National Institutes of Health Open Citation Collection, to the reference lists of 23,920 guidelines indexed in PubMed and 7,943 guidelines from 31 named national and international bodies. Research articles per year nearly doubled between 2008 and 2020 (4.7% a year), while papers cited by a guideline within five years grew 0.6% and 2.7% a year, 4.1 and 2.0 percentage points a year slower than the literature. The five-year probability of guideline citation fell from 1 in 25 papers (2008) to 1 in 43 (2019) for PubMed-indexed guidelines, and from 1 in 87 to 1 in 112 for named bodies. A decline across cohorts in the odds of citation was supported for named bodies (odds ratio 0.983 per year; 95% confidence interval 0.978 to 0.993) but inconclusive for PubMed-indexed guidelines, which a 2022–23 indexing gap affected. Guideline citation capacity grew only 0.7–2.7% a year. Restricted post hoc to articles indexed for MEDLINE, which grew 2.5% a year, guideline-cited papers still lagged the literature but the cohort trend was inconclusive, as within journals already cited by guidelines. The dilution is concentrated outside MEDLINE and outside established journals, so indicators built on PubMed totals partly reflect the database’s widening scope.

Research Square
scientometrics and bibliometrics research
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon