Mining transparency: Assessing open science practices in crime research over time using machine learning

This pilot study addresses the current lack of systematic, large-scale evidence on the adoption of open science practices (OSPs) in criminology and legal psychology. A scalable, machine-learning-based text classification pipeline is introduced to map the prevalence of Open Access (OA), Open Data (OD), Open Materials (OM) and Preregistration (PR). The analysis is based on publication metadata and a year-stratified sample of full texts from the top 100 journals in Criminology & Penology, Law, and Psychology (2013–2023). After identifying articles containing statistical inference (SI) via a high-performing classifier, the author utilised GPT-assisted coding and supervised learning to train specific classifiers for OD, OM and PR. OA was classified using publicly available metadata. Among 1763 SI articles with usable full text, design-based estimates reveal a significant disparity in OSP adoption. OA is relatively common (40.9%, 95% CI: 38.8–43.1) and has steadily increased from approximately 20% in 2013 to 50% in 2023. In sharp contrast, trends for OD, OM and PR cannot be reliably quantified. Extreme class imbalance and the minimal number of positive cases indicate a very low underlying true prevalence for these practices in the assessed field. Methodologically, the study confirms that GPT-assisted coding supports accurate SI detection, but robust prevalence estimation for extremely low-frequency OSPs remains challenging for downstream classifiers. Overall, this project establishes a transparent and reproducible pipeline and provides critical baseline estimates for future, larger-scale assessments of research transparency in crime-related fields.

Institutions

Publication Details

Journal
European Journal of Criminology
Published
2026-11-18
DOI
https://doi.org/10.1177/14773708261505385
Citations
1
Primary Topic
Academic Publishing and Open Access
Type
article
Field-Weighted Citation Impact
3.45
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

Mining transparency: Assessing open science practices in crime research over time using machine learning

1 citations
European Journal of Criminology
Academic Publishing and Open Access
3.45
article

Mining transparency: Assessing open science practices in crime research over time using machine learning

article en
1 citations

Abstract

This pilot study addresses the current lack of systematic, large-scale evidence on the adoption of open science practices (OSPs) in criminology and legal psychology. A scalable, machine-learning-based text classification pipeline is introduced to map the prevalence of Open Access (OA), Open Data (OD), Open Materials (OM) and Preregistration (PR). The analysis is based on publication metadata and a year-stratified sample of full texts from the top 100 journals in Criminology & Penology, Law, and Psychology (2013–2023). After identifying articles containing statistical inference (SI) via a high-performing classifier, the author utilised GPT-assisted coding and supervised learning to train specific classifiers for OD, OM and PR. OA was classified using publicly available metadata. Among 1763 SI articles with usable full text, design-based estimates reveal a significant disparity in OSP adoption. OA is relatively common (40.9%, 95% CI: 38.8–43.1) and has steadily increased from approximately 20% in 2013 to 50% in 2023. In sharp contrast, trends for OD, OM and PR cannot be reliably quantified. Extreme class imbalance and the minimal number of positive cases indicate a very low underlying true prevalence for these practices in the assessed field. Methodologically, the study confirms that GPT-assisted coding supports accurate SI detection, but robust prevalence estimation for extremely low-frequency OSPs remains challenging for downstream classifiers. Overall, this project establishes a transparent and reproducible pipeline and provides critical baseline estimates for future, larger-scale assessments of research transparency in crime-related fields.

European Journal of Criminology
German Institute for Adult Education – Leibniz Centre for Lifelong Learning (DE)
Peace, justice, and strong institutions
Openalex Percentile: Top 11%
Academic Publishing and Open Access
3.45
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon