Metrological audit of soil antibiotic-resistome inference: sensitivity of published ecological conclusions to ARG annotation pipelines, with a calibrated correction path

Soil antibiotic-resistome studies increasingly rely on computational annotation of metagenomic data, yet the sensitivity of published ecological conclusions—global patterns, temporal trends, risk rankings, and soil–human connectivity—to the choice of annotation pipeline (database × classifier × threshold × quantification convention) has never been systematically measured. This audit preregisters a measurement-science study of two flagship studies (Zheng et al. 2022, Science Advances; Zhao et al. 2025, Nature Communications), using a six-ruler matrix (ARGs-OAP, DIAMOND/CARD, RGI, Resfams, FunGeneTyper, LARGE) plus one calibrated correction ruler with an abstention mechanism. Pre-registered endpoints: (E1) Rank-I risk ranking, (E2) ecological structure, (E3) environmental drivers, (E4) habitat connectivity. For each endpoint we froze operational definitions of "conclusion flip" (direction change with 95% CI excluding zero, reproduced in two independent data scenarios) before analysis. A frozen sentinel set (726 ResFinderFG holdout + 297 functionally verified records) and a failure-mode atlas of 136 curated false reports lock the evaluation layer; sentinel sequences never enter training or threshold selection. Hypotheses: H1 (at least one endpoint flips reproducibly), H2 (calibrated measurement with unknown imputation reduces pipeline sensitivity), H3 (failure-mode-locked hard negatives reduce false reports at matched low-homology recall; query–reference residual features provide independent external gain). Falsification conditions, SESOIs, cluster-bootstrap CIs, multiple-testing control, leakage isolation rules, and deviation policies are specified in the attached protocol (G0 v1.0, frozen 2026-11-16, SHA-256 recorded in-document).

Authors

Institutions

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-11-18
DOI
https://doi.org/10.5281/zenodo.24327604
Primary Topic
Pharmaceutical and Antibiotic Environmental Impacts
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

Metrological audit of soil antibiotic-resistome inference: sensitivity of published ecological conclusions to ARG annotation pipelines, with a calibrated correction path

Lei Zhou
2 links
Zenodo (CERN European Organization for Nuclear Research)
Pharmaceutical and Antibiotic Environmental Impacts
article

Metrological audit of soil antibiotic-resistome inference: sensitivity of published ecological conclusions to ARG annotation pipelines, with a calibrated correction path

Lei Zhou
article en

Abstract

Soil antibiotic-resistome studies increasingly rely on computational annotation of metagenomic data, yet the sensitivity of published ecological conclusions—global patterns, temporal trends, risk rankings, and soil–human connectivity—to the choice of annotation pipeline (database × classifier × threshold × quantification convention) has never been systematically measured. This audit preregisters a measurement-science study of two flagship studies (Zheng et al. 2022, Science Advances; Zhao et al. 2025, Nature Communications), using a six-ruler matrix (ARGs-OAP, DIAMOND/CARD, RGI, Resfams, FunGeneTyper, LARGE) plus one calibrated correction ruler with an abstention mechanism. Pre-registered endpoints: (E1) Rank-I risk ranking, (E2) ecological structure, (E3) environmental drivers, (E4) habitat connectivity. For each endpoint we froze operational definitions of "conclusion flip" (direction change with 95% CI excluding zero, reproduced in two independent data scenarios) before analysis. A frozen sentinel set (726 ResFinderFG holdout + 297 functionally verified records) and a failure-mode atlas of 136 curated false reports lock the evaluation layer; sentinel sequences never enter training or threshold selection. Hypotheses: H1 (at least one endpoint flips reproducibly), H2 (calibrated measurement with unknown imputation reduces pipeline sensitivity), H3 (failure-mode-locked hard negatives reduce false reports at matched low-homology recall; query–reference residual features provide independent external gain). Falsification conditions, SESOIs, cluster-bootstrap CIs, multiple-testing control, leakage isolation rules, and deviation policies are specified in the attached protocol (G0 v1.0, frozen 2026-11-16, SHA-256 recorded in-document).

Zenodo (CERN European Organization for Nuclear Research)
Zhejiang A & F University (CN)
Life on land
Pharmaceutical and Antibiotic Environmental Impacts
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon