Variant effect predictors are shaping the ClinVar classifications used to train and evaluate them

Variant effect predictors (VEPs) are playing an increasingly influential role in clinical variant classification. Following recent calibration efforts and the development of points-based classification standards, computational predictions can now carry enough weight to move variants out of uncertain significance with little additional evidence. While clinically valuable, this increases the potential for classification-level circularity, where VEP predictions help determine the clinical classifications later used to train, benchmark and calibrate VEPs. Here, we show that computational evidence is already leaving a detectable signature in ClinVar. Among rare missense variants from a major submitter, likely benign classifications shifted markedly towards more benign scores and show a sharp step change at the calibrated moderate-evidence threshold of BayesDel_noAF. This signal extends to nearly all 52 predictors examined, including population-free models unlikely to have been used in classification, probably reflecting shared evolutionary information. Classifications informed by computational evidence therefore cannot be treated as independent ground truth, and temporal holdouts cannot eliminate this circularity. To prevent a self-reinforcing feedback loop between prediction and classification, we recommend that ClinVar submissions routinely record the evidence criteria and computational tools supporting each classification in a standardised format, alongside greater use of classification-independent benchmarks.

Authors

Institutions

Publication Details

Journal
bioRxiv (Cold Spring Harbor Laboratory)
Published
2026-10-27
DOI
https://doi.org/10.64898/2026.10.24.761512
Primary Topic
Genomics and Rare Diseases
Type
preprint

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
preprint

Variant effect predictors are shaping the ClinVar classifications used to train and evaluate them

Joseph A. Marsh, Minyu Tao
6 links
bioRxiv (Cold Spring Harbor Laboratory)
Genomics and Rare Diseases
preprint

Variant effect predictors are shaping the ClinVar classifications used to train and evaluate them

Joseph A. Marsh, Minyu Tao
preprint en

Abstract

Variant effect predictors (VEPs) are playing an increasingly influential role in clinical variant classification. Following recent calibration efforts and the development of points-based classification standards, computational predictions can now carry enough weight to move variants out of uncertain significance with little additional evidence. While clinically valuable, this increases the potential for classification-level circularity, where VEP predictions help determine the clinical classifications later used to train, benchmark and calibrate VEPs. Here, we show that computational evidence is already leaving a detectable signature in ClinVar. Among rare missense variants from a major submitter, likely benign classifications shifted markedly towards more benign scores and show a sharp step change at the calibrated moderate-evidence threshold of BayesDel_noAF. This signal extends to nearly all 52 predictors examined, including population-free models unlikely to have been used in classification, probably reflecting shared evolutionary information. Classifications informed by computational evidence therefore cannot be treated as independent ground truth, and temporal holdouts cannot eliminate this circularity. To prevent a self-reinforcing feedback loop between prediction and classification, we recommend that ClinVar submissions routinely record the evidence criteria and computational tools supporting each classification in a standardised format, alongside greater use of classification-independent benchmarks.

bioRxiv (Cold Spring Harbor Laboratory)
University of Edinburgh (GB)
Lister Institute of Preventive Medicine, Medical Research Council
Good health and well-being
Genomics and Rare Diseases
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon