Optimal Predictivity of Random Signatures: Causes and Good Modeling Practices

In high-throughput omics data, randomly-selected sets of markers ("signatures") have large and often optimal phenotypic predictivity. This creates problems of over-interpretation of biological and predictive importance of signatures, of bioinformatics algorithms and expert knowledge-driven selection. We conduct first an empirical study establishing that the phenomenon occurs across a variety of types of datasets/omics types and algorithms (224 combinations, >120 million models fitted). Random signatures are systematically reproducible across datasets. We develop a comprehensive theoretical framework, encompassing definitions, feasibility and impossibility theorems, and analytical formulas. The theory reveals as necessary and sufficient causes of these anomalous behaviors, the existence of large equivalence classes of optimally predictive feature sets, and their structure of information equivalences. We validate the theory with additional experiments and propose good practices intended to strengthen scientific rigor. Our findings apply to both algorithmic discovery and expert knowledge-driven signature selection, and to both existing and future algorithms and expert criteria. They also extend to all types of data with similar equivalence classes of optimal predictors.

Authors

Institutions

Publication Details

Journal
bioRxiv (Cold Spring Harbor Laboratory)
Published
2026-11-17
DOI
https://doi.org/10.64898/2026.11.13.764046
Primary Topic
Gene expression and cancer classification
Type
preprint

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
preprint

Optimal Predictivity of Random Signatures: Causes and Good Modeling Practices

Roshan Tourani, Alexander Statnikov, Mehmet Ugurbil, Thomas Kirsh et al.
bioRxiv (Cold Spring Harbor Laboratory)
Gene expression and cancer classification
preprint

Optimal Predictivity of Random Signatures: Causes and Good Modeling Practices

Roshan Tourani, Alexander Statnikov, Mehmet Ugurbil, Thomas Kirsh, Constantin Aliferis, Sisi Ma, Jinhua Wang, Linmin Wang, Boris Winterhoff
preprint en

Abstract

In high-throughput omics data, randomly-selected sets of markers ("signatures") have large and often optimal phenotypic predictivity. This creates problems of over-interpretation of biological and predictive importance of signatures, of bioinformatics algorithms and expert knowledge-driven selection. We conduct first an empirical study establishing that the phenomenon occurs across a variety of types of datasets/omics types and algorithms (224 combinations, >120 million models fitted). Random signatures are systematically reproducible across datasets. We develop a comprehensive theoretical framework, encompassing definitions, feasibility and impossibility theorems, and analytical formulas. The theory reveals as necessary and sufficient causes of these anomalous behaviors, the existence of large equivalence classes of optimally predictive feature sets, and their structure of information equivalences. We validate the theory with additional experiments and propose good practices intended to strengthen scientific rigor. Our findings apply to both algorithmic discovery and expert knowledge-driven signature selection, and to both existing and future algorithms and expert criteria. They also extend to all types of data with similar equivalence classes of optimal predictors.

bioRxiv (Cold Spring Harbor Laboratory)
University of Minnesota (US), New York University (US)
University of Minnesota, National Institutes of Health, National Cancer Institute, National Center for Advancing Translational Sciences
Gene expression and cancer classification
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon