Rethinking Feature Selection: A Fair-Division Approach Under Model Uncertainty

Feature selection, also known as variable selection, is a foundational problem in econometrics, artificial intelligence, and machine learning. However, widely used procedures may be inaccurate, unstable under collinearity, and sensitive to sampling noise and may lack a principled interpretation in terms of how they allocate explanatory power. This paper develops a feature-selection framework that extends a fair-division approach introduced by Hu ([2020, 2025). We represent the explanatory or forecasting performance of feature subsets as payoffs in a coalitional game subject to sampling uncertainty. Candidate features are partitioned into selected and unselected sets according to their fair-division values, defined using a modified Shapley value. Model uncertainty is represented by a beta-binomial distribution over subset size and a uniform distribution over subsets conditional on size. Each feature’s value combines the expected marginal gain from inclusion with the expected opportunity loss associated with exclusion, thereby treating all candidates symmetrically ex ante under a veil-of-ignorance principle. We further propose a sequential selection algorithm that uses a Monte Carlo approximation and a likelihood-ratio screening rule that admits at most one feature per iteration. Across the simulation designs considered, the procedure attains substantially higher exact-identification rates than those of the benchmark methods, including stepwise, unidirectional, GETS-style, and LASSO-based procedures. The paper also examines residual-share-based hyperparameter calibration, computational complexity, selection consistency, and practical implementation considerations.

Authors

Publication Details

Journal
Preprints.org
Published
2026-11-16
DOI
https://doi.org/10.20944/preprints202611.1538.v1
Primary Topic
Statistical Methods and Inference
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
preprint

Rethinking Feature Selection: A Fair-Division Approach Under Model Uncertainty

Xingwei Hu, Sankhya Basu, Caihong Hu
Preprints.org
Statistical Methods and Inference
preprint

Rethinking Feature Selection: A Fair-Division Approach Under Model Uncertainty

Xingwei Hu, Sankhya Basu, Caihong Hu
preprint en

Abstract

Feature selection, also known as variable selection, is a foundational problem in econometrics, artificial intelligence, and machine learning. However, widely used procedures may be inaccurate, unstable under collinearity, and sensitive to sampling noise and may lack a principled interpretation in terms of how they allocate explanatory power. This paper develops a feature-selection framework that extends a fair-division approach introduced by Hu ([2020, 2025). We represent the explanatory or forecasting performance of feature subsets as payoffs in a coalitional game subject to sampling uncertainty. Candidate features are partitioned into selected and unselected sets according to their fair-division values, defined using a modified Shapley value. Model uncertainty is represented by a beta-binomial distribution over subset size and a uniform distribution over subsets conditional on size. Each feature’s value combines the expected marginal gain from inclusion with the expected opportunity loss associated with exclusion, thereby treating all candidates symmetrically ex ante under a veil-of-ignorance principle. We further propose a sequential selection algorithm that uses a Monte Carlo approximation and a likelihood-ratio screening rule that admits at most one feature per iteration. Across the simulation designs considered, the procedure attains substantially higher exact-identification rates than those of the benchmark methods, including stepwise, unidirectional, GETS-style, and LASSO-based procedures. The paper also examines residual-share-based hyperparameter calibration, computational complexity, selection consistency, and practical implementation considerations.

Preprints.org
Statistical Methods and Inference
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon