Finite-Smoothing Efficiency and Inference in Single-Index Models

When the error is independent of the predictors, its distribution can carry information about a single-index direction beyond the conditional mean. We develop Single-Index Kernel Density Regression (SI-KDR): at each candidate direction, it refits the link and evaluates a leave-one-out kernel log-likelihood of the residuals. Under Gaussian design, the population score vanishes at the true line at every positive smoothing tuple. At a fixed positive-curvature tuple, the leading covariance in the sample expansion is the conditional-mean efficiency bound times $Λ/G$, where $G$ is the information gain from independence and $Λ$ is the variance inflation from smoothing. We derive $Λ$ by following each observation through link refitting, the dual role of its residual as evaluation point and kernel center, and training standardization. Case-weight covariance estimates guide tuning for point estimation. Tuning separately at each candidate gives an exact conditional $F$ test. When predictors outnumber observations, independent screening that retains the support preserves the covariance comparison and the exact test, and $G/Λ$ becomes the squared-noncentrality ratio of a retained-coordinate test relative to the conditional-mean oracle. In four non-Gaussian error distribution designs at $n=600$, covariance-trace tuning reduced direction risk by 56% to 74% relative to reference bandwidths, and score-inversion coverage was 93.8% to 96.6%.

Authors

Publication Details

Journal
arXiv (Cornell University)
Published
2026-11-17
DOI
https://doi.org/10.48550/arxiv.2611.22384
Primary Topic
Statistical Methods and Inference
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
preprint

Finite-Smoothing Efficiency and Inference in Single-Index Models

Yangzhou Chen, Yusen Jia, Jiayang Xu, Xin Chen
arXiv (Cornell University)
Statistical Methods and Inference
preprint

Finite-Smoothing Efficiency and Inference in Single-Index Models

Yangzhou Chen, Yusen Jia, Jiayang Xu, Xin Chen
preprint en

Abstract

When the error is independent of the predictors, its distribution can carry information about a single-index direction beyond the conditional mean. We develop Single-Index Kernel Density Regression (SI-KDR): at each candidate direction, it refits the link and evaluates a leave-one-out kernel log-likelihood of the residuals. Under Gaussian design, the population score vanishes at the true line at every positive smoothing tuple. At a fixed positive-curvature tuple, the leading covariance in the sample expansion is the conditional-mean efficiency bound times $Λ/G$, where $G$ is the information gain from independence and $Λ$ is the variance inflation from smoothing. We derive $Λ$ by following each observation through link refitting, the dual role of its residual as evaluation point and kernel center, and training standardization. Case-weight covariance estimates guide tuning for point estimation. Tuning separately at each candidate gives an exact conditional $F$ test. When predictors outnumber observations, independent screening that retains the support preserves the covariance comparison and the exact test, and $G/Λ$ becomes the squared-noncentrality ratio of a retained-coordinate test relative to the conditional-mean oracle. In four non-Gaussian error distribution designs at $n=600$, covariance-trace tuning reduced direction risk by 56% to 74% relative to reference bandwidths, and score-inversion coverage was 93.8% to 96.6%.

arXiv (Cornell University)
Statistical Methods and Inference
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon