The Second-Order Perspectives of Minimax Parameter Estimation in Restricted Space with Weighted Squared Error Loss

In this paper, we investigate the parameter estimation problems, where the unknown parameter is assumed to be within certain restricted parameter space. To this end, we adopt the conventional minimax formulation and apply the weighted mean-squared error as the loss function. In particular, we focus on analyzing the minimax risk in the asymptotic regime, where the second-order convergence rate, and the ordinary differential equation for computing the second-order terms are presented. Moreover, our results are applied to some widely considered probability distribution models, where the analytical expressions of the second-order terms and the corresponding estimators are explicitly provided. Finally, some numerical simulations are also presented when the second-order term cannot be explicitly expressed, which further supports our theoretical results.

Authors

Institutions

Publication Details

Published
2024-11-24
DOI
https://doi.org/10.1109/itw61385.2024.10806981
Primary Topic
Numerical methods in inverse problems
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

The Second-Order Perspectives of Minimax Parameter Estimation in Restricted Space with Weighted Squared Error Loss

Tianren Peng, Xinyi Tong, Shao-Lun Huang
Numerical methods in inverse problems
article

The Second-Order Perspectives of Minimax Parameter Estimation in Restricted Space with Weighted Squared Error Loss

Tianren Peng, Xinyi Tong, Shao-Lun Huang
article en

Abstract

In this paper, we investigate the parameter estimation problems, where the unknown parameter is assumed to be within certain restricted parameter space. To this end, we adopt the conventional minimax formulation and apply the weighted mean-squared error as the loss function. In particular, we focus on analyzing the minimax risk in the asymptotic regime, where the second-order convergence rate, and the ordinary differential equation for computing the second-order terms are presented. Moreover, our results are applied to some widely considered probability distribution models, where the analytical expressions of the second-order terms and the corresponding estimators are explicitly provided. Finally, some numerical simulations are also presented when the second-order term cannot be explicitly expressed, which further supports our theoretical results.

Tsinghua–Berkeley Shenzhen Institute (CN)
National Key Research and Development Program of China
Openalex Percentile: Top 59%
Numerical methods in inverse problems
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

The Second-Order Perspectives of Minimax Parameter Estimation in Restricted Space with Weighted Squared Error Loss — Tianren Peng, Xinyi Tong, et al. · (2024) | TGRS Research Map | TGRS