Deep Transformation Model
The increasing data complexity leads to the demand for more general and flexible modeling approaches. We consider a nonparametric transformation model with weak assumptions, which encompasses many popular models as special cases. A rank-based deep neural network (DNN) estimation approach is developed, with a loss function significantly different from the existing ones. It can accommodate outliers in response, which is a robustness property not broadly shared. For computational feasibility, we propose a double rectified linear unit (DReLU)-based estimator. To accommodate a diverging number of input variables and/or noises, we propose variable selection based on group penalization. We further expand the scope to accommodate censored survival data. We establish a new deep ReLU network approximation result as well as the estimation and variable selection properties. Numerical studies, including simulations and data analyses, establish practical utility of the proposed methods.
Authors
- Shuangge Ma (ORCID: https://orcid.org/0000-0001-9001-4999)
- Tong Wang (ORCID: https://orcid.org/0000-0003-3454-042X)
- Jian Huang (ORCID: https://orcid.org/0000-0002-2409-0878)
- Shunqin Zhang (ORCID: https://orcid.org/0000-0003-1082-6407)
- Sanguo Zhang (ORCID: https://orcid.org/0000-0001-5931-8177)
Institutions
- Hong Kong Polytechnic University (HK)
- Yale University (US)
- Southeast University (BD)
- University of Chinese Academy of Sciences (CN)
- Southeast University (CN)
Publication Details
- Journal
- Journal of the American Statistical Association
- Published
- 2026-09-28
- DOI
- https://doi.org/10.1080/01621459.2026.2739658
- Primary Topic
- Adversarial Robustness in Machine Learning
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- National Institutes of Health