MINIMAX APPROXIMATION AS A METHOD FOR OVERCOMING THE DOUBLE DESCENT PHENOMENON

This paper explores minimax approximation methods as a tool for overcoming the double descent phenomenon in machine learning. Double descent is an important issue that arises when models begin to demonstrate improved results after overfitting. This phenomenon is observed when training complex models with a large number of parameters, which increases the risk of overfitting. Minimax approximation allows for the reduction of maximum losses that occur during training and stabilizes model results even in situations where data may be noisy or unpredictable. The paper describes the main strategies for minimizing maximum losses, optimizing model complexity, controlling overfitting, and implementing regularization. Special attention is given to identifying the optimal point of the second descent, which enhances the generalization capabilities of models and reduces their susceptibility to overfitting. The research shows that using minimax approximation can significantly improve the effectiveness of model training, especially in conditions where data has a high level of noise or when models have a large number of parameters. The obtained results may be beneficial for researchers and practitioners in the field of machine learning, as they demonstrate new approaches to improving overall model performance and enhancing their reliability.

Authors

Publication Details

Published
2024-11-21
DOI
https://doi.org/10.31649/mccs2024.1-06
Primary Topic
Advanced Data Processing Techniques
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

MINIMAX APPROXIMATION AS A METHOD FOR OVERCOMING THE DOUBLE DESCENT PHENOMENON

Mykhail Kryvosheia, Roman Kvyetnyy
Advanced Data Processing Techniques
article

MINIMAX APPROXIMATION AS A METHOD FOR OVERCOMING THE DOUBLE DESCENT PHENOMENON

Mykhail Kryvosheia, Roman Kvyetnyy
article en

Abstract

This paper explores minimax approximation methods as a tool for overcoming the double descent phenomenon in machine learning. Double descent is an important issue that arises when models begin to demonstrate improved results after overfitting. This phenomenon is observed when training complex models with a large number of parameters, which increases the risk of overfitting. Minimax approximation allows for the reduction of maximum losses that occur during training and stabilizes model results even in situations where data may be noisy or unpredictable. The paper describes the main strategies for minimizing maximum losses, optimizing model complexity, controlling overfitting, and implementing regularization. Special attention is given to identifying the optimal point of the second descent, which enhances the generalization capabilities of models and reduces their susceptibility to overfitting. The research shows that using minimax approximation can significantly improve the effectiveness of model training, especially in conditions where data has a high level of noise or when models have a large number of parameters. The obtained results may be beneficial for researchers and practitioners in the field of machine learning, as they demonstrate new approaches to improving overall model performance and enhancing their reliability.

Openalex Percentile: Top 71%
Advanced Data Processing Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.