A stochastic use of the Kurdyka-Łojasiewicz property: Investigation of optimization algorithms behaviours in a non-convex differentiable framework

Asymptotic analysis of generic stochastic algorithms often relies on descent conditions. In a convex setting, some technical shortcuts can be considered to establish asymptotic convergence guarantees of the associated scheme. However, in a non-convex setting, obtaining similar guarantees is usually more complicated, and relies on the use of the Kurdyka-Łojasiewicz (KŁ) property. While this tool has become popular in the field of deterministic optimization, it is much less widespread in the stochastic context and the few works making use of it are essentially based on trajectory-by-trajectory approaches. In this paper, we propose a new framework for using the $ \text{K}Ł $ property in a non-convex stochastic setting based on conditioning theory. We show that this framework allows for deeper asymptotic investigations on stochastic schemes verifying some generic descent conditions. We further show that our methodology can be used to prove convergence of generic stochastic gradient descent (SGD) schemes, and unifies conditions investigated in multiple articles of the literature.

Authors

Institutions

Publication Details

Journal
Foundations of Data Science
Published
2025-08-18
DOI
https://doi.org/10.3934/fods.2025016
Primary Topic
Stochastic Gradient Optimization Techniques
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A stochastic use of the Kurdyka-Łojasiewicz property: Investigation of optimization algorithms behaviours in a non-convex differentiable framework

Jean-Baptiste Fest, Émilie Chouzenoux, Audrey Repetti
Foundations of Data Science
Stochastic Gradient Optimization Techniques
article

A stochastic use of the Kurdyka-Łojasiewicz property: Investigation of optimization algorithms behaviours in a non-convex differentiable framework

Jean-Baptiste Fest, Émilie Chouzenoux, Audrey Repetti
article en

Abstract

Asymptotic analysis of generic stochastic algorithms often relies on descent conditions. In a convex setting, some technical shortcuts can be considered to establish asymptotic convergence guarantees of the associated scheme. However, in a non-convex setting, obtaining similar guarantees is usually more complicated, and relies on the use of the Kurdyka-Łojasiewicz (KŁ) property. While this tool has become popular in the field of deterministic optimization, it is much less widespread in the stochastic context and the few works making use of it are essentially based on trajectory-by-trajectory approaches. In this paper, we propose a new framework for using the $ \text{K}Ł $ property in a non-convex stochastic setting based on conditioning theory. We show that this framework allows for deeper asymptotic investigations on stochastic schemes verifying some generic descent conditions. We further show that our methodology can be used to prove convergence of generic stochastic gradient descent (SGD) schemes, and unifies conditions investigated in multiple articles of the literature.

Foundations of Data ScienceVol. 9(0)
École Polytechnique (FR), Université Paris-Saclay (FR), Heriot-Watt University (GB), Centre de Mathématiques Appliquées de l'École polytechnique (FR), CentraleSupélec (FR), Maxwell Institute for Mathematical Sciences (GB)
Engineering and Physical Sciences Research Council
Openalex Percentile: Top 100%
Stochastic Gradient Optimization Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.