$$\hbox {HNAG}^{++}$$: An Accelerated Gradient Method with a Refined Asymptotic Rate for Strongly Convex Optimization

Abstract Two accelerated first-order methods, $$\hbox {HNAG}^+$$ HNAG + and $$\hbox {HNAG}^{++}$$ HNAG + + , are introduced for smooth strongly convex optimization. They are derived from the Hessian-driven Nesterov Accelerated Gradient (HNAG) flow by optimizing the coercivity of shifted Lyapunov functions. Let $$\kappa =L/\mu $$ κ = L / μ , where $$\mu $$ μ is the strong-convexity constant and L is the gradient Lipschitz constant. To leading order as $$\kappa \rightarrow \infty $$ κ → ∞ , $$\hbox {HNAG}^+$$ HNAG + attains the global rate $$1-2/\sqrt{\kappa }$$ 1 - 2 / κ , matching the information-theoretic lower bound. Under local asymptotic symmetry at the minimizer, $$\hbox {HNAG}^{++}$$ HNAG + + achieves the faster asymptotic rate $$1-2\sqrt{2/\kappa }$$ 1 - 2 2 / κ to leading order. This matches the fastest known asymptotic rate for twice continuously differentiable objectives at leading order and extends it to a strictly larger function class. In particular, local asymptotic symmetry permits objectives that are not twice differentiable at the minimizer, showing that $${\mathcal {C}}^2$$ C 2 regularity is not necessary for this accelerated rate. A unified Lyapunov analysis establishes these guarantees, and numerical experiments confirm the predicted rates and show favorable performance against existing accelerated schemes.

Authors

Institutions

Publication Details

Journal
Journal of Optimization Theory and Applications
Published
2026-10-29
DOI
https://doi.org/10.1007/s10957-026-03131-x
Primary Topic
Stochastic Gradient Optimization Techniques
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

$$\hbox {HNAG}^{++}$$: An Accelerated Gradient Method with a Refined Asymptotic Rate for Strongly Convex Optimization

Zidu Xu, Long Chen
Journal of Optimization Theory and Applications
Stochastic Gradient Optimization Techniques
article

$$\hbox {HNAG}^{++}$$: An Accelerated Gradient Method with a Refined Asymptotic Rate for Strongly Convex Optimization

Zidu Xu, Long Chen
article en

Abstract

Abstract Two accelerated first-order methods, $$\hbox {HNAG}^+$$ HNAG + and $$\hbox {HNAG}^{++}$$ HNAG + + , are introduced for smooth strongly convex optimization. They are derived from the Hessian-driven Nesterov Accelerated Gradient (HNAG) flow by optimizing the coercivity of shifted Lyapunov functions. Let $$\kappa =L/\mu $$ κ = L / μ , where $$\mu $$ μ is the strong-convexity constant and L is the gradient Lipschitz constant. To leading order as $$\kappa \rightarrow \infty $$ κ → ∞ , $$\hbox {HNAG}^+$$ HNAG + attains the global rate $$1-2/\sqrt{\kappa }$$ 1 - 2 / κ , matching the information-theoretic lower bound. Under local asymptotic symmetry at the minimizer, $$\hbox {HNAG}^{++}$$ HNAG + + achieves the faster asymptotic rate $$1-2\sqrt{2/\kappa }$$ 1 - 2 2 / κ to leading order. This matches the fastest known asymptotic rate for twice continuously differentiable objectives at leading order and extends it to a strictly larger function class. In particular, local asymptotic symmetry permits objectives that are not twice differentiable at the minimizer, showing that $${\mathcal {C}}^2$$ C 2 regularity is not necessary for this accelerated rate. A unified Lyapunov analysis establishes these guarantees, and numerical experiments confirm the predicted rates and show favorable performance against existing accelerated schemes.

Journal of Optimization Theory and ApplicationsVol. 211(2)
University of California, Irvine (US)
National Science Foundation
Openalex Percentile: Top 14%
Stochastic Gradient Optimization Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon