Convergence Rate of Greedy SR1 With Trust Region Method

Recently, Greedy Quasi-Newton methods have attracted wide interests of some researchers for their explicit superlinear convergence rate. These algorithms which achieve rapid local convergence construct a matrix sequence to approximate the Hessian matrix of the objective function iteratively. This paper proposes an algorithm, GR-SR1-TR, which incorporate Greedy SR1 method with Trust Region framework and employs a new correction technique. We prove that the approximation matrix sequence has a linear descent property under the Frobenius-norm metric. Further, both the global convergence and an explicit superlinear rate are established. The effectiveness of GR-SR1-TR has been verified by preliminary numerical experiments.

Authors

Publication Details

Journal
Highlights in Science Engineering and Technology
Published
2024-10-28
DOI
https://doi.org/10.54097/axh66s95
Primary Topic
DNA and Biological Computing
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Convergence Rate of Greedy SR1 With Trust Region Method

Yu Xia, Hao Wu
Highlights in Science Engineering and Technology
DNA and Biological Computing
article

Convergence Rate of Greedy SR1 With Trust Region Method

Yu Xia, Hao Wu
article en

Abstract

Recently, Greedy Quasi-Newton methods have attracted wide interests of some researchers for their explicit superlinear convergence rate. These algorithms which achieve rapid local convergence construct a matrix sequence to approximate the Hessian matrix of the objective function iteratively. This paper proposes an algorithm, GR-SR1-TR, which incorporate Greedy SR1 method with Trust Region framework and employs a new correction technique. We prove that the approximation matrix sequence has a linear descent property under the Frobenius-norm metric. Further, both the global convergence and an explicit superlinear rate are established. The effectiveness of GR-SR1-TR has been verified by preliminary numerical experiments.

Highlights in Science Engineering and TechnologyVol. 115
Openalex Percentile: Top 83%
DNA and Biological Computing
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.