{"title":"Complexity bound of a Levenberg–Marquardt algorithm based on probabilistic Jacobian models","authors":"Ruixue Zhao","doi":"10.1007/s11590-024-02140-x","DOIUrl":null,"url":null,"abstract":"<p>In this paper, we present a Levenberg–Marquardt algorithm for nonlinear equations, where the exact Jacobians are unavailable, but their model approximations can be built in some random fashion. We study the complexity of the algorithm and show that the upper bound of the iteration numbers in expectation to obtain a first order stationary point is <span>\\(O(\\epsilon ^{-3})\\)</span>.</p>","PeriodicalId":49720,"journal":{"name":"Optimization Letters","volume":"15 1","pages":""},"PeriodicalIF":1.3000,"publicationDate":"2024-07-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Optimization Letters","FirstCategoryId":"100","ListUrlMain":"https://doi.org/10.1007/s11590-024-02140-x","RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"MATHEMATICS, APPLIED","Score":null,"Total":0}
引用次数: 0
Abstract
In this paper, we present a Levenberg–Marquardt algorithm for nonlinear equations, where the exact Jacobians are unavailable, but their model approximations can be built in some random fashion. We study the complexity of the algorithm and show that the upper bound of the iteration numbers in expectation to obtain a first order stationary point is \(O(\epsilon ^{-3})\).
期刊介绍:
Optimization Letters is an international journal covering all aspects of optimization, including theory, algorithms, computational studies, and applications, and providing an outlet for rapid publication of short communications in the field. Originality, significance, quality and clarity are the essential criteria for choosing the material to be published.
Optimization Letters has been expanding in all directions at an astonishing rate during the last few decades. New algorithmic and theoretical techniques have been developed, the diffusion into other disciplines has proceeded at a rapid pace, and our knowledge of all aspects of the field has grown even more profound. At the same time one of the most striking trends in optimization is the constantly increasing interdisciplinary nature of the field.
Optimization Letters aims to communicate in a timely fashion all recent developments in optimization with concise short articles (limited to a total of ten journal pages). Such concise articles will be easily accessible by readers working in any aspects of optimization and wish to be informed of recent developments.