{"title":"A revisit on Nesterov acceleration for linear ill-posed problems","authors":"Duo Liu , Qin Huang , Qinian Jin","doi":"10.1016/j.jco.2024.101920","DOIUrl":null,"url":null,"abstract":"<div><div>In recent years, Nesterov acceleration has been introduced to enhance the efficiency of Landweber iteration for solving ill-posed problems. For linear ill-posed problems in Hilbert spaces, Nesterov acceleration has been analyzed with a discrepancy principle proposed to terminate the iterations. However, the existing approach requires computing residuals along two distinct iterative sequences, resulting in increased computational costs. In this paper, we propose an alternative discrepancy principle for Nesterov acceleration that eliminates the need to compute the residuals for one of the iterative sequences, thereby reducing computational time by approximately one-third per iteration. We provide a convergence analysis of the proposed method, establishing both its convergence and convergence rates. The effectiveness of our approach is demonstrated through numerical simulations.</div></div>","PeriodicalId":50227,"journal":{"name":"Journal of Complexity","volume":"87 ","pages":"Article 101920"},"PeriodicalIF":1.8000,"publicationDate":"2024-12-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Complexity","FirstCategoryId":"100","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0885064X24000979","RegionNum":2,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"MATHEMATICS","Score":null,"Total":0}
引用次数: 0
Abstract
In recent years, Nesterov acceleration has been introduced to enhance the efficiency of Landweber iteration for solving ill-posed problems. For linear ill-posed problems in Hilbert spaces, Nesterov acceleration has been analyzed with a discrepancy principle proposed to terminate the iterations. However, the existing approach requires computing residuals along two distinct iterative sequences, resulting in increased computational costs. In this paper, we propose an alternative discrepancy principle for Nesterov acceleration that eliminates the need to compute the residuals for one of the iterative sequences, thereby reducing computational time by approximately one-third per iteration. We provide a convergence analysis of the proposed method, establishing both its convergence and convergence rates. The effectiveness of our approach is demonstrated through numerical simulations.
期刊介绍:
The multidisciplinary Journal of Complexity publishes original research papers that contain substantial mathematical results on complexity as broadly conceived. Outstanding review papers will also be published. In the area of computational complexity, the focus is on complexity over the reals, with the emphasis on lower bounds and optimal algorithms. The Journal of Complexity also publishes articles that provide major new algorithms or make important progress on upper bounds. Other models of computation, such as the Turing machine model, are also of interest. Computational complexity results in a wide variety of areas are solicited.
Areas Include:
• Approximation theory
• Biomedical computing
• Compressed computing and sensing
• Computational finance
• Computational number theory
• Computational stochastics
• Control theory
• Cryptography
• Design of experiments
• Differential equations
• Discrete problems
• Distributed and parallel computation
• High and infinite-dimensional problems
• Information-based complexity
• Inverse and ill-posed problems
• Machine learning
• Markov chain Monte Carlo
• Monte Carlo and quasi-Monte Carlo
• Multivariate integration and approximation
• Noisy data
• Nonlinear and algebraic equations
• Numerical analysis
• Operator equations
• Optimization
• Quantum computing
• Scientific computation
• Tractability of multivariate problems
• Vision and image understanding.