An accelerated distributed method with inexact model of relative smoothness and strong convexity

IF 1.1 4区 工程技术 Q4 ENGINEERING, ELECTRICAL & ELECTRONIC IET Signal Processing Pub Date : 2023-03-29 DOI:10.1049/sil2.12199
Xuexue Zhang, Sanyang Liu, Nannan Zhao
{"title":"An accelerated distributed method with inexact model of relative smoothness and strong convexity","authors":"Xuexue Zhang,&nbsp;Sanyang Liu,&nbsp;Nannan Zhao","doi":"10.1049/sil2.12199","DOIUrl":null,"url":null,"abstract":"<p>Distributed optimisation methods are widely applied in many systems where agents cooperate with each other to minimise a sum-type problem over a connected network. An accelerated distributed method based on the inexact model of relative smoothness and strong convexity is introduced by the authors. The authors demonstrate that the proposed method can converge to the optimal solution at the linear rate <math>\n <semantics>\n <mrow>\n <mfrac>\n <mn>1</mn>\n <msup>\n <mrow>\n <mo>(</mo>\n <mrow>\n <mn>1</mn>\n <mo>+</mo>\n <mn>1</mn>\n <mo>/</mo>\n <mrow>\n <mo>(</mo>\n <mrow>\n <mn>4</mn>\n <msqrt>\n <msub>\n <mi>κ</mi>\n <mi>g</mi>\n </msub>\n </msqrt>\n </mrow>\n <mo>)</mo>\n </mrow>\n </mrow>\n <mo>)</mo>\n </mrow>\n <mn>2</mn>\n </msup>\n </mfrac>\n </mrow>\n <annotation> $\\frac{1}{{(1+1/(4\\sqrt{{\\kappa }_{g}}))}^{2}}$</annotation>\n </semantics></math> and achieve the optimal gradient computation complexity and the near optimal communication complexity, where <i>κ</i><sub><i>g</i></sub> denotes the global condition number. Finally, the numerical experiments are provided to validate the theoretical results and further show the efficacy of the proposed method.</p>","PeriodicalId":56301,"journal":{"name":"IET Signal Processing","volume":null,"pages":null},"PeriodicalIF":1.1000,"publicationDate":"2023-03-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1049/sil2.12199","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IET Signal Processing","FirstCategoryId":"5","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1049/sil2.12199","RegionNum":4,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q4","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0

Abstract

Distributed optimisation methods are widely applied in many systems where agents cooperate with each other to minimise a sum-type problem over a connected network. An accelerated distributed method based on the inexact model of relative smoothness and strong convexity is introduced by the authors. The authors demonstrate that the proposed method can converge to the optimal solution at the linear rate 1 ( 1 + 1 / ( 4 κ g ) ) 2 $\frac{1}{{(1+1/(4\sqrt{{\kappa }_{g}}))}^{2}}$ and achieve the optimal gradient computation complexity and the near optimal communication complexity, where κg denotes the global condition number. Finally, the numerical experiments are provided to validate the theoretical results and further show the efficacy of the proposed method.

Abstract Image

查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
一种具有相对光滑和强凸性的不精确模型的加速分布方法
分布式优化方法广泛应用于许多系统中,其中代理相互协作以最小化连接网络上的和型问题。介绍了一种基于相对光滑和强凸性的不精确模型的加速分布方法。作者证明了所提出的方法可以在线性速率为1时收敛到最优解(1+1/(4κg)2$\frac{1}{(1+1/(4\sqrt{\kappa}_{g}))}^{2}}$,并实现最优梯度计算复杂性和接近最优的通信复杂性,其中κg表示全局条件数。最后,通过数值实验验证了理论结果,进一步验证了该方法的有效性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
IET Signal Processing
IET Signal Processing 工程技术-工程:电子与电气
CiteScore
3.80
自引率
5.90%
发文量
83
审稿时长
9.5 months
期刊介绍: IET Signal Processing publishes research on a diverse range of signal processing and machine learning topics, covering a variety of applications, disciplines, modalities, and techniques in detection, estimation, inference, and classification problems. The research published includes advances in algorithm design for the analysis of single and high-multi-dimensional data, sparsity, linear and non-linear systems, recursive and non-recursive digital filters and multi-rate filter banks, as well a range of topics that span from sensor array processing, deep convolutional neural network based approaches to the application of chaos theory, and far more. Topics covered by scope include, but are not limited to: advances in single and multi-dimensional filter design and implementation linear and nonlinear, fixed and adaptive digital filters and multirate filter banks statistical signal processing techniques and analysis classical, parametric and higher order spectral analysis signal transformation and compression techniques, including time-frequency analysis system modelling and adaptive identification techniques machine learning based approaches to signal processing Bayesian methods for signal processing, including Monte-Carlo Markov-chain and particle filtering techniques theory and application of blind and semi-blind signal separation techniques signal processing techniques for analysis, enhancement, coding, synthesis and recognition of speech signals direction-finding and beamforming techniques for audio and electromagnetic signals analysis techniques for biomedical signals baseband signal processing techniques for transmission and reception of communication signals signal processing techniques for data hiding and audio watermarking sparse signal processing and compressive sensing Special Issue Call for Papers: Intelligent Deep Fuzzy Model for Signal Processing - https://digital-library.theiet.org/files/IET_SPR_CFP_IDFMSP.pdf
期刊最新文献
The Effect of Antenna Place Codes for Reducing Sidelobes of SIAR and Frequency Diverse Array Sensors A Variational Bayesian Truncated Adaptive Filter for Uncertain Systems with Inequality Constraints A Novel Approach of Optimal Signal Streaming Analysis Implicated Supervised Feedforward Neural Networks Energy Sharing and Performance Bounds in MIMO DFRC Systems: A Trade-Off Analysis A Labeled Multi-Bernoulli Filter Based on Maximum Likelihood Recursive Updating
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1