{"title":"基于gossip的分布式复合优化异步算法","authors":"Xianju Fang, Baoyong Zhang, Deming Yuan","doi":"10.1016/j.neucom.2024.128952","DOIUrl":null,"url":null,"abstract":"<div><div>The distributed composite optimization problem associated a multi-agent network is investigated in this paper. Different from conventional optimization issues, the cost function of composite optimization consists of a convex function and a regularization function (possibly nonsmooth). The gossip protocol is also introduced to enhance the robustness of the network, and a gossip-based distributed composite mirror descent algorithm is presented to deal with the previous problem, which adopts the asynchronous communication method. Moreover, the algorithm performance is analyzed and the theoretical results on the corresponding error bounds are obtained. Finally, the distributed logistic regression is provided as an example to validate the practicability of the proposed algorithm.</div></div>","PeriodicalId":19268,"journal":{"name":"Neurocomputing","volume":"616 ","pages":"Article 128952"},"PeriodicalIF":5.5000,"publicationDate":"2024-11-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Gossip-based asynchronous algorithms for distributed composite optimization\",\"authors\":\"Xianju Fang, Baoyong Zhang, Deming Yuan\",\"doi\":\"10.1016/j.neucom.2024.128952\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>The distributed composite optimization problem associated a multi-agent network is investigated in this paper. Different from conventional optimization issues, the cost function of composite optimization consists of a convex function and a regularization function (possibly nonsmooth). The gossip protocol is also introduced to enhance the robustness of the network, and a gossip-based distributed composite mirror descent algorithm is presented to deal with the previous problem, which adopts the asynchronous communication method. Moreover, the algorithm performance is analyzed and the theoretical results on the corresponding error bounds are obtained. Finally, the distributed logistic regression is provided as an example to validate the practicability of the proposed algorithm.</div></div>\",\"PeriodicalId\":19268,\"journal\":{\"name\":\"Neurocomputing\",\"volume\":\"616 \",\"pages\":\"Article 128952\"},\"PeriodicalIF\":5.5000,\"publicationDate\":\"2024-11-22\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Neurocomputing\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0925231224017235\",\"RegionNum\":2,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Neurocomputing","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0925231224017235","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
Gossip-based asynchronous algorithms for distributed composite optimization
The distributed composite optimization problem associated a multi-agent network is investigated in this paper. Different from conventional optimization issues, the cost function of composite optimization consists of a convex function and a regularization function (possibly nonsmooth). The gossip protocol is also introduced to enhance the robustness of the network, and a gossip-based distributed composite mirror descent algorithm is presented to deal with the previous problem, which adopts the asynchronous communication method. Moreover, the algorithm performance is analyzed and the theoretical results on the corresponding error bounds are obtained. Finally, the distributed logistic regression is provided as an example to validate the practicability of the proposed algorithm.
期刊介绍:
Neurocomputing publishes articles describing recent fundamental contributions in the field of neurocomputing. Neurocomputing theory, practice and applications are the essential topics being covered.