联邦边缘学习中抑制不公平能源消耗和偏差模型的新方法

IF 5.3 2区 计算机科学 Q1 TELECOMMUNICATIONS IEEE Transactions on Green Communications and Networking Pub Date : 2024-01-08 DOI:10.1109/TGCN.2024.3350735
Abdullatif Albaseer;Abegaz Mohammed Seid;Mohamed Abdallah;Ala Al-Fuqaha;Aiman Erbad
{"title":"联邦边缘学习中抑制不公平能源消耗和偏差模型的新方法","authors":"Abdullatif Albaseer;Abegaz Mohammed Seid;Mohamed Abdallah;Ala Al-Fuqaha;Aiman Erbad","doi":"10.1109/TGCN.2024.3350735","DOIUrl":null,"url":null,"abstract":"Researchers and practitioners have recently shown interest in deploying federated learning for enhanced privacy preservation in wireless edge networks. In such settings, resource-constrained user equipment (UE) often experiences unfair energy consumption and performance degradation of machine learning models due to data heterogeneity and constrained computation and communication resources. Several approaches have been proposed in the literature to reduce energy consumption, including scheduling a subset of UEs to undertake learning tasks based on their energy budgets. However, these approaches are inherently unfair as the frequently selected UEs rapidly deplete their energy and are rendered inaccessible. Furthermore, the server may be unable to capture the incongruent data distribution, resulting in a biased model. In this paper, we propose a novel approach that addresses those challenges, considering the historical participation of the UEs to ensure that all the training data of the UEs are incorporated into the global model. Specifically, using Jain’s fairness index, we formulate the overall optimization problem, decompose it into two sub-problems, and iteratively solve the sub-problems. Towards this end, we partition the optimization variables into two-blocks; one on the server-side and another on the UEs’ side. The server-side algorithm aims to balance energy usage and learning performance, while the client-side algorithm seeks to optimize CPU frequency and transmit power. Extensive experiments using two realistic datasets, FEMNIST and CIFAR-10, indicate that the proposed algorithms minimize overall energy while curbing unfair energy consumption between the UEs, accelerating convergence rates, and significantly enhancing local accuracy for all UEs.","PeriodicalId":13052,"journal":{"name":"IEEE Transactions on Green Communications and Networking","volume":null,"pages":null},"PeriodicalIF":5.3000,"publicationDate":"2024-01-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Novel Approach for Curbing Unfair Energy Consumption and Biased Model in Federated Edge Learning\",\"authors\":\"Abdullatif Albaseer;Abegaz Mohammed Seid;Mohamed Abdallah;Ala Al-Fuqaha;Aiman Erbad\",\"doi\":\"10.1109/TGCN.2024.3350735\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Researchers and practitioners have recently shown interest in deploying federated learning for enhanced privacy preservation in wireless edge networks. In such settings, resource-constrained user equipment (UE) often experiences unfair energy consumption and performance degradation of machine learning models due to data heterogeneity and constrained computation and communication resources. Several approaches have been proposed in the literature to reduce energy consumption, including scheduling a subset of UEs to undertake learning tasks based on their energy budgets. However, these approaches are inherently unfair as the frequently selected UEs rapidly deplete their energy and are rendered inaccessible. Furthermore, the server may be unable to capture the incongruent data distribution, resulting in a biased model. In this paper, we propose a novel approach that addresses those challenges, considering the historical participation of the UEs to ensure that all the training data of the UEs are incorporated into the global model. Specifically, using Jain’s fairness index, we formulate the overall optimization problem, decompose it into two sub-problems, and iteratively solve the sub-problems. Towards this end, we partition the optimization variables into two-blocks; one on the server-side and another on the UEs’ side. The server-side algorithm aims to balance energy usage and learning performance, while the client-side algorithm seeks to optimize CPU frequency and transmit power. Extensive experiments using two realistic datasets, FEMNIST and CIFAR-10, indicate that the proposed algorithms minimize overall energy while curbing unfair energy consumption between the UEs, accelerating convergence rates, and significantly enhancing local accuracy for all UEs.\",\"PeriodicalId\":13052,\"journal\":{\"name\":\"IEEE Transactions on Green Communications and Networking\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":5.3000,\"publicationDate\":\"2024-01-08\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Transactions on Green Communications and Networking\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10382668/\",\"RegionNum\":2,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"TELECOMMUNICATIONS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Green Communications and Networking","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/10382668/","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"TELECOMMUNICATIONS","Score":null,"Total":0}
引用次数: 0

摘要

最近,研究人员和从业人员对在无线边缘网络中部署联合学习以加强隐私保护表现出了浓厚的兴趣。在这种情况下,资源受限的用户设备(UE)往往会因为数据异构、计算和通信资源受限而导致不公平的能耗和机器学习模型的性能下降。文献中提出了几种降低能耗的方法,包括根据 UE 的能耗预算调度其子集来执行学习任务。然而,这些方法本质上是不公平的,因为经常被选中的 UE 会迅速耗尽能量而无法访问。此外,服务器可能无法捕捉到不一致的数据分布,从而导致模型出现偏差。在本文中,我们提出了一种新方法来应对这些挑战,即考虑 UE 的历史参与情况,确保将 UE 的所有训练数据纳入全局模型。具体来说,我们使用 Jain 的公平性指数来制定整体优化问题,将其分解为两个子问题,并对子问题进行迭代求解。为此,我们将优化变量分为两块:一块在服务器端,另一块在 UE 端。服务器端算法旨在平衡能源使用和学习性能,而客户端算法旨在优化 CPU 频率和发射功率。使用 FEMNIST 和 CIFAR-10 这两个现实数据集进行的广泛实验表明,所提出的算法最大限度地降低了总体能耗,同时抑制了 UE 之间不公平的能耗,加快了收敛速度,并显著提高了所有 UE 的局部准确性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
Novel Approach for Curbing Unfair Energy Consumption and Biased Model in Federated Edge Learning
Researchers and practitioners have recently shown interest in deploying federated learning for enhanced privacy preservation in wireless edge networks. In such settings, resource-constrained user equipment (UE) often experiences unfair energy consumption and performance degradation of machine learning models due to data heterogeneity and constrained computation and communication resources. Several approaches have been proposed in the literature to reduce energy consumption, including scheduling a subset of UEs to undertake learning tasks based on their energy budgets. However, these approaches are inherently unfair as the frequently selected UEs rapidly deplete their energy and are rendered inaccessible. Furthermore, the server may be unable to capture the incongruent data distribution, resulting in a biased model. In this paper, we propose a novel approach that addresses those challenges, considering the historical participation of the UEs to ensure that all the training data of the UEs are incorporated into the global model. Specifically, using Jain’s fairness index, we formulate the overall optimization problem, decompose it into two sub-problems, and iteratively solve the sub-problems. Towards this end, we partition the optimization variables into two-blocks; one on the server-side and another on the UEs’ side. The server-side algorithm aims to balance energy usage and learning performance, while the client-side algorithm seeks to optimize CPU frequency and transmit power. Extensive experiments using two realistic datasets, FEMNIST and CIFAR-10, indicate that the proposed algorithms minimize overall energy while curbing unfair energy consumption between the UEs, accelerating convergence rates, and significantly enhancing local accuracy for all UEs.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
IEEE Transactions on Green Communications and Networking
IEEE Transactions on Green Communications and Networking Computer Science-Computer Networks and Communications
CiteScore
9.30
自引率
6.20%
发文量
181
期刊最新文献
Table of Contents Guest Editorial Special Issue on Green Open Radio Access Networks: Architecture, Challenges, Opportunities, and Use Cases IEEE Transactions on Green Communications and Networking IEEE Communications Society Information HSADR: A New Highly Secure Aggregation and Dropout-Resilient Federated Learning Scheme for Radio Access Networks With Edge Computing Systems
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1