Learner Referral for Cost-Effective Federated Learning Over Hierarchical IoT Networks

IF 7 1区 计算机科学 Q1 TELECOMMUNICATIONS IEEE Transactions on Cognitive Communications and Networking Pub Date : 2024-10-14 DOI:10.1109/TCCN.2024.3480053
Yulan Gao;Ziqiang Ye;Yue Xiao;Ming Xiao;Wei Xiang
{"title":"Learner Referral for Cost-Effective Federated Learning Over Hierarchical IoT Networks","authors":"Yulan Gao;Ziqiang Ye;Yue Xiao;Ming Xiao;Wei Xiang","doi":"10.1109/TCCN.2024.3480053","DOIUrl":null,"url":null,"abstract":"Addressing data privacy concerns, Federated Learning (FL) has been recognized for its ability to train parameters locally on resource-constrained clients in a distributed manner. However, the problem of optimization of FL client selection and resource allocation in hierarchical Internet of Things (HieIoT) networks, where clients move in and out of each others’ D2D communication coverage and no FL server knows all the data owners, remains open. To bridge this gap, we propose a learner referral aided federated client selection (LRef-FedCS) approach, complemented by communications and computing resource scheduling, along with local model accuracy optimization (LMAO). LRef-FedCS enhances cost efficiency and FL model quality by enabling data owners to share FL task details within their trusted local networks, increasing the opportunity of the FL server choosing the optimal clients. Using Lyapunov optimization, the problem is transformed into a joint optimization problem (JOP). To address the JOP’s complexities, we combine a centralized method for LRef-FedCS and the self-adaptive global best harmony search algorithm for LMAO. For enhance scalability, a distributed LRef-FedCS based on a matching game is proposed. Numerical experiments on the Fashion-MNIST dataset show LRef-FedCS outperforms existing state-of-the-art approaches, delivering enhanced model accuracy with notable cost savings.","PeriodicalId":13069,"journal":{"name":"IEEE Transactions on Cognitive Communications and Networking","volume":"11 3","pages":"1830-1844"},"PeriodicalIF":7.0000,"publicationDate":"2024-10-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Cognitive Communications and Networking","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/10716547/","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"TELECOMMUNICATIONS","Score":null,"Total":0}
引用次数: 0

Abstract

Addressing data privacy concerns, Federated Learning (FL) has been recognized for its ability to train parameters locally on resource-constrained clients in a distributed manner. However, the problem of optimization of FL client selection and resource allocation in hierarchical Internet of Things (HieIoT) networks, where clients move in and out of each others’ D2D communication coverage and no FL server knows all the data owners, remains open. To bridge this gap, we propose a learner referral aided federated client selection (LRef-FedCS) approach, complemented by communications and computing resource scheduling, along with local model accuracy optimization (LMAO). LRef-FedCS enhances cost efficiency and FL model quality by enabling data owners to share FL task details within their trusted local networks, increasing the opportunity of the FL server choosing the optimal clients. Using Lyapunov optimization, the problem is transformed into a joint optimization problem (JOP). To address the JOP’s complexities, we combine a centralized method for LRef-FedCS and the self-adaptive global best harmony search algorithm for LMAO. For enhance scalability, a distributed LRef-FedCS based on a matching game is proposed. Numerical experiments on the Fashion-MNIST dataset show LRef-FedCS outperforms existing state-of-the-art approaches, delivering enhanced model accuracy with notable cost savings.
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
通过分层物联网网络推荐学习者,实现经济高效的联盟学习
为了解决数据隐私问题,联邦学习(FL)以分布式方式在资源受限的客户端上本地训练参数的能力得到了认可。然而,在分层物联网(HieIoT)网络中,客户端在彼此的D2D通信覆盖范围内进出,并且FL服务器不知道所有数据所有者的情况下,FL客户端选择和资源分配的优化问题仍然存在。为了弥补这一差距,我们提出了一种学习者推荐辅助联邦客户选择(lref - fedc)方法,辅以通信和计算资源调度,以及局部模型精度优化(LMAO)。lref - fedc使数据所有者能够在可信的本地网络中共享FL任务细节,从而提高了成本效率和FL模型质量,增加了FL服务器选择最佳客户端的机会。利用李雅普诺夫优化,将该问题转化为一个联合优化问题(JOP)。为了解决JOP的复杂性,我们结合了lref - fedc的集中式方法和LMAO的自适应全局最佳和谐搜索算法。为了提高可扩展性,提出了一种基于匹配博弈的分布式lref - fedc。Fashion-MNIST数据集上的数值实验表明,lref - fedc优于现有的最先进的方法,在显著节省成本的同时提高了模型精度。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
IEEE Transactions on Cognitive Communications and Networking
IEEE Transactions on Cognitive Communications and Networking Computer Science-Artificial Intelligence
CiteScore
15.50
自引率
7.00%
发文量
108
期刊介绍: The IEEE Transactions on Cognitive Communications and Networking (TCCN) aims to publish high-quality manuscripts that push the boundaries of cognitive communications and networking research. Cognitive, in this context, refers to the application of perception, learning, reasoning, memory, and adaptive approaches in communication system design. The transactions welcome submissions that explore various aspects of cognitive communications and networks, focusing on innovative and holistic approaches to complex system design. Key topics covered include architecture, protocols, cross-layer design, and cognition cycle design for cognitive networks. Additionally, research on machine learning, artificial intelligence, end-to-end and distributed intelligence, software-defined networking, cognitive radios, spectrum sharing, and security and privacy issues in cognitive networks are of interest. The publication also encourages papers addressing novel services and applications enabled by these cognitive concepts.
期刊最新文献
PreNS: A Hybrid Predictive and Real-Time Resource Allocation Framework for 5G and beyond RAN Network Slicing TSS-LCD: A Temporal-Spectral-Spatial Guided Latent Conditional Diffusion Model for Spectrum Prediction Under Incomplete Observations Satellite-Cellular Coexistence in FR3 via Hybrid True-Time-Delay Array Based Nulling Semantic Radio Access Networks: Architecture, State-of-the-Art, and Future Directions Generative AI Agent Empowered Power Allocation for HAP Propulsion and Communication Systems
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1