One-Bit Over-the-Air Aggregation for Communication-Efficient Federated Edge Learning

Guangxu Zhu, Yuqing Du, Deniz Gündüz, Kaibin Huang
{"title":"One-Bit Over-the-Air Aggregation for Communication-Efficient Federated Edge Learning","authors":"Guangxu Zhu, Yuqing Du, Deniz Gündüz, Kaibin Huang","doi":"10.1109/GLOBECOM42002.2020.9322334","DOIUrl":null,"url":null,"abstract":"To mitigate the multi-access latency in federated edge learning, an efficient broadband analog transmission scheme has been recently proposed, featuring the aggregation of analog modulated gradients via the waveform-superposition property of the wireless medium. However, the assumed linear analog modulation makes it difficult to deploy this technique in modern wireless systems that exclusively use digital modulation. To address this issue, we propose in this work a novel digital version of broadband over-the-air aggregation, called one-bit broadband digital aggregation. The new scheme features one-bit gradient quantization followed by digital modulation at the edge devices and a simple threshold-based decoding at the edge server. We develop a comprehensive analysis framework for quantifying the effects of wireless channel hostilities (channel noise and fading) on the convergence rate. The analysis shows that the hostilities slow down the convergence of the learning process by introducing a scaling factor and a bias term into the gradient norm. However, all the negative effects vanish as the number of devices grows, but at a different rate for each type of channel hostility.","PeriodicalId":12759,"journal":{"name":"GLOBECOM 2020 - 2020 IEEE Global Communications Conference","volume":"6 1","pages":"1-6"},"PeriodicalIF":0.0000,"publicationDate":"2020-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"3","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"GLOBECOM 2020 - 2020 IEEE Global Communications Conference","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/GLOBECOM42002.2020.9322334","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 3

Abstract

To mitigate the multi-access latency in federated edge learning, an efficient broadband analog transmission scheme has been recently proposed, featuring the aggregation of analog modulated gradients via the waveform-superposition property of the wireless medium. However, the assumed linear analog modulation makes it difficult to deploy this technique in modern wireless systems that exclusively use digital modulation. To address this issue, we propose in this work a novel digital version of broadband over-the-air aggregation, called one-bit broadband digital aggregation. The new scheme features one-bit gradient quantization followed by digital modulation at the edge devices and a simple threshold-based decoding at the edge server. We develop a comprehensive analysis framework for quantifying the effects of wireless channel hostilities (channel noise and fading) on the convergence rate. The analysis shows that the hostilities slow down the convergence of the learning process by introducing a scaling factor and a bias term into the gradient norm. However, all the negative effects vanish as the number of devices grows, but at a different rate for each type of channel hostility.
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
用于通信高效的联邦边缘学习的位无线聚合
为了减轻联邦边缘学习中的多址延迟,最近提出了一种高效的宽带模拟传输方案,该方案利用无线介质的波形叠加特性聚合模拟调制梯度。然而,假设的线性模拟调制使得该技术难以在专门使用数字调制的现代无线系统中部署。为了解决这个问题,我们在这项工作中提出了一种新的宽带无线聚合的数字版本,称为一位宽带数字聚合。新方案的特点是在边缘设备上进行1位梯度量化,然后进行数字调制,在边缘服务器上进行简单的基于阈值的解码。我们开发了一个全面的分析框架,用于量化无线信道敌对(信道噪声和衰落)对收敛速率的影响。分析表明,敌对状态通过在梯度范数中引入比例因子和偏差项,减缓了学习过程的收敛速度。然而,随着设备数量的增加,所有的负面影响都会消失,但每种渠道敌意的速度不同。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
自引率
0.00%
发文量
0
期刊最新文献
AirID: Injecting a Custom RF Fingerprint for Enhanced UAV Identification using Deep Learning Oversampling Algorithm based on Reinforcement Learning in Imbalanced Problems FAST-RAM: A Fast AI-assistant Solution for Task Offloading and Resource Allocation in MEC Achieving Privacy-Preserving Vehicle Selection for Effective Content Dissemination in Smart Cities Age-optimal Transmission Policy for Markov Source with Differential Encoding
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1