Li Zeng;Dingzhu Wen;Guangxu Zhu;Changsheng You;Qimei Chen;Yuanming Shi
{"title":"利用能量收集设备进行联合学习","authors":"Li Zeng;Dingzhu Wen;Guangxu Zhu;Changsheng You;Qimei Chen;Yuanming Shi","doi":"10.1109/TGCN.2023.3310569","DOIUrl":null,"url":null,"abstract":"Federated learning (FL) is a promising technique for distilling artificial intelligence from massive data distributed in Internet-of-Things networks, while keeping data privacy. However, the efficient deployment of FL faces several challenges due to, e.g., limited radio resources, computation capabilities, and battery lives of Internet-of-Things devices. To address these challenges, in this work, the energy harvesting technique is first enabled on Internet-of-Things devices for supporting their sustainable lifelong learning. Then, the convergence rate of the FL algorithm is derived, which is shown to depend on the data utility (defined as the number of used training samples) in each training iteration. Thus, to accelerate the convergence rate and reduce the training latency, a data utility maximization problem for each iteration is formulated, under several practical constraints on the limited time, bandwidth (i.e., number of subcarriers), computation frequency, and energy supply. The problem is mixed-integer and non-convex, and hence NP-hard. To solve the problem, an optimal joint device selection and resource allocation (JDSRA) scheme is proposed. In this scheme, a distributed on-device resource allocation problem is first solved to determine the minimum required number of subcarriers for each device, followed by a dynamic programming approach for attaining the optimal device selection policy. In particular, no global channel state information (CSI) sharing is needed to execute the scheme. Finally, extensive experiments are presented to demonstrate the performance of the proposed optimal algorithm.","PeriodicalId":13052,"journal":{"name":"IEEE Transactions on Green Communications and Networking","volume":"8 1","pages":"190-204"},"PeriodicalIF":5.3000,"publicationDate":"2023-08-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Federated Learning With Energy Harvesting Devices\",\"authors\":\"Li Zeng;Dingzhu Wen;Guangxu Zhu;Changsheng You;Qimei Chen;Yuanming Shi\",\"doi\":\"10.1109/TGCN.2023.3310569\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Federated learning (FL) is a promising technique for distilling artificial intelligence from massive data distributed in Internet-of-Things networks, while keeping data privacy. However, the efficient deployment of FL faces several challenges due to, e.g., limited radio resources, computation capabilities, and battery lives of Internet-of-Things devices. To address these challenges, in this work, the energy harvesting technique is first enabled on Internet-of-Things devices for supporting their sustainable lifelong learning. Then, the convergence rate of the FL algorithm is derived, which is shown to depend on the data utility (defined as the number of used training samples) in each training iteration. Thus, to accelerate the convergence rate and reduce the training latency, a data utility maximization problem for each iteration is formulated, under several practical constraints on the limited time, bandwidth (i.e., number of subcarriers), computation frequency, and energy supply. The problem is mixed-integer and non-convex, and hence NP-hard. To solve the problem, an optimal joint device selection and resource allocation (JDSRA) scheme is proposed. In this scheme, a distributed on-device resource allocation problem is first solved to determine the minimum required number of subcarriers for each device, followed by a dynamic programming approach for attaining the optimal device selection policy. In particular, no global channel state information (CSI) sharing is needed to execute the scheme. Finally, extensive experiments are presented to demonstrate the performance of the proposed optimal algorithm.\",\"PeriodicalId\":13052,\"journal\":{\"name\":\"IEEE Transactions on Green Communications and Networking\",\"volume\":\"8 1\",\"pages\":\"190-204\"},\"PeriodicalIF\":5.3000,\"publicationDate\":\"2023-08-31\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Transactions on Green Communications and Networking\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10236499/\",\"RegionNum\":2,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"TELECOMMUNICATIONS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Green Communications and Networking","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/10236499/","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"TELECOMMUNICATIONS","Score":null,"Total":0}
Federated learning (FL) is a promising technique for distilling artificial intelligence from massive data distributed in Internet-of-Things networks, while keeping data privacy. However, the efficient deployment of FL faces several challenges due to, e.g., limited radio resources, computation capabilities, and battery lives of Internet-of-Things devices. To address these challenges, in this work, the energy harvesting technique is first enabled on Internet-of-Things devices for supporting their sustainable lifelong learning. Then, the convergence rate of the FL algorithm is derived, which is shown to depend on the data utility (defined as the number of used training samples) in each training iteration. Thus, to accelerate the convergence rate and reduce the training latency, a data utility maximization problem for each iteration is formulated, under several practical constraints on the limited time, bandwidth (i.e., number of subcarriers), computation frequency, and energy supply. The problem is mixed-integer and non-convex, and hence NP-hard. To solve the problem, an optimal joint device selection and resource allocation (JDSRA) scheme is proposed. In this scheme, a distributed on-device resource allocation problem is first solved to determine the minimum required number of subcarriers for each device, followed by a dynamic programming approach for attaining the optimal device selection policy. In particular, no global channel state information (CSI) sharing is needed to execute the scheme. Finally, extensive experiments are presented to demonstrate the performance of the proposed optimal algorithm.