{"title":"Energy-Efficient Personalized Federated Continual Learning on Edge","authors":"Zhao Yang;Haoyang Wang;Qingshuang Sun","doi":"10.1109/LES.2024.3439552","DOIUrl":null,"url":null,"abstract":"Federated learning (FL) on the edge devices must support continual learning (CL) to handle continuously evolving the data and perform the model training in an energy-efficient manner to accommodate the devices with limited computational and energy resources. This letter proposes an energy-efficient personalized federated CL (FCL) framework for the edge devices. The network structure on each device is divided into parts for retaining old knowledge and learning new knowledge, training only part of the model to reduce overhead. A data-free parameter selection approach selects important parameters from the trained model to retain old knowledge. During new task learning, a federated search method determines a resource-adaptive personalized model structure for each device. Experimental results demonstrate that our method can effectively support FCL in an energy-efficient manner on the edge devices.","PeriodicalId":56143,"journal":{"name":"IEEE Embedded Systems Letters","volume":"16 4","pages":"345-348"},"PeriodicalIF":1.7000,"publicationDate":"2024-12-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Embedded Systems Letters","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/10779516/","RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"COMPUTER SCIENCE, HARDWARE & ARCHITECTURE","Score":null,"Total":0}
引用次数: 0
Abstract
Federated learning (FL) on the edge devices must support continual learning (CL) to handle continuously evolving the data and perform the model training in an energy-efficient manner to accommodate the devices with limited computational and energy resources. This letter proposes an energy-efficient personalized federated CL (FCL) framework for the edge devices. The network structure on each device is divided into parts for retaining old knowledge and learning new knowledge, training only part of the model to reduce overhead. A data-free parameter selection approach selects important parameters from the trained model to retain old knowledge. During new task learning, a federated search method determines a resource-adaptive personalized model structure for each device. Experimental results demonstrate that our method can effectively support FCL in an energy-efficient manner on the edge devices.
期刊介绍:
The IEEE Embedded Systems Letters (ESL), provides a forum for rapid dissemination of latest technical advances in embedded systems and related areas in embedded software. The emphasis is on models, methods, and tools that ensure secure, correct, efficient and robust design of embedded systems and their applications.