{"title":"FlexGen: Efficient On-Demand Generative AI Service With Flexible Diffusion Model in Mobile Edge Networks","authors":"Peichun Li;Huanyu Dong;Liping Qian;Sheng Zhou;Yuan Wu","doi":"10.1109/TCCN.2024.3522084","DOIUrl":null,"url":null,"abstract":"Generative artificial intelligence (AI) in edge networks has excelled in delivering human-level creative services close to the end users. However, providing customized intelligence services to a wide range of end clients remains challenging due to the diverse demands of edge applications. In this paper, we present FlexGen, an efficient generative AI framework with flexible diffusion models, to tailor the intelligence service for different client-side requests under diverse quality and efficiency constraints. To this end, we first design and train a flexible diffusion model to support quality-and-cost adjustable image synthesis. After that, we focus on the server-side energy minimization problem subject to the quality level of generative service and the client-side latency constraint. We further theoretically characterize the relationship between the width of the diffusion model and the expected quality of the synthetic image. Following that, the decomposition solution is applied to optimize the generative service, where the image synthesis strategy and resource allocation policy are personalized for different client-side requests. Experiments indicate that, compared to existing image generation schemes, our framework can save up to two times energy consumption without sacrificing the quality of the service.","PeriodicalId":13069,"journal":{"name":"IEEE Transactions on Cognitive Communications and Networking","volume":"11 2","pages":"961-973"},"PeriodicalIF":7.0000,"publicationDate":"2024-12-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Cognitive Communications and Networking","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/10813021/","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"TELECOMMUNICATIONS","Score":null,"Total":0}
引用次数: 0
Abstract
Generative artificial intelligence (AI) in edge networks has excelled in delivering human-level creative services close to the end users. However, providing customized intelligence services to a wide range of end clients remains challenging due to the diverse demands of edge applications. In this paper, we present FlexGen, an efficient generative AI framework with flexible diffusion models, to tailor the intelligence service for different client-side requests under diverse quality and efficiency constraints. To this end, we first design and train a flexible diffusion model to support quality-and-cost adjustable image synthesis. After that, we focus on the server-side energy minimization problem subject to the quality level of generative service and the client-side latency constraint. We further theoretically characterize the relationship between the width of the diffusion model and the expected quality of the synthetic image. Following that, the decomposition solution is applied to optimize the generative service, where the image synthesis strategy and resource allocation policy are personalized for different client-side requests. Experiments indicate that, compared to existing image generation schemes, our framework can save up to two times energy consumption without sacrificing the quality of the service.
期刊介绍:
The IEEE Transactions on Cognitive Communications and Networking (TCCN) aims to publish high-quality manuscripts that push the boundaries of cognitive communications and networking research. Cognitive, in this context, refers to the application of perception, learning, reasoning, memory, and adaptive approaches in communication system design. The transactions welcome submissions that explore various aspects of cognitive communications and networks, focusing on innovative and holistic approaches to complex system design. Key topics covered include architecture, protocols, cross-layer design, and cognition cycle design for cognitive networks. Additionally, research on machine learning, artificial intelligence, end-to-end and distributed intelligence, software-defined networking, cognitive radios, spectrum sharing, and security and privacy issues in cognitive networks are of interest. The publication also encourages papers addressing novel services and applications enabled by these cognitive concepts.