{"title":"Engineering a Lightweight Deep Joint Source-Channel-Coding-Based Semantic Communication System","authors":"Weihan Zhang;Shaohua Wu;Siqi Meng;Jinghang He;Qinyu Zhang","doi":"10.1109/JIOT.2024.3463652","DOIUrl":null,"url":null,"abstract":"Deep joint source-channel coding (DeepJSCC) has emerged as a novel technology in semantic communication, coinciding with the increasing demand for the edge devices in the Internet of Things (IoT). Consequently, the deployment of DeepJSCC on edge devices has become a crucial research direction. However, DeepJSCC faces challenges related to channel fading. Moreover, implementing DeepJSCC on the edge devices poses challenges due to the constrained computational resources as well as the compatibility issue between DeepJSCC and digital systems. In this article, we devote to engineering the DeepJSCC system deployed on the edge devices. First, we propose a method named DeepJSCC with Ensemble learning (DeepJSCC-ES) to resist the channel fading. Then, we present a pruning algorithm called the DeepJSCC signal-to-noise ratio (SNR)-adaptive pruning method (DJSAP) to make the DeepJSCC network lightweight, reducing the computational demands on the edge nodes. Further, we propose a method called the simulated fixed-point quantization training based on soft quantization function (SFPQSQ) to tackle the compatibility issue between DeepJSCC and digital systems. Finally, we deploy the whole DeepJSCC system on the edge devices and conduct experiments to test the DeepJSCC system. The results of simulations show that the proposed DeepJSCC-ES system outperforms the baseline DeepJSCC, particularly excelling in low SNR conditions. Furthermore, the parameter size of the pruned model using DJSAP is compressed by 93.37% while the average structural similarity index metric (SSIM) decreases only by 0.92% compared with the baseline DeepJSCC. Additionally, the SFPQSQ works better than the ordinary quantization methods in tackling the compatibility issue between DeepJSCC and digital systems. The experiment results also show that our proposed system can serve as a feasible solution for practical deployment on the edge devices.","PeriodicalId":54347,"journal":{"name":"IEEE Internet of Things Journal","volume":"12 1","pages":"458-471"},"PeriodicalIF":8.9000,"publicationDate":"2024-09-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Internet of Things Journal","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/10683686/","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, INFORMATION SYSTEMS","Score":null,"Total":0}
引用次数: 0
Abstract
Deep joint source-channel coding (DeepJSCC) has emerged as a novel technology in semantic communication, coinciding with the increasing demand for the edge devices in the Internet of Things (IoT). Consequently, the deployment of DeepJSCC on edge devices has become a crucial research direction. However, DeepJSCC faces challenges related to channel fading. Moreover, implementing DeepJSCC on the edge devices poses challenges due to the constrained computational resources as well as the compatibility issue between DeepJSCC and digital systems. In this article, we devote to engineering the DeepJSCC system deployed on the edge devices. First, we propose a method named DeepJSCC with Ensemble learning (DeepJSCC-ES) to resist the channel fading. Then, we present a pruning algorithm called the DeepJSCC signal-to-noise ratio (SNR)-adaptive pruning method (DJSAP) to make the DeepJSCC network lightweight, reducing the computational demands on the edge nodes. Further, we propose a method called the simulated fixed-point quantization training based on soft quantization function (SFPQSQ) to tackle the compatibility issue between DeepJSCC and digital systems. Finally, we deploy the whole DeepJSCC system on the edge devices and conduct experiments to test the DeepJSCC system. The results of simulations show that the proposed DeepJSCC-ES system outperforms the baseline DeepJSCC, particularly excelling in low SNR conditions. Furthermore, the parameter size of the pruned model using DJSAP is compressed by 93.37% while the average structural similarity index metric (SSIM) decreases only by 0.92% compared with the baseline DeepJSCC. Additionally, the SFPQSQ works better than the ordinary quantization methods in tackling the compatibility issue between DeepJSCC and digital systems. The experiment results also show that our proposed system can serve as a feasible solution for practical deployment on the edge devices.
期刊介绍:
The EEE Internet of Things (IoT) Journal publishes articles and review articles covering various aspects of IoT, including IoT system architecture, IoT enabling technologies, IoT communication and networking protocols such as network coding, and IoT services and applications. Topics encompass IoT's impacts on sensor technologies, big data management, and future internet design for applications like smart cities and smart homes. Fields of interest include IoT architecture such as things-centric, data-centric, service-oriented IoT architecture; IoT enabling technologies and systematic integration such as sensor technologies, big sensor data management, and future Internet design for IoT; IoT services, applications, and test-beds such as IoT service middleware, IoT application programming interface (API), IoT application design, and IoT trials/experiments; IoT standardization activities and technology development in different standard development organizations (SDO) such as IEEE, IETF, ITU, 3GPP, ETSI, etc.