Low-precision deep-learning-based automatic modulation recognition system

Satish Kumar, Aakash Agarwal, Neeraj Varshney, Rajarshi Mahapatra
{"title":"Low-precision deep-learning-based automatic modulation recognition system","authors":"Satish Kumar, Aakash Agarwal, Neeraj Varshney, Rajarshi Mahapatra","doi":"10.52953/ctyj2699","DOIUrl":null,"url":null,"abstract":"Convolution Neural Network (CNN)-based deep learning models have recently been employed in Automated Modulation Classification (AMC) systems, with excellent results. However, hardware deployment of these CNN-based AMC models is very difficult due to their large size, floating point weights and activations, and real-time processing requirements in hardware such as Field Programmable Gate Arrays (FPGAs). In this study, we designed CNN-based AMC techniques for complex-valued temporal radio signal domains and made them less complex with a small memory footprint for FPGA implementation. This work mainly focuses on quantized CNN, low precision mathematics, and quantization-aware CNN training to overcome the problem of larger model sizes, floating-point weights, and activations. Low precision weights, activations, and quantized CNN, on the other hand, have a considerable impact on the accuracy of the model. Thus, we propose an iterative pruning-based training mechanism to maintain the overall accuracy above a certain threshold while decreasing the model size for hardware implementation. The proposed schemes are 21.55 times less complex and achieve at least 1.6% higher accuracy than the baseline. Moreover, results show that our convolution layer-based Quantized Modulation Classification Network (QMCNet) with pruning has 92.01% less multiply-accumulate bit operations (bit_operations), 61.39% less activation bits, and 87.58% less weight bits than the 8 bit quantized baseline model whereas the quantized and pruned Residual-Unit based model (RUNet) has 95.36% less bit_operations, 29.97% less activation bits and 98.22% less weight bits than the 8 bit quantized baseline model.","PeriodicalId":274720,"journal":{"name":"ITU Journal on Future and Evolving Technologies","volume":"197 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-09-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"ITU Journal on Future and Evolving Technologies","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.52953/ctyj2699","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

Convolution Neural Network (CNN)-based deep learning models have recently been employed in Automated Modulation Classification (AMC) systems, with excellent results. However, hardware deployment of these CNN-based AMC models is very difficult due to their large size, floating point weights and activations, and real-time processing requirements in hardware such as Field Programmable Gate Arrays (FPGAs). In this study, we designed CNN-based AMC techniques for complex-valued temporal radio signal domains and made them less complex with a small memory footprint for FPGA implementation. This work mainly focuses on quantized CNN, low precision mathematics, and quantization-aware CNN training to overcome the problem of larger model sizes, floating-point weights, and activations. Low precision weights, activations, and quantized CNN, on the other hand, have a considerable impact on the accuracy of the model. Thus, we propose an iterative pruning-based training mechanism to maintain the overall accuracy above a certain threshold while decreasing the model size for hardware implementation. The proposed schemes are 21.55 times less complex and achieve at least 1.6% higher accuracy than the baseline. Moreover, results show that our convolution layer-based Quantized Modulation Classification Network (QMCNet) with pruning has 92.01% less multiply-accumulate bit operations (bit_operations), 61.39% less activation bits, and 87.58% less weight bits than the 8 bit quantized baseline model whereas the quantized and pruned Residual-Unit based model (RUNet) has 95.36% less bit_operations, 29.97% less activation bits and 98.22% less weight bits than the 8 bit quantized baseline model.
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
基于低精度深度学习的自动调制识别系统
基于卷积神经网络(CNN)的深度学习模型最近被应用于自动调制分类(AMC)系统中,并取得了良好的效果。然而,这些基于cnn的AMC模型的硬件部署非常困难,因为它们体积大,浮点权值和激活,以及现场可编程门阵列(fpga)等硬件的实时处理要求。在本研究中,我们设计了基于cnn的复杂时域无线电信号域AMC技术,并使其不那么复杂,并且具有较小的FPGA实现内存占用。这项工作主要集中在量化CNN、低精度数学和量化感知CNN训练上,以克服更大的模型尺寸、浮点权值和激活问题。另一方面,低精度权重、激活和量化CNN对模型的准确性有相当大的影响。因此,我们提出了一种基于迭代剪枝的训练机制,在减少硬件实现的模型尺寸的同时保持总体精度在一定阈值以上。所提方案的复杂性降低了21.55倍,精度比基线至少提高了1.6%。此外,结果表明,与8位量化基线模型相比,经过修剪的基于卷积层的量化调制分类网络(QMCNet)的乘累积比特操作(bit_operations)减少了92.01%,激活比特减少了61.39%,权重比特减少了87.58%;与8位量化基线模型相比,经过修剪的基于剩余单元的量化模型(RUNet)的bit_operations减少了95.36%,激活比特减少了29.97%,权重比特减少了98.22%。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
自引率
0.00%
发文量
0
期刊最新文献
Galor: Global view assisted localized fine-grained routing for LEO satellite networks Cognitive radio network architecture for GEO and LEO satellites shared downlink spectrum Adaptive multibeam hopping in geo satellite networks with non-uniformly distributed ground users A review: Performance of multibeam dual parabolic cylindrical reflector antennas in LEO satellites Two-ray channel models with doppler effects for LEO satellite communications
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1