通过预测器辅助 NSGA-III 实现高效神经网络,用于物联网异常流量检测

IF 7.4 1区 计算机科学 Q1 TELECOMMUNICATIONS IEEE Transactions on Cognitive Communications and Networking Pub Date : 2024-01-18 DOI:10.1109/TCCN.2024.3355433
Xinlei Wang;Mingshu He;Jiaxuan Wang;Xiaojuan Wang
{"title":"通过预测器辅助 NSGA-III 实现高效神经网络,用于物联网异常流量检测","authors":"Xinlei Wang;Mingshu He;Jiaxuan Wang;Xiaojuan Wang","doi":"10.1109/TCCN.2024.3355433","DOIUrl":null,"url":null,"abstract":"Edge computing enhances intrusion detection by extending its reach to smaller Internet of Things (IoT) devices and edge nodes, improving real-time detection and data privacy. However, due to the limited processing power and storage of edge nodes, lightweight models with high detection accuracy are urgently needed. The Neural Architecture Search (NAS) technique based on multi-objective genetic algorithms can simultaneously balance model complexity and performance, thus automatically designing models for fast and accurate detection. However, NAS requires training each model from scratch during the optimization process to obtain its detection accuracy as one of the fitness evaluation criteria. To address this limitation, we propose an efficient predictor-assisted NSGA-III algorithm. It uses proxy models to swiftly predict architecture accuracy, eliminating the need for complete training and greatly improving optimization efficiency. Furthermore, we have designed an innovative search space that allows for the reduction of internal channels and output feature map dimensions within the model, resulting in the creation of lightweight models with minimal impact on classification performance. The proposed method is validated by searching a narrower Pareto-optimal model of the competitive F1 score of 95.17% with 38.10 MB FLOPs on the UNSW-NB15 dataset. By adding a predictor, the number of optimizations per iteration increased, leading to faster convergence. Additionally, when comparing the search spaces before and after our design in the most complex structure (with 7 cells), the model’s classification error rate increased from 4.31% to 4.36%, while the FLOPs decreased from 271.13MB to 186.9MB.","PeriodicalId":13069,"journal":{"name":"IEEE Transactions on Cognitive Communications and Networking","volume":"10 3","pages":"982-995"},"PeriodicalIF":7.4000,"publicationDate":"2024-01-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Toward Efficient Neural Networks Through Predictor-Assisted NSGA-III for Anomaly Traffic Detection of IoT\",\"authors\":\"Xinlei Wang;Mingshu He;Jiaxuan Wang;Xiaojuan Wang\",\"doi\":\"10.1109/TCCN.2024.3355433\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Edge computing enhances intrusion detection by extending its reach to smaller Internet of Things (IoT) devices and edge nodes, improving real-time detection and data privacy. However, due to the limited processing power and storage of edge nodes, lightweight models with high detection accuracy are urgently needed. The Neural Architecture Search (NAS) technique based on multi-objective genetic algorithms can simultaneously balance model complexity and performance, thus automatically designing models for fast and accurate detection. However, NAS requires training each model from scratch during the optimization process to obtain its detection accuracy as one of the fitness evaluation criteria. To address this limitation, we propose an efficient predictor-assisted NSGA-III algorithm. It uses proxy models to swiftly predict architecture accuracy, eliminating the need for complete training and greatly improving optimization efficiency. Furthermore, we have designed an innovative search space that allows for the reduction of internal channels and output feature map dimensions within the model, resulting in the creation of lightweight models with minimal impact on classification performance. The proposed method is validated by searching a narrower Pareto-optimal model of the competitive F1 score of 95.17% with 38.10 MB FLOPs on the UNSW-NB15 dataset. By adding a predictor, the number of optimizations per iteration increased, leading to faster convergence. Additionally, when comparing the search spaces before and after our design in the most complex structure (with 7 cells), the model’s classification error rate increased from 4.31% to 4.36%, while the FLOPs decreased from 271.13MB to 186.9MB.\",\"PeriodicalId\":13069,\"journal\":{\"name\":\"IEEE Transactions on Cognitive Communications and Networking\",\"volume\":\"10 3\",\"pages\":\"982-995\"},\"PeriodicalIF\":7.4000,\"publicationDate\":\"2024-01-18\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Transactions on Cognitive Communications and Networking\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10403928/\",\"RegionNum\":1,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"TELECOMMUNICATIONS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Cognitive Communications and Networking","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/10403928/","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"TELECOMMUNICATIONS","Score":null,"Total":0}
引用次数: 0

摘要

边缘计算通过将其覆盖范围扩展到较小的物联网(IoT)设备和边缘节点,提高了入侵检测的实时性和数据私密性。然而,由于边缘节点的处理能力和存储能力有限,迫切需要具有高检测精度的轻量级模型。基于多目标遗传算法的神经架构搜索(NAS)技术可以同时兼顾模型的复杂性和性能,从而自动设计出快速准确的检测模型。然而,NAS 需要在优化过程中从头开始训练每个模型,以获得其检测准确性作为适应性评价标准之一。针对这一局限性,我们提出了一种高效的预测辅助 NSGA-III 算法。该算法使用代理模型来快速预测架构的准确性,从而省去了完整的训练过程,大大提高了优化效率。此外,我们还设计了一个创新的搜索空间,可以减少模型内部通道和输出特征图的维度,从而创建对分类性能影响最小的轻量级模型。通过在 UNSW-NB15 数据集上搜索具有竞争力的 F1 分数为 95.17%、FLOP 为 38.10 MB 的较窄帕累托最优模型,验证了所提出的方法。通过添加预测器,每次迭代的优化次数增加,从而加快了收敛速度。此外,在最复杂的结构(7 个单元)中,比较我们设计前后的搜索空间,模型的分类错误率从 4.31% 增加到 4.36%,而 FLOP 从 271.13MB 减少到 186.9MB。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
Toward Efficient Neural Networks Through Predictor-Assisted NSGA-III for Anomaly Traffic Detection of IoT
Edge computing enhances intrusion detection by extending its reach to smaller Internet of Things (IoT) devices and edge nodes, improving real-time detection and data privacy. However, due to the limited processing power and storage of edge nodes, lightweight models with high detection accuracy are urgently needed. The Neural Architecture Search (NAS) technique based on multi-objective genetic algorithms can simultaneously balance model complexity and performance, thus automatically designing models for fast and accurate detection. However, NAS requires training each model from scratch during the optimization process to obtain its detection accuracy as one of the fitness evaluation criteria. To address this limitation, we propose an efficient predictor-assisted NSGA-III algorithm. It uses proxy models to swiftly predict architecture accuracy, eliminating the need for complete training and greatly improving optimization efficiency. Furthermore, we have designed an innovative search space that allows for the reduction of internal channels and output feature map dimensions within the model, resulting in the creation of lightweight models with minimal impact on classification performance. The proposed method is validated by searching a narrower Pareto-optimal model of the competitive F1 score of 95.17% with 38.10 MB FLOPs on the UNSW-NB15 dataset. By adding a predictor, the number of optimizations per iteration increased, leading to faster convergence. Additionally, when comparing the search spaces before and after our design in the most complex structure (with 7 cells), the model’s classification error rate increased from 4.31% to 4.36%, while the FLOPs decreased from 271.13MB to 186.9MB.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
IEEE Transactions on Cognitive Communications and Networking
IEEE Transactions on Cognitive Communications and Networking Computer Science-Artificial Intelligence
CiteScore
15.50
自引率
7.00%
发文量
108
期刊介绍: The IEEE Transactions on Cognitive Communications and Networking (TCCN) aims to publish high-quality manuscripts that push the boundaries of cognitive communications and networking research. Cognitive, in this context, refers to the application of perception, learning, reasoning, memory, and adaptive approaches in communication system design. The transactions welcome submissions that explore various aspects of cognitive communications and networks, focusing on innovative and holistic approaches to complex system design. Key topics covered include architecture, protocols, cross-layer design, and cognition cycle design for cognitive networks. Additionally, research on machine learning, artificial intelligence, end-to-end and distributed intelligence, software-defined networking, cognitive radios, spectrum sharing, and security and privacy issues in cognitive networks are of interest. The publication also encourages papers addressing novel services and applications enabled by these cognitive concepts.
期刊最新文献
Joint Optimization for Mobile Crowdsensing Systems With Reliability Consideration Application-Aware Real-time Network Resource Allocation for Industry 5.0 Delay-Guaranteed Path Selection and Scheduling in IAB Networks RadioDiff: An Effective Generative Diffusion Model for Sampling-Free Dynamic Radio Map Construction An Optimized Move List for Dynamic Protection Area in CBRS
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1