Chimera:率先在城域网中实现通用和自适应智能路由

IF 8 1区 计算机科学 Q1 TELECOMMUNICATIONS IEEE Transactions on Cognitive Communications and Networking Pub Date : 2024-11-14 DOI:10.1109/TCCN.2024.3499328
Yu Fan;Pengjin Xie;Yucheng Zhang;Liang Liu;Huadong Ma
{"title":"Chimera:率先在城域网中实现通用和自适应智能路由","authors":"Yu Fan;Pengjin Xie;Yucheng Zhang;Liang Liu;Huadong Ma","doi":"10.1109/TCCN.2024.3499328","DOIUrl":null,"url":null,"abstract":"Recent routing algorithms show the potential of deep reinforcement learning (DRL) for optimal routing in mobile ad-hoc networks (MANETs). However, existing DRL-based methods still have limitations in generalization and adaptability when facing unseen scenarios and mutations under local observation constraints. In this paper, we propose Chimera, a DRL-based routing algorithm for MANETs, which achieves adaptive routing and generalizes to changing environments. Chimera contains a unified-policy multi-agent framework combining traditional routing principles and Policy Pool. Specifically, we introduce Policy Pool, a mechanism where routers select the most suitable policy from multiple policies, enabling adaptation to diverse situations without extensive parameters or real-time adjustments. To achieve overall optimization, we introduce a unified-policy multi-agent framework, where a unified routing strategy across sharing-parameters devices ensures flexibility in diverse networks. Instead of purely DRL-based routing algorithms, we combine traditional methods and DRL algorithms for the robustness of Chimera by introducing the traditional protocol as a policy in Policy Pool and leveraging routing exploration for local observation supplement. Our experimental evaluations demonstrate that Chimera outperforms rule-based and DRL-based routing algorithms in learning effective routing policies, where Chimera achieves an average of 19% higher throughput, 14% less packet loss, and 22% lower delay compared to the best baseline in various MANET scenarios.","PeriodicalId":13069,"journal":{"name":"IEEE Transactions on Cognitive Communications and Networking","volume":"11 3","pages":"2027-2042"},"PeriodicalIF":8.0000,"publicationDate":"2024-11-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Chimera: Pioneering Generalized and Adaptable Intelligent Routing in MANETs\",\"authors\":\"Yu Fan;Pengjin Xie;Yucheng Zhang;Liang Liu;Huadong Ma\",\"doi\":\"10.1109/TCCN.2024.3499328\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Recent routing algorithms show the potential of deep reinforcement learning (DRL) for optimal routing in mobile ad-hoc networks (MANETs). However, existing DRL-based methods still have limitations in generalization and adaptability when facing unseen scenarios and mutations under local observation constraints. In this paper, we propose Chimera, a DRL-based routing algorithm for MANETs, which achieves adaptive routing and generalizes to changing environments. Chimera contains a unified-policy multi-agent framework combining traditional routing principles and Policy Pool. Specifically, we introduce Policy Pool, a mechanism where routers select the most suitable policy from multiple policies, enabling adaptation to diverse situations without extensive parameters or real-time adjustments. To achieve overall optimization, we introduce a unified-policy multi-agent framework, where a unified routing strategy across sharing-parameters devices ensures flexibility in diverse networks. Instead of purely DRL-based routing algorithms, we combine traditional methods and DRL algorithms for the robustness of Chimera by introducing the traditional protocol as a policy in Policy Pool and leveraging routing exploration for local observation supplement. Our experimental evaluations demonstrate that Chimera outperforms rule-based and DRL-based routing algorithms in learning effective routing policies, where Chimera achieves an average of 19% higher throughput, 14% less packet loss, and 22% lower delay compared to the best baseline in various MANET scenarios.\",\"PeriodicalId\":13069,\"journal\":{\"name\":\"IEEE Transactions on Cognitive Communications and Networking\",\"volume\":\"11 3\",\"pages\":\"2027-2042\"},\"PeriodicalIF\":8.0000,\"publicationDate\":\"2024-11-14\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Transactions on Cognitive Communications and Networking\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10753460/\",\"RegionNum\":1,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"TELECOMMUNICATIONS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Cognitive Communications and Networking","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/10753460/","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"TELECOMMUNICATIONS","Score":null,"Total":0}
引用次数: 0

摘要

最近的路由算法显示了深度强化学习(DRL)在移动自组织网络(manet)中优化路由的潜力。然而,现有的基于drl的方法在面对局部观测约束下的未知场景和突变时,在泛化和适应性方面仍然存在局限性。在本文中,我们提出了一种基于drl的自适应路由算法Chimera,它可以实现自适应路由,并且可以适应不断变化的环境。Chimera包含了一个将传统路由原理与策略池相结合的统一策略多智能体框架。具体来说,我们引入了策略池机制,路由器可以从多个策略中选择最合适的策略,从而无需大量参数或实时调整即可适应各种情况。为了实现整体优化,我们引入了一个统一策略的多代理框架,其中跨共享参数设备的统一路由策略确保了不同网络中的灵活性。通过将传统协议作为策略引入到策略池中,利用路由探索对局部观测进行补充,取代了单纯基于DRL的路由算法,将传统方法与DRL算法相结合,增强了Chimera的鲁棒性。我们的实验评估表明,在学习有效的路由策略方面,Chimera优于基于规则和基于drl的路由算法,在各种MANET场景中,与最佳基线相比,Chimera的吞吐量平均提高19%,丢包减少14%,延迟降低22%。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
Chimera: Pioneering Generalized and Adaptable Intelligent Routing in MANETs
Recent routing algorithms show the potential of deep reinforcement learning (DRL) for optimal routing in mobile ad-hoc networks (MANETs). However, existing DRL-based methods still have limitations in generalization and adaptability when facing unseen scenarios and mutations under local observation constraints. In this paper, we propose Chimera, a DRL-based routing algorithm for MANETs, which achieves adaptive routing and generalizes to changing environments. Chimera contains a unified-policy multi-agent framework combining traditional routing principles and Policy Pool. Specifically, we introduce Policy Pool, a mechanism where routers select the most suitable policy from multiple policies, enabling adaptation to diverse situations without extensive parameters or real-time adjustments. To achieve overall optimization, we introduce a unified-policy multi-agent framework, where a unified routing strategy across sharing-parameters devices ensures flexibility in diverse networks. Instead of purely DRL-based routing algorithms, we combine traditional methods and DRL algorithms for the robustness of Chimera by introducing the traditional protocol as a policy in Policy Pool and leveraging routing exploration for local observation supplement. Our experimental evaluations demonstrate that Chimera outperforms rule-based and DRL-based routing algorithms in learning effective routing policies, where Chimera achieves an average of 19% higher throughput, 14% less packet loss, and 22% lower delay compared to the best baseline in various MANET scenarios.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
IEEE Transactions on Cognitive Communications and Networking
IEEE Transactions on Cognitive Communications and Networking Computer Science-Artificial Intelligence
CiteScore
15.50
自引率
7.00%
发文量
108
期刊介绍: The IEEE Transactions on Cognitive Communications and Networking (TCCN) aims to publish high-quality manuscripts that push the boundaries of cognitive communications and networking research. Cognitive, in this context, refers to the application of perception, learning, reasoning, memory, and adaptive approaches in communication system design. The transactions welcome submissions that explore various aspects of cognitive communications and networks, focusing on innovative and holistic approaches to complex system design. Key topics covered include architecture, protocols, cross-layer design, and cognition cycle design for cognitive networks. Additionally, research on machine learning, artificial intelligence, end-to-end and distributed intelligence, software-defined networking, cognitive radios, spectrum sharing, and security and privacy issues in cognitive networks are of interest. The publication also encourages papers addressing novel services and applications enabled by these cognitive concepts.
期刊最新文献
DREAM: Disentangled RoI Attention Map for Privacy-aware Edge Inference A Learning-based Flexible Spatial Modulation Design for Large-scale RIS-assisted Systems Energy-Efficient Radio Modulation Classification via CNN-to-CSNN Conversion Mobility-Aware Vehicle Selection and Bandwidth Allocation for Federated Learning in Vehicular Networks: An HPPO Approach Learning-Based Antenna Design and Secure Transmission for Near-Field Fluid Antenna System
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1