Yu Fan;Pengjin Xie;Yucheng Zhang;Liang Liu;Huadong Ma
{"title":"Chimera:率先在城域网中实现通用和自适应智能路由","authors":"Yu Fan;Pengjin Xie;Yucheng Zhang;Liang Liu;Huadong Ma","doi":"10.1109/TCCN.2024.3499328","DOIUrl":null,"url":null,"abstract":"Recent routing algorithms show the potential of deep reinforcement learning (DRL) for optimal routing in mobile ad-hoc networks (MANETs). However, existing DRL-based methods still have limitations in generalization and adaptability when facing unseen scenarios and mutations under local observation constraints. In this paper, we propose Chimera, a DRL-based routing algorithm for MANETs, which achieves adaptive routing and generalizes to changing environments. Chimera contains a unified-policy multi-agent framework combining traditional routing principles and Policy Pool. Specifically, we introduce Policy Pool, a mechanism where routers select the most suitable policy from multiple policies, enabling adaptation to diverse situations without extensive parameters or real-time adjustments. To achieve overall optimization, we introduce a unified-policy multi-agent framework, where a unified routing strategy across sharing-parameters devices ensures flexibility in diverse networks. Instead of purely DRL-based routing algorithms, we combine traditional methods and DRL algorithms for the robustness of Chimera by introducing the traditional protocol as a policy in Policy Pool and leveraging routing exploration for local observation supplement. Our experimental evaluations demonstrate that Chimera outperforms rule-based and DRL-based routing algorithms in learning effective routing policies, where Chimera achieves an average of 19% higher throughput, 14% less packet loss, and 22% lower delay compared to the best baseline in various MANET scenarios.","PeriodicalId":13069,"journal":{"name":"IEEE Transactions on Cognitive Communications and Networking","volume":"11 3","pages":"2027-2042"},"PeriodicalIF":8.0000,"publicationDate":"2024-11-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Chimera: Pioneering Generalized and Adaptable Intelligent Routing in MANETs\",\"authors\":\"Yu Fan;Pengjin Xie;Yucheng Zhang;Liang Liu;Huadong Ma\",\"doi\":\"10.1109/TCCN.2024.3499328\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Recent routing algorithms show the potential of deep reinforcement learning (DRL) for optimal routing in mobile ad-hoc networks (MANETs). However, existing DRL-based methods still have limitations in generalization and adaptability when facing unseen scenarios and mutations under local observation constraints. In this paper, we propose Chimera, a DRL-based routing algorithm for MANETs, which achieves adaptive routing and generalizes to changing environments. Chimera contains a unified-policy multi-agent framework combining traditional routing principles and Policy Pool. Specifically, we introduce Policy Pool, a mechanism where routers select the most suitable policy from multiple policies, enabling adaptation to diverse situations without extensive parameters or real-time adjustments. To achieve overall optimization, we introduce a unified-policy multi-agent framework, where a unified routing strategy across sharing-parameters devices ensures flexibility in diverse networks. Instead of purely DRL-based routing algorithms, we combine traditional methods and DRL algorithms for the robustness of Chimera by introducing the traditional protocol as a policy in Policy Pool and leveraging routing exploration for local observation supplement. Our experimental evaluations demonstrate that Chimera outperforms rule-based and DRL-based routing algorithms in learning effective routing policies, where Chimera achieves an average of 19% higher throughput, 14% less packet loss, and 22% lower delay compared to the best baseline in various MANET scenarios.\",\"PeriodicalId\":13069,\"journal\":{\"name\":\"IEEE Transactions on Cognitive Communications and Networking\",\"volume\":\"11 3\",\"pages\":\"2027-2042\"},\"PeriodicalIF\":8.0000,\"publicationDate\":\"2024-11-14\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Transactions on Cognitive Communications and Networking\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10753460/\",\"RegionNum\":1,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"TELECOMMUNICATIONS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Cognitive Communications and Networking","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/10753460/","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"TELECOMMUNICATIONS","Score":null,"Total":0}
Chimera: Pioneering Generalized and Adaptable Intelligent Routing in MANETs
Recent routing algorithms show the potential of deep reinforcement learning (DRL) for optimal routing in mobile ad-hoc networks (MANETs). However, existing DRL-based methods still have limitations in generalization and adaptability when facing unseen scenarios and mutations under local observation constraints. In this paper, we propose Chimera, a DRL-based routing algorithm for MANETs, which achieves adaptive routing and generalizes to changing environments. Chimera contains a unified-policy multi-agent framework combining traditional routing principles and Policy Pool. Specifically, we introduce Policy Pool, a mechanism where routers select the most suitable policy from multiple policies, enabling adaptation to diverse situations without extensive parameters or real-time adjustments. To achieve overall optimization, we introduce a unified-policy multi-agent framework, where a unified routing strategy across sharing-parameters devices ensures flexibility in diverse networks. Instead of purely DRL-based routing algorithms, we combine traditional methods and DRL algorithms for the robustness of Chimera by introducing the traditional protocol as a policy in Policy Pool and leveraging routing exploration for local observation supplement. Our experimental evaluations demonstrate that Chimera outperforms rule-based and DRL-based routing algorithms in learning effective routing policies, where Chimera achieves an average of 19% higher throughput, 14% less packet loss, and 22% lower delay compared to the best baseline in various MANET scenarios.
期刊介绍:
The IEEE Transactions on Cognitive Communications and Networking (TCCN) aims to publish high-quality manuscripts that push the boundaries of cognitive communications and networking research. Cognitive, in this context, refers to the application of perception, learning, reasoning, memory, and adaptive approaches in communication system design. The transactions welcome submissions that explore various aspects of cognitive communications and networks, focusing on innovative and holistic approaches to complex system design. Key topics covered include architecture, protocols, cross-layer design, and cognition cycle design for cognitive networks. Additionally, research on machine learning, artificial intelligence, end-to-end and distributed intelligence, software-defined networking, cognitive radios, spectrum sharing, and security and privacy issues in cognitive networks are of interest. The publication also encourages papers addressing novel services and applications enabled by these cognitive concepts.