“一加一大于二”:用协同多智能体强化学习击败智能动态干扰

Quan Zhou, Yonggui Li, Yingtao Niu, Zichao Qin, Long Zhao, Junwei Wang
{"title":"“一加一大于二”:用协同多智能体强化学习击败智能动态干扰","authors":"Quan Zhou, Yonggui Li, Yingtao Niu, Zichao Qin, Long Zhao, Junwei Wang","doi":"10.1109/ICCC51575.2020.9345127","DOIUrl":null,"url":null,"abstract":"In this paper, we investigate the problem of anti-jamming communication in multi-user scenarios. The Markov game framework is introduced to model and analyze the anti-jamming problem, and a joint multi-agent anti-jamming algorithm (JMAA) is proposed to obtain the optimal anti-jamming strategy. In intelligent dynamic jamming environment, the JMAA adopts multi-agent reinforcement learning (MARL) to make on-line channel selection, which can effectively tackle the external malicious jamming and avoid the internal mutual interference among users. The simulation results show that the proposed JMAA is superior to the frequency-hopping based method, the sensing-based method and the independent Q-learning method.","PeriodicalId":386048,"journal":{"name":"2020 IEEE 6th International Conference on Computer and Communications (ICCC)","volume":"7 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2020-12-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"3","resultStr":"{\"title\":\"“One Plus One is Greater Than Two”: Defeating Intelligent Dynamic Jamming with Collaborative Multi-agent Reinforcement Learning\",\"authors\":\"Quan Zhou, Yonggui Li, Yingtao Niu, Zichao Qin, Long Zhao, Junwei Wang\",\"doi\":\"10.1109/ICCC51575.2020.9345127\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"In this paper, we investigate the problem of anti-jamming communication in multi-user scenarios. The Markov game framework is introduced to model and analyze the anti-jamming problem, and a joint multi-agent anti-jamming algorithm (JMAA) is proposed to obtain the optimal anti-jamming strategy. In intelligent dynamic jamming environment, the JMAA adopts multi-agent reinforcement learning (MARL) to make on-line channel selection, which can effectively tackle the external malicious jamming and avoid the internal mutual interference among users. The simulation results show that the proposed JMAA is superior to the frequency-hopping based method, the sensing-based method and the independent Q-learning method.\",\"PeriodicalId\":386048,\"journal\":{\"name\":\"2020 IEEE 6th International Conference on Computer and Communications (ICCC)\",\"volume\":\"7 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2020-12-11\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"3\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2020 IEEE 6th International Conference on Computer and Communications (ICCC)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/ICCC51575.2020.9345127\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2020 IEEE 6th International Conference on Computer and Communications (ICCC)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ICCC51575.2020.9345127","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 3

摘要

本文研究了多用户场景下的抗干扰通信问题。引入马尔可夫博弈框架对系统的抗干扰问题进行建模和分析,提出了一种联合多智能体抗干扰算法(JMAA)来获得最优的抗干扰策略。在智能动态干扰环境下,JMAA采用多智能体强化学习(MARL)进行在线信道选择,有效地解决了外部恶意干扰,避免了用户之间的内部相互干扰。仿真结果表明,该方法优于基于跳频的方法、基于传感的方法和独立q -学习方法。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
“One Plus One is Greater Than Two”: Defeating Intelligent Dynamic Jamming with Collaborative Multi-agent Reinforcement Learning
In this paper, we investigate the problem of anti-jamming communication in multi-user scenarios. The Markov game framework is introduced to model and analyze the anti-jamming problem, and a joint multi-agent anti-jamming algorithm (JMAA) is proposed to obtain the optimal anti-jamming strategy. In intelligent dynamic jamming environment, the JMAA adopts multi-agent reinforcement learning (MARL) to make on-line channel selection, which can effectively tackle the external malicious jamming and avoid the internal mutual interference among users. The simulation results show that the proposed JMAA is superior to the frequency-hopping based method, the sensing-based method and the independent Q-learning method.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
期刊最新文献
A Safe and Stable Timing Method over Air Interface Based on Multi-Base Station Cooperation Peak to Average Power Ratio (PAPR) Mitigation for Underwater Acoustic OFDM System by Using an Efficient Hybridization Technique Monocular Visual-Inertial Odometry Based on Point and Line Features Block Halftoning for Size-Invariant Visual Cryptography Based on Two-Dimensional Lattices Airborne STAP with Unknown Mutual Coupling for Coprime Sampling Structure
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1