首页 > 最新文献

IEEE Internet of Things Journal最新文献

英文 中文
High-Sample-Efficient Multiagent Reinforcement Learning for Navigation and Collision Avoidance of UAV Swarms in Multitask Environments 多任务环境中无人机群导航和避撞的高采样效率多代理强化学习
IF 8.2 1区 计算机科学 Q1 COMPUTER SCIENCE, INFORMATION SYSTEMS Pub Date : 2024-11-07 DOI: 10.1109/JIOT.2024.3409169
Jiaming Cheng;Ni Li;Ban Wang;Shuhui Bu;Ming Zhou
Multiagent reinforcement learning (MARL) algorithms have shown promise in the Internet of Things devices, such as unmanned aerial vehicle (UAV) swarms. However, the dynamic nature of large-scale swarm systems, with constantly changing numbers of agents and observed neighbors, poses challenges for MARL adaptation. Existing approaches struggle to extract meaningful features and require a substantial number of experience samples, resulting in low-sample efficiency and high-risk ratios. Moreover, these methods are effective in task-specific scenarios and fail to perform well in multitask settings. To overcome these challenges, this study proposes a high-sample efficient and scalable MARL approach for UAV swarms. The proposed approach incorporates a hypernetwork-based embedding attention (HEA) mechanism for the state representation of the policy network and a multiencoder gated transformer with a multilayer attention (MEGTrMA) mechanism for the value function. The HEA automatically generates weights for each agent to adapt to dynamic scenarios, enhancing representation ability and adaptability while reducing the cost of trial and error for improved learning efficiency. The MEGTrMA captures the contribution of each agent to the global observation, establishing long-term dependencies among them and facilitating stable policy learning in multitask scenarios. Simulation results demonstrate that the proposed method is scalable, generalizable, and high-sample efficient. Compared to learning from scratch, our method significantly reduces training time to less than one-fifth of the initial time by progressively increasing the number of UAVs and their corresponding neighbors. Additionally, the average number of collisions is reduced by an order of magnitude for large-scale UAV swarms.
多代理强化学习(MARL)算法在无人机群等物联网设备中大有可为。然而,大规模蜂群系统具有动态性质,其代理数量和观察到的邻居不断变化,这给 MARL 适应性带来了挑战。现有方法难以提取有意义的特征,而且需要大量经验样本,导致样本效率低、风险率高。此外,这些方法在特定任务场景下有效,但在多任务场景下表现不佳。为了克服这些挑战,本研究为无人机群提出了一种高样本效率和可扩展的 MARL 方法。所提出的方法在策略网络的状态表示方面采用了基于超网络的嵌入注意(HEA)机制,在值函数方面采用了多编码器门控变换器和多层注意(MEGTrMA)机制。HEA 可自动为每个代理生成权重,以适应动态场景,从而增强表示能力和适应性,同时降低试错成本,提高学习效率。MEGTrMA 捕获了每个代理对全局观测的贡献,建立了代理之间的长期依赖关系,促进了多任务场景下的稳定策略学习。仿真结果表明,所提出的方法具有可扩展性、通用性和高样本效率。与从头开始学习相比,我们的方法通过逐步增加无人飞行器及其相应邻居的数量,将训练时间显著缩短到初始时间的五分之一以下。此外,大规模无人机群的平均碰撞次数减少了一个数量级。
{"title":"High-Sample-Efficient Multiagent Reinforcement Learning for Navigation and Collision Avoidance of UAV Swarms in Multitask Environments","authors":"Jiaming Cheng;Ni Li;Ban Wang;Shuhui Bu;Ming Zhou","doi":"10.1109/JIOT.2024.3409169","DOIUrl":"https://doi.org/10.1109/JIOT.2024.3409169","url":null,"abstract":"Multiagent reinforcement learning (MARL) algorithms have shown promise in the Internet of Things devices, such as unmanned aerial vehicle (UAV) swarms. However, the dynamic nature of large-scale swarm systems, with constantly changing numbers of agents and observed neighbors, poses challenges for MARL adaptation. Existing approaches struggle to extract meaningful features and require a substantial number of experience samples, resulting in low-sample efficiency and high-risk ratios. Moreover, these methods are effective in task-specific scenarios and fail to perform well in multitask settings. To overcome these challenges, this study proposes a high-sample efficient and scalable MARL approach for UAV swarms. The proposed approach incorporates a hypernetwork-based embedding attention (HEA) mechanism for the state representation of the policy network and a multiencoder gated transformer with a multilayer attention (MEGTrMA) mechanism for the value function. The HEA automatically generates weights for each agent to adapt to dynamic scenarios, enhancing representation ability and adaptability while reducing the cost of trial and error for improved learning efficiency. The MEGTrMA captures the contribution of each agent to the global observation, establishing long-term dependencies among them and facilitating stable policy learning in multitask scenarios. Simulation results demonstrate that the proposed method is scalable, generalizable, and high-sample efficient. Compared to learning from scratch, our method significantly reduces training time to less than one-fifth of the initial time by progressively increasing the number of UAVs and their corresponding neighbors. Additionally, the average number of collisions is reduced by an order of magnitude for large-scale UAV swarms.","PeriodicalId":54347,"journal":{"name":"IEEE Internet of Things Journal","volume":null,"pages":null},"PeriodicalIF":8.2,"publicationDate":"2024-11-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142595145","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
IEEE Internet of Things Journal Information for Authors IEEE 物联网期刊作者信息
IF 8.2 1区 计算机科学 Q1 COMPUTER SCIENCE, INFORMATION SYSTEMS Pub Date : 2024-11-07 DOI: 10.1109/JIOT.2024.3480517
{"title":"IEEE Internet of Things Journal Information for Authors","authors":"","doi":"10.1109/JIOT.2024.3480517","DOIUrl":"https://doi.org/10.1109/JIOT.2024.3480517","url":null,"abstract":"","PeriodicalId":54347,"journal":{"name":"IEEE Internet of Things Journal","volume":null,"pages":null},"PeriodicalIF":8.2,"publicationDate":"2024-11-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10747064","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142595813","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
IEEE Internet of Things Journal Society Information IEEE 物联网期刊学会信息
IF 8.2 1区 计算机科学 Q1 COMPUTER SCIENCE, INFORMATION SYSTEMS Pub Date : 2024-11-07 DOI: 10.1109/JIOT.2024.3480515
{"title":"IEEE Internet of Things Journal Society Information","authors":"","doi":"10.1109/JIOT.2024.3480515","DOIUrl":"https://doi.org/10.1109/JIOT.2024.3480515","url":null,"abstract":"","PeriodicalId":54347,"journal":{"name":"IEEE Internet of Things Journal","volume":null,"pages":null},"PeriodicalIF":8.2,"publicationDate":"2024-11-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10747041","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142595895","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
IEEE Internet of Things Journal Publication Information IEEE 物联网期刊出版信息
IF 8.2 1区 计算机科学 Q1 COMPUTER SCIENCE, INFORMATION SYSTEMS Pub Date : 2024-11-07 DOI: 10.1109/JIOT.2024.3480511
{"title":"IEEE Internet of Things Journal Publication Information","authors":"","doi":"10.1109/JIOT.2024.3480511","DOIUrl":"https://doi.org/10.1109/JIOT.2024.3480511","url":null,"abstract":"","PeriodicalId":54347,"journal":{"name":"IEEE Internet of Things Journal","volume":null,"pages":null},"PeriodicalIF":8.2,"publicationDate":"2024-11-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10747039","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142595041","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
See as You Desire: Scale-adaptive Face Super-Resolution for Varying Low Resolutions 随心所欲:针对不同低分辨率的规模自适应人脸超级分辨率
IF 10.6 1区 计算机科学 Q1 COMPUTER SCIENCE, INFORMATION SYSTEMS Pub Date : 2024-11-06 DOI: 10.1109/jiot.2024.3492716
Ling Li, Yan Zhang, Lin Yuan, Shuang Li, Xinbo Gao
{"title":"See as You Desire: Scale-adaptive Face Super-Resolution for Varying Low Resolutions","authors":"Ling Li, Yan Zhang, Lin Yuan, Shuang Li, Xinbo Gao","doi":"10.1109/jiot.2024.3492716","DOIUrl":"https://doi.org/10.1109/jiot.2024.3492716","url":null,"abstract":"","PeriodicalId":54347,"journal":{"name":"IEEE Internet of Things Journal","volume":null,"pages":null},"PeriodicalIF":10.6,"publicationDate":"2024-11-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142594848","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Accelerating Multi-UAV Collaborative Sensing Data Collection: A Hybrid TDMA-NOMA-Cooperative Transmission in Cell-Free MIMO Networks 加速多无人机协作传感数据采集:无小区 MIMO 网络中的混合 TDMA-NOMA 协同传输
IF 10.6 1区 计算机科学 Q1 COMPUTER SCIENCE, INFORMATION SYSTEMS Pub Date : 2024-11-06 DOI: 10.1109/jiot.2024.3492709
Eunhyuk Park, Junbeom Kim, Seok-Hwan Park, Osvaldo Simeone, Shlomo Shamai
{"title":"Accelerating Multi-UAV Collaborative Sensing Data Collection: A Hybrid TDMA-NOMA-Cooperative Transmission in Cell-Free MIMO Networks","authors":"Eunhyuk Park, Junbeom Kim, Seok-Hwan Park, Osvaldo Simeone, Shlomo Shamai","doi":"10.1109/jiot.2024.3492709","DOIUrl":"https://doi.org/10.1109/jiot.2024.3492709","url":null,"abstract":"","PeriodicalId":54347,"journal":{"name":"IEEE Internet of Things Journal","volume":null,"pages":null},"PeriodicalIF":10.6,"publicationDate":"2024-11-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142594847","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Payload-Adaptive Hybrid MAC Protocol for Sustainable Internet of Things Networks: Protocol Design and Adaptive Adjustment Mechanisms 可持续物联网网络的有效载荷自适应混合 MAC 协议:协议设计与自适应调整机制
IF 10.6 1区 计算机科学 Q1 COMPUTER SCIENCE, INFORMATION SYSTEMS Pub Date : 2024-11-06 DOI: 10.1109/jiot.2024.3491358
Xinyu Fan, Jie Hu, Kun Yang
{"title":"Payload-Adaptive Hybrid MAC Protocol for Sustainable Internet of Things Networks: Protocol Design and Adaptive Adjustment Mechanisms","authors":"Xinyu Fan, Jie Hu, Kun Yang","doi":"10.1109/jiot.2024.3491358","DOIUrl":"https://doi.org/10.1109/jiot.2024.3491358","url":null,"abstract":"","PeriodicalId":54347,"journal":{"name":"IEEE Internet of Things Journal","volume":null,"pages":null},"PeriodicalIF":10.6,"publicationDate":"2024-11-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142594838","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A Dynamic Pricing-based Offloading and Resource Allocation Scheme With Data Security for Vehicle Platoon 基于定价的动态卸载和资源分配方案与车辆排的数据安全
IF 10.6 1区 计算机科学 Q1 COMPUTER SCIENCE, INFORMATION SYSTEMS Pub Date : 2024-11-06 DOI: 10.1109/jiot.2024.3492694
Yang Yang, Haiyang Yu, Yanan Zhao, Ming Chen, Jiewei Du, Yilong Ren
{"title":"A Dynamic Pricing-based Offloading and Resource Allocation Scheme With Data Security for Vehicle Platoon","authors":"Yang Yang, Haiyang Yu, Yanan Zhao, Ming Chen, Jiewei Du, Yilong Ren","doi":"10.1109/jiot.2024.3492694","DOIUrl":"https://doi.org/10.1109/jiot.2024.3492694","url":null,"abstract":"","PeriodicalId":54347,"journal":{"name":"IEEE Internet of Things Journal","volume":null,"pages":null},"PeriodicalIF":10.6,"publicationDate":"2024-11-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142594840","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
CD-BISHAC:Cross-Domain Scheme for Blockchain-Based Industrial Internet of Things Security Hybrid Access Control CD-BISHAC:基于区块链的工业物联网安全混合访问控制跨域方案
IF 10.6 1区 计算机科学 Q1 COMPUTER SCIENCE, INFORMATION SYSTEMS Pub Date : 2024-11-06 DOI: 10.1109/jiot.2024.3492279
Buzhen He, Tao Feng, Chunyan Liu, Chunhua Su
{"title":"CD-BISHAC:Cross-Domain Scheme for Blockchain-Based Industrial Internet of Things Security Hybrid Access Control","authors":"Buzhen He, Tao Feng, Chunyan Liu, Chunhua Su","doi":"10.1109/jiot.2024.3492279","DOIUrl":"https://doi.org/10.1109/jiot.2024.3492279","url":null,"abstract":"","PeriodicalId":54347,"journal":{"name":"IEEE Internet of Things Journal","volume":null,"pages":null},"PeriodicalIF":10.6,"publicationDate":"2024-11-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142594846","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
FedSC: A Sidechain-Enhanced Edge Computing Framework for 6G IoT Multiple Scenarios FedSC:面向 6G 物联网多种场景的侧链增强型边缘计算框架
IF 10.6 1区 计算机科学 Q1 COMPUTER SCIENCE, INFORMATION SYSTEMS Pub Date : 2024-11-06 DOI: 10.1109/jiot.2024.3492321
Zhou Fang, Shuping Dang, Yang Yang, Zhihui Ge, Xiangcheng Li, Zhenrong Zhang
{"title":"FedSC: A Sidechain-Enhanced Edge Computing Framework for 6G IoT Multiple Scenarios","authors":"Zhou Fang, Shuping Dang, Yang Yang, Zhihui Ge, Xiangcheng Li, Zhenrong Zhang","doi":"10.1109/jiot.2024.3492321","DOIUrl":"https://doi.org/10.1109/jiot.2024.3492321","url":null,"abstract":"","PeriodicalId":54347,"journal":{"name":"IEEE Internet of Things Journal","volume":null,"pages":null},"PeriodicalIF":10.6,"publicationDate":"2024-11-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142594849","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
IEEE Internet of Things Journal
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1