Offloading strategy for UAV power inspection task based on deep reinforcement learning

Tong Jin, Gu Minghao, Sha Yun, Deng Fang-ming
{"title":"Offloading strategy for UAV power inspection task based on deep reinforcement learning","authors":"Tong Jin, Gu Minghao, Sha Yun, Deng Fang-ming","doi":"10.1117/12.2671522","DOIUrl":null,"url":null,"abstract":"Due to the limitation of computer capacity and energy of equipment, unmanned equipment cannot perform intensive computer tasks well during emergency failure inspection. In order to solve the above problems, this paper proposes a task waste strategy based on Deep Reinforcement Learning (DRL), which is mainly applicable to several UAVs and individual ES scenarios. First of all, an end edge cloud cooperative unloading architecture is built in the edge environment of UAV, and the problem of unloading tasks is classified as an optimization problem to achieve the minimum delay under the limit of the computing and communication resources of the Edge Server (ES). Secondly, the problem is constructed as Markov decision, and Deep Q Network (DQN) is used to solve the optimization problem, and experience playback mechanism and greedy algorithm are introduced into the learning process. Experiments show that the mitigation strategy has lower latency and higher reliability.","PeriodicalId":227528,"journal":{"name":"International Conference on Artificial Intelligence and Computer Engineering (ICAICE 2022)","volume":null,"pages":null},"PeriodicalIF":0.0000,"publicationDate":"2023-04-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"International Conference on Artificial Intelligence and Computer Engineering (ICAICE 2022)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1117/12.2671522","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

Due to the limitation of computer capacity and energy of equipment, unmanned equipment cannot perform intensive computer tasks well during emergency failure inspection. In order to solve the above problems, this paper proposes a task waste strategy based on Deep Reinforcement Learning (DRL), which is mainly applicable to several UAVs and individual ES scenarios. First of all, an end edge cloud cooperative unloading architecture is built in the edge environment of UAV, and the problem of unloading tasks is classified as an optimization problem to achieve the minimum delay under the limit of the computing and communication resources of the Edge Server (ES). Secondly, the problem is constructed as Markov decision, and Deep Q Network (DQN) is used to solve the optimization problem, and experience playback mechanism and greedy algorithm are introduced into the learning process. Experiments show that the mitigation strategy has lower latency and higher reliability.
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
基于深度强化学习的无人机电力巡检任务卸载策略
由于设备计算机容量和能量的限制,在紧急故障检测中,无人设备不能很好地完成密集的计算机任务。为了解决上述问题,本文提出了一种基于深度强化学习(Deep Reinforcement Learning, DRL)的任务浪费策略,该策略主要适用于多个无人机和单个ES场景。首先,在无人机边缘环境中构建了端边缘云协同卸载架构,并将任务卸载问题归类为在边缘服务器(ES)计算和通信资源限制下实现最小延迟的优化问题。其次,将问题构造为马尔可夫决策,利用深度Q网络(Deep Q Network, DQN)求解优化问题,并在学习过程中引入经验回放机制和贪心算法;实验表明,该缓解策略具有较低的时延和较高的可靠性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
自引率
0.00%
发文量
0
期刊最新文献
Hippocampus MRI diagnosis based on deep learning in application of preliminary screening of Alzheimer’s disease Global critic and local actor for campaign-tactic combat management in the joint operation simulation software Intelligent monitoring system of oil tank liquid level based on infrared thermal imaging Chinese named entity recognition incorporating syntactic information Object tracking based on foreground adaptive bounding box and motion state redetection
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1