Review of vision-based reinforcement learning for drone navigation

Anas Aburaya, Hazlina Selamat, Mohd Taufiq Muslim
{"title":"Review of vision-based reinforcement learning for drone navigation","authors":"Anas Aburaya, Hazlina Selamat, Mohd Taufiq Muslim","doi":"10.1007/s41315-024-00356-9","DOIUrl":null,"url":null,"abstract":"<p>In recent years, Unmanned aerial vehicles (UAVs) have witnessed a surge in popularity and implementation for both civilian and military usage. UAVs can be utilized for a wide range of applications, including mapping, surveillance, and inspection. For many of these applications, a high level of autonomy is required. Autonomy refers to the ability to complete missions or tasks without human intervention. Autonomous navigation is an essential element of autonomy, especially in GPS-denied environments where GNSS-based navigation is not reliable. Due to size and weight limitations, many UAVs employ vision-based localization and navigation techniques for GPS-denied environments. Reinforcement Learning (RL) is also increasingly being implemented for robotic applications, including obstacle avoidance, battery management, and navigation. Existing reviews typically focus on either vision-based autonomous navigation of drones or RL navigation for drones in general, but none specifically concentrate on the use of vision-based methods and RL for drone navigation. Moreover, previous reviews have highlighted the use of reinforcement learning based on tasks such as takeoff, landing, and navigation, whereas this review categorizes the use of RL based on the navigation problem and image input types for the RL models as these define the needed hardware and processing capabilities of the system. We define the current challenges and limitations for vision based RL navigation to provide direction for future works. Finally we provide an analysis of the favorable conditions for each category and the possibility of combining multiple categories to overcome the disadvantages of each.</p>","PeriodicalId":44563,"journal":{"name":"International Journal of Intelligent Robotics and Applications","volume":null,"pages":null},"PeriodicalIF":2.1000,"publicationDate":"2024-06-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"International Journal of Intelligent Robotics and Applications","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1007/s41315-024-00356-9","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"ROBOTICS","Score":null,"Total":0}
引用次数: 0

Abstract

In recent years, Unmanned aerial vehicles (UAVs) have witnessed a surge in popularity and implementation for both civilian and military usage. UAVs can be utilized for a wide range of applications, including mapping, surveillance, and inspection. For many of these applications, a high level of autonomy is required. Autonomy refers to the ability to complete missions or tasks without human intervention. Autonomous navigation is an essential element of autonomy, especially in GPS-denied environments where GNSS-based navigation is not reliable. Due to size and weight limitations, many UAVs employ vision-based localization and navigation techniques for GPS-denied environments. Reinforcement Learning (RL) is also increasingly being implemented for robotic applications, including obstacle avoidance, battery management, and navigation. Existing reviews typically focus on either vision-based autonomous navigation of drones or RL navigation for drones in general, but none specifically concentrate on the use of vision-based methods and RL for drone navigation. Moreover, previous reviews have highlighted the use of reinforcement learning based on tasks such as takeoff, landing, and navigation, whereas this review categorizes the use of RL based on the navigation problem and image input types for the RL models as these define the needed hardware and processing capabilities of the system. We define the current challenges and limitations for vision based RL navigation to provide direction for future works. Finally we provide an analysis of the favorable conditions for each category and the possibility of combining multiple categories to overcome the disadvantages of each.

Abstract Image

查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
基于视觉的无人机导航强化学习回顾
近年来,无人驾驶飞行器(UAVs)在民用和军用领域的普及和应用激增。无人飞行器的应用范围非常广泛,包括测绘、监视和检查。其中许多应用都需要高度的自主性。自主性是指在无人干预的情况下完成任务或工作的能力。自主导航是自主性的一个基本要素,尤其是在全球定位系统失效的环境中,基于全球导航卫星系统的导航并不可靠。由于尺寸和重量的限制,许多无人机在 GPS 信号缺失的环境中采用了基于视觉的定位和导航技术。强化学习(RL)也越来越多地应用于机器人领域,包括避障、电池管理和导航。现有的综述通常侧重于基于视觉的无人机自主导航或一般的无人机 RL 导航,但没有一篇专门讨论基于视觉的方法和 RL 在无人机导航中的应用。此外,以前的综述强调了基于起飞、着陆和导航等任务的强化学习的使用,而本综述则根据导航问题和 RL 模型的图像输入类型对 RL 的使用进行了分类,因为这些定义了系统所需的硬件和处理能力。我们定义了基于视觉的 RL 导航目前面临的挑战和限制,为未来的工作指明了方向。最后,我们分析了每个类别的有利条件,以及结合多个类别以克服每个类别的缺点的可能性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
CiteScore
3.80
自引率
5.90%
发文量
50
期刊介绍: The International Journal of Intelligent Robotics and Applications (IJIRA) fosters the dissemination of new discoveries and novel technologies that advance developments in robotics and their broad applications. This journal provides a publication and communication platform for all robotics topics, from the theoretical fundamentals and technological advances to various applications including manufacturing, space vehicles, biomedical systems and automobiles, data-storage devices, healthcare systems, home appliances, and intelligent highways. IJIRA welcomes contributions from researchers, professionals and industrial practitioners. It publishes original, high-quality and previously unpublished research papers, brief reports, and critical reviews. Specific areas of interest include, but are not limited to:Advanced actuators and sensorsCollective and social robots Computing, communication and controlDesign, modeling and prototypingHuman and robot interactionMachine learning and intelligenceMobile robots and intelligent autonomous systemsMulti-sensor fusion and perceptionPlanning, navigation and localizationRobot intelligence, learning and linguisticsRobotic vision, recognition and reconstructionBio-mechatronics and roboticsCloud and Swarm roboticsCognitive and neuro roboticsExploration and security roboticsHealthcare, medical and assistive roboticsRobotics for intelligent manufacturingService, social and entertainment roboticsSpace and underwater robotsNovel and emerging applications
期刊最新文献
A review of the application of fuzzy mathematical algorithm-based approach in autonomous vehicles and drones Robotic tree climbers and strategies - a survey Efficient multi-robot path planning in real environments: a centralized coordination system Cross-pollination of knowledge for object detection in domain adaptation for industrial automation Push or pull: grasping performance analysis between a pulling gripper inspired by Tetraonchus monenteron parasite versus an actively pushing gripper developed through many-objective design optimization
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1