A Reinforcement Learning Approach for Autonomous Control and Landing of a Quadrotor

M. Vankadari, K. Das, Chinmay Shinde, S. Kumar
{"title":"A Reinforcement Learning Approach for Autonomous Control and Landing of a Quadrotor","authors":"M. Vankadari, K. Das, Chinmay Shinde, S. Kumar","doi":"10.1109/ICUAS.2018.8453468","DOIUrl":null,"url":null,"abstract":"This paper looks into the problem of precise autonomous landing of an Unmanned Aerial Vehicle (UAV) which is considered to be a difficult problem as one has to generate appropriate landing trajectories in presence of dynamic constraints, such as, sudden changes in wind velocities and directions, downwash effects, change in payload etc. The problem is further compounded due to uncertainties arising from inaccurate model information and noisy sensor readings. The problem is partially solved by proposing a Reinforcement Learning (RL) based controller that uses Least Square Policy Iteration (LSPI) to learn the optimal control policies required for generating these trajectories. The efficacy of the approach is demonstrated through both simulation and real-world experiments with actual Parrot AR drone 2.0. According to our study, this is the first time such experimental results have been presented using RL based controller for drone landing, making it a novel contribution in this field.","PeriodicalId":246293,"journal":{"name":"2018 International Conference on Unmanned Aircraft Systems (ICUAS)","volume":"108 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2018-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"28","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2018 International Conference on Unmanned Aircraft Systems (ICUAS)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ICUAS.2018.8453468","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 28

Abstract

This paper looks into the problem of precise autonomous landing of an Unmanned Aerial Vehicle (UAV) which is considered to be a difficult problem as one has to generate appropriate landing trajectories in presence of dynamic constraints, such as, sudden changes in wind velocities and directions, downwash effects, change in payload etc. The problem is further compounded due to uncertainties arising from inaccurate model information and noisy sensor readings. The problem is partially solved by proposing a Reinforcement Learning (RL) based controller that uses Least Square Policy Iteration (LSPI) to learn the optimal control policies required for generating these trajectories. The efficacy of the approach is demonstrated through both simulation and real-world experiments with actual Parrot AR drone 2.0. According to our study, this is the first time such experimental results have been presented using RL based controller for drone landing, making it a novel contribution in this field.
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
四旋翼飞行器自主控制与着陆的强化学习方法
本文研究了无人机的精确自主着陆问题,该问题被认为是一个难题,因为无人机必须在风速和风向的突然变化、下冲效应、载荷变化等动态约束下生成合适的着陆轨迹。由于不准确的模型信息和噪声传感器读数带来的不确定性,问题进一步复杂化。提出了一种基于强化学习(RL)的控制器,该控制器使用最小二乘策略迭代(LSPI)来学习生成这些轨迹所需的最优控制策略,从而部分解决了这个问题。通过实际Parrot AR无人机2.0的仿真和实际实验,证明了该方法的有效性。根据我们的研究,这是第一次将基于RL的控制器用于无人机着陆的实验结果,使其在该领域做出了新的贡献。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
自引率
0.00%
发文量
0
期刊最新文献
Stabilization and Optimal Trajectory Generation for a Compact Aerial Manipulation System with a Delta-type Parallel Robot Vision-Based Autonomous Landing of a Multi-Copter Unmanned Aerial Vehicle using Reinforcement Learning Nonlinear Flight Control Design for Maneuvering Flight of Quadrotors in High Speed and Large Acceleration Integrated Navigation Based on DME+VOR/INS Under the Integrated Radio Condition Vision-based Integrated Navigation System and Optimal Allocation in Formation Flying
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1