基于滑动面的积分强化学习用于考虑不确定性的四旋翼飞行器优化跟踪控制

IF 5.7 2区 计算机科学 Q1 ENGINEERING, AEROSPACE IEEE Transactions on Aerospace and Electronic Systems Pub Date : 2024-09-18 DOI:10.1109/TAES.2024.3463637
Hanna Lee;Jinrae Kim;Youdan Kim
{"title":"基于滑动面的积分强化学习用于考虑不确定性的四旋翼飞行器优化跟踪控制","authors":"Hanna Lee;Jinrae Kim;Youdan Kim","doi":"10.1109/TAES.2024.3463637","DOIUrl":null,"url":null,"abstract":"A sliding surface-based integral reinforcement learning (IRL) control scheme is proposed for quadcopter trajectory tracking. The proposed controller combines IRL with the sliding surface approach, improving trajectory tracking performance. The proposed controller addresses the limitations of model-based controllers by leveraging the advantages of RL, particularly in dealing with uncertainties. It enables accurate trajectory tracking even in the presence of system model uncertainties, providing robust performance. The proposed controller needs significantly less data for training than existing RL approaches, including IRL. The proposed controller also incorporates Euler angle constraints in a simplified manner, distinguishing it from other constrained control methods. The online learning nature of the controller enables real-time adaptation and robustness against uncertainties. The performance of the proposed controller is compared with that of standard model-based controllers via numerical simulation, demonstrating its effectiveness and robustness.","PeriodicalId":13157,"journal":{"name":"IEEE Transactions on Aerospace and Electronic Systems","volume":"61 2","pages":"1677-1691"},"PeriodicalIF":5.7000,"publicationDate":"2024-09-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Sliding Surface-Based Integral Reinforcement Learning for Optimal Tracking Control of Quadcopters Considering Uncertainties\",\"authors\":\"Hanna Lee;Jinrae Kim;Youdan Kim\",\"doi\":\"10.1109/TAES.2024.3463637\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"A sliding surface-based integral reinforcement learning (IRL) control scheme is proposed for quadcopter trajectory tracking. The proposed controller combines IRL with the sliding surface approach, improving trajectory tracking performance. The proposed controller addresses the limitations of model-based controllers by leveraging the advantages of RL, particularly in dealing with uncertainties. It enables accurate trajectory tracking even in the presence of system model uncertainties, providing robust performance. The proposed controller needs significantly less data for training than existing RL approaches, including IRL. The proposed controller also incorporates Euler angle constraints in a simplified manner, distinguishing it from other constrained control methods. The online learning nature of the controller enables real-time adaptation and robustness against uncertainties. The performance of the proposed controller is compared with that of standard model-based controllers via numerical simulation, demonstrating its effectiveness and robustness.\",\"PeriodicalId\":13157,\"journal\":{\"name\":\"IEEE Transactions on Aerospace and Electronic Systems\",\"volume\":\"61 2\",\"pages\":\"1677-1691\"},\"PeriodicalIF\":5.7000,\"publicationDate\":\"2024-09-18\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Transactions on Aerospace and Electronic Systems\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10684097/\",\"RegionNum\":2,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENGINEERING, AEROSPACE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Aerospace and Electronic Systems","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/10684097/","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, AEROSPACE","Score":null,"Total":0}
引用次数: 0

摘要

提出了一种基于滑动面积分强化学习的四轴飞行器轨迹跟踪控制方案。该控制器将IRL与滑动面方法相结合,提高了轨迹跟踪性能。所提出的控制器通过利用强化学习的优势解决了基于模型的控制器的局限性,特别是在处理不确定性方面。即使在系统模型存在不确定性的情况下,它也能实现精确的轨迹跟踪,提供稳健的性能。与现有的强化学习方法(包括IRL)相比,所提出的控制器需要的训练数据要少得多。该控制器还以简化的方式引入了欧拉角约束,区别于其他约束控制方法。控制器的在线学习特性能够实现实时自适应和对不确定性的鲁棒性。通过数值仿真将所提控制器的性能与标准模型控制器的性能进行了比较,验证了所提控制器的有效性和鲁棒性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
Sliding Surface-Based Integral Reinforcement Learning for Optimal Tracking Control of Quadcopters Considering Uncertainties
A sliding surface-based integral reinforcement learning (IRL) control scheme is proposed for quadcopter trajectory tracking. The proposed controller combines IRL with the sliding surface approach, improving trajectory tracking performance. The proposed controller addresses the limitations of model-based controllers by leveraging the advantages of RL, particularly in dealing with uncertainties. It enables accurate trajectory tracking even in the presence of system model uncertainties, providing robust performance. The proposed controller needs significantly less data for training than existing RL approaches, including IRL. The proposed controller also incorporates Euler angle constraints in a simplified manner, distinguishing it from other constrained control methods. The online learning nature of the controller enables real-time adaptation and robustness against uncertainties. The performance of the proposed controller is compared with that of standard model-based controllers via numerical simulation, demonstrating its effectiveness and robustness.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
CiteScore
7.80
自引率
13.60%
发文量
433
审稿时长
8.7 months
期刊介绍: IEEE Transactions on Aerospace and Electronic Systems focuses on the organization, design, development, integration, and operation of complex systems for space, air, ocean, or ground environment. These systems include, but are not limited to, navigation, avionics, spacecraft, aerospace power, radar, sonar, telemetry, defense, transportation, automated testing, and command and control.
期刊最新文献
Modified Variable Step-Size Nesterov Accelerated Gradient for Robust Spline Adaptive Filtering under Half-Quadratic Criterion Adv-STMamba: A Lightweight Spatial-Temporal Mamba Model Incorporating Adversarial Training for Radar HRRPTarget Recognition Distributed Direct Position Determination of Moving Sources in Asynchronous Sensor Networks Parameter Estimation Based on Coupled Canonical Polyadic Decomposition for FDA-MIMO Radar With Unfolded Coprime Framework Optimization-Based Robust Control for Momentum Wheel Systems Subject to Large-Scale Power Supply Fluctuations
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1