采用模糊推理系统的先进稳健积分强化学习方案

IF 3.2 3区 计算机科学 Q2 AUTOMATION & CONTROL SYSTEMS International Journal of Robust and Nonlinear Control Pub Date : 2024-08-14 DOI:10.1002/rnc.7595
Ao Liu, Ding Wang, Junfei Qiao
{"title":"采用模糊推理系统的先进稳健积分强化学习方案","authors":"Ao Liu,&nbsp;Ding Wang,&nbsp;Junfei Qiao","doi":"10.1002/rnc.7595","DOIUrl":null,"url":null,"abstract":"<p>In this paper, the model-free robust control problem is investigated for nonlinear systems with a relaxed condition of initial admissible control. An advanced integral reinforcement learning method is developed, which merges the adaptive network-based fuzzy inference system (ANFIS) and pre-training of the initial weights. To loose the condition for choosing the initial control law, pre-training of initial weights is established by utilizing the ANFIS to provide the information corresponding to the system model, which is applicable to the model-free issue. Based on the actor-critic structure, the approximate optimal control law is obtained by employing adaptive dynamic programming. Redesigning the obtained control law, the robust controller can be derived to stabilize the system with the uncertain term. Eventually, two examples are utilized to verify the effectiveness of the constructed algorithm.</p>","PeriodicalId":50291,"journal":{"name":"International Journal of Robust and Nonlinear Control","volume":"34 17","pages":"11745-11759"},"PeriodicalIF":3.2000,"publicationDate":"2024-08-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"An advanced robust integral reinforcement learning scheme with the fuzzy inference system\",\"authors\":\"Ao Liu,&nbsp;Ding Wang,&nbsp;Junfei Qiao\",\"doi\":\"10.1002/rnc.7595\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p>In this paper, the model-free robust control problem is investigated for nonlinear systems with a relaxed condition of initial admissible control. An advanced integral reinforcement learning method is developed, which merges the adaptive network-based fuzzy inference system (ANFIS) and pre-training of the initial weights. To loose the condition for choosing the initial control law, pre-training of initial weights is established by utilizing the ANFIS to provide the information corresponding to the system model, which is applicable to the model-free issue. Based on the actor-critic structure, the approximate optimal control law is obtained by employing adaptive dynamic programming. Redesigning the obtained control law, the robust controller can be derived to stabilize the system with the uncertain term. Eventually, two examples are utilized to verify the effectiveness of the constructed algorithm.</p>\",\"PeriodicalId\":50291,\"journal\":{\"name\":\"International Journal of Robust and Nonlinear Control\",\"volume\":\"34 17\",\"pages\":\"11745-11759\"},\"PeriodicalIF\":3.2000,\"publicationDate\":\"2024-08-14\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"International Journal of Robust and Nonlinear Control\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://onlinelibrary.wiley.com/doi/10.1002/rnc.7595\",\"RegionNum\":3,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"AUTOMATION & CONTROL SYSTEMS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"International Journal of Robust and Nonlinear Control","FirstCategoryId":"94","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1002/rnc.7595","RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"AUTOMATION & CONTROL SYSTEMS","Score":null,"Total":0}
引用次数: 0

摘要

本文研究了非线性系统的无模型鲁棒控制问题,其初始可容许控制条件较为宽松。本文将自适应网络模糊推理系统(ANFIS)与初始权重预训练相结合,提出了一种先进的积分强化学习方法。为了放宽初始控制法的选择条件,利用 ANFIS 提供与系统模型相对应的信息,建立了初始权重的预训练,这适用于无模型问题。基于行动者批判结构,通过自适应动态编程获得近似最优控制法则。通过重新设计得到的控制法则,可以推导出鲁棒控制器来稳定带有不确定项的系统。最后,利用两个实例验证了所构建算法的有效性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
An advanced robust integral reinforcement learning scheme with the fuzzy inference system

In this paper, the model-free robust control problem is investigated for nonlinear systems with a relaxed condition of initial admissible control. An advanced integral reinforcement learning method is developed, which merges the adaptive network-based fuzzy inference system (ANFIS) and pre-training of the initial weights. To loose the condition for choosing the initial control law, pre-training of initial weights is established by utilizing the ANFIS to provide the information corresponding to the system model, which is applicable to the model-free issue. Based on the actor-critic structure, the approximate optimal control law is obtained by employing adaptive dynamic programming. Redesigning the obtained control law, the robust controller can be derived to stabilize the system with the uncertain term. Eventually, two examples are utilized to verify the effectiveness of the constructed algorithm.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
International Journal of Robust and Nonlinear Control
International Journal of Robust and Nonlinear Control 工程技术-工程:电子与电气
CiteScore
6.70
自引率
20.50%
发文量
505
审稿时长
2.7 months
期刊介绍: Papers that do not include an element of robust or nonlinear control and estimation theory will not be considered by the journal, and all papers will be expected to include significant novel content. The focus of the journal is on model based control design approaches rather than heuristic or rule based methods. Papers on neural networks will have to be of exceptional novelty to be considered for the journal.
期刊最新文献
Issue Information Disturbance observer based adaptive predefined-time sliding mode control for robot manipulators with uncertainties and disturbances Issue Information Issue Information A stabilizing reinforcement learning approach for sampled systems with partially unknown models
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1