基于观察者的强化学习,通过动态事件触发机制实现非线性多代理系统的最佳容错共识控制

IF 8.1 1区 计算机科学 N/A COMPUTER SCIENCE, INFORMATION SYSTEMS Information Sciences Pub Date : 2024-08-22 DOI:10.1016/j.ins.2024.121350
{"title":"基于观察者的强化学习,通过动态事件触发机制实现非线性多代理系统的最佳容错共识控制","authors":"","doi":"10.1016/j.ins.2024.121350","DOIUrl":null,"url":null,"abstract":"<div><p>In this article, an adaptive optimized consensus tracking control problem is studied for nonlinear strict-feedback dynamic multi-agent systems (MASs), considering both unmeasurable system states and time-varying bias faults. By utilizing the backstepping technique, we develop an adaptive reinforcement learning (RL) algorithm within the observer-critic-actor architecture, specially designed to compensate for the lack of state information and derive control inputs, thereby achieving approximate optimal control. Moreover, an event-triggered mechanism is introduced in the sensor-to-controller channel, which dynamically adjusts the triggering threshold online and employs event-sampled states to initiate control actions. To address discontinuities caused by state triggering, we construct virtual controllers that continuously sample state signals and reconfigure the actual controller based on previously triggered states. The outputs of the MASs are shown to accurately track the desired reference signals while ensuring the boundedness of all closed-loop signals. Additionally, the proposed controller is verified to be devoid of Zeno behavior. Finally, the effectiveness of our control methodology is demonstrated through numerical simulation.</p></div>","PeriodicalId":51063,"journal":{"name":"Information Sciences","volume":null,"pages":null},"PeriodicalIF":8.1000,"publicationDate":"2024-08-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Observer-based reinforcement learning for optimal fault-tolerant consensus control of nonlinear multi-agent systems via a dynamic event-triggered mechanism\",\"authors\":\"\",\"doi\":\"10.1016/j.ins.2024.121350\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><p>In this article, an adaptive optimized consensus tracking control problem is studied for nonlinear strict-feedback dynamic multi-agent systems (MASs), considering both unmeasurable system states and time-varying bias faults. By utilizing the backstepping technique, we develop an adaptive reinforcement learning (RL) algorithm within the observer-critic-actor architecture, specially designed to compensate for the lack of state information and derive control inputs, thereby achieving approximate optimal control. Moreover, an event-triggered mechanism is introduced in the sensor-to-controller channel, which dynamically adjusts the triggering threshold online and employs event-sampled states to initiate control actions. To address discontinuities caused by state triggering, we construct virtual controllers that continuously sample state signals and reconfigure the actual controller based on previously triggered states. The outputs of the MASs are shown to accurately track the desired reference signals while ensuring the boundedness of all closed-loop signals. Additionally, the proposed controller is verified to be devoid of Zeno behavior. Finally, the effectiveness of our control methodology is demonstrated through numerical simulation.</p></div>\",\"PeriodicalId\":51063,\"journal\":{\"name\":\"Information Sciences\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":8.1000,\"publicationDate\":\"2024-08-22\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Information Sciences\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0020025524012647\",\"RegionNum\":1,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"N/A\",\"JCRName\":\"COMPUTER SCIENCE, INFORMATION SYSTEMS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Information Sciences","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0020025524012647","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"N/A","JCRName":"COMPUTER SCIENCE, INFORMATION SYSTEMS","Score":null,"Total":0}
引用次数: 0

摘要

本文研究了非线性严格反馈动态多代理系统(MAS)的自适应优化共识跟踪控制问题,同时考虑了不可测量的系统状态和时变偏差故障。通过利用反向步进技术,我们在观测器-批判-代理架构内开发了一种自适应强化学习(RL)算法,专门用于补偿状态信息的缺乏和推导控制输入,从而实现近似最优控制。此外,在传感器到控制器的通道中引入了事件触发机制,可在线动态调整触发阈值,并利用事件采样状态启动控制行动。为了解决状态触发引起的不连续性问题,我们构建了虚拟控制器,持续采样状态信号,并根据先前触发的状态重新配置实际控制器。结果表明,MAS 的输出能准确跟踪所需的参考信号,同时确保所有闭环信号的有界性。此外,还验证了所提出的控制器不存在 Zeno 行为。最后,我们通过数值模拟证明了控制方法的有效性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
Observer-based reinforcement learning for optimal fault-tolerant consensus control of nonlinear multi-agent systems via a dynamic event-triggered mechanism

In this article, an adaptive optimized consensus tracking control problem is studied for nonlinear strict-feedback dynamic multi-agent systems (MASs), considering both unmeasurable system states and time-varying bias faults. By utilizing the backstepping technique, we develop an adaptive reinforcement learning (RL) algorithm within the observer-critic-actor architecture, specially designed to compensate for the lack of state information and derive control inputs, thereby achieving approximate optimal control. Moreover, an event-triggered mechanism is introduced in the sensor-to-controller channel, which dynamically adjusts the triggering threshold online and employs event-sampled states to initiate control actions. To address discontinuities caused by state triggering, we construct virtual controllers that continuously sample state signals and reconfigure the actual controller based on previously triggered states. The outputs of the MASs are shown to accurately track the desired reference signals while ensuring the boundedness of all closed-loop signals. Additionally, the proposed controller is verified to be devoid of Zeno behavior. Finally, the effectiveness of our control methodology is demonstrated through numerical simulation.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Information Sciences
Information Sciences 工程技术-计算机:信息系统
CiteScore
14.00
自引率
17.30%
发文量
1322
审稿时长
10.4 months
期刊介绍: Informatics and Computer Science Intelligent Systems Applications is an esteemed international journal that focuses on publishing original and creative research findings in the field of information sciences. We also feature a limited number of timely tutorial and surveying contributions. Our journal aims to cater to a diverse audience, including researchers, developers, managers, strategic planners, graduate students, and anyone interested in staying up-to-date with cutting-edge research in information science, knowledge engineering, and intelligent systems. While readers are expected to share a common interest in information science, they come from varying backgrounds such as engineering, mathematics, statistics, physics, computer science, cell biology, molecular biology, management science, cognitive science, neurobiology, behavioral sciences, and biochemistry.
期刊最新文献
Ex-RL: Experience-based reinforcement learning Editorial Board Joint consensus kernel learning and adaptive hypergraph regularization for graph-based clustering RT-DIFTWD: A novel data-driven intuitionistic fuzzy three-way decision model with regret theory Granular correlation-based label-specific feature augmentation for multi-label classification
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1