Event-Based Optimal Containment Control for Constrained Multiagent Systems Using Integral Reinforcement Learning

IF 5 3区 计算机科学 Q2 AUTOMATION & CONTROL SYSTEMS IEEE Transactions on Control of Network Systems Pub Date : 2024-12-03 DOI:10.1109/TCNS.2024.3510353
Zijie Guo;Hongru Ren;Hongyi Li;Tingwen Huang
{"title":"Event-Based Optimal Containment Control for Constrained Multiagent Systems Using Integral Reinforcement Learning","authors":"Zijie Guo;Hongru Ren;Hongyi Li;Tingwen Huang","doi":"10.1109/TCNS.2024.3510353","DOIUrl":null,"url":null,"abstract":"An optimal event-driven containment control problem is studied for partially unknown nonlinear multiagent systems with input constraints and state constraints. Its novelty lies in the optimization of the performance index while ensuring constraints handling abilities on states and inputs. First, an improved discounted cost function is constructed, and the state and input constraint information are encoded into the cost function by barrier functions and nonquadratic utility functions, respectively. Then, the approximate distributed optimal containment control policy is derived by an integral reinforcement learning (IRL)-based adaptive critic design, where the IRL technique can overcome the limitation of known drift dynamics in previous results. In critic neural networks learning, the weight tuning law is presented by virtue of the concurrent learning technique, which relaxes the persistence of excitation conditions by storing appropriate historical data. In order to reduce the amount of information transmitted through the controller-to-actuator channel, a containment error-dependent dynamic event-triggered mechanism is defined. Theoretical results indicate that signals in closed-loop systems driven by event-triggered optimal controllers are uniformly ultimately bounded, and Zeno behavior is avoided. Finally, the effectiveness of the developed method is illustrated by a simulation example on multiple single-link robot manipulators.","PeriodicalId":56023,"journal":{"name":"IEEE Transactions on Control of Network Systems","volume":"12 1","pages":"609-619"},"PeriodicalIF":5.0000,"publicationDate":"2024-12-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Control of Network Systems","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/10772586/","RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"AUTOMATION & CONTROL SYSTEMS","Score":null,"Total":0}
引用次数: 0

Abstract

An optimal event-driven containment control problem is studied for partially unknown nonlinear multiagent systems with input constraints and state constraints. Its novelty lies in the optimization of the performance index while ensuring constraints handling abilities on states and inputs. First, an improved discounted cost function is constructed, and the state and input constraint information are encoded into the cost function by barrier functions and nonquadratic utility functions, respectively. Then, the approximate distributed optimal containment control policy is derived by an integral reinforcement learning (IRL)-based adaptive critic design, where the IRL technique can overcome the limitation of known drift dynamics in previous results. In critic neural networks learning, the weight tuning law is presented by virtue of the concurrent learning technique, which relaxes the persistence of excitation conditions by storing appropriate historical data. In order to reduce the amount of information transmitted through the controller-to-actuator channel, a containment error-dependent dynamic event-triggered mechanism is defined. Theoretical results indicate that signals in closed-loop systems driven by event-triggered optimal controllers are uniformly ultimately bounded, and Zeno behavior is avoided. Finally, the effectiveness of the developed method is illustrated by a simulation example on multiple single-link robot manipulators.
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
基于积分强化学习的约束多智能体系统事件最优包容控制
研究了具有输入约束和状态约束的部分未知非线性多智能体系统的最优事件驱动控制问题。其新颖之处在于在保证状态和输入约束处理能力的同时,对性能指标进行了优化。首先,构造改进的折现成本函数,将状态信息和输入约束信息分别通过障碍函数和非二次效用函数编码到成本函数中;然后,通过基于积分强化学习(IRL)的自适应批评设计,推导出近似的分布式最优包容控制策略,IRL技术可以克服以往结果中已知漂移动力学的限制。在批判神经网络学习中,利用并行学习技术提出了权值调整规律,通过存储适当的历史数据来放松激励条件的持久性。为了减少通过控制器到执行器通道传输的信息量,定义了一个包含错误相关的动态事件触发机制。理论结果表明,由事件触发最优控制器驱动的闭环系统信号最终是一致有界的,并避免了芝诺行为。最后,通过多单连杆机器人的仿真实例验证了所提方法的有效性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
IEEE Transactions on Control of Network Systems
IEEE Transactions on Control of Network Systems Mathematics-Control and Optimization
CiteScore
7.80
自引率
7.10%
发文量
169
期刊介绍: The IEEE Transactions on Control of Network Systems is committed to the timely publication of high-impact papers at the intersection of control systems and network science. In particular, the journal addresses research on the analysis, design and implementation of networked control systems, as well as control over networks. Relevant work includes the full spectrum from basic research on control systems to the design of engineering solutions for automatic control of, and over, networks. The topics covered by this journal include: Coordinated control and estimation over networks, Control and computation over sensor networks, Control under communication constraints, Control and performance analysis issues that arise in the dynamics of networks used in application areas such as communications, computers, transportation, manufacturing, Web ranking and aggregation, social networks, biology, power systems, economics, Synchronization of activities across a controlled network, Stability analysis of controlled networks, Analysis of networks as hybrid dynamical systems.
期刊最新文献
2025 Index IEEE Transactions on Control of Network Systems Vol. 12 IEEE Control Systems Society Information Network-Based Epidemic Control Through Optimal Travel and Quarantine Management. Distributed Adaptive Global Stabilization of a Class of Rigid Formation Systems Node-to-Node Fault-Tolerant Control of Layered Multiagent Systems Under Deception Attack
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1