Pub Date : 2024-09-02DOI: 10.1007/s12555-023-0348-0
Maria Letizia Corradini, Gianluca Ippoliti, Giuseppe Orlando
In this paper, a novel data-driven control algorithm based on model-free adaptive control is presented, addressing general discrete-time single-input single-output nonlinear systems, approximated by an equivalent dynamic linearization model using pseudo-partial derivatives. The closed loop stability is proved, showing that the tracking error asymptotically vanishes. Moreover, the proposed approach has been applied to a 5 MW wind turbine, considering as control target the efficiency optimization issue when the turbine operates under medium wind speed conditions. Validation of the technique has been performed, testing the overall control system by simulation using the tool FAST developed by the National Renewable Energy Laboratory (NREL).
本文提出了一种基于无模型自适应控制的新型数据驱动控制算法,用于处理一般离散时间单输入单输出非线性系统,该系统通过使用伪偏导的等效动态线性化模型进行近似。证明了闭环稳定性,表明跟踪误差渐近消失。此外,建议的方法还应用于 5 兆瓦风力涡轮机,将涡轮机在中等风速条件下运行时的效率优化问题作为控制目标。通过使用美国国家可再生能源实验室(NREL)开发的工具 FAST 进行模拟,对整个控制系统进行了测试,从而对该技术进行了验证。
{"title":"Control of a Wind Turbine Working in the Intermediate Velocity Zone: A Model Free Discrete Time Approach","authors":"Maria Letizia Corradini, Gianluca Ippoliti, Giuseppe Orlando","doi":"10.1007/s12555-023-0348-0","DOIUrl":"https://doi.org/10.1007/s12555-023-0348-0","url":null,"abstract":"<p>In this paper, a novel data-driven control algorithm based on model-free adaptive control is presented, addressing general discrete-time single-input single-output nonlinear systems, approximated by an equivalent dynamic linearization model using pseudo-partial derivatives. The closed loop stability is proved, showing that the tracking error asymptotically vanishes. Moreover, the proposed approach has been applied to a 5 MW wind turbine, considering as control target the efficiency optimization issue when the turbine operates under medium wind speed conditions. Validation of the technique has been performed, testing the overall control system by simulation using the tool FAST developed by the National Renewable Energy Laboratory (NREL).</p>","PeriodicalId":54965,"journal":{"name":"International Journal of Control Automation and Systems","volume":"26 1","pages":""},"PeriodicalIF":3.2,"publicationDate":"2024-09-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142195385","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-08-31DOI: 10.1007/s12555-023-0437-0
Yasin Asadi, Malihe Maghfouri Farsangi, Mohammad Hadi Rezaei
This article presents an improved data-driven adaptive control structure to address the problem of input and output saturation in unknown nonlinear systems with multiple inputs and multiple outputs. In the suggested structure, a virtual model of the controlled system is initially built utilizing a multi-layered group method of data handling neural network. The control signal is then applied to this virtual model to predict the output before being applied to the system. If the predicted output is saturated, the control signals are readjusted to prevent saturation and are then applied to the system. By using this proposed structure, the performance of model-free adaptive control against input/output saturation phenomena is improved and the occurrence of saturation is prevented. Based on Lyapunov’s theory, the stability of the suggested structure is proven. The controller has been applied to an interconnected three-tank system and a subway train which results clearly illustrate the advantages of the suggested method over the traditional form of model-free adaptive control design.
{"title":"Improved Data-driven Adaptive Control Structure Against Input and Output Saturation","authors":"Yasin Asadi, Malihe Maghfouri Farsangi, Mohammad Hadi Rezaei","doi":"10.1007/s12555-023-0437-0","DOIUrl":"https://doi.org/10.1007/s12555-023-0437-0","url":null,"abstract":"<p>This article presents an improved data-driven adaptive control structure to address the problem of input and output saturation in unknown nonlinear systems with multiple inputs and multiple outputs. In the suggested structure, a virtual model of the controlled system is initially built utilizing a multi-layered group method of data handling neural network. The control signal is then applied to this virtual model to predict the output before being applied to the system. If the predicted output is saturated, the control signals are readjusted to prevent saturation and are then applied to the system. By using this proposed structure, the performance of model-free adaptive control against input/output saturation phenomena is improved and the occurrence of saturation is prevented. Based on Lyapunov’s theory, the stability of the suggested structure is proven. The controller has been applied to an interconnected three-tank system and a subway train which results clearly illustrate the advantages of the suggested method over the traditional form of model-free adaptive control design.</p>","PeriodicalId":54965,"journal":{"name":"International Journal of Control Automation and Systems","volume":"64 1","pages":""},"PeriodicalIF":3.2,"publicationDate":"2024-08-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142195330","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-08-31DOI: 10.1007/s12555-023-0626-x
Juan-xia Zhao, Yin-he Wang, Pei-tao Gao
This paper studies how to design a control scheme for a complex dynamical network (CDN) such that the state of nodes and links can track on any given reference signals respectively, under the view that the CDN is coupled by the nodes and links. Since the dynamic behavior of the links reflects the changes in network topology(NT), the weights of the links are regarded as state variables of the NT. In addition, since the state of the links is not always avaluable in practical engineering applications, in order to address this problem, this paper provides an asymptotical state observer that uses its observation values to estimate the links state. Based on this, this paper proposes a new control scheme which designs controllers in the nodes and links respectively, to realize the asymptotical tracking control of the nodes and links. In order to understand the NT tracking target, an illustrative example is that the star topology can be chosen as the NT tracking target of communication transmission network for the centralized management. Finally, the validity of the theoretical results is verified by a numerical experiment that applies the control scheme to a helicopter model.
本文研究了如何在复杂动态网络(CDN)由节点和链路耦合的观点下,设计一种控制方案,使节点和链路的状态能够分别跟踪任意给定的参考信号。由于链路的动态行为反映了网络拓扑结构(NT)的变化,因此链路的权重被视为 NT 的状态变量。此外,由于在实际工程应用中,链路的状态并不总是可用的,为了解决这个问题,本文提供了一种渐近状态观测器,利用其观测值来估计链路状态。在此基础上,本文提出了一种新的控制方案,分别在节点和链路中设计控制器,以实现节点和链路的渐近跟踪控制。为了理解近似跟踪目标,可以选择通信传输网络的星型拓扑结构作为集中管理的近似跟踪目标。最后,将控制方案应用于直升机模型的数值实验验证了理论结果的正确性。
{"title":"Asymptotical Tracking Control of Complex Dynamical Network Based on Links State Observer","authors":"Juan-xia Zhao, Yin-he Wang, Pei-tao Gao","doi":"10.1007/s12555-023-0626-x","DOIUrl":"https://doi.org/10.1007/s12555-023-0626-x","url":null,"abstract":"<p>This paper studies how to design a control scheme for a complex dynamical network (CDN) such that the state of nodes and links can track on any given reference signals respectively, under the view that the CDN is coupled by the nodes and links. Since the dynamic behavior of the links reflects the changes in network topology(NT), the weights of the links are regarded as state variables of the NT. In addition, since the state of the links is not always avaluable in practical engineering applications, in order to address this problem, this paper provides an asymptotical state observer that uses its observation values to estimate the links state. Based on this, this paper proposes a new control scheme which designs controllers in the nodes and links respectively, to realize the asymptotical tracking control of the nodes and links. In order to understand the NT tracking target, an illustrative example is that the star topology can be chosen as the NT tracking target of communication transmission network for the centralized management. Finally, the validity of the theoretical results is verified by a numerical experiment that applies the control scheme to a helicopter model.</p>","PeriodicalId":54965,"journal":{"name":"International Journal of Control Automation and Systems","volume":"5 1","pages":""},"PeriodicalIF":3.2,"publicationDate":"2024-08-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142195329","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-08-02DOI: 10.1007/s12555-023-0441-4
Rafael Crespo Izquierdo, Anselmo Rafael Cukla, Flávio José Lorini, Eduardo André Perondi, Daniel Fernando Tello Gamarra
This study presents an investigation into trajectory planning for a 5-degree-of-freedom pneumatic robot using the firefly metaheuristic algorithm (FMA). The methodology employed uses FMA and is based on the application of 5th-degree B-splines for interpolating intermediate points, aiming to obtain trajectories that consider the lower actuator forces associated with the dynamics of the manipulator under study (objective function). Kinematic and dynamic constraints determined by the operational characteristics of pneumatic servo-positioners were proposed, such as friction modeling, calculation of equivalent mass, velocity, acceleration etc. The results demonstrates that the trajectories generated by the proposed method and by 7th-degree optimized trajectory presented in literature resulted in similar average error and maximum error when applied in the pneumatic robot, indicating that the other issues, such as friction modeling, robot vibration, among others, need to be investigated to improve robot under investigation control.
本研究采用萤火虫元启发式算法(FMA),对 5 自由度气动机器人的轨迹规划进行了研究。所采用的方法以 FMA 为基础,应用五度 B 样条对中间点进行插值,旨在获得考虑到与所研究的机械手动态相关的较低执行器力(目标函数)的轨迹。根据气动伺服定位器的运行特性,提出了运动学和动力学约束,如摩擦建模、等效质量计算、速度、加速度等。结果表明,在气动机器人中应用所提出的方法和文献中的七度优化轨迹生成的轨迹,其平均误差和最大误差相似,这表明需要研究其他问题,如摩擦建模、机器人振动等,以改进所研究的机器人控制。
{"title":"Optimal Trajectory Planning for Pneumatic Cylindrical Manipulator Considering Dynamical and Stick Slip Constraints","authors":"Rafael Crespo Izquierdo, Anselmo Rafael Cukla, Flávio José Lorini, Eduardo André Perondi, Daniel Fernando Tello Gamarra","doi":"10.1007/s12555-023-0441-4","DOIUrl":"https://doi.org/10.1007/s12555-023-0441-4","url":null,"abstract":"<p>This study presents an investigation into trajectory planning for a 5-degree-of-freedom pneumatic robot using the firefly metaheuristic algorithm (FMA). The methodology employed uses FMA and is based on the application of 5th-degree B-splines for interpolating intermediate points, aiming to obtain trajectories that consider the lower actuator forces associated with the dynamics of the manipulator under study (objective function). Kinematic and dynamic constraints determined by the operational characteristics of pneumatic servo-positioners were proposed, such as friction modeling, calculation of equivalent mass, velocity, acceleration etc. The results demonstrates that the trajectories generated by the proposed method and by 7th-degree optimized trajectory presented in literature resulted in similar average error and maximum error when applied in the pneumatic robot, indicating that the other issues, such as friction modeling, robot vibration, among others, need to be investigated to improve robot under investigation control.</p>","PeriodicalId":54965,"journal":{"name":"International Journal of Control Automation and Systems","volume":"45 1","pages":""},"PeriodicalIF":3.2,"publicationDate":"2024-08-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141882745","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
The output regulation (OR) problem for linear heterogeneous networked multi-agent systems (NMAS) with communication constraints is investigated in this paper. A cost function is given to measure the coordinated control between NMAS. The objective of this paper is to design controllers such that not only the cost function is optimized, the asymptotic tracking and disturbance rejection are achieved but also the communication constraints are actively compensated. It is assumed that only a part of agents can receive the information of the exosystem, which can generate the reference signal and the disturbance signal. First, distributed observers are proposed to estimate the states of the subsystems and the state of the exosystem, which can guarantee the exponentially convergence of the estimation errors. Then, an observer-based predictive controller is proposed using feedforward method and networked predictive control method. With the help of OR technique, it indicates that the proposed predictive control scheme can deal with the OR problem. Finally, a numerical example is presented to illustrate our results.
本文研究了具有通信约束的线性异构网络多代理系统(NMAS)的输出调节(OR)问题。本文给出了一个成本函数来衡量 NMAS 之间的协调控制。本文的目标是设计出不仅能优化成本函数、实现渐近跟踪和干扰抑制,而且能积极补偿通信约束的控制器。假设只有一部分代理可以接收外系统的信息,从而产生参考信号和干扰信号。首先,提出了分布式观测器来估计子系统的状态和外系统的状态,这可以保证估计误差的指数收敛性。然后,利用前馈方法和网络化预测控制方法提出了基于观测器的预测控制器。借助 OR 技术,表明所提出的预测控制方案能够处理 OR 问题。最后,通过一个数值示例来说明我们的结果。
{"title":"Cooperative Output Regulation of Heterogeneous Discrete-time Networked Multi-agent Systems With Communication Constraints","authors":"Qingpeng Liang, Jiangping Hu, Linying Xiang, Kaibo Shi, Yanzhi Wu","doi":"10.1007/s12555-023-0339-1","DOIUrl":"https://doi.org/10.1007/s12555-023-0339-1","url":null,"abstract":"<p>The output regulation (OR) problem for linear heterogeneous networked multi-agent systems (NMAS) with communication constraints is investigated in this paper. A cost function is given to measure the coordinated control between NMAS. The objective of this paper is to design controllers such that not only the cost function is optimized, the asymptotic tracking and disturbance rejection are achieved but also the communication constraints are actively compensated. It is assumed that only a part of agents can receive the information of the exosystem, which can generate the reference signal and the disturbance signal. First, distributed observers are proposed to estimate the states of the subsystems and the state of the exosystem, which can guarantee the exponentially convergence of the estimation errors. Then, an observer-based predictive controller is proposed using feedforward method and networked predictive control method. With the help of OR technique, it indicates that the proposed predictive control scheme can deal with the OR problem. Finally, a numerical example is presented to illustrate our results.</p>","PeriodicalId":54965,"journal":{"name":"International Journal of Control Automation and Systems","volume":"11 1","pages":""},"PeriodicalIF":3.2,"publicationDate":"2024-08-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141886846","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
A snake robot should be robust to actuator failures because it has more actuators than required for locomotion. However, controlling a snake robot is problematic if some of the joints become passive because of problems in power supply lines. In a recent study, we proposed a controller to achieve path-following in cases where one of the joints is passive. However, the controller applies only to cases with a single passive joint. With two or more passive joints, it cannot be applied even if sufficient active joints remain. This paper considers the path-following control of a snake robot with passive joints by extending our previous study (the single passive joint case). The validity of the method is verified by numerical simulation.
{"title":"Path-following Control of a Snake Robot With Multiple Passive Joints","authors":"Ryo Ariizumi, Kazunori Sakakibara, Toru Asai, Shun-ichi Azuma","doi":"10.1007/s12555-023-0410-y","DOIUrl":"https://doi.org/10.1007/s12555-023-0410-y","url":null,"abstract":"<p>A snake robot should be robust to actuator failures because it has more actuators than required for locomotion. However, controlling a snake robot is problematic if some of the joints become passive because of problems in power supply lines. In a recent study, we proposed a controller to achieve path-following in cases where one of the joints is passive. However, the controller applies only to cases with a single passive joint. With two or more passive joints, it cannot be applied even if sufficient active joints remain. This paper considers the path-following control of a snake robot with passive joints by extending our previous study (the single passive joint case). The validity of the method is verified by numerical simulation.</p>","PeriodicalId":54965,"journal":{"name":"International Journal of Control Automation and Systems","volume":"31 1","pages":""},"PeriodicalIF":3.2,"publicationDate":"2024-08-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141882660","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
The advancement of foundation models, such as large language models (LLMs), vision-language models (VLMs), diffusion models, and robotics foundation models (RFMs), has become a new paradigm in robotics by offering innovative approaches to the long-standing challenge of building robot autonomy. These models enable the development of robotic agents that can independently understand and reason about semantic contexts, plan actions, physically interact with surroundings, and adapt to new environments and untrained tasks. This paper presents a comprehensive and systematic survey of recent advancements in applying foundation models to robot perception, planning, and control. It introduces the key concepts and terminology associated with foundation models, providing a clear understanding for researchers in robotics and control engineering. The relevant studies are categorized based on how foundation models are utilized in various elements of robotic autonomy, focusing on 1) perception and situational awareness: object detection and classification, semantic understanding, mapping, and navigation; 2) decision making and task planning: mission understanding, task decomposition and coordination, planning with symbolic and learning-based approaches, plan validation and correction, and LLM-robot interaction; 3) motion planning and control: motion planning, control command and reward generation, and trajectory generation and optimization with diffusion models. Furthermore, the survey covers essential environmental setups, including real-world and simulation datasets and platforms used in training and validating these models. It concludes with a discussion on current challenges such as robustness, explainability, data scarcity, and real-time performance, and highlights promising future directions, including retrieval augmented generation, on-device foundation models, and explainability. This survey aims to systematically summarize the latest research trends in applying foundation models to robotics, bridging the gap between the state-of-the-art in artificial intelligence and robotics. By sharing knowledge and resources, this survey is expected to foster the introduction of a new research paradigm for building generalized and autonomous robots.
{"title":"Unlocking Robotic Autonomy: A Survey on the Applications of Foundation Models","authors":"Dae-Sung Jang, Doo-Hyun Cho, Woo-Cheol Lee, Seung-Keol Ryu, Byeongmin Jeong, Minji Hong, Minjo Jung, Minchae Kim, Minjoon Lee, SeungJae Lee, Han-Lim Choi","doi":"10.1007/s12555-024-0438-7","DOIUrl":"https://doi.org/10.1007/s12555-024-0438-7","url":null,"abstract":"<p>The advancement of foundation models, such as large language models (LLMs), vision-language models (VLMs), diffusion models, and robotics foundation models (RFMs), has become a new paradigm in robotics by offering innovative approaches to the long-standing challenge of building robot autonomy. These models enable the development of robotic agents that can independently understand and reason about semantic contexts, plan actions, physically interact with surroundings, and adapt to new environments and untrained tasks. This paper presents a comprehensive and systematic survey of recent advancements in applying foundation models to robot perception, planning, and control. It introduces the key concepts and terminology associated with foundation models, providing a clear understanding for researchers in robotics and control engineering. The relevant studies are categorized based on how foundation models are utilized in various elements of robotic autonomy, focusing on 1) perception and situational awareness: object detection and classification, semantic understanding, mapping, and navigation; 2) decision making and task planning: mission understanding, task decomposition and coordination, planning with symbolic and learning-based approaches, plan validation and correction, and LLM-robot interaction; 3) motion planning and control: motion planning, control command and reward generation, and trajectory generation and optimization with diffusion models. Furthermore, the survey covers essential environmental setups, including real-world and simulation datasets and platforms used in training and validating these models. It concludes with a discussion on current challenges such as robustness, explainability, data scarcity, and real-time performance, and highlights promising future directions, including retrieval augmented generation, on-device foundation models, and explainability. This survey aims to systematically summarize the latest research trends in applying foundation models to robotics, bridging the gap between the state-of-the-art in artificial intelligence and robotics. By sharing knowledge and resources, this survey is expected to foster the introduction of a new research paradigm for building generalized and autonomous robots.</p>","PeriodicalId":54965,"journal":{"name":"International Journal of Control Automation and Systems","volume":"174 1","pages":""},"PeriodicalIF":3.2,"publicationDate":"2024-08-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141882738","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-08-02DOI: 10.1007/s12555-023-0432-5
Bo Zhang, Pudong Liu, Jintao Lai, Xiaoshan Bai
In this paper, a wave-to-wire global optimal control framework for a networked wave-energy converter array (WECA) power system is presented. For the proposed framework, a distributed global optimal control method considering maximum wave energy harvesting and optimal power dispatch (OPD) is developed in the WECA system for precise power output. First, the WECA including G-type and S-type nodes is modeled, and the corresponding model predictive control (MPC) and primary control strategy are developed to maximally harvest the wave energy and to accurately track the dispatched reference power. Second, a distributed OPD method integrating convex optimization and consensus is proposed to actively regulate each energy storage (ES) unit and to manage the power system to satisfy the specified power output reference. Finally, the effectiveness of the proposed control method is investigated and analyzed by semi-physical hardware-in-loop simulation tests. The results of the experiments demonstrate that the power system output matches with the specified power demand, and indicate reliable performance.
本文介绍了网络化波能转换阵列(WECA)电力系统的波-线全局优化控制框架。针对所提出的框架,在 WECA 系统中开发了一种分布式全局最优控制方法,考虑了最大波能收集和最优功率调度 (OPD),以获得精确的功率输出。首先,对包括 G 型和 S 型节点在内的 WECA 进行建模,并开发了相应的模型预测控制 (MPC) 和主控策略,以最大限度地收集波浪能并精确跟踪调度参考功率。其次,提出了一种集成了凸优化和共识的分布式 OPD 方法,用于主动调节每个储能 (ES) 单元,并管理电力系统以满足指定的功率输出参考。最后,通过半物理硬件在环仿真测试研究和分析了所提控制方法的有效性。实验结果表明,电力系统输出与指定的电力需求相匹配,性能可靠。
{"title":"A Wave-to-wire Global Optimal Control Strategy for Networked Power Systems With a Wave-energy Converter Array","authors":"Bo Zhang, Pudong Liu, Jintao Lai, Xiaoshan Bai","doi":"10.1007/s12555-023-0432-5","DOIUrl":"https://doi.org/10.1007/s12555-023-0432-5","url":null,"abstract":"<p>In this paper, a wave-to-wire global optimal control framework for a networked wave-energy converter array (WECA) power system is presented. For the proposed framework, a distributed global optimal control method considering maximum wave energy harvesting and optimal power dispatch (OPD) is developed in the WECA system for precise power output. First, the WECA including G-type and S-type nodes is modeled, and the corresponding model predictive control (MPC) and primary control strategy are developed to maximally harvest the wave energy and to accurately track the dispatched reference power. Second, a distributed OPD method integrating convex optimization and consensus is proposed to actively regulate each energy storage (ES) unit and to manage the power system to satisfy the specified power output reference. Finally, the effectiveness of the proposed control method is investigated and analyzed by semi-physical hardware-in-loop simulation tests. The results of the experiments demonstrate that the power system output matches with the specified power demand, and indicate reliable performance.</p>","PeriodicalId":54965,"journal":{"name":"International Journal of Control Automation and Systems","volume":"106 1","pages":""},"PeriodicalIF":3.2,"publicationDate":"2024-08-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141882740","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-08-02DOI: 10.1007/s12555-023-0358-y
Xuan Zheng, Shuaiming Yuan, Pengzhan Chen
With the increasing complexity of the robot grasping environment, it puts forward higher requirements on the grasping strategy of manipulators. However, grasping cluttered multi-class objects is a challenging task because the objects are stacked and occluded from each other, and it is often difficult for robots to find a suitable grasping position. Deep reinforcement learning with DQN algorithm has been used to study the pushing and grasping strategy to manipulate cluttered multi-class objects. However, there exists long learning time and low success rate. To solve this problem, we adopt two fully convolutional networks (FCN) to map the color and depth maps to actions: pushing and grasping. These two networks are trained by an improved soft actor-critic algorithm that includes auto entropy regularization, regularized objective function and clipped double Q learning. Pushing and grasping synergies has been learned with the dense reward feedback. The simulation experiment demonstrate that the learning process converges quickly and stable with a grasp success rate up to 83.3%. We further demonstrate the generalization ability and well performance of our models when novel objects appear in the scenes that the robot has never grasped before. Finally, real-world experiments with trained models from simulations are conducted to test the grasping performance on manually arranged scenes.
{"title":"Robotic Autonomous Grasping Strategy and System for Cluttered Multi-class Objects","authors":"Xuan Zheng, Shuaiming Yuan, Pengzhan Chen","doi":"10.1007/s12555-023-0358-y","DOIUrl":"https://doi.org/10.1007/s12555-023-0358-y","url":null,"abstract":"<p>With the increasing complexity of the robot grasping environment, it puts forward higher requirements on the grasping strategy of manipulators. However, grasping cluttered multi-class objects is a challenging task because the objects are stacked and occluded from each other, and it is often difficult for robots to find a suitable grasping position. Deep reinforcement learning with DQN algorithm has been used to study the pushing and grasping strategy to manipulate cluttered multi-class objects. However, there exists long learning time and low success rate. To solve this problem, we adopt two fully convolutional networks (FCN) to map the color and depth maps to actions: pushing and grasping. These two networks are trained by an improved soft actor-critic algorithm that includes auto entropy regularization, regularized objective function and clipped double <i>Q</i> learning. Pushing and grasping synergies has been learned with the dense reward feedback. The simulation experiment demonstrate that the learning process converges quickly and stable with a grasp success rate up to 83.3%. We further demonstrate the generalization ability and well performance of our models when novel objects appear in the scenes that the robot has never grasped before. Finally, real-world experiments with trained models from simulations are conducted to test the grasping performance on manually arranged scenes.</p>","PeriodicalId":54965,"journal":{"name":"International Journal of Control Automation and Systems","volume":"75 1","pages":""},"PeriodicalIF":3.2,"publicationDate":"2024-08-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141882746","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-08-02DOI: 10.1007/s12555-023-0015-5
Te Ma, Zhenhua Deng, Chen Hu
This paper investigates the N-coalition game, which covers the generalized Nash equilibrium problems (GNEPs) and distributed optimization problems. To seek the Nash equilibrium of the N-coalition games, we firstly exploit a centralized algorithm. Under the full information, the algorithm can exponentially converge to the Nash equilibrium of the N-coalition games. Then, based on the extremum seeking (ES) approach, we extend the centralized algorithm to distributed counterpart. Different from the centralized algorithm, the explicit cost functions are not available in the distributed algorithm. The players not only can converge to a small neighborhood of the Nash equilibrium, but do not communicate with the other coalitions. Furthermore, in order to reduce the communication burden in intra-coalition, an event-triggered based distributed algorithm is proposed. By the algorithm, the players only communicate with their neighbors in intra-coalition at event-triggered time constants, and also can converge to a neighborhood of the Nash equilibrium of the N-coalition games. Finally, an example about Nash-Cournot game is given to illustrate the effectiveness of our algorithms.
本文研究了 N 个联盟博弈,其中包括广义纳什均衡问题(GNEP)和分布式优化问题。为了寻求 N 个联盟博弈的纳什均衡,我们首先利用了一种集中算法。在全信息条件下,该算法可以指数级收敛到 N 个联盟博弈的纳什均衡。然后,基于极值搜索(ES)方法,我们将集中式算法扩展为分布式算法。与集中式算法不同,分布式算法中没有显式成本函数。玩家不仅可以收敛到纳什均衡的一个小邻域,而且不会与其他联盟交流。此外,为了减少联盟内部的通信负担,还提出了一种基于事件触发的分布式算法。通过该算法,博弈者只需在事件触发的时间常数下与联盟内的邻居交流,而且还能收敛到 N 个联盟博弈的纳什均衡邻域。最后,我们举了一个纳什-库诺博弈的例子来说明算法的有效性。
{"title":"Extremum-seeking Based Approach for Distributed Noncooperative N-coalition Games","authors":"Te Ma, Zhenhua Deng, Chen Hu","doi":"10.1007/s12555-023-0015-5","DOIUrl":"https://doi.org/10.1007/s12555-023-0015-5","url":null,"abstract":"<p>This paper investigates the N-coalition game, which covers the generalized Nash equilibrium problems (GNEPs) and distributed optimization problems. To seek the Nash equilibrium of the N-coalition games, we firstly exploit a centralized algorithm. Under the full information, the algorithm can exponentially converge to the Nash equilibrium of the N-coalition games. Then, based on the extremum seeking (ES) approach, we extend the centralized algorithm to distributed counterpart. Different from the centralized algorithm, the explicit cost functions are not available in the distributed algorithm. The players not only can converge to a small neighborhood of the Nash equilibrium, but do not communicate with the other coalitions. Furthermore, in order to reduce the communication burden in intra-coalition, an event-triggered based distributed algorithm is proposed. By the algorithm, the players only communicate with their neighbors in intra-coalition at event-triggered time constants, and also can converge to a neighborhood of the Nash equilibrium of the N-coalition games. Finally, an example about Nash-Cournot game is given to illustrate the effectiveness of our algorithms.</p>","PeriodicalId":54965,"journal":{"name":"International Journal of Control Automation and Systems","volume":"43 1","pages":""},"PeriodicalIF":3.2,"publicationDate":"2024-08-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141882749","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}