首页 > 最新文献

Annual Reviews in Control最新文献

英文 中文
Survey of distributed algorithms for resource allocation over multi-agent systems 多智能体系统资源分配的分布式算法综述
IF 7.3 2区 计算机科学 Q1 AUTOMATION & CONTROL SYSTEMS Pub Date : 2025-01-01 Epub Date: 2024-11-29 DOI: 10.1016/j.arcontrol.2024.100983
Mohammadreza Doostmohammadian , Alireza Aghasi , Mohammad Pirani , Ehsan Nekouei , Houman Zarrabi , Reza Keypour , Apostolos I. Rikos , Karl H. Johansson
Resource allocation and scheduling in multi-agent systems present challenges due to complex interactions and decentralization. This survey paper provides a comprehensive analysis of distributed algorithms for addressing the distributed resource allocation (DRA) problem over multi-agent systems. It covers a significant area of research at the intersection of optimization, multi-agent systems, and distributed consensus-based computing. The paper begins by presenting a mathematical formulation of the DRA problem, establishing a solid foundation for further exploration. Real-world applications of DRA in various domains are examined to underscore the importance of efficient resource allocation, and relevant distributed optimization formulations are presented. The survey then delves into existing solutions for DRA, encompassing linear, nonlinear, primal-based, and dual-formulation-based approaches. Furthermore, this paper evaluates the features and properties of DRA algorithms, addressing key aspects such as feasibility, convergence rate, and network reliability. The analysis of mathematical foundations, diverse applications, existing solutions, and algorithmic properties contributes to a broader comprehension of the challenges and potential solutions for this domain.
多智能体系统中的资源分配和调度由于复杂的交互和分散性而面临挑战。本文全面分析了多智能体系统中用于解决分布式资源分配问题的分布式算法。它涵盖了优化、多智能体系统和基于共识的分布式计算交叉研究的重要领域。本文首先给出了DRA问题的数学公式,为进一步的探索奠定了坚实的基础。研究了DRA在各个领域的实际应用,强调了有效分配资源的重要性,并提出了相关的分布式优化公式。然后,调查深入研究了现有的DRA解决方案,包括线性、非线性、基于原始和基于双公式的方法。此外,本文评估了DRA算法的特征和性质,解决了可行性、收敛速度和网络可靠性等关键方面的问题。对数学基础、各种应用、现有解决方案和算法属性的分析有助于更广泛地理解该领域的挑战和潜在解决方案。
{"title":"Survey of distributed algorithms for resource allocation over multi-agent systems","authors":"Mohammadreza Doostmohammadian ,&nbsp;Alireza Aghasi ,&nbsp;Mohammad Pirani ,&nbsp;Ehsan Nekouei ,&nbsp;Houman Zarrabi ,&nbsp;Reza Keypour ,&nbsp;Apostolos I. Rikos ,&nbsp;Karl H. Johansson","doi":"10.1016/j.arcontrol.2024.100983","DOIUrl":"10.1016/j.arcontrol.2024.100983","url":null,"abstract":"<div><div>Resource allocation and scheduling in multi-agent systems present challenges due to complex interactions and decentralization. This survey paper provides a comprehensive analysis of distributed algorithms for addressing the distributed resource allocation (DRA) problem over multi-agent systems. It covers a significant area of research at the intersection of optimization, multi-agent systems, and distributed consensus-based computing. The paper begins by presenting a mathematical formulation of the DRA problem, establishing a solid foundation for further exploration. Real-world applications of DRA in various domains are examined to underscore the importance of efficient resource allocation, and relevant distributed optimization formulations are presented. The survey then delves into existing solutions for DRA, encompassing linear, nonlinear, primal-based, and dual-formulation-based approaches. Furthermore, this paper evaluates the features and properties of DRA algorithms, addressing key aspects such as feasibility, convergence rate, and network reliability. The analysis of mathematical foundations, diverse applications, existing solutions, and algorithmic properties contributes to a broader comprehension of the challenges and potential solutions for this domain.</div></div>","PeriodicalId":50750,"journal":{"name":"Annual Reviews in Control","volume":"59 ","pages":"Article 100983"},"PeriodicalIF":7.3,"publicationDate":"2025-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142746294","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Implementation of deep reinforcement learning in permanent magnet synchronous motors control: A review 深度强化学习在永磁同步电机控制中的应用综述
IF 10.7 2区 计算机科学 Q1 AUTOMATION & CONTROL SYSTEMS Pub Date : 2025-01-01 Epub Date: 2025-09-04 DOI: 10.1016/j.arcontrol.2025.101014
Larbi Assem Moulai , Fardila M. Zaihidee , Saad Mekhilef , Jing Rui Tang , Marizan Mubin
Permanent Magnet Synchronous Motors (PMSMs) are recognized for high efficiency, torque-to-inertia ratio, and robust properties, making them ideal for the rapid development of electric vehicles, robotics, and the aerospace industry. Recently, Deep Reinforcement Learning (DRL) algorithms have gained significant attention in the control domain due to their independence from plant models and advanced decision-making capabilities. These features make DRL highly suitable for addressing challenges in PMSM control such as load disturbances, speed tracking, and parameter variations. This review explores recent DRL techniques applied to PMSM speed, current, and torque control. Discrete and continuous algorithms, including Deep Q-Network (DQN), Deep Deterministic Policy Gradient (DDPG), and Twin Delayed DDPG (TD3), are examined in terms of their basic principles, practical implementations, and the benefits they provide in overcoming challenges in PMSM control. In addition, to demonstrate the efficiency of DRL, the review provides a summary and comparison of DRL applied to optimize classical control methods elaborated within various PMSM control strategies. Comparisons of DRL implementations in PMSM control are highlighted to validate their real-time applicability in experiments, and potential areas for future research and improvement are outlined.
永磁同步电机(pmms)以高效率、转惯量比和坚固的性能而闻名,使其成为电动汽车、机器人和航空航天工业快速发展的理想选择。近年来,深度强化学习(DRL)算法因其独立于植物模型和先进的决策能力而在控制领域受到了广泛关注。这些特性使得DRL非常适合解决PMSM控制中的挑战,如负载干扰、速度跟踪和参数变化。本文综述了最近应用于永磁同步电机速度、电流和转矩控制的DRL技术。本文对离散和连续算法,包括深度q -网络(DQN)、深度确定性策略梯度(DDPG)和双延迟DDPG (TD3)的基本原理、实际实现以及它们在克服永磁同步电机控制挑战方面提供的好处进行了研究。此外,为了证明DRL的有效性,本文总结和比较了DRL在各种永磁同步电机控制策略中用于优化经典控制方法的应用。重点比较了DRL在PMSM控制中的实现,验证了它们在实验中的实时性,并概述了未来可能的研究和改进领域。
{"title":"Implementation of deep reinforcement learning in permanent magnet synchronous motors control: A review","authors":"Larbi Assem Moulai ,&nbsp;Fardila M. Zaihidee ,&nbsp;Saad Mekhilef ,&nbsp;Jing Rui Tang ,&nbsp;Marizan Mubin","doi":"10.1016/j.arcontrol.2025.101014","DOIUrl":"10.1016/j.arcontrol.2025.101014","url":null,"abstract":"<div><div>Permanent Magnet Synchronous Motors (PMSMs) are recognized for high efficiency, torque-to-inertia ratio, and robust properties, making them ideal for the rapid development of electric vehicles, robotics, and the aerospace industry. Recently, Deep Reinforcement Learning (DRL) algorithms have gained significant attention in the control domain due to their independence from plant models and advanced decision-making capabilities. These features make DRL highly suitable for addressing challenges in PMSM control such as load disturbances, speed tracking, and parameter variations. This review explores recent DRL techniques applied to PMSM speed, current, and torque control. Discrete and continuous algorithms, including Deep Q-Network (DQN), Deep Deterministic Policy Gradient (DDPG), and Twin Delayed DDPG (TD3), are examined in terms of their basic principles, practical implementations, and the benefits they provide in overcoming challenges in PMSM control. In addition, to demonstrate the efficiency of DRL, the review provides a summary and comparison of DRL applied to optimize classical control methods elaborated within various PMSM control strategies. Comparisons of DRL implementations in PMSM control are highlighted to validate their real-time applicability in experiments, and potential areas for future research and improvement are outlined.</div></div>","PeriodicalId":50750,"journal":{"name":"Annual Reviews in Control","volume":"60 ","pages":"Article 101014"},"PeriodicalIF":10.7,"publicationDate":"2025-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144988558","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Generalized inverse optimal control and its application in biology 广义逆最优控制及其在生物学中的应用
IF 10.7 2区 计算机科学 Q1 AUTOMATION & CONTROL SYSTEMS Pub Date : 2025-01-01 Epub Date: 2025-10-07 DOI: 10.1016/j.arcontrol.2025.101029
Julio R. Banga , Sebastian Sager
Living organisms exhibit remarkable adaptations across all scales, from molecules to ecosystems. We believe that many of these adaptations correspond to optimal solutions driven by evolution, training, and underlying physical and chemical laws and constraints. While some argue against such optimality principles due to their potential ambiguity, we propose generalized inverse optimal control to infer them directly from data. This comprehensive approach incorporates multi-criteria optimality, nestedness of objective functions on different scales, the presence of active constraints, the possibility of switches of optimality principles during the observed time horizon, maximization of robustness and minimization of time as important special cases, as well as uncertainties involved with the mathematical modeling of biological systems. This data-driven approach ensures that optimality principles are not merely theoretical constructs but are firmly rooted in experimental observations. The inferred principles can also be used in forward optimal control to predict and manipulate biological systems, with possible applications in bio-medicine, biotechnology, and agriculture. As discussed and illustrated, the well-posed problem formulation and the inference are challenging and require a substantial interdisciplinary effort in the development of theory and robust numerical methods.
从分子到生态系统,生物体在所有尺度上都表现出非凡的适应性。我们相信,这些适应中的许多都是由进化、训练以及潜在的物理和化学定律和约束所驱动的最佳解决方案。虽然有些人反对这种最优性原则,因为它们潜在的模糊性,我们提出广义逆最优控制,直接从数据中推断它们。这种综合方法结合了多准则最优性、不同尺度上目标函数的嵌套性、主动约束的存在、在观察时间范围内最优性原则切换的可能性、鲁棒性最大化和时间最小化作为重要的特殊情况,以及与生物系统数学建模相关的不确定性。这种数据驱动的方法确保了最优性原则不仅仅是理论结构,而是牢固地植根于实验观察。推断出的原理也可以用于前向最优控制,以预测和操纵生物系统,可能应用于生物医学,生物技术和农业。正如所讨论和说明的那样,适定问题的表述和推理是具有挑战性的,需要在理论和稳健的数值方法的发展中进行大量的跨学科努力。
{"title":"Generalized inverse optimal control and its application in biology","authors":"Julio R. Banga ,&nbsp;Sebastian Sager","doi":"10.1016/j.arcontrol.2025.101029","DOIUrl":"10.1016/j.arcontrol.2025.101029","url":null,"abstract":"<div><div>Living organisms exhibit remarkable adaptations across all scales, from molecules to ecosystems. We believe that many of these adaptations correspond to optimal solutions driven by evolution, training, and underlying physical and chemical laws and constraints. While some argue against such optimality principles due to their potential ambiguity, we propose generalized inverse optimal control to infer them directly from data. This comprehensive approach incorporates multi-criteria optimality, nestedness of objective functions on different scales, the presence of active constraints, the possibility of switches of optimality principles during the observed time horizon, maximization of robustness and minimization of time as important special cases, as well as uncertainties involved with the mathematical modeling of biological systems. This data-driven approach ensures that optimality principles are not merely theoretical constructs but are firmly rooted in experimental observations. The inferred principles can also be used in forward optimal control to predict and manipulate biological systems, with possible applications in bio-medicine, biotechnology, and agriculture. As discussed and illustrated, the well-posed problem formulation and the inference are challenging and require a substantial interdisciplinary effort in the development of theory and robust numerical methods.</div></div>","PeriodicalId":50750,"journal":{"name":"Annual Reviews in Control","volume":"60 ","pages":"Article 101029"},"PeriodicalIF":10.7,"publicationDate":"2025-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145265649","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A view on learning robust goal-conditioned value functions: Interplay between RL and MPC 鲁棒目标条件值函数的学习:RL与MPC的相互作用
IF 10.7 2区 计算机科学 Q1 AUTOMATION & CONTROL SYSTEMS Pub Date : 2025-01-01 Epub Date: 2025-10-10 DOI: 10.1016/j.arcontrol.2025.101027
Nathan P. Lawrence , Philip D. Loewen , Michael G. Forbes , R. Bhushan Gopaluni , Ali Mesbah
Reinforcement learning (RL) and model predictive control (MPC) offer a wealth of distinct approaches for automatic decision-making under uncertainty. Given the impact both fields have had independently across numerous domains, there is growing interest in combining the general-purpose learning capability of RL with the safety and robustness features of MPC. To this end, this paper presents a tutorial-style treatment of RL and MPC, treating them as alternative approaches to solving Markov decision processes. In our formulation, RL aims to learn a global value function through offline exploration in an uncertain environment, whereas MPC constructs a local value function through online optimization. This local–global perspective suggests new ways to design policies that combine robustness and goal-conditioned learning. Robustness is incorporated into the RL and MPC pipelines through a scenario-based approach. Goal-conditioned learning aims to alleviate the burden of engineering a reward function for RL. Combining the two leads to a single policy that unites a robust, high-level RL terminal value function with short-term, scenario-based MPC planning for reliable constraint satisfaction. This approach leverages the benefits of both RL and MPC, the effectiveness of which is demonstrated on classical control benchmarks.
强化学习(RL)和模型预测控制(MPC)为不确定条件下的自动决策提供了多种不同的方法。考虑到这两个领域在许多领域都具有独立的影响,将RL的通用学习能力与MPC的安全性和鲁棒性相结合的兴趣越来越大。为此,本文提出了RL和MPC的教程式处理,将它们视为解决马尔可夫决策过程的替代方法。在我们的公式中,RL旨在通过在不确定环境下的离线探索学习全局价值函数,而MPC通过在线优化构建局部价值函数。这种局部-全球视角提出了结合鲁棒性和目标条件学习的新策略设计方法。鲁棒性通过基于场景的方法整合到RL和MPC管道中。目标条件学习旨在减轻强化学习中奖励函数的工程化负担。将两者结合起来,就形成了一个单一的策略,该策略将强大的、高水平的RL终端价值功能与短期的、基于场景的MPC规划结合起来,以实现可靠的约束满足。这种方法利用了RL和MPC的优点,其有效性在经典控制基准测试中得到了证明。
{"title":"A view on learning robust goal-conditioned value functions: Interplay between RL and MPC","authors":"Nathan P. Lawrence ,&nbsp;Philip D. Loewen ,&nbsp;Michael G. Forbes ,&nbsp;R. Bhushan Gopaluni ,&nbsp;Ali Mesbah","doi":"10.1016/j.arcontrol.2025.101027","DOIUrl":"10.1016/j.arcontrol.2025.101027","url":null,"abstract":"<div><div>Reinforcement learning (RL) and model predictive control (MPC) offer a wealth of distinct approaches for automatic decision-making under uncertainty. Given the impact both fields have had independently across numerous domains, there is growing interest in combining the general-purpose learning capability of RL with the safety and robustness features of MPC. To this end, this paper presents a tutorial-style treatment of RL and MPC, treating them as alternative approaches to solving Markov decision processes. In our formulation, RL aims to learn a <em>global</em> value function through offline exploration in an uncertain environment, whereas MPC constructs a <em>local</em> value function through online optimization. This local–global perspective suggests new ways to design policies that combine robustness and goal-conditioned learning. Robustness is incorporated into the RL and MPC pipelines through a scenario-based approach. Goal-conditioned learning aims to alleviate the burden of engineering a reward function for RL. Combining the two leads to a single policy that unites a robust, high-level RL terminal value function with short-term, scenario-based MPC planning for reliable constraint satisfaction. This approach leverages the benefits of both RL and MPC, the effectiveness of which is demonstrated on classical control benchmarks.</div></div>","PeriodicalId":50750,"journal":{"name":"Annual Reviews in Control","volume":"60 ","pages":"Article 101027"},"PeriodicalIF":10.7,"publicationDate":"2025-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145265773","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Distributed design of ultra large-scale control systems: Progress, Challenges, and Prospects 超大规模控制系统的分布式设计:进展、挑战与展望
IF 7.3 2区 计算机科学 Q1 AUTOMATION & CONTROL SYSTEMS Pub Date : 2025-01-01 Epub Date: 2025-04-07 DOI: 10.1016/j.arcontrol.2025.100987
Leonardo Pedroso , Pedro Batista , W.P.M.H. (Maurice) Heemels
The transition from large centralized complex control systems to distributed configurations that rely on a network of a very large number of interconnected simpler subsystems is ongoing and inevitable in many applications. It is attributed to the quest for resilience, flexibility, and scalability in a multitude of engineering fields with far-reaching societal impact. Although many design methods for distributed and decentralized control systems are available, most of them rely on a centralized design procedure requiring some form of global information of the whole system. Clearly, beyond a certain scale of the network, these centralized design procedures for distributed controllers are no longer feasible and we refer to the corresponding systems as ultra large-scale systems (ULSS). For these ULSS, design algorithms are needed that are distributed themselves among the subsystems and are subject to stringent requirements regarding communication, computation, and memory usage of each subsystem. In this paper, a set of requirements is provided that assures a feasible real-time implementation of all phases of a control solution on an ultra large scale. State-of-the-art approaches are reviewed in the light of these requirements and the challenges hampering the development of befitting control algorithms are pinpointed. Comparing the challenges with the current progress leads to the identification and motivation of promising research directions.
在许多应用中,从大型集中式复杂控制系统到依赖于大量相互连接的简单子系统的网络的分布式配置的转变正在进行并且是不可避免的。这是由于对具有深远社会影响的众多工程领域的弹性,灵活性和可扩展性的追求。虽然有许多分布式和分散控制系统的设计方法,但大多数都依赖于需要整个系统的某种形式的全局信息的集中设计过程。显然,超过一定的网络规模,这些分布式控制器的集中设计程序就不再可行了,我们将相应的系统称为超大规模系统(ULSS)。对于这些ULSS,需要设计算法,这些算法本身分布在子系统之间,并且对每个子系统的通信、计算和内存使用都有严格的要求。在本文中,提供了一组要求,以确保在超大规模的控制解决方案的所有阶段都是可行的实时实现。根据这些要求,对最先进的方法进行了审查,并指出了阻碍适当控制算法发展的挑战。将挑战与当前的进展进行比较,可以识别和激励有前途的研究方向。
{"title":"Distributed design of ultra large-scale control systems: Progress, Challenges, and Prospects","authors":"Leonardo Pedroso ,&nbsp;Pedro Batista ,&nbsp;W.P.M.H. (Maurice) Heemels","doi":"10.1016/j.arcontrol.2025.100987","DOIUrl":"10.1016/j.arcontrol.2025.100987","url":null,"abstract":"<div><div>The transition from large centralized complex control systems to distributed configurations that rely on a network of a very large number of interconnected simpler subsystems is ongoing and inevitable in many applications. It is attributed to the quest for resilience, flexibility, and scalability in a multitude of engineering fields with far-reaching societal impact. Although many design methods for distributed and decentralized control systems are available, most of them rely on a centralized design procedure requiring some form of global information of the whole system. Clearly, beyond a certain scale of the network, these centralized design procedures for distributed controllers are no longer feasible and we refer to the corresponding systems as <em>ultra large-scale systems</em> (ULSS). For these ULSS, design algorithms are needed that are distributed themselves among the subsystems and are subject to stringent requirements regarding communication, computation, and memory usage of each subsystem. In this paper, a set of requirements is provided that assures a feasible real-time implementation of all phases of a control solution on an ultra large scale. State-of-the-art approaches are reviewed in the light of these requirements and the challenges hampering the development of befitting control algorithms are pinpointed. Comparing the challenges with the current progress leads to the identification and motivation of promising research directions.</div></div>","PeriodicalId":50750,"journal":{"name":"Annual Reviews in Control","volume":"59 ","pages":"Article 100987"},"PeriodicalIF":7.3,"publicationDate":"2025-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143792201","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A review on VSC-HVDC control schemes VSC-HVDC 控制方案综述
IF 7.3 2区 计算机科学 Q1 AUTOMATION & CONTROL SYSTEMS Pub Date : 2025-01-01 Epub Date: 2025-03-21 DOI: 10.1016/j.arcontrol.2025.100988
Juan Ramón Camarillo-Peñaranda , Ana Carolina Cunha , Bruno W. França , Francis de Abreu Oliveira , Luan de Oliveira Senna
Designing a VSC-HVDC controller capable of effectively operating in most operational scenarios is challenging due to the highly complex dynamics, unexpected failures, and system uncertainty prevalent in a broad range of post-deployment situations. Furthermore, the stability of the closed-loop system stands as a crucial and undeniable aspect that necessitates special attention during the system development phase. From today’s point of view, this review provides a comprehensive overview of the literature on control technologies, their characteristics, and control options applicable to HVDC systems. This article discusses their applications, advantages, limitations, and recent developments within these techniques.
由于高度复杂的动态、意外故障以及在广泛的部署后情况下普遍存在的系统不确定性,设计能够在大多数操作场景中有效运行的vcs - hvdc控制器具有挑战性。此外,在系统开发阶段,闭环系统的稳定性是一个至关重要和不可否认的方面,需要特别注意。从今天的角度来看,这篇综述提供了一个关于控制技术的文献的全面概述,它们的特点,以及适用于高压直流系统的控制选项。本文讨论了它们的应用、优点、限制以及这些技术的最新发展。
{"title":"A review on VSC-HVDC control schemes","authors":"Juan Ramón Camarillo-Peñaranda ,&nbsp;Ana Carolina Cunha ,&nbsp;Bruno W. França ,&nbsp;Francis de Abreu Oliveira ,&nbsp;Luan de Oliveira Senna","doi":"10.1016/j.arcontrol.2025.100988","DOIUrl":"10.1016/j.arcontrol.2025.100988","url":null,"abstract":"<div><div>Designing a VSC-HVDC controller capable of effectively operating in most operational scenarios is challenging due to the highly complex dynamics, unexpected failures, and system uncertainty prevalent in a broad range of post-deployment situations. Furthermore, the stability of the closed-loop system stands as a crucial and undeniable aspect that necessitates special attention during the system development phase. From today’s point of view, this review provides a comprehensive overview of the literature on control technologies, their characteristics, and control options applicable to HVDC systems. This article discusses their applications, advantages, limitations, and recent developments within these techniques.</div></div>","PeriodicalId":50750,"journal":{"name":"Annual Reviews in Control","volume":"59 ","pages":"Article 100988"},"PeriodicalIF":7.3,"publicationDate":"2025-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143687059","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Gaussian processes for dynamics learning in model predictive control 模型预测控制中动态学习的高斯过程
IF 10.7 2区 计算机科学 Q1 AUTOMATION & CONTROL SYSTEMS Pub Date : 2025-01-01 Epub Date: 2025-11-08 DOI: 10.1016/j.arcontrol.2025.101034
Anna Scampicchio, Elena Arcari, Amon Lahr , Melanie N. Zeilinger
Due to its state-of-the-art estimation performance complemented by rigorous and non-conservative uncertainty bounds, Gaussian process regression is a popular tool for enhancing dynamical system models and coping with their inaccuracies. This has enabled a plethora of successful implementations of Gaussian process-based model predictive control in a variety of applications over the last years. However, despite its evident practical effectiveness, there are still many open questions when attempting to analyze the associated optimal control problem theoretically and to exploit the full potential of Gaussian process regression in view of safe learning-based control. The contribution of this review is twofold. The first is to survey the available literature on the topic, highlighting the major theoretical challenges such as (i) addressing scalability issues of Gaussian process regression; (ii) taking into account the necessary approximations to obtain a tractable MPC formulation; (iii) including online model updates to refine the dynamics description, exploiting data collected during operation. The second is to provide an extensive discussion of future research directions, collecting results on uncertainty quantification that are related to (but yet unexploited in) optimal control, among others. Ultimately, this paper provides a toolkit to study and advance Gaussian process-based model predictive control.
由于其最先进的估计性能加上严格和非保守的不确定性界限,高斯过程回归是增强动力系统模型和处理其不准确性的流行工具。在过去的几年中,这使得基于高斯过程的模型预测控制在各种应用中获得了大量成功的实现。然而,尽管它具有明显的实际有效性,但在试图从理论上分析相关的最优控制问题以及从基于安全学习的控制角度充分利用高斯过程回归的潜力时,仍然存在许多悬而未决的问题。这篇综述的贡献是双重的。首先是调查关于该主题的现有文献,突出主要的理论挑战,如(i)解决高斯过程回归的可扩展性问题;(ii)考虑到必要的近似,以获得可处理的MPC配方;(iii)利用在操作过程中收集的数据,包括在线模型更新以完善动力学描述。第二是对未来的研究方向进行广泛的讨论,收集与最优控制相关(但尚未开发)的不确定性量化结果等。最后,本文提供了一个工具箱来研究和推进基于高斯过程的模型预测控制。
{"title":"Gaussian processes for dynamics learning in model predictive control","authors":"Anna Scampicchio,&nbsp;Elena Arcari,&nbsp;Amon Lahr ,&nbsp;Melanie N. Zeilinger","doi":"10.1016/j.arcontrol.2025.101034","DOIUrl":"10.1016/j.arcontrol.2025.101034","url":null,"abstract":"<div><div>Due to its state-of-the-art estimation performance complemented by rigorous and non-conservative uncertainty bounds, Gaussian process regression is a popular tool for enhancing dynamical system models and coping with their inaccuracies. This has enabled a plethora of successful implementations of Gaussian process-based model predictive control in a variety of applications over the last years. However, despite its evident practical effectiveness, there are still many open questions when attempting to analyze the associated optimal control problem theoretically and to exploit the full potential of Gaussian process regression in view of safe learning-based control. The contribution of this review is twofold. The first is to survey the available literature on the topic, highlighting the major theoretical challenges such as (i) addressing scalability issues of Gaussian process regression; (ii) taking into account the necessary approximations to obtain a tractable MPC formulation; (iii) including online model updates to refine the dynamics description, exploiting data collected during operation. The second is to provide an extensive discussion of future research directions, collecting results on uncertainty quantification that are related to (but yet unexploited in) optimal control, among others. Ultimately, this paper provides a toolkit to study and advance Gaussian process-based model predictive control.</div></div>","PeriodicalId":50750,"journal":{"name":"Annual Reviews in Control","volume":"60 ","pages":"Article 101034"},"PeriodicalIF":10.7,"publicationDate":"2025-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145527905","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Hierarchical generalized extended parameter identification for multivariable equation-error ARMA-like systems by using the filtering identification idea 基于滤波辨识思想的多变量方程误差类arma系统的层次广义扩展参数辨识
IF 7.3 2区 计算机科学 Q1 AUTOMATION & CONTROL SYSTEMS Pub Date : 2025-01-01 Epub Date: 2025-06-24 DOI: 10.1016/j.arcontrol.2025.100993
Feng Ding , Ling Xu , Xiao Zhang , Huan Xu , Yihong Zhou , Xiaoli Luan
The filtering identification idea is an effective tool for handling the parameter identification of systems with colored noise. The hierarchical identification principle is an effective approach for addressing the identification of complex systems. For multivariable equation-error autoregressive moving-average-like (M-EEARMA-like) models with colored noise, which are also called multivariable controlled autoregressive autoregressive moving-average-like (M-CARARMA-like) models, this paper investigates and proposes the filtered hierarchical generalized extended stochastic gradient identification method, the filtered hierarchical multi-innovation generalized extended stochastic gradient identification method, the filtered hierarchical generalized extended recursive gradient identification method, the filtered hierarchical multi-innovation generalized extended recursive gradient identification method, the filtered hierarchical generalized extended least squares identification method, and the filtered hierarchical multi-innovation generalized extended least squares identification method by using the filtering identification idea and the hierarchical identification principle from available input–output data. These filtered hierarchical generalized extended identification methods can be extended to other linear and nonlinear multivariable stochastic systems with colored noise.
滤波辨识思想是处理有色噪声系统参数辨识的有效工具。层次辨识原理是解决复杂系统辨识问题的有效方法。针对带有色噪声的多变量方程误差自回归类移动平均(M-EEARMA-like)模型,又称多变量控制自回归类移动平均(M-CARARMA-like)模型,研究并提出了滤波分层广义扩展随机梯度辨识方法、滤波分层多创新广义扩展随机梯度辨识方法、滤波层次广义扩展递推梯度辨识方法、滤波层次多创新广义扩展递推梯度辨识方法、滤波层次广义扩展最小二乘辨识方法;利用滤波辨识思想和层次辨识原理,从可用的输入输出数据中得到滤波层次多创新广义扩展最小二乘辨识方法。这些滤波后的层次广义扩展辨识方法可以推广到其他具有有色噪声的线性和非线性多变量随机系统。
{"title":"Hierarchical generalized extended parameter identification for multivariable equation-error ARMA-like systems by using the filtering identification idea","authors":"Feng Ding ,&nbsp;Ling Xu ,&nbsp;Xiao Zhang ,&nbsp;Huan Xu ,&nbsp;Yihong Zhou ,&nbsp;Xiaoli Luan","doi":"10.1016/j.arcontrol.2025.100993","DOIUrl":"10.1016/j.arcontrol.2025.100993","url":null,"abstract":"<div><div>The filtering identification idea is an effective tool for handling the parameter identification of systems with colored noise. The hierarchical identification principle is an effective approach for addressing the identification of complex systems. For multivariable equation-error autoregressive moving-average-like (M-EEARMA-like) models with colored noise, which are also called multivariable controlled autoregressive autoregressive moving-average-like (M-CARARMA-like) models, this paper investigates and proposes the filtered hierarchical generalized extended stochastic gradient identification method, the filtered hierarchical multi-innovation generalized extended stochastic gradient identification method, the filtered hierarchical generalized extended recursive gradient identification method, the filtered hierarchical multi-innovation generalized extended recursive gradient identification method, the filtered hierarchical generalized extended least squares identification method, and the filtered hierarchical multi-innovation generalized extended least squares identification method by using the filtering identification idea and the hierarchical identification principle from available input–output data. These filtered hierarchical generalized extended identification methods can be extended to other linear and nonlinear multivariable stochastic systems with colored noise.</div></div>","PeriodicalId":50750,"journal":{"name":"Annual Reviews in Control","volume":"60 ","pages":"Article 100993"},"PeriodicalIF":7.3,"publicationDate":"2025-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144365942","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A systems perspective on promoting sustainable food systems 促进可持续粮食系统的系统视角
IF 10.7 2区 计算机科学 Q1 AUTOMATION & CONTROL SYSTEMS Pub Date : 2025-01-01 Epub Date: 2025-09-29 DOI: 10.1016/j.arcontrol.2025.101020
Angela Fontan , Patricia Eustachio Colombo , Rosemary Green , Karl H. Johansson
Global food systems are at the center of some of the most pressing modern societal challenges: They are significant contributors to a range of systemic issues, including health problems and chronic diseases, greenhouse gas emissions and general environmental degradation, and increasing financial burdens on healthcare and economies. Within these complex systems, final sustainable consumption, which refers to the adoption of diets that are both healthy and environmentally friendly, plays a critical role. Significant changes in contemporary dietary patterns are essential to address the rising burden of chronic diseases and public health outcomes and the escalating climate crisis. Achieving these shifts requires coordinated action from policymakers, consumers, and the scientific community in an effort to support the development, implementation, and evaluation of advertising and policy instruments that promote healthier and more sustainable dietary choices. However, driving changes in dietary behavior is a complex challenge, shaped by the interplay of heterogeneous influences, including biological, social, cultural, environmental, political, and economic factors, and further complicated by the difficulty of validating proposed approaches in ways that are both efficient and ethically sound. This vision paper presents the problem of promoting healthy and environmentally friendly diets and their implications for environmental sustainability. In particular, it discusses a systems approach based on social network dynamics and social interventions, illustrating recent findings that demonstrate the potential of influence strategies to drive dietary change. Finally, key scientific challenges and emerging research opportunities are highlighted.
全球粮食系统处于一些最紧迫的现代社会挑战的中心:它们是一系列系统性问题的重要贡献者,包括健康问题和慢性病、温室气体排放和一般环境退化,以及医疗保健和经济日益沉重的财政负担。在这些复杂的系统中,最终可持续消费,即采用既健康又环保的饮食,起着关键作用。当代饮食模式的重大改变对于解决慢性病和公共卫生后果日益加重的负担以及不断升级的气候危机至关重要。实现这些转变需要决策者、消费者和科学界的协调行动,努力支持广告和政策工具的制定、实施和评估,以促进更健康和更可持续的饮食选择。然而,推动饮食行为的改变是一项复杂的挑战,受到各种异质影响的相互作用,包括生物、社会、文化、环境、政治和经济因素,而以既有效又合乎道德的方式验证所提出的方法的难度进一步复杂化。本远景文件提出了促进健康和环境友好型饮食的问题及其对环境可持续性的影响。特别地,它讨论了一种基于社会网络动态和社会干预的系统方法,说明了最近的发现,证明了影响策略在推动饮食变化方面的潜力。最后,强调了关键的科学挑战和新兴的研究机会。
{"title":"A systems perspective on promoting sustainable food systems","authors":"Angela Fontan ,&nbsp;Patricia Eustachio Colombo ,&nbsp;Rosemary Green ,&nbsp;Karl H. Johansson","doi":"10.1016/j.arcontrol.2025.101020","DOIUrl":"10.1016/j.arcontrol.2025.101020","url":null,"abstract":"<div><div>Global food systems are at the center of some of the most pressing modern societal challenges: They are significant contributors to a range of systemic issues, including health problems and chronic diseases, greenhouse gas emissions and general environmental degradation, and increasing financial burdens on healthcare and economies. Within these complex systems, final sustainable consumption, which refers to the adoption of diets that are both healthy and environmentally friendly, plays a critical role. Significant changes in contemporary dietary patterns are essential to address the rising burden of chronic diseases and public health outcomes and the escalating climate crisis. Achieving these shifts requires coordinated action from policymakers, consumers, and the scientific community in an effort to support the development, implementation, and evaluation of advertising and policy instruments that promote healthier and more sustainable dietary choices. However, driving changes in dietary behavior is a complex challenge, shaped by the interplay of heterogeneous influences, including biological, social, cultural, environmental, political, and economic factors, and further complicated by the difficulty of validating proposed approaches in ways that are both efficient and ethically sound. This vision paper presents the problem of promoting healthy and environmentally friendly diets and their implications for environmental sustainability. In particular, it discusses a systems approach based on social network dynamics and social interventions, illustrating recent findings that demonstrate the potential of influence strategies to drive dietary change. Finally, key scientific challenges and emerging research opportunities are highlighted.</div></div>","PeriodicalId":50750,"journal":{"name":"Annual Reviews in Control","volume":"60 ","pages":"Article 101020"},"PeriodicalIF":10.7,"publicationDate":"2025-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145219177","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A general framework for verification and control of dynamical models via certificate synthesis 一个通过证书合成来验证和控制动态模型的通用框架
IF 10.7 2区 计算机科学 Q1 AUTOMATION & CONTROL SYSTEMS Pub Date : 2025-01-01 Epub Date: 2025-10-04 DOI: 10.1016/j.arcontrol.2025.101028
Alec Edwards , Andrea Peruffo , Alessandro Abate
An emerging branch of control theory specialises in certificate learning, concerning the specification of a desired (possibly complex) system behaviour for an autonomous or control model, which is then analytically verified by means of a function-based proof. However, the synthesis of controllers abiding by these complex requirements is in general a non-trivial task and may elude the most expert control engineers. This results in a need for automatic techniques that are able to design controllers and to analyse a wide range of elaborate specifications. In this paper, we provide a general framework to encode system specifications and define corresponding certificates, and we present an automated approach to formally synthesise controllers and certificates. Our approach contributes to the broad field of safe learning for control, exploiting the flexibility of neural networks to provide candidate control and certificate functions, whilst using SAT-modulo-theory (SMT)-solvers to offer a formal guarantee of correctness. We test our framework by developing a prototype software tool, and assess its efficacy at verification via control and certificate synthesis over a large and varied suite of benchmarks.
控制理论的一个新兴分支专注于证书学习,涉及自治或控制模型所需(可能复杂的)系统行为的规范,然后通过基于功能的证明进行分析验证。然而,符合这些复杂要求的控制器的合成通常是一项不平凡的任务,可能会避开最专业的控制工程师。这导致需要能够设计控制器和分析各种详细规格的自动技术。在本文中,我们提供了一个通用的框架来编码系统规范和定义相应的证书,我们提出了一种自动化的方法来形式化地综合控制器和证书。我们的方法有助于控制安全学习的广泛领域,利用神经网络的灵活性来提供候选控制和证书功能,同时使用sat -模理论(SMT)求解器来提供正确性的正式保证。我们通过开发一个原型软件工具来测试我们的框架,并通过对大量不同基准的控制和证书合成来评估其有效性。
{"title":"A general framework for verification and control of dynamical models via certificate synthesis","authors":"Alec Edwards ,&nbsp;Andrea Peruffo ,&nbsp;Alessandro Abate","doi":"10.1016/j.arcontrol.2025.101028","DOIUrl":"10.1016/j.arcontrol.2025.101028","url":null,"abstract":"<div><div>An emerging branch of control theory specialises in <em>certificate learning</em>, concerning the specification of a desired (possibly complex) system behaviour for an autonomous or control model, which is then analytically verified by means of a function-based proof. However, the synthesis of controllers abiding by these complex requirements is in general a non-trivial task and may elude the most expert control engineers. This results in a need for automatic techniques that are able to design controllers and to analyse a wide range of elaborate specifications. In this paper, we provide a general framework to encode system specifications and define corresponding certificates, and we present an automated approach to formally synthesise controllers and certificates. Our approach contributes to the broad field of safe learning for control, exploiting the flexibility of neural networks to provide candidate control and certificate functions, whilst using SAT-modulo-theory (SMT)-solvers to offer a formal guarantee of correctness. We test our framework by developing a prototype software tool, and assess its efficacy at verification via control and certificate synthesis over a large and varied suite of benchmarks.</div></div>","PeriodicalId":50750,"journal":{"name":"Annual Reviews in Control","volume":"60 ","pages":"Article 101028"},"PeriodicalIF":10.7,"publicationDate":"2025-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145219178","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Annual Reviews in Control
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1