Pub Date : 2025-01-01DOI: 10.1016/j.arcontrol.2025.101012
Clara Lucía Galimberti, Luca Furieri, Giancarlo Ferrari-Trecate
The complexity of modern control systems necessitates architectures that achieve high performance while ensuring robust stability, particularly for nonlinear systems. In this work, we tackle the challenge of designing output-feedback controllers to boost the performance of -stable discrete-time nonlinear systems while preserving closed-loop stability from external disturbances to input and output channels. Leveraging operator theory and neural network representations, we parametrize the achievable closed-loop maps for a given system and propose novel parametrizations of all -stabilizing controllers, unifying frameworks such as nonlinear Youla parametrization and internal model control. Contributing to a rapidly growing research line, our approach enables unconstrained optimization exclusively over stabilizing controllers and provides sufficient conditions to ensure robustness against model mismatch. Additionally, our methods reveal that stronger notions of stability can be imposed on the closed-loop maps if disturbance realizations are available after one time step. Last, our approaches are compatible with the design of nonlinear distributed controllers. Numerical experiments on cooperative robotics demonstrate the flexibility of the proposed framework, allowing cost functions to be freely designed for achieving complex behaviors while preserving stability.
{"title":"Parametrizations of all stable closed-loop responses: From theory to neural network control design","authors":"Clara Lucía Galimberti, Luca Furieri, Giancarlo Ferrari-Trecate","doi":"10.1016/j.arcontrol.2025.101012","DOIUrl":"10.1016/j.arcontrol.2025.101012","url":null,"abstract":"<div><div>The complexity of modern control systems necessitates architectures that achieve high performance while ensuring robust stability, particularly for nonlinear systems. In this work, we tackle the challenge of designing output-feedback controllers to boost the performance of <span><math><msub><mrow><mi>ℓ</mi></mrow><mrow><mi>p</mi></mrow></msub></math></span>-stable discrete-time nonlinear systems while preserving closed-loop stability from external disturbances to input and output channels. Leveraging operator theory and neural network representations, we parametrize the achievable closed-loop maps for a given system and propose novel parametrizations of all <span><math><msub><mrow><mi>ℓ</mi></mrow><mrow><mi>p</mi></mrow></msub></math></span>-stabilizing controllers, unifying frameworks such as nonlinear Youla parametrization and internal model control. Contributing to a rapidly growing research line, our approach enables unconstrained optimization exclusively over stabilizing controllers and provides sufficient conditions to ensure robustness against model mismatch. Additionally, our methods reveal that stronger notions of stability can be imposed on the closed-loop maps if disturbance realizations are available after one time step. Last, our approaches are compatible with the design of nonlinear distributed controllers. Numerical experiments on cooperative robotics demonstrate the flexibility of the proposed framework, allowing cost functions to be freely designed for achieving complex behaviors while preserving stability.</div></div>","PeriodicalId":50750,"journal":{"name":"Annual Reviews in Control","volume":"60 ","pages":"Article 101012"},"PeriodicalIF":10.7,"publicationDate":"2025-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144888884","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2025-01-01DOI: 10.1016/j.arcontrol.2025.100991
Joana F. Almeida , Cristina P. Santos
Wearable robotic devices such as exoskeletons and orthoses have undergone significant advancements over the past two decades, aiming to support human mobility in rehabilitation, daily life, and industrial settings. Central to their effectiveness is the implementation of control strategies that generate smooth, adaptive, and user-synchronized movements. Among these, bio-inspired approaches that emulate neural and motor mechanisms of human locomotion have gained increasing attention.
This review presents a comprehensive analysis of two prominent bio-inspired control frameworks – Central Pattern Generators (CPGs) and Dynamic Movement Primitives (DMPs) – implemented in wearable lower-limb robotic systems. A total of 45 articles were systematically analysed to identify trends and challenges in their application.
The review examines the purposes of these controllers, the joints and degrees of freedom addressed, the sensors employed, the structural characteristics of each approach, the integration of sensory feedback and intention decoding, the tracking controllers used, and the validation methodologies adopted.
The findings reveal that CPGs and DMPs are primarily adopted for generating adaptive joint trajectories, enabling stable, rhythmic, and responsive locomotion. Their flexibility allows for encoding motion patterns that adapt to user-specific and task-specific requirements. However, challenges such as parameter tuning, integration of sensory feedback, real-time intention decoding, and validation robustness remain open issues.
This work highlights the potential of CPG- and DMP-based strategies to enhance the autonomy, safety, and personalization of wearable robots and provides future research directions to address their current limitations and improve their practical applicability.
{"title":"Bio-inspired control strategies in wearable robotics: A comprehensive review of CPGs and DMPs","authors":"Joana F. Almeida , Cristina P. Santos","doi":"10.1016/j.arcontrol.2025.100991","DOIUrl":"10.1016/j.arcontrol.2025.100991","url":null,"abstract":"<div><div>Wearable robotic devices such as exoskeletons and orthoses have undergone significant advancements over the past two decades, aiming to support human mobility in rehabilitation, daily life, and industrial settings. Central to their effectiveness is the implementation of control strategies that generate smooth, adaptive, and user-synchronized movements. Among these, bio-inspired approaches that emulate neural and motor mechanisms of human locomotion have gained increasing attention.</div><div>This review presents a comprehensive analysis of two prominent bio-inspired control frameworks – Central Pattern Generators (CPGs) and Dynamic Movement Primitives (DMPs) – implemented in wearable lower-limb robotic systems. A total of 45 articles were systematically analysed to identify trends and challenges in their application.</div><div>The review examines the purposes of these controllers, the joints and degrees of freedom addressed, the sensors employed, the structural characteristics of each approach, the integration of sensory feedback and intention decoding, the tracking controllers used, and the validation methodologies adopted.</div><div>The findings reveal that CPGs and DMPs are primarily adopted for generating adaptive joint trajectories, enabling stable, rhythmic, and responsive locomotion. Their flexibility allows for encoding motion patterns that adapt to user-specific and task-specific requirements. However, challenges such as parameter tuning, integration of sensory feedback, real-time intention decoding, and validation robustness remain open issues.</div><div>This work highlights the potential of CPG- and DMP-based strategies to enhance the autonomy, safety, and personalization of wearable robots and provides future research directions to address their current limitations and improve their practical applicability.</div></div>","PeriodicalId":50750,"journal":{"name":"Annual Reviews in Control","volume":"60 ","pages":"Article 100991"},"PeriodicalIF":7.3,"publicationDate":"2025-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144106345","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2025-01-01DOI: 10.1016/j.arcontrol.2025.100996
Amani R. Ynineb , Bouchra Khoumeri , Erhan Yumuk , Bora Ayvaz , Ghada Ben Othman , Clara M. Ionescu , Dana Copot
Drug related dynamic uptake, clearance and anomalous diffusion patterns are dependent of biological tissue composition. Of particular importance is the fat volume, where drug trapping occurs in long term usage and related to lipophilic properties of drugs and non-homogeneous mixing. This paper introduces three probable drug pathways from fat volumes to augmented compartments, herein called trap volumes. In silico validation by using patient simulators with body mass index larger than 25. A non-homogeneous drug diffusion in biological tissue was considered using the partial-Caputo fractional-order compartmental model. To understand the effects in potential monitoring and sensing data information systems, an experiment has been proposed for in vitro impedance spectroscopy of fat samples. Variability with fat volume in observed data confirms the fractional-order characteristics that support theoretical model assumptions. A discussion section provides the implications for control of drug delivery systems.
{"title":"Modeling, analysis and experimental observations of fat volume properties in compartmental models for drug pharmacokinetics","authors":"Amani R. Ynineb , Bouchra Khoumeri , Erhan Yumuk , Bora Ayvaz , Ghada Ben Othman , Clara M. Ionescu , Dana Copot","doi":"10.1016/j.arcontrol.2025.100996","DOIUrl":"10.1016/j.arcontrol.2025.100996","url":null,"abstract":"<div><div>Drug related dynamic uptake, clearance and anomalous diffusion patterns are dependent of biological tissue composition. Of particular importance is the fat volume, where drug trapping occurs in long term usage and related to lipophilic properties of drugs and non-homogeneous mixing. This paper introduces three probable drug pathways from fat volumes to augmented compartments, herein called trap volumes. In silico validation by using patient simulators with body mass index larger than 25. A non-homogeneous drug diffusion in biological tissue was considered using the partial-Caputo fractional-order compartmental model. To understand the effects in potential monitoring and sensing data information systems, an experiment has been proposed for in vitro impedance spectroscopy of fat samples. Variability with fat volume in observed data confirms the fractional-order characteristics that support theoretical model assumptions. A discussion section provides the implications for control of drug delivery systems.</div></div>","PeriodicalId":50750,"journal":{"name":"Annual Reviews in Control","volume":"60 ","pages":"Article 100996"},"PeriodicalIF":7.3,"publicationDate":"2025-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144239336","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-11-29DOI: 10.1016/j.arcontrol.2024.100983
Mohammadreza Doostmohammadian , Alireza Aghasi , Mohammad Pirani , Ehsan Nekouei , Houman Zarrabi , Reza Keypour , Apostolos I. Rikos , Karl H. Johansson
Resource allocation and scheduling in multi-agent systems present challenges due to complex interactions and decentralization. This survey paper provides a comprehensive analysis of distributed algorithms for addressing the distributed resource allocation (DRA) problem over multi-agent systems. It covers a significant area of research at the intersection of optimization, multi-agent systems, and distributed consensus-based computing. The paper begins by presenting a mathematical formulation of the DRA problem, establishing a solid foundation for further exploration. Real-world applications of DRA in various domains are examined to underscore the importance of efficient resource allocation, and relevant distributed optimization formulations are presented. The survey then delves into existing solutions for DRA, encompassing linear, nonlinear, primal-based, and dual-formulation-based approaches. Furthermore, this paper evaluates the features and properties of DRA algorithms, addressing key aspects such as feasibility, convergence rate, and network reliability. The analysis of mathematical foundations, diverse applications, existing solutions, and algorithmic properties contributes to a broader comprehension of the challenges and potential solutions for this domain.
{"title":"Survey of distributed algorithms for resource allocation over multi-agent systems","authors":"Mohammadreza Doostmohammadian , Alireza Aghasi , Mohammad Pirani , Ehsan Nekouei , Houman Zarrabi , Reza Keypour , Apostolos I. Rikos , Karl H. Johansson","doi":"10.1016/j.arcontrol.2024.100983","DOIUrl":"10.1016/j.arcontrol.2024.100983","url":null,"abstract":"<div><div>Resource allocation and scheduling in multi-agent systems present challenges due to complex interactions and decentralization. This survey paper provides a comprehensive analysis of distributed algorithms for addressing the distributed resource allocation (DRA) problem over multi-agent systems. It covers a significant area of research at the intersection of optimization, multi-agent systems, and distributed consensus-based computing. The paper begins by presenting a mathematical formulation of the DRA problem, establishing a solid foundation for further exploration. Real-world applications of DRA in various domains are examined to underscore the importance of efficient resource allocation, and relevant distributed optimization formulations are presented. The survey then delves into existing solutions for DRA, encompassing linear, nonlinear, primal-based, and dual-formulation-based approaches. Furthermore, this paper evaluates the features and properties of DRA algorithms, addressing key aspects such as feasibility, convergence rate, and network reliability. The analysis of mathematical foundations, diverse applications, existing solutions, and algorithmic properties contributes to a broader comprehension of the challenges and potential solutions for this domain.</div></div>","PeriodicalId":50750,"journal":{"name":"Annual Reviews in Control","volume":"59 ","pages":"Article 100983"},"PeriodicalIF":7.3,"publicationDate":"2024-11-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142746294","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-01-01DOI: 10.1016/j.arcontrol.2024.100948
Kunal Garg, Songyuan Zhang, Oswin So, Charles Dawson, Chuchu Fan
In this survey, we review the recent advances in control design methods for robotic multi-agent systems (MAS), focusing on learning-based methods with safety considerations. We start by reviewing various notions of safety and liveness properties, and modeling frameworks used for problem formulation of MAS. Then we provide a comprehensive review of learning-based methods for safe control design for multi-robot systems. We start with various shielding-based methods, such as safety certificates, predictive filters, and reachability tools. Then, we review the current state of control barrier certificate learning in both a centralized and distributed manner, followed by a comprehensive review of multi-agent reinforcement learning with a particular focus on safety. Next, we discuss the state-of-the-art verification tools for the correctness of learning-based methods. Based on the capabilities and the limitations of the state-of-the-art methods in learning and verification for MAS, we identify various broad themes for open challenges: how to design methods that can achieve good performance along with safety guarantees; how to decompose single-agent-based centralized methods for MAS; how to account for communication-related practical issues; and how to assess transfer of theoretical guarantees to practice.
在本调查报告中,我们回顾了机器人多代理系统(MAS)控制设计方法的最新进展,重点是基于学习并考虑安全因素的方法。首先,我们回顾了安全和有效性的各种概念,以及用于 MAS 问题表述的建模框架。然后,我们全面回顾了基于学习的多机器人系统安全控制设计方法。我们首先介绍各种基于屏蔽的方法,如安全证书、预测过滤器和可达性工具。然后,我们回顾了集中式和分布式控制屏障证书学习的现状,接着全面回顾了多机器人强化学习,并特别关注安全性。接下来,我们讨论了基于学习的方法正确性的最新验证工具。基于最先进的 MAS 学习和验证方法的能力和局限性,我们确定了各种开放挑战的广泛主题:如何设计既能实现良好性能又能保证安全的方法;如何分解基于单个代理的 MAS 集中式方法;如何考虑与通信相关的实际问题;以及如何评估理论保证向实践的转移。
{"title":"Learning safe control for multi-robot systems: Methods, verification, and open challenges","authors":"Kunal Garg, Songyuan Zhang, Oswin So, Charles Dawson, Chuchu Fan","doi":"10.1016/j.arcontrol.2024.100948","DOIUrl":"https://doi.org/10.1016/j.arcontrol.2024.100948","url":null,"abstract":"<div><p>In this survey, we review the recent advances in control design methods for robotic multi-agent systems (MAS), focusing on learning-based methods with safety considerations. We start by reviewing various notions of safety and liveness properties, and modeling frameworks used for problem formulation of MAS. Then we provide a comprehensive review of learning-based methods for safe control design for multi-robot systems. We start with various shielding-based methods, such as safety certificates, predictive filters, and reachability tools. Then, we review the current state of control barrier certificate learning in both a centralized and distributed manner, followed by a comprehensive review of multi-agent reinforcement learning with a particular focus on safety. Next, we discuss the state-of-the-art verification tools for the correctness of learning-based methods. Based on the capabilities and the limitations of the state-of-the-art methods in learning and verification for MAS, we identify various broad themes for open challenges: how to design methods that can achieve good performance along with safety guarantees; how to decompose single-agent-based centralized methods for MAS; how to account for communication-related practical issues; and how to assess transfer of theoretical guarantees to practice.</p></div>","PeriodicalId":50750,"journal":{"name":"Annual Reviews in Control","volume":"57 ","pages":"Article 100948"},"PeriodicalIF":9.4,"publicationDate":"2024-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140187916","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}