Pub Date : 2023-01-01Epub Date: 2023-05-25DOI: 10.1016/j.arcontrol.2023.03.002
Mohammad Rasool Mojallizadeh , Bernard Brogliato , Christophe Prieur
This article presents a complete review of the modeling and control schemes for overhead cranes operating in 2D and 3D spaces published to date. The modeling schemes including the pendulum-like models with rigid and flexible links are reviewed and their key characteristics are studied. Subsequently, an overview of the control methods developed for such models is presented. Afterward, a new simulation-oriented model enabling to capture both cables’ dynamic and global nonlinearities caused by the pendulation is developed, and different control methods that exist in the literature are evaluated and compared based on this model using numerical experiments. In the end, several research gaps are identified to be considered in future works.
{"title":"Modeling and control of overhead cranes: A tutorial overview and perspectives","authors":"Mohammad Rasool Mojallizadeh , Bernard Brogliato , Christophe Prieur","doi":"10.1016/j.arcontrol.2023.03.002","DOIUrl":"10.1016/j.arcontrol.2023.03.002","url":null,"abstract":"<div><p>This article presents a complete review of the modeling and control schemes for overhead cranes operating in 2D and 3D spaces published to date. The modeling schemes including the pendulum-like models with rigid and flexible links are reviewed and their key characteristics are studied. Subsequently, an overview of the control methods developed for such models is presented. Afterward, a new simulation-oriented model enabling to capture both cables’ dynamic and global nonlinearities caused by the pendulation is developed, and different control methods that exist in the literature are evaluated and compared based on this model using numerical experiments. In the end, several research gaps are identified to be considered in future works.</p></div>","PeriodicalId":50750,"journal":{"name":"Annual Reviews in Control","volume":"56 ","pages":"Article 100877"},"PeriodicalIF":9.4,"publicationDate":"2023-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"44791919","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-01-01Epub Date: 2022-12-07DOI: 10.1016/j.arcontrol.2022.11.001
P. Stano , U. Montanaro , D. Tavernini , M. Tufo , G. Fiengo , L. Novella , A. Sorniotti
Thanks to their road safety potential, automated vehicles are rapidly becoming a reality. In the last decade, automated driving has been the focus of intensive automotive engineering research, with the support of industry and governmental organisations. In automated driving systems, the path tracking layer defines the actuator commands to follow the reference path and speed profile. Model predictive control (MPC) is widely used for trajectory tracking because of its capability of managing multi-variable problems, and systematically considering constraints on states and control actions, as well as accounting for the expected future behaviour of the system. Despite the very large number of publications of the last few years, the literature lacks a comprehensive and updated survey on MPC for path tracking. To cover the gap, this literature review deals with the research conducted from 2015 until 2021 on model predictive path tracking control. Firstly, the survey highlights the significance of MPC in the recent path tracking control literature, with respect to alternative control structures. After classifying the different typologies of MPC for path tracking control, the adopted prediction models are critically analysed, together with typical optimal control problem formulations. This is followed by a summary of the most relevant results, which provides practical design indications, e.g., in terms of selection of prediction and control horizons. Finally, the most recent development trends are analysed, together with likely areas of further investigations, and the main conclusions are drawn.
{"title":"Model predictive path tracking control for automated road vehicles: A review","authors":"P. Stano , U. Montanaro , D. Tavernini , M. Tufo , G. Fiengo , L. Novella , A. Sorniotti","doi":"10.1016/j.arcontrol.2022.11.001","DOIUrl":"https://doi.org/10.1016/j.arcontrol.2022.11.001","url":null,"abstract":"<div><p>Thanks to their road safety potential, automated vehicles are rapidly becoming a reality. In the last decade, automated driving has been the focus of intensive automotive engineering research, with the support of industry and governmental organisations. In automated driving systems, the path tracking layer defines the actuator commands to follow the reference path and speed profile. Model predictive control (MPC) is widely used for trajectory tracking because of its capability of managing multi-variable problems, and systematically considering constraints on states and control actions, as well as accounting for the expected future behaviour of the system. Despite the very large number of publications of the last few years, the literature lacks a comprehensive and updated survey on MPC for path tracking. To cover the gap, this literature review deals with the research conducted from 2015 until 2021 on model predictive path tracking control. Firstly, the survey highlights the significance of MPC in the recent path tracking control literature, with respect to alternative control structures. After classifying the different typologies of MPC for path tracking control, the adopted prediction models are critically analysed, together with typical optimal control problem formulations. This is followed by a summary of the most relevant results, which provides practical design indications, e.g., in terms of selection of prediction and control horizons. Finally, the most recent development trends are analysed, together with likely areas of further investigations, and the main conclusions are drawn.</p></div>","PeriodicalId":50750,"journal":{"name":"Annual Reviews in Control","volume":"55 ","pages":"Pages 194-236"},"PeriodicalIF":9.4,"publicationDate":"2023-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"49739356","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-01-01Epub Date: 2023-04-17DOI: 10.1016/j.arcontrol.2023.04.001
Ye Tian , Long Wang
The past few decades have witnessed a prevalence of applying dynamical models to the study of social networks. This paper reviews recent advances in the investigation of social networks with a predominant focus on agent-based models. Starting from classical models of opinion dynamics, we survey several recently developed models on opinion formation and social power evolution. These models extend the classical models’ cognitive assumption that individuals’ opinions evolve on a single issue by incorporating various sociological or psychological hypotheses to account for the evolution of opinions over multiple or a sequence of interdependent issues. We summarize basic results on the asymptotic behaviors of these models and discuss their sociological interpretations. In addition, we show how these models play a role in the emergence of collective intelligence by applying them to a naïve learning setting. Novel results that reveal how individuals successfully learn an unknown truth over issue sequences are presented. Finally, we conclude the paper and discuss potential directions for future research.
{"title":"Dynamics of opinion formation, social power evolution, and naïve learning in social networks","authors":"Ye Tian , Long Wang","doi":"10.1016/j.arcontrol.2023.04.001","DOIUrl":"https://doi.org/10.1016/j.arcontrol.2023.04.001","url":null,"abstract":"<div><p>The past few decades have witnessed a prevalence of applying dynamical models to the study of social networks. This paper reviews recent advances in the investigation of social networks with a predominant focus on agent-based models. Starting from classical models of opinion dynamics, we survey several recently developed models on opinion formation and social power evolution. These models extend the classical models’ cognitive assumption that individuals’ opinions evolve on a single issue by incorporating various sociological or psychological hypotheses to account for the evolution of opinions over multiple or a sequence of interdependent issues. We summarize basic results on the asymptotic behaviors of these models and discuss their sociological interpretations. In addition, we show how these models play a role in the emergence of collective intelligence by applying them to a naïve learning setting. Novel results that reveal how individuals successfully learn an unknown truth over issue sequences are presented. Finally, we conclude the paper and discuss potential directions for future research.</p></div>","PeriodicalId":50750,"journal":{"name":"Annual Reviews in Control","volume":"55 ","pages":"Pages 182-193"},"PeriodicalIF":9.4,"publicationDate":"2023-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"49739355","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
This work proposes an operational management approach for water distribution networks (WDNs) that can detect and localize leakages while also mitigating contamination resulting from these leaks. The primary emphasis of this work is the development of a contamination mitigation control scheme. A leak typically leads to a drop in network pressure that increases the risk of contamination. A leakage localization algorithm is responsible for detecting and localizing the leakage in the WDN. When a leak is detected in the network the contamination mitigation control is activated. The flow and pressure settings of the pumps are regulated by the contamination mitigation control in an optimal manner to minimize the risk of contamination. The entire framework is tested on the Smart Water Infrastructure Laboratory situated at Aalborg University, Denmark and a large-scale benchmark water network, which is part of a city network, L-town.
{"title":"Leakage diagnosis with a contamination mitigation control framework using a graph theory based model","authors":"Saruch Satishkumar Rathore , Rahul Misra , Carsten Skovmose Kallesøe , Rafal Wisniewski","doi":"10.1016/j.arcontrol.2023.03.010","DOIUrl":"https://doi.org/10.1016/j.arcontrol.2023.03.010","url":null,"abstract":"<div><p>This work proposes an operational management approach for water distribution networks (WDNs) that can detect and localize leakages while also mitigating contamination resulting from these leaks. The primary emphasis of this work is the development of a contamination mitigation control scheme. A leak typically leads to a drop in network pressure that increases the risk of contamination. A leakage localization algorithm is responsible for detecting and localizing the leakage in the WDN. When a leak is detected in the network the contamination mitigation control is activated. The flow and pressure settings of the pumps are regulated by the contamination mitigation control in an optimal manner to minimize the risk of contamination. The entire framework is tested on the Smart Water Infrastructure Laboratory situated at Aalborg University, Denmark and a large-scale benchmark water network, which is part of a city network, L-town.</p></div>","PeriodicalId":50750,"journal":{"name":"Annual Reviews in Control","volume":"55 ","pages":"Pages 498-519"},"PeriodicalIF":9.4,"publicationDate":"2023-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"49739117","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-01-01DOI: 10.1016/j.arcontrol.2023.04.003
Marios M. Polycarpou , Iven Mareels , Ahmad F. Taha , Demetrios G. Eliades
The purpose of this Special Section is to provide an account of the state-of-the-art and perspectives for future research in the design and analysis of monitoring and control methods for smart water systems. This paper provides an overview of the six articles in the special section. Specifically, the special section consists of four review articles, as well as one vision and one tutorial article. These articles provide a review of leakage detection and isolation, a review of contamination event diagnosis, a review of state- space modelling of multiple reacting species in drinking water systems, a review of the application of model predictive control in Water Systems, a vision of optimizing pressure management and self-cleaning, as well as a tutorial for leakage detection and mitigation of potential contamination risk.
{"title":"Special section: Smart water systems","authors":"Marios M. Polycarpou , Iven Mareels , Ahmad F. Taha , Demetrios G. Eliades","doi":"10.1016/j.arcontrol.2023.04.003","DOIUrl":"https://doi.org/10.1016/j.arcontrol.2023.04.003","url":null,"abstract":"<div><p>The purpose of this Special Section is to provide an account of the state-of-the-art and perspectives for future research in the design and analysis of monitoring and control methods for smart water systems. This paper provides an overview of the six articles in the special section. Specifically, the special section consists of four review articles, as well as one vision and one tutorial article. These articles provide a review of leakage detection and isolation, a review of contamination event diagnosis, a review of state- space modelling of multiple reacting species in drinking water systems, a review of the application of model predictive control in Water Systems, a vision of optimizing pressure management and self-cleaning, as well as a tutorial for leakage detection and mitigation of potential contamination risk.</p></div>","PeriodicalId":50750,"journal":{"name":"Annual Reviews in Control","volume":"55 ","pages":"Pages 390-391"},"PeriodicalIF":9.4,"publicationDate":"2023-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"49739267","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-01-01DOI: 10.1016/j.arcontrol.2023.03.011
Demetrios G. Eliades , Stelios G. Vrachimis , Alireza Moghaddam , Ioannis Tzortzis , Marios M. Polycarpou
Water distribution systems are susceptible to contamination events, which can occur due to naturally occurring events, accidents or even malicious attacks. When a contamination event occurs, dangerous substances infiltrating the network may be consumed thereby deteriorating the consumers’ health and possibly affecting the economy. Advances in sensor and actuator technologies are enabling water networks to become smarter and more resilient to these types of events. This paper provides a broad review of the theoretical, modeling, and computational developments in the area of contamination event diagnosis for water distribution systems. Research is segmented into three main tasks, summarized as “Preparedness”, “Event Detection and Isolation” and “Emergency Event Management”. The key research topics from each task are described within a unified systems-theoretic mathematical framework, and their open challenges are discussed.
{"title":"Contamination event diagnosis in drinking water networks: A review","authors":"Demetrios G. Eliades , Stelios G. Vrachimis , Alireza Moghaddam , Ioannis Tzortzis , Marios M. Polycarpou","doi":"10.1016/j.arcontrol.2023.03.011","DOIUrl":"https://doi.org/10.1016/j.arcontrol.2023.03.011","url":null,"abstract":"<div><p>Water distribution systems are susceptible to contamination events, which can occur due to naturally occurring events, accidents or even malicious attacks. When a contamination event occurs, dangerous substances infiltrating the network may be consumed thereby deteriorating the consumers’ health and possibly affecting the economy. Advances in sensor and actuator technologies are enabling water networks to become smarter and more resilient to these types of events. This paper provides a broad review of the theoretical, modeling, and computational developments in the area of contamination event diagnosis for water distribution systems. Research is segmented into three main tasks, summarized as “Preparedness”, “Event Detection and Isolation” and “Emergency Event Management”. The key research topics from each task are described within a unified systems-theoretic mathematical framework, and their open challenges are discussed.</p></div>","PeriodicalId":50750,"journal":{"name":"Annual Reviews in Control","volume":"55 ","pages":"Pages 420-441"},"PeriodicalIF":9.4,"publicationDate":"2023-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"49739412","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-01-01Epub Date: 2023-11-07DOI: 10.1016/j.arcontrol.2023.100915
C. De Persis , P. Tesi
This article provides an overview of a new approach to designing controllers for nonlinear systems using data-driven control. Data-driven control is an important area of research in control theory, and this novel method offers several benefits. It can recreate from a data-centred perspective many of the results available in the model-based case, including local stabilization based on Taylor or polynomial expansion, absolute stabilization, as well as approximate and exact feedback linearization. Moreover, the method is analytically and computationally simple, and permits to infer regions of attraction and invariant sets, also when the data are corrupted by noise.
{"title":"Learning controllers for nonlinear systems from data","authors":"C. De Persis , P. Tesi","doi":"10.1016/j.arcontrol.2023.100915","DOIUrl":"10.1016/j.arcontrol.2023.100915","url":null,"abstract":"<div><p>This article provides an overview of a new approach to designing controllers for nonlinear systems using data-driven control. Data-driven control is an important area of research in control theory, and this novel method offers several benefits. It can recreate from a data-centred perspective many of the results available in the model-based case, including local stabilization based on Taylor or polynomial expansion, absolute stabilization, as well as approximate and exact feedback linearization. Moreover, the method is analytically and computationally simple, and permits to infer regions of attraction and invariant sets, also when the data are corrupted by noise.</p></div>","PeriodicalId":50750,"journal":{"name":"Annual Reviews in Control","volume":"56 ","pages":"Article 100915"},"PeriodicalIF":9.4,"publicationDate":"2023-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S1367578823000792/pdfft?md5=1146c891ca54acdbe7e93bcb151c00b9&pid=1-s2.0-S1367578823000792-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135515522","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-01-01Epub Date: 2023-04-03DOI: 10.1016/j.arcontrol.2023.03.003
Rachel Gehlhar , Maegan Tucker , Aaron J. Young , Aaron D. Ames
Lower-limb prostheses aim to restore ambulatory function for individuals with lower-limb amputations. While the design of lower-limb prostheses is important, this paper focuses on the complementary challenge—the control of lower-limb prostheses. Specifically, we focus on powered prostheses, a subset of lower-limb prostheses, which utilize actuators to inject mechanical power into the walking gait of a human user.
In this paper, we present a review of existing control strategies for lower-limb powered prostheses, including the control objectives, sensing capabilities, and control methodologies. We separate the various control methods into three main tiers of prosthesis control: High-level control for task and gait phase estimation, mid-level control for desired torque computation (both with and without the use of reference trajectories), and low-level control for enforcing the computed torque commands on the prosthesis. In particular, we focus on the high- and mid-level control approaches in this review. Additionally, we outline existing methods for customizing the prosthetic behavior for individual human users. Finally, we conclude with a discussion on future research directions for powered lower-limb prostheses based on the potential of current control methods and open problems in the field.
{"title":"A review of current state-of-the-art control methods for lower-limb powered prostheses","authors":"Rachel Gehlhar , Maegan Tucker , Aaron J. Young , Aaron D. Ames","doi":"10.1016/j.arcontrol.2023.03.003","DOIUrl":"10.1016/j.arcontrol.2023.03.003","url":null,"abstract":"<div><p>Lower-limb prostheses aim to restore ambulatory function for individuals with lower-limb amputations. While the design of lower-limb prostheses is important, this paper focuses on the complementary challenge—the control of lower-limb prostheses. Specifically, we focus on powered prostheses, a subset of lower-limb prostheses, which utilize actuators to inject mechanical power into the walking gait of a human user.</p><p>In this paper, we present a review of existing control strategies for lower-limb powered prostheses, including the control objectives, sensing capabilities, and control methodologies. We separate the various control methods into three main tiers of prosthesis control: High-level control for task and gait phase estimation, mid-level control for desired torque computation (both with and without the use of reference trajectories), and low-level control for enforcing the computed torque commands on the prosthesis. In particular, we focus on the high- and mid-level control approaches in this review. Additionally, we outline existing methods for customizing the prosthetic behavior for individual human users. Finally, we conclude with a discussion on future research directions for powered lower-limb prostheses based on the potential of current control methods and open problems in the field.</p></div>","PeriodicalId":50750,"journal":{"name":"Annual Reviews in Control","volume":"55 ","pages":"Pages 142-164"},"PeriodicalIF":9.4,"publicationDate":"2023-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10449377/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10107806","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-01-01Epub Date: 2023-08-04DOI: 10.1016/j.arcontrol.2023.100901
J.E. Sereno , A. D’Jorge , A. Ferramosca , E.A. Hernandez-Vargas , A.H. González
{"title":"Switched NMPC for epidemiological and social-economic control objectives in SIR-type systems","authors":"J.E. Sereno , A. D’Jorge , A. Ferramosca , E.A. Hernandez-Vargas , A.H. González","doi":"10.1016/j.arcontrol.2023.100901","DOIUrl":"https://doi.org/10.1016/j.arcontrol.2023.100901","url":null,"abstract":"","PeriodicalId":50750,"journal":{"name":"Annual Reviews in Control","volume":"56 ","pages":"100901"},"PeriodicalIF":9.4,"publicationDate":"2023-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"49740218","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-01-01Epub Date: 2023-11-24DOI: 10.1016/j.arcontrol.2023.100926
Mahmoud Abdelgalil, Daniel E. Ochoa, Jorge I. Poveda
Multi-time scale techniques based on singular perturbations and averaging theory are among the most powerful tools developed for the synthesis and analysis of feedback control algorithms. This paper introduces some of the recent advances in singular perturbation theory and averaging theory for continuous-time dynamical systems modeled as ordinary differential equations (ODEs), as well as for hybrid dynamical systems that combine continuous-time dynamics and discrete-time dynamics. Novel multi-time scale analytical tools based on higher-order averaging and singular perturbation theory are also discussed and illustrated via different examples. In the context of hybrid dynamical systems, a class of sufficient Lyapunov-based conditions for global stability results are also presented. The analytical tools are illustrated through various new architectures and algorithms within the context of adaptive and extremum-seeking systems. These tools are suitable for the study of model-free optimization and stabilization problems that require the synergistic use of continuous-time and discrete-time feedback. The paper aims to acquaint the reader with a range of modern tools for studying multi-time scale phenomena in optimization and control systems, providing some guidelines for future research in this field.
{"title":"Multi-time scale control and optimization via averaging and singular perturbation theory: From ODEs to hybrid dynamical systems","authors":"Mahmoud Abdelgalil, Daniel E. Ochoa, Jorge I. Poveda","doi":"10.1016/j.arcontrol.2023.100926","DOIUrl":"https://doi.org/10.1016/j.arcontrol.2023.100926","url":null,"abstract":"<div><p>Multi-time scale techniques based on singular perturbations and averaging theory are among the most powerful tools developed for the synthesis and analysis of feedback control algorithms. This paper introduces some of the recent advances in singular perturbation theory and averaging theory for continuous-time dynamical systems modeled as ordinary differential equations (ODEs), as well as for hybrid dynamical systems that combine continuous-time dynamics and discrete-time dynamics. Novel multi-time scale analytical tools based on higher-order averaging and singular perturbation theory are also discussed and illustrated via different examples. In the context of hybrid dynamical systems, a class of sufficient Lyapunov-based conditions for global stability results are also presented. The analytical tools are illustrated through various new architectures and algorithms within the context of adaptive and extremum-seeking systems. These tools are suitable for the study of model-free optimization and stabilization problems that require the synergistic use of continuous-time and discrete-time feedback. The paper aims to acquaint the reader with a range of modern tools for studying multi-time scale phenomena in optimization and control systems, providing some guidelines for future research in this field.</p></div>","PeriodicalId":50750,"journal":{"name":"Annual Reviews in Control","volume":"56 ","pages":"Article 100926"},"PeriodicalIF":9.4,"publicationDate":"2023-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S1367578823000901/pdfft?md5=bf2297a434b63cf7c9074cea71bd8782&pid=1-s2.0-S1367578823000901-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138436737","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}