Pub Date : 2023-10-09DOI: 10.1109/OJCSYS.2023.3322906
Erick Mejia Uzeda;Mireille E. Broucke
We consider the problem of mixed feedforward and feedback based disturbance rejection, where the feedforward measurement only provides a partial reconstruction of the disturbance. In doing so, we pose a new biologically relevant disturbance rejection problem which puts the role of feedforward measurements at the forefront. Based on the architecture of the human brain, we propose a design that utilizes an adaptive internal model operating on a fast timescale that, in turn, trains the correct feedforward gains on a slow timescale. As such, the training of reflexes in biological systems can be explained by leveraging the theory of adaptive feedforward control. It is proven that our design provides an arbitrary level of disturbance attenuation, and the benefits of using reflexes are illustrated via a multitude of simulations.
{"title":"Training Reflexes Using Adaptive Feedforward Control","authors":"Erick Mejia Uzeda;Mireille E. Broucke","doi":"10.1109/OJCSYS.2023.3322906","DOIUrl":"https://doi.org/10.1109/OJCSYS.2023.3322906","url":null,"abstract":"We consider the problem of mixed feedforward and feedback based disturbance rejection, where the feedforward measurement only provides a partial reconstruction of the disturbance. In doing so, we pose a new biologically relevant disturbance rejection problem which puts the role of feedforward measurements at the forefront. Based on the architecture of the human brain, we propose a design that utilizes an adaptive internal model operating on a fast timescale that, in turn, trains the correct feedforward gains on a slow timescale. As such, the training of reflexes in biological systems can be explained by leveraging the theory of adaptive feedforward control. It is proven that our design provides an arbitrary level of disturbance attenuation, and the benefits of using reflexes are illustrated via a multitude of simulations.","PeriodicalId":73299,"journal":{"name":"IEEE open journal of control systems","volume":"2 ","pages":"396-409"},"PeriodicalIF":0.0,"publicationDate":"2023-10-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/iel7/9552933/9973428/10274847.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"50376167","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-10-06DOI: 10.1109/OJCSYS.2023.3322636
Kameron Eves;John Valasek
Singularly perturbed systems are a class of mathematical systems that are not well approximated by their limits and can be used to model plants with multiple fast and slow states. Multiple-timescale systems are very common in engineering applications, but adaptive control can be sensitive to timescale effects. Recently a method called [K]control of Adaptive Multiple-timescale Systems (KAMS) has shown improved performance and increased robustness for singularly perturbed systems, but it has only been studied on systems using adaptive control for the slow states. This article extends KAMS to the general case when adaptive control is used to stabilize both the slow and fast states simultaneously. This causes complex interactions between the fast state reference model and the manifold to which the fast states converge. It is proven that under certain conditions the system still converges to the reference model despite these complex interactions. This method is demonstrated on a nonlinear, nonstandard, numerical example.
{"title":"Adaptive Control for Singularly Perturbed Systems","authors":"Kameron Eves;John Valasek","doi":"10.1109/OJCSYS.2023.3322636","DOIUrl":"10.1109/OJCSYS.2023.3322636","url":null,"abstract":"Singularly perturbed systems are a class of mathematical systems that are not well approximated by their limits and can be used to model plants with multiple fast and slow states. Multiple-timescale systems are very common in engineering applications, but adaptive control can be sensitive to timescale effects. Recently a method called [K]control of Adaptive Multiple-timescale Systems (KAMS) has shown improved performance and increased robustness for singularly perturbed systems, but it has only been studied on systems using adaptive control for the slow states. This article extends KAMS to the general case when adaptive control is used to stabilize both the slow and fast states simultaneously. This causes complex interactions between the fast state reference model and the manifold to which the fast states converge. It is proven that under certain conditions the system still converges to the reference model despite these complex interactions. This method is demonstrated on a nonlinear, nonstandard, numerical example.","PeriodicalId":73299,"journal":{"name":"IEEE open journal of control systems","volume":"3 ","pages":"1-13"},"PeriodicalIF":0.0,"publicationDate":"2023-10-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10273579","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"136008098","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
This article addresses the problem of data-driven model discrimination for unknown switched systems with unknown linear temporal logic (LTL) specifications, representing tasks, that govern their mode sequences, where only sampled data of the unknown dynamics and tasks are available. To tackle this problem, we propose data-driven methods to over-approximate the unknown dynamics and to infer the unknown specifications such that both set-membership models of the unknown dynamics and LTL formulas are guaranteed to include the ground truth model and specification/task. Moreover, we present an optimization-based algorithm for analyzing the distinguishability of a set of learned/inferred model-task pairs as well as a model discrimination algorithm for ruling out model-task pairs from this set that are inconsistent with new observations at run time. Further, we present an approach for reducing the size of inferred specifications to increase the computational efficiency of the model discrimination algorithms.
{"title":"Data-Driven Model Discrimination of Switched Nonlinear Systems With Temporal Logic Inference","authors":"Zeyuan Jin;Nasim Baharisangari;Zhe Xu;Sze Zheng Yong","doi":"10.1109/OJCSYS.2023.3322069","DOIUrl":"10.1109/OJCSYS.2023.3322069","url":null,"abstract":"This article addresses the problem of data-driven model discrimination for unknown switched systems with unknown linear temporal logic (LTL) specifications, representing tasks, that govern their mode sequences, where only sampled data of the unknown dynamics and tasks are available. To tackle this problem, we propose data-driven methods to over-approximate the unknown dynamics and to infer the unknown specifications such that both set-membership models of the unknown dynamics and LTL formulas are guaranteed to include the ground truth model and specification/task. Moreover, we present an optimization-based algorithm for analyzing the distinguishability of a set of learned/inferred model-task pairs as well as a model discrimination algorithm for ruling out model-task pairs from this set that are inconsistent with new observations at run time. Further, we present an approach for reducing the size of inferred specifications to increase the computational efficiency of the model discrimination algorithms.","PeriodicalId":73299,"journal":{"name":"IEEE open journal of control systems","volume":"2 ","pages":"410-424"},"PeriodicalIF":0.0,"publicationDate":"2023-10-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10271526","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135955069","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-09-28DOI: 10.1109/OJCSYS.2023.3320512
Babak Salamat;Abolfazl Yaghmaei;Gerhard Elsbacher;Andrea M. Tonello;Mohammad Javad Yazdanpanah
In this article, we propose a procedure to solve the controlled design for a class of under-actuated mechanical systems. Our proposed method can be viewed as a sub-method of the IDA-PBC or Controlled Lagrangian approaches, with a particular focus on shaping the potential energy. By emphasizing potential energy shaping, we can effectively tackle the bottleneck presented by the matching equation in these approaches. Moreover, our method leverages a suitable coordinate transformation that is inspired by the physics of the system, further enhancing its efficacy. Therefore, our design procedure is based on a coordinate transformation plus potential energy shaping in the new coordinates, and its existence and possibility of potential energy shaping can be verified via some algebraic calculations, making it constructive. To illustrate the results, we consider the cart-pole system and a recently introduced under-actuated mechanical system named swash mass pendulum (SMP) (Salamat and Tonello, 2021). The SMP consists of a pendulum made of a rigid shaft connected to a pair of cross-shafts where two swash masses can move under the action of servo-mechanisms.
{"title":"An Innovative Control Design Procedure for Under-Actuated Mechanical Systems: Emphasizing Potential Energy Shaping and Structural Preservation","authors":"Babak Salamat;Abolfazl Yaghmaei;Gerhard Elsbacher;Andrea M. Tonello;Mohammad Javad Yazdanpanah","doi":"10.1109/OJCSYS.2023.3320512","DOIUrl":"https://doi.org/10.1109/OJCSYS.2023.3320512","url":null,"abstract":"In this article, we propose a procedure to solve the controlled design for a class of under-actuated mechanical systems. Our proposed method can be viewed as a sub-method of the IDA-PBC or Controlled Lagrangian approaches, with a particular focus on shaping the potential energy. By emphasizing potential energy shaping, we can effectively tackle the bottleneck presented by the matching equation in these approaches. Moreover, our method leverages a suitable coordinate transformation that is inspired by the physics of the system, further enhancing its efficacy. Therefore, our design procedure is based on a coordinate transformation plus potential energy shaping in the new coordinates, and its existence and possibility of potential energy shaping can be verified via some algebraic calculations, making it constructive. To illustrate the results, we consider the cart-pole system and a recently introduced under-actuated mechanical system named swash mass pendulum (SMP) (Salamat and Tonello, 2021). The SMP consists of a pendulum made of a rigid shaft connected to a pair of cross-shafts where two swash masses can move under the action of servo-mechanisms.","PeriodicalId":73299,"journal":{"name":"IEEE open journal of control systems","volume":"2 ","pages":"356-365"},"PeriodicalIF":0.0,"publicationDate":"2023-09-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/iel7/9552933/9973428/10266689.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"50376165","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-09-15DOI: 10.1109/OJCSYS.2023.3316071
Yuanhanqing Huang;Jianghai Hu
Non-cooperative games serve as a powerful framework for capturing the interactions among self-interested players and have broad applicability in modeling a wide range of practical scenarios, ranging from power management to path planning of self-driving vehicles. Although most existing solution algorithms assume the availability of first-order information or full knowledge of the objectives and others' action profiles, there are situations where the only accessible information at players' disposal is the realized objective function values. In this article, we devise a bandit online learning algorithm that integrates the optimistic mirror descent scheme and multi-point pseudo-gradient estimates. We further prove that the generated actual sequence of play converges a.s. to a critical point if the game under study is globally merely coherent, without resorting to extra Tikhonov regularization terms or additional norm conditions. We also discuss the convergence properties of the proposed bandit learning algorithm in locally merely coherent games. Finally, we illustrate the validity of the proposed algorithm via two two-player minimax problems and a cognitive radio bandwidth allocation game.
{"title":"Global and Local Convergence Analysis of a Bandit Learning Algorithm in Merely Coherent Games","authors":"Yuanhanqing Huang;Jianghai Hu","doi":"10.1109/OJCSYS.2023.3316071","DOIUrl":"https://doi.org/10.1109/OJCSYS.2023.3316071","url":null,"abstract":"Non-cooperative games serve as a powerful framework for capturing the interactions among self-interested players and have broad applicability in modeling a wide range of practical scenarios, ranging from power management to path planning of self-driving vehicles. Although most existing solution algorithms assume the availability of first-order information or full knowledge of the objectives and others' action profiles, there are situations where the only accessible information at players' disposal is the realized objective function values. In this article, we devise a bandit online learning algorithm that integrates the optimistic mirror descent scheme and multi-point pseudo-gradient estimates. We further prove that the generated actual sequence of play converges a.s. to a critical point if the game under study is globally merely coherent, without resorting to extra Tikhonov regularization terms or additional norm conditions. We also discuss the convergence properties of the proposed bandit learning algorithm in locally merely coherent games. Finally, we illustrate the validity of the proposed algorithm via two two-player minimax problems and a cognitive radio bandwidth allocation game.","PeriodicalId":73299,"journal":{"name":"IEEE open journal of control systems","volume":"2 ","pages":"366-379"},"PeriodicalIF":0.0,"publicationDate":"2023-09-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/iel7/9552933/9973428/10251984.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"50226403","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-09-15DOI: 10.1109/OJCSYS.2023.3316090
Zhan Gao;Amanda Prorok
Traditional approaches for multi-agent navigation consider the environment as a fixed constraint, despite the obvious influence of spatial constraints on agents' performance. Yet hand-designing conducive environments is inefficient and potentially expensive. The goal of this article is to consider the obstacle layout of the environment as a decision variable in a system-level optimization problem. In other words, we aim to find an automated solution that optimizes the obstacle layout to improve the performance of multi-agent navigation, under a variety of realistic constraints. Towards this end, we propose novel problems of unprioritized