首页 > 最新文献

Annual Review of Control Robotics and Autonomous Systems最新文献

英文 中文
Instinctive Negotiation by Autonomous Agents in Dense, Unstructured Traffic: A Controls Perspective 密集非结构化交通中自主主体的本能协商:控制视角
1区 计算机科学 Q1 AUTOMATION & CONTROL SYSTEMS Pub Date : 2023-11-14 DOI: 10.1146/annurev-control-060923-025701
Mrdjan Jankovic
Operating autonomous agents in unstructured space presents a difficult problem. The complexity of making decisions such as when to yield and when to go ahead increases exponentially with the number of agents. This is true for humans as well as for software that controls autonomous agents. With some practice, however, human operators are able to move efficiently in a maze of interacting agents in dense traffic. One recent result correlates the instability of equilibria in a multiagent system with an absence of gridlocks. These control barrier function–based algorithms do not include a decision-making component—the action is continuous, and negotiation happens through instability. This mechanism, referred to as instinctive negotiation, is contrasted with discontinuity-induced decisions arising from nonconvex optimization. Based on observed behavioral similarities and insights into human implicit and explicit learning, this article proposes a connection with human driving and suggests that humans may employ a mechanism similar to instinctive negotiation to navigate dense traffic. Expected final online publication date for the Annual Review of Control, Robotics, and Autonomous Systems, Volume 7 is May 2024. Please see http://www.annualreviews.org/page/journal/pubdates for revised estimates.
在非结构化空间中操作自主代理是一个难题。决策的复杂性,比如什么时候退让,什么时候继续,随着代理的数量呈指数增长。对于人类和控制自主代理的软件来说都是如此。然而,经过一些实践,人类操作员能够在密集交通中由相互作用的代理组成的迷宫中有效地移动。最近的一个结果将多智能体系统的不稳定性与不存在僵局联系起来。这些基于控制障碍函数的算法不包括决策组件——动作是连续的,协商发生在不稳定性中。这种机制被称为本能协商,与非凸优化引起的非连续性决策形成对比。基于观察到的行为相似性和对人类内隐和外显学习的见解,本文提出了与人类驾驶的联系,并提出人类可能采用类似于本能协商的机制来驾驭密集的交通。预计《控制、机器人和自主系统年度评论》第七卷的最终在线出版日期是2024年5月。修订后的估计数请参阅http://www.annualreviews.org/page/journal/pubdates。
{"title":"Instinctive Negotiation by Autonomous Agents in Dense, Unstructured Traffic: A Controls Perspective","authors":"Mrdjan Jankovic","doi":"10.1146/annurev-control-060923-025701","DOIUrl":"https://doi.org/10.1146/annurev-control-060923-025701","url":null,"abstract":"Operating autonomous agents in unstructured space presents a difficult problem. The complexity of making decisions such as when to yield and when to go ahead increases exponentially with the number of agents. This is true for humans as well as for software that controls autonomous agents. With some practice, however, human operators are able to move efficiently in a maze of interacting agents in dense traffic. One recent result correlates the instability of equilibria in a multiagent system with an absence of gridlocks. These control barrier function–based algorithms do not include a decision-making component—the action is continuous, and negotiation happens through instability. This mechanism, referred to as instinctive negotiation, is contrasted with discontinuity-induced decisions arising from nonconvex optimization. Based on observed behavioral similarities and insights into human implicit and explicit learning, this article proposes a connection with human driving and suggests that humans may employ a mechanism similar to instinctive negotiation to navigate dense traffic. Expected final online publication date for the Annual Review of Control, Robotics, and Autonomous Systems, Volume 7 is May 2024. Please see http://www.annualreviews.org/page/journal/pubdates for revised estimates.","PeriodicalId":29961,"journal":{"name":"Annual Review of Control Robotics and Autonomous Systems","volume":"9 2","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-11-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"134956849","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A Control Framework for Ocean Wave Energy Conversion Systems: The Potential of Moments 海浪能量转换系统的控制框架:矩势
1区 计算机科学 Q1 AUTOMATION & CONTROL SYSTEMS Pub Date : 2023-11-14 DOI: 10.1146/annurev-control-070523-115155
Nicolás Faedo, John V. Ringwood
The control of wave energy converters (WECs) to maximize power capture is a challenging problem. In particular, the nature of the wave excitation, which is in general panchromatic (or multi-sinusoidal), presents a reciprocating energy source that needs to be rectified through some means. In addition, the development of suitable control-oriented models is also challenging, requiring correct representation of system hydrodynamics and power take-off (PTO) components, while also lending themselves to control synthesis and real-time computational performance, along with a challenging optimal control problem. This article presents a moment-based mathematical framework for the formulation and solution of WEC control. It shows that moments are ideally suited to WEC control in terms of their ability to accurately characterize the nature of the wave excitation force (and the consequent evolutions in the system variables) while also gracefully including hydrodynamic and PTO nonlinearities as well as a natural extension to WEC arrays. Model reduction, to mold the system model into a control-friendly form, is also a feature of this framework. Expected final online publication date for the Annual Review of Control, Robotics, and Autonomous Systems, Volume 7 is May 2024. Please see http://www.annualreviews.org/page/journal/pubdates for revised estimates.
如何控制波能转换器(WECs)以最大限度地捕获能量是一个具有挑战性的问题。特别是,波激发的性质通常是全色的(或多正弦的),呈现出一种往复的能量源,需要通过某种方式进行整流。此外,开发合适的面向控制的模型也具有挑战性,需要正确表示系统流体动力学和动力输出(PTO)组件,同时还需要考虑控制综合和实时计算性能,以及具有挑战性的最优控制问题。本文提出了一种基于矩量的WEC控制数学框架。它表明,力矩非常适合WEC控制,因为它们能够准确地表征波浪激励力的性质(以及系统变量的后续演变),同时还优雅地包括流体动力和PTO非线性以及对WEC阵列的自然扩展。模型简化,将系统模型塑造成一种易于控制的形式,也是这个框架的一个特点。预计《控制、机器人和自主系统年度评论》第七卷的最终在线出版日期是2024年5月。修订后的估计数请参阅http://www.annualreviews.org/page/journal/pubdates。
{"title":"A Control Framework for Ocean Wave Energy Conversion Systems: The Potential of Moments","authors":"Nicolás Faedo, John V. Ringwood","doi":"10.1146/annurev-control-070523-115155","DOIUrl":"https://doi.org/10.1146/annurev-control-070523-115155","url":null,"abstract":"The control of wave energy converters (WECs) to maximize power capture is a challenging problem. In particular, the nature of the wave excitation, which is in general panchromatic (or multi-sinusoidal), presents a reciprocating energy source that needs to be rectified through some means. In addition, the development of suitable control-oriented models is also challenging, requiring correct representation of system hydrodynamics and power take-off (PTO) components, while also lending themselves to control synthesis and real-time computational performance, along with a challenging optimal control problem. This article presents a moment-based mathematical framework for the formulation and solution of WEC control. It shows that moments are ideally suited to WEC control in terms of their ability to accurately characterize the nature of the wave excitation force (and the consequent evolutions in the system variables) while also gracefully including hydrodynamic and PTO nonlinearities as well as a natural extension to WEC arrays. Model reduction, to mold the system model into a control-friendly form, is also a feature of this framework. Expected final online publication date for the Annual Review of Control, Robotics, and Autonomous Systems, Volume 7 is May 2024. Please see http://www.annualreviews.org/page/journal/pubdates for revised estimates.","PeriodicalId":29961,"journal":{"name":"Annual Review of Control Robotics and Autonomous Systems","volume":"12 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-11-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"134957156","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Control Co-Design of Wind Turbines 风力发电机控制协同设计
1区 计算机科学 Q1 AUTOMATION & CONTROL SYSTEMS Pub Date : 2023-11-14 DOI: 10.1146/annurev-control-061423-101708
Lucy Y. Pao, Manuel Pusch, Daniel S. Zalkind
Wind energy is recognized worldwide as cost-effective and environmentally friendly, and it is among the fastest-growing sources of electrical energy. To further decrease the cost of wind energy, wind turbines are being designed at ever-larger scales. To expand the deployment of wind energy, wind turbines are also being designed on floating platforms for placement in deep-water locations offshore. Both larger-scale and floating wind turbines pose challenges because of their greater structural loads and deflections. Complex, large-scale systems such as modern wind turbines increasingly require a control co-design approach, whereby the system design and control design are performed in a more integrated fashion. This article reviews recent developments in control co-design of wind turbines. We provide an overview of wind turbine design objectives and constraints, issues in the design of key wind turbine components, modeling of the wind turbine and environment, and controller coupling issues. Wind turbine control functions and the integration of control design in co-design are detailed with a focus on co-design compatible control approaches. Expected final online publication date for the Annual Review of Control, Robotics, and Autonomous Systems, Volume 7 is May 2024. Please see http://www.annualreviews.org/page/journal/pubdates for revised estimates.
风能是世界公认的具有成本效益和环境友好性的能源,是发展最快的电力能源之一。为了进一步降低风能的成本,风力涡轮机的设计规模越来越大。为了扩大风能的部署,风力涡轮机也被设计在浮动平台上,以便放置在海上的深水位置。大型风力涡轮机和浮动风力涡轮机都面临挑战,因为它们的结构载荷和挠度更大。复杂的大型系统,如现代风力涡轮机,越来越需要控制协同设计方法,即系统设计和控制设计以更加集成的方式进行。本文综述了风力发电机组控制协同设计的最新进展。我们概述了风力涡轮机的设计目标和约束,关键风力涡轮机部件的设计问题,风力涡轮机和环境的建模,以及控制器耦合问题。详细介绍了风力发电机的控制功能和控制设计在协同设计中的集成,重点介绍了协同设计兼容的控制方法。预计《控制、机器人和自主系统年度评论》第七卷的最终在线出版日期是2024年5月。修订后的估计数请参阅http://www.annualreviews.org/page/journal/pubdates。
{"title":"Control Co-Design of Wind Turbines","authors":"Lucy Y. Pao, Manuel Pusch, Daniel S. Zalkind","doi":"10.1146/annurev-control-061423-101708","DOIUrl":"https://doi.org/10.1146/annurev-control-061423-101708","url":null,"abstract":"Wind energy is recognized worldwide as cost-effective and environmentally friendly, and it is among the fastest-growing sources of electrical energy. To further decrease the cost of wind energy, wind turbines are being designed at ever-larger scales. To expand the deployment of wind energy, wind turbines are also being designed on floating platforms for placement in deep-water locations offshore. Both larger-scale and floating wind turbines pose challenges because of their greater structural loads and deflections. Complex, large-scale systems such as modern wind turbines increasingly require a control co-design approach, whereby the system design and control design are performed in a more integrated fashion. This article reviews recent developments in control co-design of wind turbines. We provide an overview of wind turbine design objectives and constraints, issues in the design of key wind turbine components, modeling of the wind turbine and environment, and controller coupling issues. Wind turbine control functions and the integration of control design in co-design are detailed with a focus on co-design compatible control approaches. Expected final online publication date for the Annual Review of Control, Robotics, and Autonomous Systems, Volume 7 is May 2024. Please see http://www.annualreviews.org/page/journal/pubdates for revised estimates.","PeriodicalId":29961,"journal":{"name":"Annual Review of Control Robotics and Autonomous Systems","volume":"6 3","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-11-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"134956675","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
From Virtual Reality to the Emerging Discipline of Perception Engineering 从虚拟现实到新兴的感知工程学科
1区 计算机科学 Q1 AUTOMATION & CONTROL SYSTEMS Pub Date : 2023-11-06 DOI: 10.1146/annurev-control-062323-102456
Steven M. LaValle, Evan G. Center, Timo Ojala, Matti Pouke, Nicoletta Prencipe, Basak Sakcak, Markku Suomalainen, Kalle G. Timperi, Vadim Weinstein
This article makes the case that a powerful new discipline, which we term perception engineering, is steadily emerging. It follows from a progression of ideas that involve creating illusions, from historical paintings and film to modern video games and virtual reality. Rather than creating physical artifacts such as bridges, airplanes, or computers, perception engineers create illusory perceptual experiences. The scope is defined over any agent that interacts with the physical world, including both biological organisms (humans and animals) and engineered systems (robots and autonomous systems). The key idea is that an agent, called a producer, alters the environment with the intent to alter the perceptual experience of another agent, called a receiver. Most importantly, the article introduces a precise mathematical formulation of this process, based on the von Neumann–Morgenstern notion of information, to help scope and define the discipline. This formulation is then applied to the cases of engineered and biological agents, with discussion of its implications for existing fields such as virtual reality, robotics, and even social media. Finally, open challenges and opportunities for involvement are identified. Expected final online publication date for the Annual Review of Control, Robotics, and Autonomous Systems, Volume 7 is May 2024. Please see http://www.annualreviews.org/page/journal/pubdates for revised estimates.
这篇文章说明了一个强大的新学科,我们称之为感知工程,正在稳步崛起。从历史绘画和电影到现代电子游戏和虚拟现实,它遵循了一系列涉及创造幻觉的想法。感知工程师创造的不是像桥梁、飞机或计算机这样的实体人工制品,而是虚幻的感知体验。范围定义为与物理世界相互作用的任何代理,包括生物有机体(人类和动物)和工程系统(机器人和自主系统)。关键思想是,一个被称为生产者的主体,改变环境的目的是改变另一个被称为接受者的主体的感知体验。最重要的是,本文基于冯·诺伊曼-摩根斯坦的信息概念,引入了这一过程的精确数学公式,以帮助界定和定义这一学科。然后将此公式应用于工程和生物制剂的案例,并讨论其对虚拟现实,机器人甚至社交媒体等现有领域的影响。最后,确定了公开的挑战和参与的机会。预计《控制、机器人和自主系统年度评论》第七卷的最终在线出版日期是2024年5月。修订后的估计数请参阅http://www.annualreviews.org/page/journal/pubdates。
{"title":"From Virtual Reality to the Emerging Discipline of Perception Engineering","authors":"Steven M. LaValle, Evan G. Center, Timo Ojala, Matti Pouke, Nicoletta Prencipe, Basak Sakcak, Markku Suomalainen, Kalle G. Timperi, Vadim Weinstein","doi":"10.1146/annurev-control-062323-102456","DOIUrl":"https://doi.org/10.1146/annurev-control-062323-102456","url":null,"abstract":"This article makes the case that a powerful new discipline, which we term perception engineering, is steadily emerging. It follows from a progression of ideas that involve creating illusions, from historical paintings and film to modern video games and virtual reality. Rather than creating physical artifacts such as bridges, airplanes, or computers, perception engineers create illusory perceptual experiences. The scope is defined over any agent that interacts with the physical world, including both biological organisms (humans and animals) and engineered systems (robots and autonomous systems). The key idea is that an agent, called a producer, alters the environment with the intent to alter the perceptual experience of another agent, called a receiver. Most importantly, the article introduces a precise mathematical formulation of this process, based on the von Neumann–Morgenstern notion of information, to help scope and define the discipline. This formulation is then applied to the cases of engineered and biological agents, with discussion of its implications for existing fields such as virtual reality, robotics, and even social media. Finally, open challenges and opportunities for involvement are identified. Expected final online publication date for the Annual Review of Control, Robotics, and Autonomous Systems, Volume 7 is May 2024. Please see http://www.annualreviews.org/page/journal/pubdates for revised estimates.","PeriodicalId":29961,"journal":{"name":"Annual Review of Control Robotics and Autonomous Systems","volume":"13 3","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-11-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135589113","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Ethics of Social Robotics: Individual and Societal Concerns and Opportunities 社会机器人伦理:个人和社会的关注和机会
1区 计算机科学 Q1 AUTOMATION & CONTROL SYSTEMS Pub Date : 2023-10-23 DOI: 10.1146/annurev-control-062023-082238
Carme Torras
Focus on the ethics of a given technology tends to lag far behind its development. This lag has been particularly acute in the case of artificial intelligence, whose accelerated deployment in a wide range of domains has triggered unprecedented attention on the risks and consequences for society at large, leading to a myriad of ethics regulations, which are difficult to coordinate and integrate due to their late appearance. The very nature of social robots forces their deployment to occur at a much slower pace, providing an opportunity for a profound reflection on ethics, which is already happening in multidisciplinary teams. This article provides a personal view of the ethics landscape, centered on the particularities of social robotics, with the main issues being ordered along two axes (individual and societal) and grouped into eight categories (human dignity, human autonomy, robot transparency, emotional bonding, privacy and safety, justice, freedom, and responsibility). This structure stems from the experience of developing and teaching a university course on ethics in social robotics, whose pedagogical materials are freely available. Expected final online publication date for the Annual Review of Control, Robotics, and Autonomous Systems, Volume 7 is May 2024. Please see http://www.annualreviews.org/page/journal/pubdates for revised estimates.
对特定技术伦理的关注往往远远落后于其发展。这种滞后在人工智能的情况下尤为严重,人工智能在广泛领域的加速部署引发了对整个社会的风险和后果的前所未有的关注,导致了无数的道德法规,这些法规由于出现较晚而难以协调和整合。社交机器人的本质迫使它们的部署以慢得多的速度进行,这为对伦理的深刻反思提供了机会,这种反思已经在多学科团队中发生了。本文以社会机器人的特殊性为中心,提供了个人对伦理景观的看法,主要问题沿着两个轴(个人和社会)排序,并分为八个类别(人类尊严,人类自主性,机器人透明度,情感联系,隐私和安全,正义,自由和责任)。这种结构源于开发和教授一门关于社会机器人伦理的大学课程的经验,该课程的教学材料是免费的。预计《控制、机器人和自主系统年度评论》第七卷的最终在线出版日期是2024年5月。修订后的估计数请参阅http://www.annualreviews.org/page/journal/pubdates。
{"title":"Ethics of Social Robotics: Individual and Societal Concerns and Opportunities","authors":"Carme Torras","doi":"10.1146/annurev-control-062023-082238","DOIUrl":"https://doi.org/10.1146/annurev-control-062023-082238","url":null,"abstract":"Focus on the ethics of a given technology tends to lag far behind its development. This lag has been particularly acute in the case of artificial intelligence, whose accelerated deployment in a wide range of domains has triggered unprecedented attention on the risks and consequences for society at large, leading to a myriad of ethics regulations, which are difficult to coordinate and integrate due to their late appearance. The very nature of social robots forces their deployment to occur at a much slower pace, providing an opportunity for a profound reflection on ethics, which is already happening in multidisciplinary teams. This article provides a personal view of the ethics landscape, centered on the particularities of social robotics, with the main issues being ordered along two axes (individual and societal) and grouped into eight categories (human dignity, human autonomy, robot transparency, emotional bonding, privacy and safety, justice, freedom, and responsibility). This structure stems from the experience of developing and teaching a university course on ethics in social robotics, whose pedagogical materials are freely available. Expected final online publication date for the Annual Review of Control, Robotics, and Autonomous Systems, Volume 7 is May 2024. Please see http://www.annualreviews.org/page/journal/pubdates for revised estimates.","PeriodicalId":29961,"journal":{"name":"Annual Review of Control Robotics and Autonomous Systems","volume":"41 6","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-10-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135366968","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Robotics Software: Past, Present, and Future 机器人软件:过去、现在和未来
1区 计算机科学 Q1 AUTOMATION & CONTROL SYSTEMS Pub Date : 2023-10-20 DOI: 10.1146/annurev-control-061323-095841
Jesse Haviland, Peter Corke
Robotics is powered by software. Software tools control the rate of innovation in robotics research, drive the growth of the robotics industry, and power the education of future innovators and developers. Nearly 900,000 open-source repositories on GitHub are tagged with the keyword robotics—a potentially vast resource, but only a fraction of those are truly accessible in terms of quality, licensability, understandability, and total cost of ownership. The challenge is to match this resource to the needs of students, researchers, and companies to power cutting-edge research and real-world industrial solutions. This article reviews software tools for robotics, including both those created by the community at large and those created by the authors, as well as their impact on education, research, and industry. Expected final online publication date for the Annual Review of Control, Robotics, and Autonomous Systems, Volume 7 is May 2024. Please see http://www.annualreviews.org/page/journal/pubdates for revised estimates.
机器人是由软件驱动的。软件工具控制着机器人研究的创新速度,推动机器人产业的发展,并为未来的创新者和开发人员的教育提供动力。GitHub上有近900,000个开源存储库被标记为关键字机器人,这是一个潜在的巨大资源,但其中只有一小部分在质量、许可性、可理解性和总拥有成本方面是真正可访问的。我们面临的挑战是将这些资源与学生、研究人员和公司的需求相匹配,以推动前沿研究和现实世界的工业解决方案。本文回顾了机器人技术的软件工具,包括由社区和作者创建的软件工具,以及它们对教育、研究和工业的影响。预计《控制、机器人和自主系统年度评论》第七卷的最终在线出版日期是2024年5月。修订后的估计数请参阅http://www.annualreviews.org/page/journal/pubdates。
{"title":"Robotics Software: Past, Present, and Future","authors":"Jesse Haviland, Peter Corke","doi":"10.1146/annurev-control-061323-095841","DOIUrl":"https://doi.org/10.1146/annurev-control-061323-095841","url":null,"abstract":"Robotics is powered by software. Software tools control the rate of innovation in robotics research, drive the growth of the robotics industry, and power the education of future innovators and developers. Nearly 900,000 open-source repositories on GitHub are tagged with the keyword robotics—a potentially vast resource, but only a fraction of those are truly accessible in terms of quality, licensability, understandability, and total cost of ownership. The challenge is to match this resource to the needs of students, researchers, and companies to power cutting-edge research and real-world industrial solutions. This article reviews software tools for robotics, including both those created by the community at large and those created by the authors, as well as their impact on education, research, and industry. Expected final online publication date for the Annual Review of Control, Robotics, and Autonomous Systems, Volume 7 is May 2024. Please see http://www.annualreviews.org/page/journal/pubdates for revised estimates.","PeriodicalId":29961,"journal":{"name":"Annual Review of Control Robotics and Autonomous Systems","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-10-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135567913","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Robot Model Identification and Learning: A Modern Perspective 机器人模型识别与学习:现代视角
1区 计算机科学 Q1 AUTOMATION & CONTROL SYSTEMS Pub Date : 2023-10-20 DOI: 10.1146/annurev-control-061523-102310
Taeyoon Lee, Jaewoon Kwon, Patrick M. Wensing, Frank C. Park
In recent years, the increasing complexity and safety-critical nature of robotic tasks have highlighted the importance of accurate and reliable robot models. This trend has led to a growing belief that, given enough data, traditional physics-based robot models can be replaced by appropriately trained deep networks or their variants. Simultaneously, there has been a renewed interest in physics-based simulation, fueled by the widespread use of simulators to train reinforcement learning algorithms in the sim-to-real paradigm. The primary objective of this review is to present a unified perspective on the process of determining robot models from data, commonly known as system identification or model learning in different subfields. The review aims to illuminate the key challenges encountered and highlight recent advancements in system identification for robotics. Specifically, we focus on recent breakthroughs that leverage the geometry of the identification problem and incorporate physics-based knowledge beyond mere first-principles model parameterizations. Through these efforts, we strive to provide a contemporary outlook on this problem, bridging classical findings with the latest progress in the field. Expected final online publication date for the Annual Review of Control, Robotics, and Autonomous Systems, Volume 7 is May 2024. Please see http://www.annualreviews.org/page/journal/pubdates for revised estimates.
近年来,机器人任务的复杂性和安全性日益增加,这凸显了准确可靠的机器人模型的重要性。这一趋势使人们越来越相信,只要有足够的数据,传统的基于物理的机器人模型可以被经过适当训练的深度网络或其变体所取代。与此同时,人们对基于物理的仿真重新产生了兴趣,这得益于模拟器在模拟到真实范式中广泛使用来训练强化学习算法。本综述的主要目的是对从数据中确定机器人模型的过程提出统一的观点,通常称为系统识别或不同子领域的模型学习。该评论旨在阐明遇到的关键挑战,并强调机器人系统识别的最新进展。具体来说,我们关注的是最近的突破,这些突破利用了识别问题的几何学,并结合了基于物理的知识,而不仅仅是第一原理模型参数化。通过这些努力,我们努力为这个问题提供一个当代的观点,将经典的发现与该领域的最新进展联系起来。预计《控制、机器人和自主系统年度评论》第七卷的最终在线出版日期是2024年5月。修订后的估计数请参阅http://www.annualreviews.org/page/journal/pubdates。
{"title":"Robot Model Identification and Learning: A Modern Perspective","authors":"Taeyoon Lee, Jaewoon Kwon, Patrick M. Wensing, Frank C. Park","doi":"10.1146/annurev-control-061523-102310","DOIUrl":"https://doi.org/10.1146/annurev-control-061523-102310","url":null,"abstract":"In recent years, the increasing complexity and safety-critical nature of robotic tasks have highlighted the importance of accurate and reliable robot models. This trend has led to a growing belief that, given enough data, traditional physics-based robot models can be replaced by appropriately trained deep networks or their variants. Simultaneously, there has been a renewed interest in physics-based simulation, fueled by the widespread use of simulators to train reinforcement learning algorithms in the sim-to-real paradigm. The primary objective of this review is to present a unified perspective on the process of determining robot models from data, commonly known as system identification or model learning in different subfields. The review aims to illuminate the key challenges encountered and highlight recent advancements in system identification for robotics. Specifically, we focus on recent breakthroughs that leverage the geometry of the identification problem and incorporate physics-based knowledge beyond mere first-principles model parameterizations. Through these efforts, we strive to provide a contemporary outlook on this problem, bridging classical findings with the latest progress in the field. Expected final online publication date for the Annual Review of Control, Robotics, and Autonomous Systems, Volume 7 is May 2024. Please see http://www.annualreviews.org/page/journal/pubdates for revised estimates.","PeriodicalId":29961,"journal":{"name":"Annual Review of Control Robotics and Autonomous Systems","volume":"37 11","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-10-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135568032","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Toward a Theoretical Foundation of Policy Optimization for Learning Control Policies 基于学习控制策略的策略优化理论基础
1区 计算机科学 Q1 AUTOMATION & CONTROL SYSTEMS Pub Date : 2023-05-03 DOI: 10.1146/annurev-control-042920-020021
Bin Hu, Kaiqing Zhang, Na Li, Mehran Mesbahi, Maryam Fazel, Tamer Başar
Gradient-based methods have been widely used for system design and optimization in diverse application domains. Recently, there has been a renewed interest in studying theoretical properties of these methods in the context of control and reinforcement learning. This article surveys some of the recent developments on policy optimization, a gradient-based iterative approach for feedback control synthesis that has been popularized by successes of reinforcement learning. We take an interdisciplinary perspective in our exposition that connects control theory, reinforcement learning, and large-scale optimization. We review a number of recently developed theoretical results on the optimization landscape, global convergence, and sample complexityof gradient-based methods for various continuous control problems, such as the linear quadratic regulator (LQR), [Formula: see text] control, risk-sensitive control, linear quadratic Gaussian (LQG) control, and output feedback synthesis. In conjunction with these optimization results, we also discuss how direct policy optimization handles stability and robustness concerns in learning-based control, two main desiderata in control engineering. We conclude the survey by pointing out several challenges and opportunities at the intersection of learning and control.
基于梯度的方法已广泛应用于各种应用领域的系统设计和优化。最近,在控制和强化学习的背景下,研究这些方法的理论性质重新引起了人们的兴趣。本文概述了策略优化的一些最新发展,这是一种基于梯度的反馈控制综合迭代方法,通过强化学习的成功而得到推广。我们采取跨学科的观点,在我们的博览会,连接控制理论,强化学习和大规模优化。我们回顾了一些最近发展的理论结果,关于各种连续控制问题的基于梯度的方法的优化前景,全局收敛和样本复杂性,例如线性二次调节器(LQR),[公式:见文本]控制,风险敏感控制,线性二次高斯(LQG)控制和输出反馈综合。结合这些优化结果,我们还讨论了直接策略优化如何处理基于学习的控制中的稳定性和鲁棒性问题,这是控制工程中的两个主要需求。我们通过指出在学习和控制的交叉点上的一些挑战和机遇来结束调查。
{"title":"Toward a Theoretical Foundation of Policy Optimization for Learning Control Policies","authors":"Bin Hu, Kaiqing Zhang, Na Li, Mehran Mesbahi, Maryam Fazel, Tamer Başar","doi":"10.1146/annurev-control-042920-020021","DOIUrl":"https://doi.org/10.1146/annurev-control-042920-020021","url":null,"abstract":"Gradient-based methods have been widely used for system design and optimization in diverse application domains. Recently, there has been a renewed interest in studying theoretical properties of these methods in the context of control and reinforcement learning. This article surveys some of the recent developments on policy optimization, a gradient-based iterative approach for feedback control synthesis that has been popularized by successes of reinforcement learning. We take an interdisciplinary perspective in our exposition that connects control theory, reinforcement learning, and large-scale optimization. We review a number of recently developed theoretical results on the optimization landscape, global convergence, and sample complexityof gradient-based methods for various continuous control problems, such as the linear quadratic regulator (LQR), [Formula: see text] control, risk-sensitive control, linear quadratic Gaussian (LQG) control, and output feedback synthesis. In conjunction with these optimization results, we also discuss how direct policy optimization handles stability and robustness concerns in learning-based control, two main desiderata in control engineering. We conclude the survey by pointing out several challenges and opportunities at the intersection of learning and control.","PeriodicalId":29961,"journal":{"name":"Annual Review of Control Robotics and Autonomous Systems","volume":"15 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-05-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"134923116","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
Noise in Biomolecular Systems: Modeling, Analysis, and Control Implications 生物分子系统中的噪声:建模、分析和控制意义
1区 计算机科学 Q1 AUTOMATION & CONTROL SYSTEMS Pub Date : 2023-05-03 DOI: 10.1146/annurev-control-042920-101825
Corentin Briat, Mustafa Khammash
While noise is generally associated with uncertainties and often has a negative connotation in engineering, living organisms have evolved to adapt to (and even exploit) such uncertainty to ensure the survival of a species or implement certain functions that would have been difficult or even impossible otherwise. In this article, we review the role and impact of noise in systems and synthetic biology, with a particular emphasis on its role in the genetic control of biological systems, an area we refer to as cybergenetics. The main modeling paradigm is that of stochastic reaction networks, whose applicability goes beyond biology, as these networks can represent any population dynamics system, including ecological, epidemiological, and opinion dynamics networks. We review different ways to mathematically represent these systems, and we notably argue that the concept of ergodicity presents a particularly suitable way to characterize their stability. We then discuss noise-induced properties and show that noise can be both an asset and a nuisance in this setting. Finally, we discuss recent results on (stochastic) cybergenetics and explore their relationships to noise. Along the way, we detail the different technical and biological constraints that need to be respected when designing synthetic biological circuits. Finally, we discuss the concepts, problems, and solutions exposed in the article; raise criticisms and concerns about current ideas and approaches; suggest current (open) problems with potential solutions; and provide some ideas for future research directions.
虽然噪音通常与不确定性联系在一起,并且在工程中通常具有负面含义,但生物体已经进化到适应(甚至利用)这种不确定性,以确保物种的生存或实现某些本来很难甚至不可能实现的功能。在这篇文章中,我们回顾了噪声在系统和合成生物学中的作用和影响,特别强调了它在生物系统遗传控制中的作用,我们称之为控制论遗传学。主要的建模范式是随机反应网络,其适用性超越了生物学,因为这些网络可以代表任何种群动态系统,包括生态、流行病学和舆论动态网络。我们回顾了不同的数学方法来表示这些系统,我们特别认为遍历性的概念提出了一个特别合适的方法来表征它们的稳定性。然后,我们讨论了噪声诱发的特性,并表明噪声在这种情况下既是一种资产,也是一种麻烦。最后,我们讨论了(随机)控制遗传学的最新成果,并探讨了它们与噪声的关系。在此过程中,我们详细介绍了在设计合成生物电路时需要考虑的不同技术和生物学限制。最后,我们讨论了文章中暴露的概念、问题和解决方案;对当前的想法和方法提出批评和关注;提出当前(未解决)问题的潜在解决方案;并对今后的研究方向提出了一些设想。
{"title":"Noise in Biomolecular Systems: Modeling, Analysis, and Control Implications","authors":"Corentin Briat, Mustafa Khammash","doi":"10.1146/annurev-control-042920-101825","DOIUrl":"https://doi.org/10.1146/annurev-control-042920-101825","url":null,"abstract":"While noise is generally associated with uncertainties and often has a negative connotation in engineering, living organisms have evolved to adapt to (and even exploit) such uncertainty to ensure the survival of a species or implement certain functions that would have been difficult or even impossible otherwise. In this article, we review the role and impact of noise in systems and synthetic biology, with a particular emphasis on its role in the genetic control of biological systems, an area we refer to as cybergenetics. The main modeling paradigm is that of stochastic reaction networks, whose applicability goes beyond biology, as these networks can represent any population dynamics system, including ecological, epidemiological, and opinion dynamics networks. We review different ways to mathematically represent these systems, and we notably argue that the concept of ergodicity presents a particularly suitable way to characterize their stability. We then discuss noise-induced properties and show that noise can be both an asset and a nuisance in this setting. Finally, we discuss recent results on (stochastic) cybergenetics and explore their relationships to noise. Along the way, we detail the different technical and biological constraints that need to be respected when designing synthetic biological circuits. Finally, we discuss the concepts, problems, and solutions exposed in the article; raise criticisms and concerns about current ideas and approaches; suggest current (open) problems with potential solutions; and provide some ideas for future research directions.","PeriodicalId":29961,"journal":{"name":"Annual Review of Control Robotics and Autonomous Systems","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-05-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"134923115","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
How the CYBATHLON Competition Has Advanced Assistive Technologies CYBATHLON比赛如何使用先进的辅助技术
IF 13.4 1区 计算机科学 Q1 AUTOMATION & CONTROL SYSTEMS Pub Date : 2023-05-03 DOI: 10.1146/annurev-control-071822-095355
L. Jaeger, R. Baptista, Chiara Basla, P. Capsi-Morales, Yong Kuk Kim, S. Nakajima, C. Piazza, Michael Sommerhalder, L. Tonin, G. Valle, R. Riener, R. Sigrist
Approximately 1.1. billion people worldwide live with some form of disability, and assistive technology has the potential to increase their overall quality of life. However, the end users’ perspective and needs are often not sufficiently considered during the development of this technology, leading to frustration and nonuse of existing devices. Since its first competition in 2016, CYBATHLON has aimed to drive innovation in the field of assistive technology by motivating teams to involve end users more actively in the development process and to tailor novel devices to their actual daily-life needs. Competition tasks therefore represent unsolved daily-life challenges for people with disabilities and serve the purpose of benchmarking the latest developments from research laboratories and companies from around the world. This review describes each of the competition disciplines, their contributions to assistive technology, and remaining challenges in the user-centered development of this technology.
大约1.1。全世界有十亿人患有某种形式的残疾,辅助技术有可能提高他们的整体生活质量。然而,在这项技术的开发过程中,最终用户的观点和需求往往没有得到充分的考虑,导致现有设备的挫折和不使用。自2016年首届比赛以来,CYBATHLON旨在推动辅助技术领域的创新,激励团队让最终用户更积极地参与开发过程,并根据他们的实际日常生活需求定制新颖的设备。因此,竞赛任务代表了残疾人日常生活中尚未解决的挑战,并为来自世界各地的研究实验室和公司的最新发展提供基准。这篇综述描述了每个竞赛学科,它们对辅助技术的贡献,以及在以用户为中心的辅助技术开发中仍然存在的挑战。
{"title":"How the CYBATHLON Competition Has Advanced Assistive Technologies","authors":"L. Jaeger, R. Baptista, Chiara Basla, P. Capsi-Morales, Yong Kuk Kim, S. Nakajima, C. Piazza, Michael Sommerhalder, L. Tonin, G. Valle, R. Riener, R. Sigrist","doi":"10.1146/annurev-control-071822-095355","DOIUrl":"https://doi.org/10.1146/annurev-control-071822-095355","url":null,"abstract":"Approximately 1.1. billion people worldwide live with some form of disability, and assistive technology has the potential to increase their overall quality of life. However, the end users’ perspective and needs are often not sufficiently considered during the development of this technology, leading to frustration and nonuse of existing devices. Since its first competition in 2016, CYBATHLON has aimed to drive innovation in the field of assistive technology by motivating teams to involve end users more actively in the development process and to tailor novel devices to their actual daily-life needs. Competition tasks therefore represent unsolved daily-life challenges for people with disabilities and serve the purpose of benchmarking the latest developments from research laboratories and companies from around the world. This review describes each of the competition disciplines, their contributions to assistive technology, and remaining challenges in the user-centered development of this technology.","PeriodicalId":29961,"journal":{"name":"Annual Review of Control Robotics and Autonomous Systems","volume":"1 1","pages":""},"PeriodicalIF":13.4,"publicationDate":"2023-05-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"88404706","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
期刊
Annual Review of Control Robotics and Autonomous Systems
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1