首页 > 最新文献

SIAM Conf. on Control and its Applications最新文献

英文 中文
Analytical Study of Optimal Control Intervention Strategies for Ebola Epidemic Model 埃博拉疫情模型最优控制干预策略的分析研究
Pub Date : 1900-01-01 DOI: 10.1137/1.9781611974072.54
E. Grigorieva, E. Khailov
A SEIR type model for the spread of Ebola epidemic in a population of constant size is considered. In order to control the spread of infection and prevent such epidemics, we add to the model four bounded controls. Three of them represent the efforts that reduce the contact between the susceptible and infectious individuals, between the susceptible and hospitalized, and, lastly, between susceptible and buried individuals. The fourth control represents the burial efforts. We state the optimal control problem of minimizing the number of the infectious individuals at the given terminal time. The corresponding optimal solutions are obtained with the use of the Pontryagin maximum principle. Such values of the model parameters and control constraints are used, for which the optimal controls are bang-bang. Their types are found and investigated analytically. An approach for estimating the number of zeros of the corresponding switching functions, different from the one that was used in our previous papers, is applied. The resulting estimates enable us to reduce the optimal control problem to a considerably simpler problem of the finite-dimensional constrained minimization.
考虑了埃博拉疫情在恒定规模人群中传播的SEIR型模型。为了控制感染的传播和预防这种流行病,我们在模型中加入了四个有界控制。其中三个项目代表了减少易感者和感染者之间、易感者和住院者之间以及易感者和掩埋者之间接触的努力。第四个控制代表埋葬的努力。我们描述了在给定的终端时间内使感染个体数量最小化的最优控制问题。利用庞特里亚金极大值原理,得到了相应的最优解。利用模型参数和控制约束的这些值,对其进行最优控制。他们的类型被发现和分析研究。本文采用了一种估计相应开关函数的零个数的方法,这种方法不同于我们以前的论文中使用的方法。结果估计使我们能够将最优控制问题简化为一个相当简单的有限维约束最小化问题。
{"title":"Analytical Study of Optimal Control Intervention Strategies for Ebola Epidemic Model","authors":"E. Grigorieva, E. Khailov","doi":"10.1137/1.9781611974072.54","DOIUrl":"https://doi.org/10.1137/1.9781611974072.54","url":null,"abstract":"A SEIR type model for the spread of Ebola epidemic in a population of constant size is considered. In order to control the spread of infection and prevent such epidemics, we add to the model four bounded controls. Three of them represent the efforts that reduce the contact between the susceptible and infectious individuals, between the susceptible and hospitalized, and, lastly, between susceptible and buried individuals. The fourth control represents the burial efforts. We state the optimal control problem of minimizing the number of the infectious individuals at the given terminal time. The corresponding optimal solutions are obtained with the use of the Pontryagin maximum principle. Such values of the model parameters and control constraints are used, for which the optimal controls are bang-bang. Their types are found and investigated analytically. An approach for estimating the number of zeros of the corresponding switching functions, different from the one that was used in our previous papers, is applied. The resulting estimates enable us to reduce the optimal control problem to a considerably simpler problem of the finite-dimensional constrained minimization.","PeriodicalId":193106,"journal":{"name":"SIAM Conf. on Control and its Applications","volume":"31 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1900-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115154524","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
Stability issues in disturbance decoupling for switching linear systems 切换线性系统扰动解耦中的稳定性问题
Pub Date : 1900-01-01 DOI: 10.1137/1.9781611974072.50
E. Zattoni
Disturbance decoupling — i.e., the problem of making the output of a dynamical system insensitive to undesired inputs — is a classical problem of control theory and a main concern in control applications. Hence, it has been solved for many classes of dynamical systems, considering both structural and stability requirements. As to decoupling in linear switching systems, several definitions of stability apply. The aim of this contribution is investigating different decoupling problems with progressively more stringent stability requirements: from structural decoupling to decoupling with local input-to-state stability. A convex procedure for the computation of the switching compensator is presented, based on the fact that quadratic stability under arbitrary switching guarantees global uniform asymptotic stability and the latter implies local input-to-state stability. Measurable and inaccessible disturbances are considered in a unified setting. The work is focused on discrete-time systems, although all the results hold for continuous-time systems as well, with the obvious modifications.
干扰解耦-即使动力系统的输出对不期望的输入不敏感的问题-是控制理论的经典问题,也是控制应用中的主要关注点。因此,在考虑结构和稳定性要求的情况下,已经求解了许多类型的动力系统。对于线性开关系统的解耦,有几种稳定性的定义。本贡献的目的是研究具有越来越严格的稳定性要求的不同解耦问题:从结构解耦到与局部输入到状态稳定性的解耦。基于任意切换下的二次稳定性保证了全局一致渐近稳定,而后者意味着局部输入-状态稳定,给出了切换补偿器计算的一个凸过程。在一个统一的设置中考虑可测量和不可接近的干扰。虽然所有的结果都适用于连续时间系统,但工作的重点是离散时间系统,并进行了明显的修改。
{"title":"Stability issues in disturbance decoupling for switching linear systems","authors":"E. Zattoni","doi":"10.1137/1.9781611974072.50","DOIUrl":"https://doi.org/10.1137/1.9781611974072.50","url":null,"abstract":"Disturbance decoupling — i.e., the problem of making the output of a dynamical system insensitive to undesired inputs — is a classical problem of control theory and a main concern in control applications. Hence, it has been solved for many classes of dynamical systems, considering both structural and stability requirements. As to decoupling in linear switching systems, several definitions of stability apply. The aim of this contribution is investigating different decoupling problems with progressively more stringent stability requirements: from structural decoupling to decoupling with local input-to-state stability. A convex procedure for the computation of the switching compensator is presented, based on the fact that quadratic stability under arbitrary switching guarantees global uniform asymptotic stability and the latter implies local input-to-state stability. Measurable and inaccessible disturbances are considered in a unified setting. The work is focused on discrete-time systems, although all the results hold for continuous-time systems as well, with the obvious modifications.","PeriodicalId":193106,"journal":{"name":"SIAM Conf. on Control and its Applications","volume":"130 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1900-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125051407","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 5
Necessary Conditions for Feedback Passivation of Nonaffine-in-Control Systems 非仿射控制系统反馈钝化的必要条件
Pub Date : 1900-01-01 DOI: 10.1137/1.9781611973273.13
Anshu Narang-Siddarth, J. Valasek
It is well understood that an open-loop Lyapunov stable nonaffine-in-control nonlinear system can be asymptotically stabilized through feedback. But stabilizing an open-loop unstable nonaffine system remains an open research question. This paper derives the necessary conditions required to render a general open-loop unstable nonlinear system passive through static feedback. It is shown that this is possible only if the system under consideration has relative degree one and is weakly minimum phase through an appropriate output definition. Unlike feedback passivation for affine-incontrol nonlinear systems this result is not sufficient. The developments and the essential ideas of the paper are verified for a continuously stirred tank reactor.
开环李雅普诺夫稳定非仿射控制非线性系统可以通过反馈渐近稳定。但稳定开环不稳定非仿射系统仍然是一个开放的研究问题。本文导出了一般开环不稳定非线性系统通过静态反馈使其无源化的必要条件。通过适当的输出定义表明,只有当所考虑的系统的相对阶为1且是弱最小相位时,这才有可能。与仿射控制非线性系统的反馈钝化不同,这个结果是不充分的。以连续搅拌槽式反应器为例,验证了本文的研究进展和基本思想。
{"title":"Necessary Conditions for Feedback Passivation of Nonaffine-in-Control Systems","authors":"Anshu Narang-Siddarth, J. Valasek","doi":"10.1137/1.9781611973273.13","DOIUrl":"https://doi.org/10.1137/1.9781611973273.13","url":null,"abstract":"It is well understood that an open-loop Lyapunov stable nonaffine-in-control nonlinear system can be asymptotically stabilized through feedback. But stabilizing an open-loop unstable nonaffine system remains an open research question. This paper derives the necessary conditions required to render a general open-loop unstable nonlinear system passive through static feedback. It is shown that this is possible only if the system under consideration has relative degree one and is weakly minimum phase through an appropriate output definition. Unlike feedback passivation for affine-incontrol nonlinear systems this result is not sufficient. The developments and the essential ideas of the paper are verified for a continuously stirred tank reactor.","PeriodicalId":193106,"journal":{"name":"SIAM Conf. on Control and its Applications","volume":"23 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1900-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129750562","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
Convex Methods for Rank-Constrained Optimization Problems 秩约束优化问题的凸方法
Pub Date : 1900-01-01 DOI: 10.1137/1.9781611974072.18
V. Mai, Dipankar Maity, B. Ramasubramanian, M. Rotkowitz
This paper considers optimization problems which are convex, except for a constraint on the rank of a matrix variable. Minimizing or penalizing the nuclear norm of a matrix has proven to be an effective method for generally keeping its rank small, and a vast amount of recent work has focused on this technique; however, many problems require finding a matrix whose rank is constrained to be a particular value. We present a new method for these problems, introducing a convex constraint that forces the rank to be at least the desired value, while using the nuclear norm penalty to keep the rank from rising above that value. This results in a convex optimization problem that will attempt to satisfy the constraints, to minimize the objective, and will usually produce the desired rank. We further study the choice of parameter used with the nuclear norm penalty, both with and without the constraint. It is shown that another convex optimization problem can be formulated from the dual problem which will find the best parameter in some cases, and will still produce a useful result in other cases. We find that considering parameters which are negative, that is, considering rewarding the nuclear norm, as well as penalizing it, can result in better performance with the desired rank. The methods developed are demonstrated on rank-constrained semidefinite programming problems (SDPs). The first three authors contributed equally to this work. Department of Electrical and Computer Engineering and Institute for Systems Research, University of Maryland, College Park, MD 20740. email:vsmai@umd.edu Department of Electrical and Computer Engineering and Institute for Systems Research, University of Maryland, College Park, MD 20740. email:dmaity@umd.edu Department of Electrical and Computer Engineering and Institute for Systems Research, University of Maryland, College Park, MD 20740. email:rbhaskar@umd.edu Department of Electrical and Computer Engineering and Institute for Systems Research, University of Maryland, College Park, MD 20740. email:mcrotk@umd.edu
本文研究了除矩阵变量秩约束外的凸优化问题。最小化或惩罚矩阵的核范数已被证明是通常保持其秩小的有效方法,并且最近的大量工作都集中在该技术上;然而,许多问题需要找到一个矩阵,它的秩被约束为一个特定的值。我们提出了一种新的方法来解决这些问题,引入一个凸约束来强制排名至少是期望的值,同时使用核范数惩罚来防止排名超过该值。这将导致一个凸优化问题,该问题将尝试满足约束,最小化目标,并且通常会产生期望的秩。我们进一步研究了有约束和无约束情况下核范数罚参数的选择。结果表明,对偶问题可以形成另一个凸优化问题,在某些情况下可以找到最优参数,在其他情况下仍然可以得到有用的结果。我们发现,考虑负参数,即考虑奖励核规范,以及惩罚它,可以导致更好的性能与期望的排名。最后在秩约束半确定规划问题(sdp)上进行了验证。前三位作者对这项工作的贡献相同。马里兰大学电气与计算机工程系和系统研究所,马里兰大学帕克分校20740。电子邮件:vsmai@umd.edu马里兰大学电气与计算机工程系和系统研究所,马里兰大学帕克分校20740。电子邮件:dmaity@umd.edu马里兰大学电气与计算机工程系和系统研究所,马里兰大学帕克分校20740。电子邮件:rbhaskar@umd.edu马里兰大学电气与计算机工程系和系统研究所,马里兰大学帕克分校20740。电子邮件:mcrotk@umd.edu
{"title":"Convex Methods for Rank-Constrained Optimization Problems","authors":"V. Mai, Dipankar Maity, B. Ramasubramanian, M. Rotkowitz","doi":"10.1137/1.9781611974072.18","DOIUrl":"https://doi.org/10.1137/1.9781611974072.18","url":null,"abstract":"This paper considers optimization problems which are convex, except for a constraint on the rank of a matrix variable. Minimizing or penalizing the nuclear norm of a matrix has proven to be an effective method for generally keeping its rank small, and a vast amount of recent work has focused on this technique; however, many problems require finding a matrix whose rank is constrained to be a particular value. We present a new method for these problems, introducing a convex constraint that forces the rank to be at least the desired value, while using the nuclear norm penalty to keep the rank from rising above that value. This results in a convex optimization problem that will attempt to satisfy the constraints, to minimize the objective, and will usually produce the desired rank. We further study the choice of parameter used with the nuclear norm penalty, both with and without the constraint. It is shown that another convex optimization problem can be formulated from the dual problem which will find the best parameter in some cases, and will still produce a useful result in other cases. We find that considering parameters which are negative, that is, considering rewarding the nuclear norm, as well as penalizing it, can result in better performance with the desired rank. The methods developed are demonstrated on rank-constrained semidefinite programming problems (SDPs). The first three authors contributed equally to this work. Department of Electrical and Computer Engineering and Institute for Systems Research, University of Maryland, College Park, MD 20740. email:vsmai@umd.edu Department of Electrical and Computer Engineering and Institute for Systems Research, University of Maryland, College Park, MD 20740. email:dmaity@umd.edu Department of Electrical and Computer Engineering and Institute for Systems Research, University of Maryland, College Park, MD 20740. email:rbhaskar@umd.edu Department of Electrical and Computer Engineering and Institute for Systems Research, University of Maryland, College Park, MD 20740. email:mcrotk@umd.edu","PeriodicalId":193106,"journal":{"name":"SIAM Conf. on Control and its Applications","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1900-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126023825","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 8
Reduced-order Observer Design for Structure and Motion Estimation 结构与运动估计的降阶观测器设计
Pub Date : 1900-01-01 DOI: 10.1137/1.9781611973273.6
Hui Xie, R. T. Fomena, Alan Francis Lynch
The problem of Structure and Motion Estimation in machine vision can be addressed by designing observers for dynamic systems. We propose an observer for feature point depth and camera linear velocity. The camera’s angular velocity is assumed known. As well, we require two feature points with known displacement. Relative to previous work, we do not require linear acceleration measurements. The local exponential stability of the observer is proven using a converse Lyapunov theorem. We assume the camera motion satisfies a persistency of excitation condition and the linear acceleration is bounded and has finite energy.
机器视觉中的结构和运动估计问题可以通过设计动态系统的观测器来解决。我们提出了一个特征点深度和相机线速度的观测器。假设相机的角速度是已知的。同样,我们需要两个已知位移的特征点。相对于以前的工作,我们不需要线性加速度测量。利用逆李雅普诺夫定理证明了观测器的局部指数稳定性。我们假设摄像机运动满足持续激励条件,线性加速度有界且能量有限。
{"title":"Reduced-order Observer Design for Structure and Motion Estimation","authors":"Hui Xie, R. T. Fomena, Alan Francis Lynch","doi":"10.1137/1.9781611973273.6","DOIUrl":"https://doi.org/10.1137/1.9781611973273.6","url":null,"abstract":"The problem of Structure and Motion Estimation in machine vision can be addressed by designing observers for dynamic systems. We propose an observer for feature point depth and camera linear velocity. The camera’s angular velocity is assumed known. As well, we require two feature points with known displacement. Relative to previous work, we do not require linear acceleration measurements. The local exponential stability of the observer is proven using a converse Lyapunov theorem. We assume the camera motion satisfies a persistency of excitation condition and the linear acceleration is bounded and has finite energy.","PeriodicalId":193106,"journal":{"name":"SIAM Conf. on Control and its Applications","volume":"33 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1900-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130459573","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
The Wasserstein metric in Factor Analysis 因子分析中的Wasserstein度量
Pub Date : 1900-01-01 DOI: 10.1137/1.9781611973273.2
L. Ning, T. Georgiou
We consider the problem of approximating a (nonnegative definite) covariance matrix by the sum of two structured covariances –one which is diagonal and one which has low-rank. Such an additive decomposition follows the dictum of factor analysis where linear relations are sought between variables corrupted by independent measurement noise. We use as distance the Wasserstein metric between their respective distributions (assumed Gaussian) which induces a metric between nonnegative definite matrices, in general. The rank-constraint renders the optimization non-convex. We propose alternating between optimization with respect to each of the two summands. Properties of these optimization problems and the performance of the approach are being analyzed.
考虑用两个结构协方差的和逼近一个(非负定)协方差矩阵的问题——一个是对角的,另一个是低秩的。这种加性分解遵循因子分析的原则,其中寻求被独立测量噪声破坏的变量之间的线性关系。我们在它们各自的分布(假设是高斯分布)之间使用Wasserstein度规作为距离,它通常在非负确定矩阵之间推导出一个度规。秩约束使得优化非凸。我们建议交替对这两个和进行优化。分析了这些优化问题的性质和方法的性能。
{"title":"The Wasserstein metric in Factor Analysis","authors":"L. Ning, T. Georgiou","doi":"10.1137/1.9781611973273.2","DOIUrl":"https://doi.org/10.1137/1.9781611973273.2","url":null,"abstract":"We consider the problem of approximating a (nonnegative definite) covariance matrix by the sum of two structured covariances –one which is diagonal and one which has low-rank. Such an additive decomposition follows the dictum of factor analysis where linear relations are sought between variables corrupted by independent measurement noise. We use as distance the Wasserstein metric between their respective distributions (assumed Gaussian) which induces a metric between nonnegative definite matrices, in general. The rank-constraint renders the optimization non-convex. We propose alternating between optimization with respect to each of the two summands. Properties of these optimization problems and the performance of the approach are being analyzed.","PeriodicalId":193106,"journal":{"name":"SIAM Conf. on Control and its Applications","volume":"40 9","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1900-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132537063","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Aircraft Preliminary Design Using Nonlinear Inverse Dynamics 基于非线性逆动力学的飞机初步设计
Pub Date : 1900-01-01 DOI: 10.1137/1.9781611974072.41
Marco Torres-Reyna, D. Martinez-Vazquez, E. Licéaga-Castro
Abstract What shape should an aircraft have to give certain desirable properties? Nonlinear Inverse Dynamics (NID) may be one of the necessary tools needed to find an answer to this question. In flight dynamics NID is usually applied to define flight trajectories calculations and flight control systems design. The underlying concept behind inverse dynamics applications is the definition of a desired manoeuvre, usually defined by a dynamical model or a pre-established trajectory. By forcing a aircraft whose dynamics are described by a set of nonlinear differential equations to behave like a prescribed model -non necessarily linearflight control systems are designed. This technique is referred to as nonlinear model matching. As follows NID is used to assist the preliminary design of aircraft. From a set of flight characteristics defined by customer specifications the parameters which define the shape and size, such as: wing span, weight, wing aerofoil selection, engine characteristics and wing polar are estimated.
什么形状的飞机应该给某些理想的性能?非线性逆动力学(NID)可能是找到这个问题的答案所需的必要工具之一。在飞行动力学中,NID通常用于定义飞行轨迹计算和飞行控制系统设计。逆动力学应用背后的基本概念是期望机动的定义,通常由动力学模型或预先建立的轨迹定义。通过强迫动力学由一组非线性微分方程描述的飞机像规定模型一样运动,设计了非必然线性飞行控制系统。这种技术被称为非线性模型匹配。以下是NID用于协助飞机的初步设计。从一组由客户规范定义的飞行特性中,估计出定义形状和尺寸的参数,如:翼展、重量、机翼翼型选择、发动机特性和机翼极性。
{"title":"Aircraft Preliminary Design Using Nonlinear Inverse Dynamics","authors":"Marco Torres-Reyna, D. Martinez-Vazquez, E. Licéaga-Castro","doi":"10.1137/1.9781611974072.41","DOIUrl":"https://doi.org/10.1137/1.9781611974072.41","url":null,"abstract":"Abstract What shape should an aircraft have to give certain desirable properties? Nonlinear Inverse Dynamics (NID) may be one of the necessary tools needed to find an answer to this question. In flight dynamics NID is usually applied to define flight trajectories calculations and flight control systems design. The underlying concept behind inverse dynamics applications is the definition of a desired manoeuvre, usually defined by a dynamical model or a pre-established trajectory. By forcing a aircraft whose dynamics are described by a set of nonlinear differential equations to behave like a prescribed model -non necessarily linearflight control systems are designed. This technique is referred to as nonlinear model matching. As follows NID is used to assist the preliminary design of aircraft. From a set of flight characteristics defined by customer specifications the parameters which define the shape and size, such as: wing span, weight, wing aerofoil selection, engine characteristics and wing polar are estimated.","PeriodicalId":193106,"journal":{"name":"SIAM Conf. on Control and its Applications","volume":"10 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1900-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125033358","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
The Complexity of Uncertainty in Markov Decision Processes 马尔可夫决策过程中不确定性的复杂性
Pub Date : 1900-01-01 DOI: 10.1137/1.9781611974072.42
Dimitri Scheftelowitsch
We consider Markov decision processes with uncertain transition probabilities and two optimization problems in this context: the finite horizon problem which asks to find an optimal policy for a finite number of transitions and the percentile optimization problem for a wide class of uncertain Markov decision processes which asks to find a policy with the optimal probability to reach a given reward objective. To the best of our knowledge, unlike other optimality criteria, the finite horizon problem has not been considered for the case of bounded-parameter Markov decision processes, and the percentile optimization problem has only been considered for very special cases. Unlike most problems in the Markov decision process research context, dynamic programming is not applicable, as the usual subdivision in independent subproblems in each state is not anymore possible. Justified by this observation, we establish NP-hardness results for these problems by showing appropriate reductions.
在此背景下,我们考虑具有不确定转移概率的马尔可夫决策过程和两个优化问题:有限视界问题(要求为有限数量的转移找到最优策略)和广泛类别的不确定马尔可夫决策过程的百分位优化问题(要求找到达到给定奖励目标的最优概率的策略)。据我们所知,与其他最优性准则不同,有限水平问题还没有考虑到有界参数马尔可夫决策过程的情况,百分位优化问题只考虑了非常特殊的情况。与马尔可夫决策过程研究背景下的大多数问题不同,动态规划不适用,因为在每个状态下对独立子问题进行通常的细分不再可能。根据这一观察结果,我们通过显示适当的还原来建立这些问题的np -硬度结果。
{"title":"The Complexity of Uncertainty in Markov Decision Processes","authors":"Dimitri Scheftelowitsch","doi":"10.1137/1.9781611974072.42","DOIUrl":"https://doi.org/10.1137/1.9781611974072.42","url":null,"abstract":"We consider Markov decision processes with uncertain transition probabilities and two optimization problems in this context: the finite horizon problem which asks to find an optimal policy for a finite number of transitions and the percentile optimization problem for a wide class of uncertain Markov decision processes which asks to find a policy with the optimal probability to reach a given reward objective. To the best of our knowledge, unlike other optimality criteria, the finite horizon problem has not been considered for the case of bounded-parameter Markov decision processes, and the percentile optimization problem has only been considered for very special cases. Unlike most problems in the Markov decision process research context, dynamic programming is not applicable, as the usual subdivision in independent subproblems in each state is not anymore possible. Justified by this observation, we establish NP-hardness results for these problems by showing appropriate reductions.","PeriodicalId":193106,"journal":{"name":"SIAM Conf. on Control and its Applications","volume":"43 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1900-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124520113","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Yield-Analysis of Different Coupling Schemes for Interconnected Bio-Reactors 互联生物反应器不同耦合方案的产率分析
Pub Date : 1900-01-01 DOI: 10.1137/1.9781611974072.53
W. Halter, Nico Kress, Konrad Otte, Sabrina Reich, B. Hauer, F. Allgöwer
Bio-chemical reaction networks are more and more adapted to be used for the production of fine chemicals. Due to the appearance of intermediate species which influence the single reaction steps, a single compartment approach for the implementation of such a reaction may not be optimal. Multi-compartment approaches however might have the potential to increase the yield of desired product if the coupling of the compartments is chosen appropriately. A model based approach is presented to identify and analyze such coupling schemes for a specific enzyme cascade as an example system.
生物化学反应网络越来越适应于精细化学品的生产。由于中间物质的出现会影响单个反应步骤,因此单室方法可能不是实现这种反应的最佳方法。然而,如果选择适当的隔室耦合,多隔室方法可能有可能增加所需产品的产量。以一个特定酶级联为例,提出了一种基于模型的方法来识别和分析这种耦合方案。
{"title":"Yield-Analysis of Different Coupling Schemes for Interconnected Bio-Reactors","authors":"W. Halter, Nico Kress, Konrad Otte, Sabrina Reich, B. Hauer, F. Allgöwer","doi":"10.1137/1.9781611974072.53","DOIUrl":"https://doi.org/10.1137/1.9781611974072.53","url":null,"abstract":"Bio-chemical reaction networks are more and more adapted to be used for the production of fine chemicals. Due to the appearance of intermediate species which influence the single reaction steps, a single compartment approach for the implementation of such a reaction may not be optimal. Multi-compartment approaches however might have the potential to increase the yield of desired product if the coupling of the compartments is chosen appropriately. A model based approach is presented to identify and analyze such coupling schemes for a specific enzyme cascade as an example system.","PeriodicalId":193106,"journal":{"name":"SIAM Conf. on Control and its Applications","volume":"53 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1900-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133215442","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Observer-Based Feedback Control of a Mathematical Model of Intimal Hyperplasia 基于观测器的内膜增生数学模型反馈控制
Pub Date : 1900-01-01 DOI: 10.1137/1.9781611973273.25
Jiacheng Wu, K. Cassel
A theoretical model of a potential treatment for intimal hyperplasia due to hemodialysis is proposed. This model consists of two parts. The first part is modeling the development of intimal hyperplasia as a diffusion process of muscle cells from the media to the lumen, for which the governing equation is a partial differential equation. The second part is designing an observer-based feedback controller to stabilize the equilibrium point of the system, corresponding to no intimal hyperplasia. Simulation results show that the intimal hyperplasia can be reduced by 90% in nearly 30 days of treatment.
提出了一种治疗血液透析引起的内膜增生的潜在理论模型。该模型由两部分组成。第一部分是将内膜增生的发展建模为肌肉细胞从介质到管腔的扩散过程,其控制方程为偏微分方程。第二部分是设计一个基于观测器的反馈控制器来稳定系统的平衡点,对应于不发生内膜增生。模拟结果表明,在近30天的治疗中,内膜增生可减少90%。
{"title":"Observer-Based Feedback Control of a Mathematical Model of Intimal Hyperplasia","authors":"Jiacheng Wu, K. Cassel","doi":"10.1137/1.9781611973273.25","DOIUrl":"https://doi.org/10.1137/1.9781611973273.25","url":null,"abstract":"A theoretical model of a potential treatment for intimal hyperplasia due to hemodialysis is proposed. This model consists of two parts. The first part is modeling the development of intimal hyperplasia as a diffusion process of muscle cells from the media to the lumen, for which the governing equation is a partial differential equation. The second part is designing an observer-based feedback controller to stabilize the equilibrium point of the system, corresponding to no intimal hyperplasia. Simulation results show that the intimal hyperplasia can be reduced by 90% in nearly 30 days of treatment.","PeriodicalId":193106,"journal":{"name":"SIAM Conf. on Control and its Applications","volume":"5 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1900-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130569702","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
期刊
SIAM Conf. on Control and its Applications
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1