首页 > 最新文献

Applied Mathematics and Optimization最新文献

英文 中文
Steady Navier–Stokes Equations with Regularized Directional Do-Nothing Boundary Condition: Optimal Boundary Control for a Velocity Tracking Problem
IF 1.6 2区 数学 Q2 MATHEMATICS, APPLIED Pub Date : 2025-01-27 DOI: 10.1007/s00245-024-10216-4
Pedro Nogueira, Ana L. Silvestre, Jorge Tiago

We consider the steady Navier–Stokes equations with mixed boundary conditions, where a regularized directional do-nothing (RDDN) condition is defined on the Neumann boundary portion. An auxiliary Stokes reference flow, which also works as a lifting of the inhomogeneous Dirichlet boundary values, is used to define the RDDN condition. Our aim is to study the minimization of a velocity tracking cost functional with controls localized on a part of the boundary. We prove the existence of a solution for this optimal control problem and derive the corresponding first order necessary optimality conditions in terms of dual variables. All results are obtained under appropriate assumptions on the size of the data and the controls, which, however, are less restrictive when compared with the case of the classical do-nothing outflow condition. This is further confirmed by the numerical examples presented, which include scenarios where only noisy data is available.

{"title":"Steady Navier–Stokes Equations with Regularized Directional Do-Nothing Boundary Condition: Optimal Boundary Control for a Velocity Tracking Problem","authors":"Pedro Nogueira,&nbsp;Ana L. Silvestre,&nbsp;Jorge Tiago","doi":"10.1007/s00245-024-10216-4","DOIUrl":"10.1007/s00245-024-10216-4","url":null,"abstract":"<div><p>We consider the steady Navier–Stokes equations with mixed boundary conditions, where a regularized directional do-nothing (RDDN) condition is defined on the Neumann boundary portion. An auxiliary Stokes reference flow, which also works as a lifting of the inhomogeneous Dirichlet boundary values, is used to define the RDDN condition. Our aim is to study the minimization of a velocity tracking cost functional with controls localized on a part of the boundary. We prove the existence of a solution for this optimal control problem and derive the corresponding first order necessary optimality conditions in terms of dual variables. All results are obtained under appropriate assumptions on the size of the data and the controls, which, however, are less restrictive when compared with the case of the classical do-nothing outflow condition. This is further confirmed by the numerical examples presented, which include scenarios where only noisy data is available.</p></div>","PeriodicalId":55566,"journal":{"name":"Applied Mathematics and Optimization","volume":"91 1","pages":""},"PeriodicalIF":1.6,"publicationDate":"2025-01-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://link.springer.com/content/pdf/10.1007/s00245-024-10216-4.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143109690","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Viscosity Solutions of a Class of Second Order Hamilton–Jacobi–Bellman Equations in the Wasserstein Space
IF 1.6 2区 数学 Q2 MATHEMATICS, APPLIED Pub Date : 2025-01-27 DOI: 10.1007/s00245-025-10219-9
Hang Cheung, Ho Man Tai, Jinniao Qiu

This paper is devoted to solving a class of second order Hamilton–Jacobi–Bellman (HJB) equations in the Wasserstein space, associated with mean field control problems involving common noise. The well-posedness of viscosity solution to the HJB equation under a new notion is established under general assumptions on the coefficients. Our approach adopts the smooth metric developed by Bayraktar et al. (Proc Am Math Soc 151(09):4089–4098, 2023) as our gauge function for the purpose of smooth variational principle used in the proof of comparison theorem. Further estimates and regularity of the metric, including a novel second order derivative estimate with respect to the measure variable, are derived in order to ensure the uniqueness and existence.

{"title":"Viscosity Solutions of a Class of Second Order Hamilton–Jacobi–Bellman Equations in the Wasserstein Space","authors":"Hang Cheung,&nbsp;Ho Man Tai,&nbsp;Jinniao Qiu","doi":"10.1007/s00245-025-10219-9","DOIUrl":"10.1007/s00245-025-10219-9","url":null,"abstract":"<div><p>This paper is devoted to solving a class of second order Hamilton–Jacobi–Bellman (HJB) equations in the Wasserstein space, associated with mean field control problems involving common noise. The well-posedness of viscosity solution to the HJB equation under a new notion is established under general assumptions on the coefficients. Our approach adopts the smooth metric developed by Bayraktar et al. (Proc Am Math Soc 151(09):4089–4098, 2023) as our gauge function for the purpose of smooth variational principle used in the proof of comparison theorem. Further estimates and regularity of the metric, including a novel second order derivative estimate with respect to the measure variable, are derived in order to ensure the uniqueness and existence.</p></div>","PeriodicalId":55566,"journal":{"name":"Applied Mathematics and Optimization","volume":"91 1","pages":""},"PeriodicalIF":1.6,"publicationDate":"2025-01-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143109607","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
On Stationarity Conditions and Constraint Qualifications for Multiobjective Optimization Problems with Cardinality Constraints
IF 1.6 2区 数学 Q2 MATHEMATICS, APPLIED Pub Date : 2025-01-23 DOI: 10.1007/s00245-025-10224-y
Rohollah Garmanjani, Evelin H. M. Krulikovski, Alberto Ramos

The purpose of this paper is to develop Pareto optimality conditions and constraint qualifications (CQs) for Multiobjective Programs with Cardinality Constraints (MOPCaC). In general, such problems are difficult to solve, not only because they involve a cardinality constraint that is neither continuous nor convex, but also because there may be a potential conflict between the various objective functions. Thus, we reformulate the MOPCaC based on the problem with continuous variables, namely the relaxed problem. Furthermore, we consider different notions of optimality (weak/strong Pareto optimal solutions). Thereby, we define new stationarity conditions that extend the classical Karush-Kuhn-Tucker (KKT) conditions of the scalar case. Moreover, we also introduce new CQs, based on the recently defined multiobjective normal cone, to ensure compliance with such stationarity conditions. Important statements are illustrated by examples.

{"title":"On Stationarity Conditions and Constraint Qualifications for Multiobjective Optimization Problems with Cardinality Constraints","authors":"Rohollah Garmanjani,&nbsp;Evelin H. M. Krulikovski,&nbsp;Alberto Ramos","doi":"10.1007/s00245-025-10224-y","DOIUrl":"10.1007/s00245-025-10224-y","url":null,"abstract":"<div><p>The purpose of this paper is to develop Pareto optimality conditions and constraint qualifications (CQs) for Multiobjective Programs with Cardinality Constraints (MOPCaC). In general, such problems are difficult to solve, not only because they involve a cardinality constraint that is neither continuous nor convex, but also because there may be a potential conflict between the various objective functions. Thus, we reformulate the MOPCaC based on the problem with continuous variables, namely the relaxed problem. Furthermore, we consider different notions of optimality (weak/strong Pareto optimal solutions). Thereby, we define new stationarity conditions that extend the classical Karush-Kuhn-Tucker (KKT) conditions of the scalar case. Moreover, we also introduce new CQs, based on the recently defined multiobjective normal cone, to ensure compliance with such stationarity conditions. Important statements are illustrated by examples.</p></div>","PeriodicalId":55566,"journal":{"name":"Applied Mathematics and Optimization","volume":"91 1","pages":""},"PeriodicalIF":1.6,"publicationDate":"2025-01-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143109264","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Exact Controllability to Nonnegative Trajectory for a Chemotaxis System 趋化系统的非负轨迹精确可控性
IF 1.6 2区 数学 Q2 MATHEMATICS, APPLIED Pub Date : 2025-01-22 DOI: 10.1007/s00245-025-10221-1
Qiang Tao, Muming Zhang

This paper studies the controllability for a Keller–Segel type chemotaxis model with singular sensitivity. Based on the Hopf–Cole transformation, a nonlinear parabolic system, which has first-order couplings, and the coupling coefficients are functions that depend on both time and space variables, is derived. Then, the controllability result is proved by a new global Carleman estimate for general coupled parabolic equations allowed to contain a convective term. Also, the global existence of nonnegative solution for the chemotaxis system is discussed.

本文研究了一类具有奇异灵敏度的Keller-Segel型趋化性模型的可控性。基于Hopf-Cole变换,导出了一类具有一阶耦合且耦合系数是依赖于时间和空间变量的函数的非线性抛物型系统。然后,用一种新的全局Carleman估计证明了含对流项的一般耦合抛物方程的可控性结果。同时,讨论了趋化系统的非负解的整体存在性。
{"title":"Exact Controllability to Nonnegative Trajectory for a Chemotaxis System","authors":"Qiang Tao,&nbsp;Muming Zhang","doi":"10.1007/s00245-025-10221-1","DOIUrl":"10.1007/s00245-025-10221-1","url":null,"abstract":"<div><p>This paper studies the controllability for a Keller–Segel type chemotaxis model with singular sensitivity. Based on the Hopf–Cole transformation, a nonlinear parabolic system, which has first-order couplings, and the coupling coefficients are functions that depend on both time and space variables, is derived. Then, the controllability result is proved by a new global Carleman estimate for general coupled parabolic equations allowed to contain a convective term. Also, the global existence of nonnegative solution for the chemotaxis system is discussed.</p></div>","PeriodicalId":55566,"journal":{"name":"Applied Mathematics and Optimization","volume":"91 1","pages":""},"PeriodicalIF":1.6,"publicationDate":"2025-01-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142995633","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Fractional, Semilinear, and Sparse Optimal Control: A Priori Error Bounds 分数、半线性和稀疏最优控制:先验误差界
IF 1.6 2区 数学 Q2 MATHEMATICS, APPLIED Pub Date : 2025-01-22 DOI: 10.1007/s00245-024-10200-y
Francisco Bersetche, Francisco Fuica, Enrique Otárola, Daniel Quero

In this work, we use the integral definition of the fractional Laplace operator and study a sparse optimal control problem involving a fractional, semilinear, and elliptic partial differential equation as state equation; control constraints are also considered. We establish the existence of optimal solutions and first and second order optimality conditions. We also analyze regularity properties for optimal variables. We propose and analyze two finite element strategies of discretization: a fully discrete scheme, where the control variable is discretized with piecewise constant functions, and a semidiscrete scheme, where the control variable is not discretized. For both discretization schemes, we analyze convergence properties and a priori error bounds.

本文利用分数阶拉普拉斯算子的积分定义,研究了一个包含分数阶半线性椭圆型偏微分方程作为状态方程的稀疏最优控制问题;还考虑了控制约束。我们建立了最优解的存在性以及一阶和二阶最优性条件。我们还分析了最优变量的正则性。我们提出并分析了两种有限元离散化策略:一种完全离散方案,其中控制变量用分段常数函数离散化;一种半离散方案,其中控制变量不离散化。对于这两种离散化方案,我们分析了收敛性和先验误差界。
{"title":"Fractional, Semilinear, and Sparse Optimal Control: A Priori Error Bounds","authors":"Francisco Bersetche,&nbsp;Francisco Fuica,&nbsp;Enrique Otárola,&nbsp;Daniel Quero","doi":"10.1007/s00245-024-10200-y","DOIUrl":"10.1007/s00245-024-10200-y","url":null,"abstract":"<div><p>In this work, we use the integral definition of the fractional Laplace operator and study a sparse optimal control problem involving a fractional, semilinear, and elliptic partial differential equation as state equation; control constraints are also considered. We establish the existence of optimal solutions and first and second order optimality conditions. We also analyze regularity properties for optimal variables. We propose and analyze two finite element strategies of discretization: a fully discrete scheme, where the control variable is discretized with piecewise constant functions, and a semidiscrete scheme, where the control variable is not discretized. For both discretization schemes, we analyze convergence properties and a priori error bounds.</p></div>","PeriodicalId":55566,"journal":{"name":"Applied Mathematics and Optimization","volume":"91 1","pages":""},"PeriodicalIF":1.6,"publicationDate":"2025-01-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142995677","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
On the Relationship Between Viscosity and Distribution Solutions for Nonlinear Neumann Type PDEs: The Probabilistic Approach 非线性Neumann型偏微分方程黏度与分布解的关系:概率方法
IF 1.6 2区 数学 Q2 MATHEMATICS, APPLIED Pub Date : 2025-01-18 DOI: 10.1007/s00245-025-10222-0
Jiagang Ren, Shoutian Wang, Jing Wu

Based on probabilistic methods, we discuss the relationship between viscosity and distribution solutions for semi-linear partial differential equations (PDEs) with Neumann boundary conditions. We also extend the research to a type of nonlinear PDEs, which is completed through the well-posedness and continuity results of solutions to the corresponding forward-backward SDE.

基于概率方法,讨论了具有Neumann边界条件的半线性偏微分方程的粘度与分布解之间的关系。我们还将研究扩展到一类非线性偏微分方程,这是通过相应的正向后偏微分方程解的适定性和连续性结果来完成的。
{"title":"On the Relationship Between Viscosity and Distribution Solutions for Nonlinear Neumann Type PDEs: The Probabilistic Approach","authors":"Jiagang Ren,&nbsp;Shoutian Wang,&nbsp;Jing Wu","doi":"10.1007/s00245-025-10222-0","DOIUrl":"10.1007/s00245-025-10222-0","url":null,"abstract":"<div><p>Based on probabilistic methods, we discuss the relationship between viscosity and distribution solutions for semi-linear partial differential equations (PDEs) with Neumann boundary conditions. We also extend the research to a type of nonlinear PDEs, which is completed through the well-posedness and continuity results of solutions to the corresponding forward-backward SDE.</p></div>","PeriodicalId":55566,"journal":{"name":"Applied Mathematics and Optimization","volume":"91 1","pages":""},"PeriodicalIF":1.6,"publicationDate":"2025-01-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142994889","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Asymptotic Behavior of Rao–Nakra Sandwich Beam with Nonlinear Localized Damping and Source Terms 具有非线性局域阻尼和源项的Rao-Nakra夹层梁的渐近特性
IF 1.6 2区 数学 Q2 MATHEMATICS, APPLIED Pub Date : 2025-01-16 DOI: 10.1007/s00245-024-10218-2
Marcelo M. Cavalcanti, Baowei Feng, Victor Hugo Gonzalez Martinez, Sabeur Mansouri

This paper is concerned with a semilinear Rao–Nakra sandwich beam under the action of three nonlinear localized frictional damping terms in which the core viscoelastic layer is constrained by the pure elasticity or piezoelectric outer layers. The main goal is to prove its asymptotic behavior by applying minimal amount of support to the damping. We firstly prove that the system is global well-posedness by the theory of monotone operators. For asymptotic behavior of solutions, we obtain uniform decay rate results of the system and the energy decay rates are determined by a nonlinear first-order ODE. The existence of a smooth global attractor with finite fractal dimension and generalized exponential attractors are finally obtained.

本文研究了三非线性局域摩擦阻尼项作用下的半线性Rao-Nakra夹芯梁,其中芯粘弹性层受纯弹性层或压电外层约束。主要目标是通过对阻尼施加最小的支持来证明其渐近性。首先利用单调算子理论证明了该系统是全局适定性的。对于解的渐近性,我们得到了系统的一致衰减率结果,并且能量衰减率由非线性一阶ODE确定。最后得到了有限分形维数光滑全局吸引子和广义指数吸引子的存在性。
{"title":"Asymptotic Behavior of Rao–Nakra Sandwich Beam with Nonlinear Localized Damping and Source Terms","authors":"Marcelo M. Cavalcanti,&nbsp;Baowei Feng,&nbsp;Victor Hugo Gonzalez Martinez,&nbsp;Sabeur Mansouri","doi":"10.1007/s00245-024-10218-2","DOIUrl":"10.1007/s00245-024-10218-2","url":null,"abstract":"<div><p>This paper is concerned with a semilinear Rao–Nakra sandwich beam under the action of three nonlinear localized frictional damping terms in which the core viscoelastic layer is constrained by the pure elasticity or piezoelectric outer layers. The main goal is to prove its asymptotic behavior by applying <i>minimal amount of support to the damping</i>. We firstly prove that the system is global well-posedness by the theory of monotone operators. For asymptotic behavior of solutions, we obtain uniform decay rate results of the system and the energy decay rates are determined by a nonlinear first-order ODE. The existence of a smooth global attractor with finite fractal dimension and generalized exponential attractors are finally obtained.</p></div>","PeriodicalId":55566,"journal":{"name":"Applied Mathematics and Optimization","volume":"91 1","pages":""},"PeriodicalIF":1.6,"publicationDate":"2025-01-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142995195","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Strict Efficiency in Vector Optimization Via a Directional Curvature Functional 基于方向曲率泛函的矢量优化的严格效率
IF 1.6 2区 数学 Q2 MATHEMATICS, APPLIED Pub Date : 2025-01-12 DOI: 10.1007/s00245-025-10220-2
José Cerda-Hernández, Alberto Ramos

We derive new necessary and sufficient conditions for strict efficiency in vector optimization problems for non-smooth mappings. Unlike other approaches, our conditions are described in terms of a suitable directional curvature functional that allows us to derive no-gap second-order optimality conditions in an abstract setting. Our approach allows us to apply our results even when classical assumptions such as the second-order regularity conditions to the feasible set fail, extending the applicability of our approach. As applications to mathematical programming, we provide new primal and dual Karush-Kuhn-Tucker (KKT) second-order necessary and sufficient conditions. We provide some examples to illustrate our findings.

给出了非光滑映射矢量优化问题严格有效的新的充要条件。与其他方法不同,我们的条件是用合适的方向曲率泛函来描述的,这使我们能够在抽象设置中推导出无间隙二阶最优性条件。我们的方法允许我们应用我们的结果,即使经典的假设,如二阶正则条件的可行集失败,扩展了我们的方法的适用性。作为数学规划的应用,我们给出了新的KKT二阶充要条件。我们提供了一些例子来说明我们的发现。
{"title":"Strict Efficiency in Vector Optimization Via a Directional Curvature Functional","authors":"José Cerda-Hernández,&nbsp;Alberto Ramos","doi":"10.1007/s00245-025-10220-2","DOIUrl":"10.1007/s00245-025-10220-2","url":null,"abstract":"<div><p>We derive new necessary and sufficient conditions for strict efficiency in vector optimization problems for non-smooth mappings. Unlike other approaches, our conditions are described in terms of a suitable directional curvature functional that allows us to derive no-gap second-order optimality conditions in an abstract setting. Our approach allows us to apply our results even when classical assumptions such as the second-order regularity conditions to the feasible set fail, extending the applicability of our approach. As applications to mathematical programming, we provide new primal and dual Karush-Kuhn-Tucker (KKT) second-order necessary and sufficient conditions. We provide some examples to illustrate our findings.</p></div>","PeriodicalId":55566,"journal":{"name":"Applied Mathematics and Optimization","volume":"91 1","pages":""},"PeriodicalIF":1.6,"publicationDate":"2025-01-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142963090","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Another Look at Partially Observed Optimal Stochastic Control: Existence, Ergodicity, and Approximations Without Belief-Reduction 再看部分可观察的最优随机控制:存在性、遍历性和无信念约简的近似
IF 1.6 2区 数学 Q2 MATHEMATICS, APPLIED Pub Date : 2025-01-04 DOI: 10.1007/s00245-024-10211-9
Serdar Yüksel

We present an alternative view for the study of optimal control of partially observed Markov Decision Processes (POMDPs). We first revisit the traditional (and by now standard) separated-design method of reducing the problem to fully observed MDPs (belief-MDPs), and present conditions for the existence of optimal policies. Then, rather than working with this standard method, we define a Markov chain taking values in an infinite dimensional product space with the history process serving as the controlled state process and a further refinement in which the control actions and the state process are causally conditionally independent given the measurement/information process. We provide new sufficient conditions for the existence of optimal control policies under the discounted cost and average cost infinite horizon criteria. In particular, while in the belief-MDP reduction of POMDPs, weak Feller condition requirement imposes total variation continuity on either the system kernel or the measurement kernel, with the approach of this paper only weak continuity of both the transition kernel and the measurement kernel is needed (and total variation continuity is not) together with regularity conditions related to filter stability. For the discounted cost setup, we establish near optimality of finite window policies via a direct argument involving near optimality of quantized approximations for MDPs under weak Feller continuity, where finite truncations of memory can be viewed as quantizations of infinite memory with a uniform diameter in each finite window restriction under the product metric. For the average cost setup, we provide new existence conditions and also a general approach on how to initialize the randomness which we show to establish convergence to optimal cost. In the control-free case, our analysis leads to new and weak conditions for the existence and uniqueness of invariant probability measures for nonlinear filter processes, where we show that unique ergodicity of the measurement process and a measurability condition related to filter stability leads to unique ergodicity.

我们提出了部分观测马尔可夫决策过程(pomdp)最优控制研究的另一种观点。我们首先重新审视传统的(也是现在标准的)分离设计方法,将问题简化为完全观察到的MDPs(信念MDPs),并给出最优策略存在的条件。然后,我们定义了一个马尔可夫链,在无限维的积空间中取值,历史过程作为受控状态过程,并进一步细化,其中控制动作和状态过程在给定的测量/信息过程中是因果条件独立的。在折现成本和平均成本无限水平准则下,给出了最优控制策略存在的新的充分条件。特别是,在pomdp的belief-MDP约简中,弱Feller条件要求对系统核或测量核都施加了总变差连续性,而本文的方法只需要转换核和测量核都具有弱连续性(不需要总变差连续性)以及与滤波器稳定性相关的正则性条件。对于贴现成本设置,我们通过涉及弱Feller连续性下mdp量化近似的近最优性的直接论证建立了有限窗口策略的近最优性,其中内存的有限截断可以被视为在产品度量下每个有限窗口限制下具有均匀直径的无限内存的量化。对于平均代价设置,我们给出了新的存在条件,并给出了如何初始化随机性的一般方法,证明了该方法可以收敛到最优代价。在无控制情况下,我们的分析给出了非线性滤波过程不变概率测度存在唯一性的新的弱条件,其中我们证明了测量过程的唯一遍历性和与滤波器稳定性相关的可测性条件导致唯一遍历性。
{"title":"Another Look at Partially Observed Optimal Stochastic Control: Existence, Ergodicity, and Approximations Without Belief-Reduction","authors":"Serdar Yüksel","doi":"10.1007/s00245-024-10211-9","DOIUrl":"10.1007/s00245-024-10211-9","url":null,"abstract":"<div><p>We present an alternative view for the study of optimal control of partially observed Markov Decision Processes (POMDPs). We first revisit the traditional (and by now standard) separated-design method of reducing the problem to fully observed MDPs (belief-MDPs), and present conditions for the existence of optimal policies. Then, rather than working with this standard method, we define a Markov chain taking values in an infinite dimensional product space with the history process serving as the controlled state process and a further refinement in which the control actions and the state process are causally conditionally independent given the measurement/information process. We provide new sufficient conditions for the existence of optimal control policies under the discounted cost and average cost infinite horizon criteria. In particular, while in the belief-MDP reduction of POMDPs, weak Feller condition requirement imposes total variation continuity on either the system kernel or the measurement kernel, with the approach of this paper only weak continuity of both the transition kernel and the measurement kernel is needed (and total variation continuity is not) together with regularity conditions related to filter stability. For the discounted cost setup, we establish near optimality of finite window policies via a direct argument involving near optimality of quantized approximations for MDPs under weak Feller continuity, where finite truncations of memory can be viewed as quantizations of infinite memory with a uniform diameter in each finite window restriction under the product metric. For the average cost setup, we provide new existence conditions and also a general approach on how to initialize the randomness which we show to establish convergence to optimal cost. In the control-free case, our analysis leads to new and weak conditions for the existence and uniqueness of invariant probability measures for nonlinear filter processes, where we show that unique ergodicity of the measurement process and a measurability condition related to filter stability leads to unique ergodicity.</p></div>","PeriodicalId":55566,"journal":{"name":"Applied Mathematics and Optimization","volume":"91 1","pages":""},"PeriodicalIF":1.6,"publicationDate":"2025-01-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142925674","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Necessary Optimality Conditions for Minimax Multiprocesses 极大极小多进程的必要最优性条件
IF 1.6 2区 数学 Q2 MATHEMATICS, APPLIED Pub Date : 2024-12-30 DOI: 10.1007/s00245-024-10209-3
Abdallah Abdel Wahab, Piernicola Bettiol

In this paper we establish necessary optimality conditions for minimax multiprocess problems: these are optimal control problems in which we have a family of control systems coupled by endpoint constraints and a minimax cost functional to minimize.

本文建立了极大极小多过程问题的必要最优性条件:这是一类最优控制问题,其中我们有一组由端点约束耦合的控制系统和一个最小化的极大极小代价泛函。
{"title":"Necessary Optimality Conditions for Minimax Multiprocesses","authors":"Abdallah Abdel Wahab,&nbsp;Piernicola Bettiol","doi":"10.1007/s00245-024-10209-3","DOIUrl":"10.1007/s00245-024-10209-3","url":null,"abstract":"<div><p>In this paper we establish necessary optimality conditions for minimax multiprocess problems: these are optimal control problems in which we have a family of control systems coupled by endpoint constraints and a minimax cost functional to minimize.</p></div>","PeriodicalId":55566,"journal":{"name":"Applied Mathematics and Optimization","volume":"91 1","pages":""},"PeriodicalIF":1.6,"publicationDate":"2024-12-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142890062","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Applied Mathematics and Optimization
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1