Optimal controls for forward-backward stochastic differential equations: Time-inconsistency and time-consistent solutions

IF 4.6 Q2 MATERIALS SCIENCE, BIOMATERIALS ACS Applied Bio Materials Pub Date : 2024-07-24 DOI:10.1016/j.matpur.2024.103603
Hanxiao Wang , Jiongmin Yong , Chao Zhou
{"title":"Optimal controls for forward-backward stochastic differential equations: Time-inconsistency and time-consistent solutions","authors":"Hanxiao Wang ,&nbsp;Jiongmin Yong ,&nbsp;Chao Zhou","doi":"10.1016/j.matpur.2024.103603","DOIUrl":null,"url":null,"abstract":"<div><p>This paper is concerned with an optimal control problem for a forward-backward stochastic differential equation (FBSDE, for short) with a recursive cost functional determined by a backward stochastic Volterra integral equation (BSVIE, for short). It is found that such an optimal control problem is time-inconsistent in general, even if the cost functional is reduced to a classical Bolza type one as in Peng <span><span>[47]</span></span>, Lim–Zhou <span><span>[38]</span></span>, and Yong <span><span>[72]</span></span>. Therefore, instead of finding a global optimal control (which is time-inconsistent), we will look for a time-consistent and locally optimal equilibrium strategy, which can be constructed via the solution of an associated equilibrium Hamilton–Jacobi–Bellman (HJB, for short) equation. A verification theorem for the local optimality of the equilibrium strategy is proved by means of the generalized Feynman–Kac formula for BSVIEs and some stability estimates of the representation parabolic partial differential equations (PDEs, for short). Under certain conditions, it is proved that the equilibrium HJB equation, which is a nonlocal PDE, admits a unique classical solution. As special cases and applications, the linear-quadratic problems, a mean-variance model, a social planner problem with heterogeneous Epstein–Zin utilities, and a Stackelberg game are briefly investigated. It turns out that our framework can cover not only the optimal control problems for FBSDEs studied in <span><span>[47]</span></span>, <span><span>[38]</span></span>, <span><span>[72]</span></span>, and so on, but also the problems of the general discounting and some nonlinear appearance of conditional expectations for the terminal state, studied in Yong <span><span>[73]</span></span>, <span><span>[75]</span></span> and Björk–Khapko–Murgoci <span><span>[6]</span></span>.</p></div>","PeriodicalId":2,"journal":{"name":"ACS Applied Bio Materials","volume":null,"pages":null},"PeriodicalIF":4.6000,"publicationDate":"2024-07-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"ACS Applied Bio Materials","FirstCategoryId":"100","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0021782424001016","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"MATERIALS SCIENCE, BIOMATERIALS","Score":null,"Total":0}
引用次数: 0

Abstract

This paper is concerned with an optimal control problem for a forward-backward stochastic differential equation (FBSDE, for short) with a recursive cost functional determined by a backward stochastic Volterra integral equation (BSVIE, for short). It is found that such an optimal control problem is time-inconsistent in general, even if the cost functional is reduced to a classical Bolza type one as in Peng [47], Lim–Zhou [38], and Yong [72]. Therefore, instead of finding a global optimal control (which is time-inconsistent), we will look for a time-consistent and locally optimal equilibrium strategy, which can be constructed via the solution of an associated equilibrium Hamilton–Jacobi–Bellman (HJB, for short) equation. A verification theorem for the local optimality of the equilibrium strategy is proved by means of the generalized Feynman–Kac formula for BSVIEs and some stability estimates of the representation parabolic partial differential equations (PDEs, for short). Under certain conditions, it is proved that the equilibrium HJB equation, which is a nonlocal PDE, admits a unique classical solution. As special cases and applications, the linear-quadratic problems, a mean-variance model, a social planner problem with heterogeneous Epstein–Zin utilities, and a Stackelberg game are briefly investigated. It turns out that our framework can cover not only the optimal control problems for FBSDEs studied in [47], [38], [72], and so on, but also the problems of the general discounting and some nonlinear appearance of conditional expectations for the terminal state, studied in Yong [73], [75] and Björk–Khapko–Murgoci [6].

查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
前后向随机微分方程的最优控制:时间不一致和时间一致解
本文讨论的是一个随机渐进-逆行微分方程(EDSP-R)的最优控制问题,其递归代价函数由随机逆行伏特拉积分方程(SRVI)决定。研究发现,正如 Peng 、Lim-Zhou 和 Yong 所观察到的那样,即使成本函数被简化为经典的 Bolza 类型形式,这样的最优控制问题通常也是时间不一致的。因此,与其寻找全局最优控制(这是时间不一致的),我们建议寻找局部最优和时间一致的均衡策略,这可以通过求解与均衡相关的汉密尔顿-雅各比-贝尔曼(HJB)方程来构建。通过 EISRV 的广义费曼-卡克公式和抛物线偏微分方程(PDE)的某些表示稳定性估计,证明了均衡策略局部最优性的验证定理。在某些条件下,证明了作为非局部 PDE 的均衡 HJB 方程具有唯一的经典解。作为特例和应用,我们简要地考虑了线性二次问题、均值方差模型、具有异质爱泼斯坦-津效用的社会规划者问题和斯塔克伯格博弈。事实证明,我们的框架不仅可以涵盖以前著作中研究的 EDSP-R 的最优控制问题,如 Peng、Lim-Zhou 和 Yong 等人的著作,还可以涵盖 Yong 和 Björk-Khapko-Murgoci 等人的著作中研究的一般贴现问题和一些终端状态条件期望的非线性显现问题。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
ACS Applied Bio Materials
ACS Applied Bio Materials Chemistry-Chemistry (all)
CiteScore
9.40
自引率
2.10%
发文量
464
期刊最新文献
A Systematic Review of Sleep Disturbance in Idiopathic Intracranial Hypertension. Advancing Patient Education in Idiopathic Intracranial Hypertension: The Promise of Large Language Models. Anti-Myelin-Associated Glycoprotein Neuropathy: Recent Developments. Approach to Managing the Initial Presentation of Multiple Sclerosis: A Worldwide Practice Survey. Association Between LACE+ Index Risk Category and 90-Day Mortality After Stroke.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1