混合状态空间上马尔可夫链演化的稳态概率计算

IF 0.8 Q3 STATISTICS & PROBABILITY Monte Carlo Methods and Applications Pub Date : 2023-03-30 DOI:10.1515/mcma-2023-2003
Az-eddine Zakrad, A. Nasroallah
{"title":"混合状态空间上马尔可夫链演化的稳态概率计算","authors":"Az-eddine Zakrad, A. Nasroallah","doi":"10.1515/mcma-2023-2003","DOIUrl":null,"url":null,"abstract":"Abstract The partitioning algorithm is an iterative procedure that computes explicitly the steady-state probability of a finite Markov chain 𝑋. In this paper, we propose to adapt this algorithm to the case where the state space E := C ∪ D E:=C\\cup D is composed of a continuous part 𝐶 and a finite part 𝐷 such that C ∩ D = ∅ C\\cap D=\\emptyset . In this case, the steady-state probability 𝜋 of 𝑋 is a convex combination of two steady-state probabilities π C \\pi_{C} and π D \\pi_{D} of two Markov chains on 𝐶 and 𝐷 respectively. The obtained algorithm allows to compute explicitly π D \\pi_{D} . If π C \\pi_{C} cannot be computed explicitly, our algorithm approximates it by numerical resolution of successive integral equations. Some numerical examples are studied to show the usefulness and proper functioning of our proposal.","PeriodicalId":46576,"journal":{"name":"Monte Carlo Methods and Applications","volume":null,"pages":null},"PeriodicalIF":0.8000,"publicationDate":"2023-03-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Computation of the steady-state probability of Markov chain evolving on a mixed state space\",\"authors\":\"Az-eddine Zakrad, A. Nasroallah\",\"doi\":\"10.1515/mcma-2023-2003\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Abstract The partitioning algorithm is an iterative procedure that computes explicitly the steady-state probability of a finite Markov chain 𝑋. In this paper, we propose to adapt this algorithm to the case where the state space E := C ∪ D E:=C\\\\cup D is composed of a continuous part 𝐶 and a finite part 𝐷 such that C ∩ D = ∅ C\\\\cap D=\\\\emptyset . In this case, the steady-state probability 𝜋 of 𝑋 is a convex combination of two steady-state probabilities π C \\\\pi_{C} and π D \\\\pi_{D} of two Markov chains on 𝐶 and 𝐷 respectively. The obtained algorithm allows to compute explicitly π D \\\\pi_{D} . If π C \\\\pi_{C} cannot be computed explicitly, our algorithm approximates it by numerical resolution of successive integral equations. Some numerical examples are studied to show the usefulness and proper functioning of our proposal.\",\"PeriodicalId\":46576,\"journal\":{\"name\":\"Monte Carlo Methods and Applications\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":0.8000,\"publicationDate\":\"2023-03-30\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Monte Carlo Methods and Applications\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1515/mcma-2023-2003\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q3\",\"JCRName\":\"STATISTICS & PROBABILITY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Monte Carlo Methods and Applications","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1515/mcma-2023-2003","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"STATISTICS & PROBABILITY","Score":null,"Total":0}
引用次数: 0

摘要

分划算法是显式计算有限马尔可夫链稳态概率的迭代过程𝑋。在本文中,我们提出将该算法应用于状态空间E:=C∪D E:=C \cup D由连续部分和有限部分𝐷组成,使得C∩D=∅C \cap D= \emptyset。在这种情况下,稳态概率𝑋分别是两条马尔可夫链的两个稳态概率π C \pi _C{和π }D \pi _D{的凸组合。得到的算法允许显式计算π D }\pi _D{。如果π C }\pi _C{不能显式计算,我们的算法通过连续积分方程的数值解析近似它。通过数值算例分析,说明了该方法的有效性和良好的功能。}
本文章由计算机程序翻译,如有差异,请以英文原文为准。
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
Computation of the steady-state probability of Markov chain evolving on a mixed state space
Abstract The partitioning algorithm is an iterative procedure that computes explicitly the steady-state probability of a finite Markov chain 𝑋. In this paper, we propose to adapt this algorithm to the case where the state space E := C ∪ D E:=C\cup D is composed of a continuous part 𝐶 and a finite part 𝐷 such that C ∩ D = ∅ C\cap D=\emptyset . In this case, the steady-state probability 𝜋 of 𝑋 is a convex combination of two steady-state probabilities π C \pi_{C} and π D \pi_{D} of two Markov chains on 𝐶 and 𝐷 respectively. The obtained algorithm allows to compute explicitly π D \pi_{D} . If π C \pi_{C} cannot be computed explicitly, our algorithm approximates it by numerical resolution of successive integral equations. Some numerical examples are studied to show the usefulness and proper functioning of our proposal.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Monte Carlo Methods and Applications
Monte Carlo Methods and Applications STATISTICS & PROBABILITY-
CiteScore
1.20
自引率
22.20%
发文量
31
期刊最新文献
Investigating the ecological fallacy through sampling distributions constructed from finite populations Joint application of the Monte Carlo method and computational probabilistic analysis in problems of numerical modeling with data uncertainties Choice of a constant in the expression for the error of the Monte Carlo method Estimation in shape mixtures of skew-normal linear regression models via ECM coupled with Gibbs sampling A gradient method for high-dimensional BSDEs
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1