根据逆向学习数据校准的行为变化代理模型

Roben Delos Reyes, Hugo Lyons Keenan, Cameron Zachreson
{"title":"根据逆向学习数据校准的行为变化代理模型","authors":"Roben Delos Reyes, Hugo Lyons Keenan, Cameron Zachreson","doi":"arxiv-2406.14062","DOIUrl":null,"url":null,"abstract":"Behaviour change lies at the heart of many observable collective phenomena\nsuch as the transmission and control of infectious diseases, adoption of public\nhealth policies, and migration of animals to new habitats. Representing the\nprocess of individual behaviour change in computer simulations of these\nphenomena remains an open challenge. Often, computational models use\nphenomenological implementations with limited support from behavioural data.\nWithout a strong connection to observable quantities, such models have limited\nutility for simulating observed and counterfactual scenarios of emergent\nphenomena because they cannot be validated or calibrated. Here, we present a\nsimple stochastic individual-based model of reversal learning that captures\nfundamental properties of individual behaviour change, namely, the capacity to\nlearn based on accumulated reward signals, and the transient persistence of\nlearned behaviour after rewards are removed or altered. The model has only two\nparameters, and we use approximate Bayesian computation to demonstrate that\nthey are fully identifiable from empirical reversal learning time series data.\nFinally, we demonstrate how the model can be extended to account for the\nincreased complexity of behavioural dynamics over longer time scales involving\nfluctuating stimuli. This work is a step towards the development and evaluation\nof fully identifiable individual-level behaviour change models that can\nfunction as validated submodels for complex simulations of collective behaviour\nchange.","PeriodicalId":501215,"journal":{"name":"arXiv - STAT - Computation","volume":"34 1","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2024-06-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"An agent-based model of behaviour change calibrated to reversal learning data\",\"authors\":\"Roben Delos Reyes, Hugo Lyons Keenan, Cameron Zachreson\",\"doi\":\"arxiv-2406.14062\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Behaviour change lies at the heart of many observable collective phenomena\\nsuch as the transmission and control of infectious diseases, adoption of public\\nhealth policies, and migration of animals to new habitats. Representing the\\nprocess of individual behaviour change in computer simulations of these\\nphenomena remains an open challenge. Often, computational models use\\nphenomenological implementations with limited support from behavioural data.\\nWithout a strong connection to observable quantities, such models have limited\\nutility for simulating observed and counterfactual scenarios of emergent\\nphenomena because they cannot be validated or calibrated. Here, we present a\\nsimple stochastic individual-based model of reversal learning that captures\\nfundamental properties of individual behaviour change, namely, the capacity to\\nlearn based on accumulated reward signals, and the transient persistence of\\nlearned behaviour after rewards are removed or altered. The model has only two\\nparameters, and we use approximate Bayesian computation to demonstrate that\\nthey are fully identifiable from empirical reversal learning time series data.\\nFinally, we demonstrate how the model can be extended to account for the\\nincreased complexity of behavioural dynamics over longer time scales involving\\nfluctuating stimuli. This work is a step towards the development and evaluation\\nof fully identifiable individual-level behaviour change models that can\\nfunction as validated submodels for complex simulations of collective behaviour\\nchange.\",\"PeriodicalId\":501215,\"journal\":{\"name\":\"arXiv - STAT - Computation\",\"volume\":\"34 1\",\"pages\":\"\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-06-20\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"arXiv - STAT - Computation\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/arxiv-2406.14062\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"arXiv - STAT - Computation","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/arxiv-2406.14062","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

行为变化是许多可观察到的集体现象的核心,例如传染病的传播和控制、公共卫生政策的采用以及动物向新栖息地的迁移。在对这些现象的计算机模拟中,如何表现个体行为变化的过程仍然是一个公开的挑战。由于与可观测量没有紧密联系,这些模型在模拟突发现象的观测情景和反事实情景时作用有限,因为它们无法得到验证或校准。在这里,我们提出了一个简单的基于个体的随机逆向学习模型,它捕捉到了个体行为变化的基本特性,即基于累积奖励信号的学习能力,以及在奖励被移除或改变后所学行为的短暂持续性。该模型只有两个参数,我们利用近似贝叶斯计算证明它们完全可以从经验反转学习时间序列数据中识别出来。最后,我们证明了如何扩展该模型,以解释在涉及波动刺激的更长时间尺度上行为动态的复杂性。这项工作是朝着开发和评估完全可识别的个体水平行为变化模型迈出的一步,这些模型可以作为复杂的集体行为变化模拟的验证子模型发挥作用。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
An agent-based model of behaviour change calibrated to reversal learning data
Behaviour change lies at the heart of many observable collective phenomena such as the transmission and control of infectious diseases, adoption of public health policies, and migration of animals to new habitats. Representing the process of individual behaviour change in computer simulations of these phenomena remains an open challenge. Often, computational models use phenomenological implementations with limited support from behavioural data. Without a strong connection to observable quantities, such models have limited utility for simulating observed and counterfactual scenarios of emergent phenomena because they cannot be validated or calibrated. Here, we present a simple stochastic individual-based model of reversal learning that captures fundamental properties of individual behaviour change, namely, the capacity to learn based on accumulated reward signals, and the transient persistence of learned behaviour after rewards are removed or altered. The model has only two parameters, and we use approximate Bayesian computation to demonstrate that they are fully identifiable from empirical reversal learning time series data. Finally, we demonstrate how the model can be extended to account for the increased complexity of behavioural dynamics over longer time scales involving fluctuating stimuli. This work is a step towards the development and evaluation of fully identifiable individual-level behaviour change models that can function as validated submodels for complex simulations of collective behaviour change.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
期刊最新文献
Model-Embedded Gaussian Process Regression for Parameter Estimation in Dynamical System Effects of the entropy source on Monte Carlo simulations A Robust Approach to Gaussian Processes Implementation HJ-sampler: A Bayesian sampler for inverse problems of a stochastic process by leveraging Hamilton-Jacobi PDEs and score-based generative models Reducing Shape-Graph Complexity with Application to Classification of Retinal Blood Vessels and Neurons
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1