Roben Delos Reyes, Hugo Lyons Keenan, Cameron Zachreson
{"title":"根据逆向学习数据校准的行为变化代理模型","authors":"Roben Delos Reyes, Hugo Lyons Keenan, Cameron Zachreson","doi":"arxiv-2406.14062","DOIUrl":null,"url":null,"abstract":"Behaviour change lies at the heart of many observable collective phenomena\nsuch as the transmission and control of infectious diseases, adoption of public\nhealth policies, and migration of animals to new habitats. Representing the\nprocess of individual behaviour change in computer simulations of these\nphenomena remains an open challenge. Often, computational models use\nphenomenological implementations with limited support from behavioural data.\nWithout a strong connection to observable quantities, such models have limited\nutility for simulating observed and counterfactual scenarios of emergent\nphenomena because they cannot be validated or calibrated. Here, we present a\nsimple stochastic individual-based model of reversal learning that captures\nfundamental properties of individual behaviour change, namely, the capacity to\nlearn based on accumulated reward signals, and the transient persistence of\nlearned behaviour after rewards are removed or altered. The model has only two\nparameters, and we use approximate Bayesian computation to demonstrate that\nthey are fully identifiable from empirical reversal learning time series data.\nFinally, we demonstrate how the model can be extended to account for the\nincreased complexity of behavioural dynamics over longer time scales involving\nfluctuating stimuli. This work is a step towards the development and evaluation\nof fully identifiable individual-level behaviour change models that can\nfunction as validated submodels for complex simulations of collective behaviour\nchange.","PeriodicalId":501215,"journal":{"name":"arXiv - STAT - Computation","volume":"34 1","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2024-06-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"An agent-based model of behaviour change calibrated to reversal learning data\",\"authors\":\"Roben Delos Reyes, Hugo Lyons Keenan, Cameron Zachreson\",\"doi\":\"arxiv-2406.14062\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Behaviour change lies at the heart of many observable collective phenomena\\nsuch as the transmission and control of infectious diseases, adoption of public\\nhealth policies, and migration of animals to new habitats. Representing the\\nprocess of individual behaviour change in computer simulations of these\\nphenomena remains an open challenge. Often, computational models use\\nphenomenological implementations with limited support from behavioural data.\\nWithout a strong connection to observable quantities, such models have limited\\nutility for simulating observed and counterfactual scenarios of emergent\\nphenomena because they cannot be validated or calibrated. Here, we present a\\nsimple stochastic individual-based model of reversal learning that captures\\nfundamental properties of individual behaviour change, namely, the capacity to\\nlearn based on accumulated reward signals, and the transient persistence of\\nlearned behaviour after rewards are removed or altered. The model has only two\\nparameters, and we use approximate Bayesian computation to demonstrate that\\nthey are fully identifiable from empirical reversal learning time series data.\\nFinally, we demonstrate how the model can be extended to account for the\\nincreased complexity of behavioural dynamics over longer time scales involving\\nfluctuating stimuli. This work is a step towards the development and evaluation\\nof fully identifiable individual-level behaviour change models that can\\nfunction as validated submodels for complex simulations of collective behaviour\\nchange.\",\"PeriodicalId\":501215,\"journal\":{\"name\":\"arXiv - STAT - Computation\",\"volume\":\"34 1\",\"pages\":\"\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-06-20\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"arXiv - STAT - Computation\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/arxiv-2406.14062\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"arXiv - STAT - Computation","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/arxiv-2406.14062","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
An agent-based model of behaviour change calibrated to reversal learning data
Behaviour change lies at the heart of many observable collective phenomena
such as the transmission and control of infectious diseases, adoption of public
health policies, and migration of animals to new habitats. Representing the
process of individual behaviour change in computer simulations of these
phenomena remains an open challenge. Often, computational models use
phenomenological implementations with limited support from behavioural data.
Without a strong connection to observable quantities, such models have limited
utility for simulating observed and counterfactual scenarios of emergent
phenomena because they cannot be validated or calibrated. Here, we present a
simple stochastic individual-based model of reversal learning that captures
fundamental properties of individual behaviour change, namely, the capacity to
learn based on accumulated reward signals, and the transient persistence of
learned behaviour after rewards are removed or altered. The model has only two
parameters, and we use approximate Bayesian computation to demonstrate that
they are fully identifiable from empirical reversal learning time series data.
Finally, we demonstrate how the model can be extended to account for the
increased complexity of behavioural dynamics over longer time scales involving
fluctuating stimuli. This work is a step towards the development and evaluation
of fully identifiable individual-level behaviour change models that can
function as validated submodels for complex simulations of collective behaviour
change.