Analysing public goods games using reinforcement learning: effect of increasing group size on cooperation.

IF 2.9 3区 综合性期刊 Q1 MULTIDISCIPLINARY SCIENCES Royal Society Open Science Pub Date : 2024-12-11 eCollection Date: 2024-12-01 DOI:10.1098/rsos.241195
Kazuhiro Tamura, Satoru Morita
{"title":"Analysing public goods games using reinforcement learning: effect of increasing group size on cooperation.","authors":"Kazuhiro Tamura, Satoru Morita","doi":"10.1098/rsos.241195","DOIUrl":null,"url":null,"abstract":"<p><p>Electricity competition, restrictions on carbon dioxide (CO2) emissions and arm races between nations are examples of social dilemmas within human society. In the presence of social dilemmas, rational choice in game theory leads to the avoidance of cooperative behaviour owing to its cost. However, in experiments using public goods games that simulate social dilemmas, humans have often exhibited cooperative behaviour that deviates from individual rationality. Despite extensive research, the alignment between human cooperative behaviour and game theory predictions remains inconsistent. This study proposes an alternative approach to solve this problem. We used Q-learning, a form of artificial intelligence that mimics decision-making processes of humans who do not possess the rationality assumed in game theory. This study explores the potential for cooperation by varying the number of participants in public goods games using deep Q-learning. The simulations demonstrate that agents with Q-learning can acquire cooperative behaviour similar to that of humans. Moreover, we found that cooperation is more likely to occur as the group size increases. These results support and reinforce existing experiments involving humans. In addition, they have potential applications for creating cooperation without sanctions.</p>","PeriodicalId":21525,"journal":{"name":"Royal Society Open Science","volume":"11 12","pages":"241195"},"PeriodicalIF":2.9000,"publicationDate":"2024-12-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11631413/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Royal Society Open Science","FirstCategoryId":"103","ListUrlMain":"https://doi.org/10.1098/rsos.241195","RegionNum":3,"RegionCategory":"综合性期刊","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2024/12/1 0:00:00","PubModel":"eCollection","JCR":"Q1","JCRName":"MULTIDISCIPLINARY SCIENCES","Score":null,"Total":0}
引用次数: 0

Abstract

Electricity competition, restrictions on carbon dioxide (CO2) emissions and arm races between nations are examples of social dilemmas within human society. In the presence of social dilemmas, rational choice in game theory leads to the avoidance of cooperative behaviour owing to its cost. However, in experiments using public goods games that simulate social dilemmas, humans have often exhibited cooperative behaviour that deviates from individual rationality. Despite extensive research, the alignment between human cooperative behaviour and game theory predictions remains inconsistent. This study proposes an alternative approach to solve this problem. We used Q-learning, a form of artificial intelligence that mimics decision-making processes of humans who do not possess the rationality assumed in game theory. This study explores the potential for cooperation by varying the number of participants in public goods games using deep Q-learning. The simulations demonstrate that agents with Q-learning can acquire cooperative behaviour similar to that of humans. Moreover, we found that cooperation is more likely to occur as the group size increases. These results support and reinforce existing experiments involving humans. In addition, they have potential applications for creating cooperation without sanctions.

查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
用强化学习分析公共物品博弈:群体规模增加对合作的影响。
电力竞争、限制二氧化碳排放和国家间的军备竞赛是人类社会中社会困境的例子。在社会困境下,博弈论中的理性选择导致合作行为由于其成本而被回避。然而,在模拟社会困境的公共物品游戏实验中,人类经常表现出偏离个人理性的合作行为。尽管进行了广泛的研究,但人类合作行为与博弈论预测之间的一致性仍然不一致。本研究提出了另一种解决这一问题的方法。我们使用了Q-learning,这是一种人工智能,可以模仿不具备博弈论中假设的理性的人类的决策过程。本研究通过改变使用深度q学习的公共产品游戏的参与者数量来探索合作的潜力。仿真结果表明,具有q学习功能的智能体可以获得与人类相似的合作行为。此外,我们发现,随着群体规模的增加,合作更有可能发生。这些结果支持并加强了现有的涉及人类的实验。此外,它们有可能用于在没有制裁的情况下建立合作。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
Royal Society Open Science
Royal Society Open Science Multidisciplinary-Multidisciplinary
CiteScore
6.00
自引率
0.00%
发文量
508
审稿时长
14 weeks
期刊介绍: Royal Society Open Science is a new open journal publishing high-quality original research across the entire range of science on the basis of objective peer-review. The journal covers the entire range of science and mathematics and will allow the Society to publish all the high-quality work it receives without the usual restrictions on scope, length or impact.
期刊最新文献
Crystallographic and computational characterization and in silico target fishing of six aromatic and aliphatic sulfonamide derivatives. Evolution under intensive industrial breeding: skull size and shape comparison between historic and modern pig lineages. Investigating the encapsulation of lead bromide perovskite with poly(3-bromothiophene) for improved aqua stability and enhanced fluorescence memory. Modelling transmission and control of Toxoplasma gondii in New Zealand farmland. Pigs, people, and proximity: a 6000-year isotopic record of pig management in Ireland.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1