LamBaDa:研究进化和学习之间相互作用的人工环境

Marília Oliveira, J. Barreiros, E. Costa, F. B. Pereira
{"title":"LamBaDa:研究进化和学习之间相互作用的人工环境","authors":"Marília Oliveira, J. Barreiros, E. Costa, F. B. Pereira","doi":"10.1109/CEC.1999.781919","DOIUrl":null,"url":null,"abstract":"The study of evolutionary processes presents a major challenge due to its physical and temporal scales. Artificial life systems allow the realization of experiments concerning evolution that overcome these constraints. One aspect of the evolution of species that has been widely discussed is the role played by learning in the evolutionary process. We developed an artificial environment, LamBaDa, whose main purpose is the experimental study of interactions between learning in individual agents and evolution of populations. Agents have an internal state and a neural network that can empower them with learning faculties through a reinforcement learning algorithm. The modeling of the evolution of populations is achieved through genetic mechanisms applied during the reproduction process to the neural network weights. In this paper we describe LamBaDa, its architecture and dynamics. We present the simulation settings and discuss the results obtained, with special emphasis on the comparison of populations of agents with and without learning capabilities. The analysis of the results we obtained shows that populations of agents with learning capabilities are in advantage when compared to populations where agents can not learn, even though learned characteristics are not genetically codified. We also observed that this advantage is significant if the agents lived long enough to learn anything useful!.","PeriodicalId":292523,"journal":{"name":"Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406)","volume":"40 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"1999-07-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":"{\"title\":\"LamBaDa: an artificial environment to study the interaction between evolution and learning\",\"authors\":\"Marília Oliveira, J. Barreiros, E. Costa, F. B. Pereira\",\"doi\":\"10.1109/CEC.1999.781919\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"The study of evolutionary processes presents a major challenge due to its physical and temporal scales. Artificial life systems allow the realization of experiments concerning evolution that overcome these constraints. One aspect of the evolution of species that has been widely discussed is the role played by learning in the evolutionary process. We developed an artificial environment, LamBaDa, whose main purpose is the experimental study of interactions between learning in individual agents and evolution of populations. Agents have an internal state and a neural network that can empower them with learning faculties through a reinforcement learning algorithm. The modeling of the evolution of populations is achieved through genetic mechanisms applied during the reproduction process to the neural network weights. In this paper we describe LamBaDa, its architecture and dynamics. We present the simulation settings and discuss the results obtained, with special emphasis on the comparison of populations of agents with and without learning capabilities. The analysis of the results we obtained shows that populations of agents with learning capabilities are in advantage when compared to populations where agents can not learn, even though learned characteristics are not genetically codified. We also observed that this advantage is significant if the agents lived long enough to learn anything useful!.\",\"PeriodicalId\":292523,\"journal\":{\"name\":\"Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406)\",\"volume\":\"40 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"1999-07-06\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"1\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/CEC.1999.781919\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/CEC.1999.781919","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 1

摘要

由于其物理和时间尺度,进化过程的研究提出了一个重大挑战。人工生命系统使克服这些限制的有关进化的实验得以实现。被广泛讨论的物种进化的一个方面是学习在进化过程中所起的作用。我们开发了一个人工环境LamBaDa,其主要目的是实验研究个体智能体的学习与群体进化之间的相互作用。智能体有一个内部状态和一个神经网络,可以通过强化学习算法赋予它们学习能力。种群进化的建模是通过在繁殖过程中对神经网络权值施加遗传机制来实现的。在本文中,我们描述了LamBaDa,它的结构和动态。我们给出了模拟设置并讨论了获得的结果,特别强调了具有和不具有学习能力的智能体群体的比较。对我们获得的结果的分析表明,具有学习能力的智能体群体比没有学习能力的智能体群体更有优势,即使学习的特征不是遗传编码的。我们还观察到,如果智能体活得足够长,能够学到有用的东西,那么这种优势是显著的。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
LamBaDa: an artificial environment to study the interaction between evolution and learning
The study of evolutionary processes presents a major challenge due to its physical and temporal scales. Artificial life systems allow the realization of experiments concerning evolution that overcome these constraints. One aspect of the evolution of species that has been widely discussed is the role played by learning in the evolutionary process. We developed an artificial environment, LamBaDa, whose main purpose is the experimental study of interactions between learning in individual agents and evolution of populations. Agents have an internal state and a neural network that can empower them with learning faculties through a reinforcement learning algorithm. The modeling of the evolution of populations is achieved through genetic mechanisms applied during the reproduction process to the neural network weights. In this paper we describe LamBaDa, its architecture and dynamics. We present the simulation settings and discuss the results obtained, with special emphasis on the comparison of populations of agents with and without learning capabilities. The analysis of the results we obtained shows that populations of agents with learning capabilities are in advantage when compared to populations where agents can not learn, even though learned characteristics are not genetically codified. We also observed that this advantage is significant if the agents lived long enough to learn anything useful!.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
期刊最新文献
Investigation of a characteristic bimodal convergence-time/mutation-rate feature in evolutionary search Classifier systems evolving multi-agent system with distributed elitism A unified model of non-panmictic population structures in evolutionary algorithms Control of autonomous robots using fuzzy logic controllers tuned by genetic algorithms Oil reservoir production forecasting with uncertainty estimation using genetic algorithms
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1