首页 > 最新文献

Biologically Inspired Cognitive Architectures最新文献

英文 中文
Simulation Analysis Based on Behavioral Experiment of Cooperative Pattern Task 基于合作模式任务行为实验的仿真分析
Q2 Psychology Pub Date : 2019-04-08 DOI: 10.1007/978-3-030-25719-4_74
Norifumi Watanabe, Kota Itoda
{"title":"Simulation Analysis Based on Behavioral Experiment of Cooperative Pattern Task","authors":"Norifumi Watanabe, Kota Itoda","doi":"10.1007/978-3-030-25719-4_74","DOIUrl":"https://doi.org/10.1007/978-3-030-25719-4_74","url":null,"abstract":"","PeriodicalId":48756,"journal":{"name":"Biologically Inspired Cognitive Architectures","volume":"1 1","pages":"568-573"},"PeriodicalIF":0.0,"publicationDate":"2019-04-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"47399066","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Metacognition for a Common Model of Cognition 一种常见认知模型的元认知
Q2 Psychology Pub Date : 2018-10-18 DOI: 10.1016/J.PROCS.2018.11.046
J. Kralik, J. Lee, P. Rosenbloom, Philip C. Jackson, Susan L. Epstein, Oscar J. Romero, R. Sanz, O. Larue, H. Schmidtke, Sang Wan Lee, Keith McGreggor
{"title":"Metacognition for a Common Model of Cognition","authors":"J. Kralik, J. Lee, P. Rosenbloom, Philip C. Jackson, Susan L. Epstein, Oscar J. Romero, R. Sanz, O. Larue, H. Schmidtke, Sang Wan Lee, Keith McGreggor","doi":"10.1016/J.PROCS.2018.11.046","DOIUrl":"https://doi.org/10.1016/J.PROCS.2018.11.046","url":null,"abstract":"","PeriodicalId":48756,"journal":{"name":"Biologically Inspired Cognitive Architectures","volume":"1 1","pages":"730-739"},"PeriodicalIF":0.0,"publicationDate":"2018-10-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1016/J.PROCS.2018.11.046","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"45098324","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 27
Bio-plausible simulation of three monoamine systems to replicate emotional phenomena in a machine 仿生模拟三种单胺系统,在机器中复制情感现象
Q2 Psychology Pub Date : 2018-10-01 DOI: 10.1016/j.bica.2018.10.007
Alexey Leukhin , Max Talanov , Jordi Vallverdú , Fail Gafarov

In this paper we present the validation of the three-dimensional model of emotions by Hugo Lövheim the “cube of emotion” via neurosimulation in the NEST. We also present the extension of original “cube of emotion” with the bridge to computational processes parameters. The neurosimulation is done via re-implementation of DA, 5-HT and NA subsystems of a rat brain to replicate 8 basic psycho-emotional states according to the “cube of emotion”. Results of neurosimulations indicate the incremental influence of DA and NA over computational resources of a psycho-emotional state while 5-HT decreases the computational resources used to calculate a psycho-emotional state. This way we indicate the feasibility of the bio-plausible re-implementation of psycho-emotional states in a computational system. This approach could be useful extension of decision making and load balancing components of modern artificial agents as well as intelligent robotic systems.

在本文中,我们提出了通过神经模拟在NEST中验证雨果Lövheim“情绪立方体”的三维情绪模型。我们还提出了原始“情感立方体”的扩展,并建立了计算过程参数的桥梁。神经模拟是通过重新实现大鼠大脑的DA、5-HT和NA子系统,根据“情绪立方体”复制8种基本的心理-情绪状态来完成的。神经模拟的结果表明,DA和NA对心理情绪状态计算资源的影响是增加的,而5-HT则减少了用于计算心理情绪状态的计算资源。通过这种方式,我们表明了在计算系统中心理-情绪状态的生物似是而非的重新实现的可行性。这种方法可以作为现代人工智能体和智能机器人系统的决策和负载平衡组件的有用扩展。
{"title":"Bio-plausible simulation of three monoamine systems to replicate emotional phenomena in a machine","authors":"Alexey Leukhin ,&nbsp;Max Talanov ,&nbsp;Jordi Vallverdú ,&nbsp;Fail Gafarov","doi":"10.1016/j.bica.2018.10.007","DOIUrl":"https://doi.org/10.1016/j.bica.2018.10.007","url":null,"abstract":"<div><p><span>In this paper we present the validation of the three-dimensional model of emotions by Hugo Lövheim the “cube of emotion” via neurosimulation in the NEST. We also present the extension of original “cube of emotion” with the bridge to computational processes parameters. The neurosimulation is done via re-implementation of DA, 5-HT and NA subsystems of a rat brain to replicate 8 basic psycho-emotional states according to the “cube of emotion”. Results of neurosimulations indicate the incremental influence of DA and NA over computational resources of a psycho-emotional state while 5-HT decreases the computational resources used to calculate a psycho-emotional state. This way we indicate the feasibility of the bio-plausible re-implementation of psycho-emotional states in a computational system. This approach could be useful extension of </span>decision making<span> and load balancing components of modern artificial agents as well as intelligent robotic systems.</span></p></div>","PeriodicalId":48756,"journal":{"name":"Biologically Inspired Cognitive Architectures","volume":"26 ","pages":"Pages 166-173"},"PeriodicalIF":0.0,"publicationDate":"2018-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1016/j.bica.2018.10.007","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"136924640","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
An adaptive Network-Oriented cognitive model for Major Depression and its treatment 重度抑郁症的自适应网络导向认知模型及其治疗
Q2 Psychology Pub Date : 2018-10-01 DOI: 10.1016/j.bica.2018.10.001
Marcia A. van der Poel, Jan Treur

This paper presents an adaptive neurologically inspired cognitive model for Major Depressive Disorder. It is based on an (adaptive) temporal-causal network modelling approach incorporating a dynamic perspective on mental states and causal relations. The adaptive network model addresses how a Deep Brain Stimulation treatment used for this disorder can work by a Hebbian learning effect.

本文提出了一种自适应神经学启发的重度抑郁症认知模型。它基于一种(自适应的)时间因果网络建模方法,结合了心理状态和因果关系的动态视角。自适应网络模型解决了深部脑刺激治疗如何通过Hebbian学习效应来治疗这种疾病。
{"title":"An adaptive Network-Oriented cognitive model for Major Depression and its treatment","authors":"Marcia A. van der Poel,&nbsp;Jan Treur","doi":"10.1016/j.bica.2018.10.001","DOIUrl":"10.1016/j.bica.2018.10.001","url":null,"abstract":"<div><p><span>This paper presents an adaptive neurologically inspired cognitive model for Major Depressive Disorder. It is based on an (adaptive) temporal-causal network modelling<span> approach incorporating a dynamic perspective on mental states and causal relations. The adaptive network model addresses how a Deep Brain Stimulation treatment used for this disorder can work by a </span></span>Hebbian learning effect.</p></div>","PeriodicalId":48756,"journal":{"name":"Biologically Inspired Cognitive Architectures","volume":"26 ","pages":"Pages 159-165"},"PeriodicalIF":0.0,"publicationDate":"2018-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1016/j.bica.2018.10.001","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"46483556","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Schema formalism for the common model of cognition 图式形式主义为认知的共同模式
Q2 Psychology Pub Date : 2018-10-01 DOI: 10.1016/j.bica.2018.10.008
Alexei V. Samsonovich

Common Model of Cognition (CMC) is a collective attempt to develop a consensus on cognitive architectures. The model needs to be extended to include components and functions that are vital to achieving the goals of Humanlike AI, supporting humanlike learnability, social acceptability and humanlike creativity. Being biologically grounded, together these components will enable social-emotional character reasoning in artifacts and support emotionally-driven behavior generation. Historically, cognitive architectures originated from rule-based systems. Their main building block then evolved to a variety of structures, collectively called here schemas. While a schema is an overloaded term, in the field of biologically inspired cognitive architectures (BICA) it can be given a precise and useful meaning, allowing comparison of different models. Here one particular model is used as the main example: emotional BICA, or eBICA (Samsonovich, BICA, 2013) that extends GMU BICA (Samsonovich & De Jong, 2005) and supports human-like socially-emotional intelligence. This becomes possible with the help of so-called moral schemas. Their operation relies on semantic maps and contributes to the functioning of narrative networks. The present work documents the general formalism of schemas of eBICA, defines moral schemas, and explains their usage on examples. This framework is expected to enable a human-level believability and social compatibility in virtual actors and cobots across a variety of practically important domains and paradigms, thereby contributing to the expected breakthrough in humane artificial intelligence. Expected applications include virtual cobots-assistants and actors-partners in a broad spectrum of tasks. Forming a consensus on goals, paradigms, metrics and target applications for the new framework is equally important in understanding the overarching mission of solving the BICA Challenge.

通用认知模型(CMC)是一种集体尝试,旨在发展认知架构的共识。该模型需要扩展,以包括对实现类人人工智能目标至关重要的组件和功能,支持类人的可学习性、社会可接受性和类人的创造力。在生物学基础上,这些组成部分将使人工制品中的社会情感特征推理成为可能,并支持情感驱动行为的产生。历史上,认知架构起源于基于规则的系统。它们的主要构建块随后演变成各种各样的结构,在这里统称为模式。虽然模式是一个过载的术语,但在生物学启发的认知架构(BICA)领域,它可以被赋予精确而有用的含义,允许对不同的模型进行比较。这里使用一个特定的模型作为主要示例:情感BICA,或eBICA (Samsonovich, BICA, 2013),它扩展了GMU BICA (Samsonovich &De Jong, 2005),并支持类似人类的社交情商。这在所谓的道德图式的帮助下成为可能。它们的运作依赖于语义地图,并有助于叙事网络的功能。本文记录了道德图式的一般形式,定义了道德图式,并举例说明了道德图式的用法。该框架有望在各种实际重要领域和范式的虚拟演员和协作机器人中实现人类水平的可信度和社会兼容性,从而为人类人工智能的预期突破做出贡献。预期的应用包括虚拟协作机器人——助手和演员——在广泛的任务中的合作伙伴。就新框架的目标、范例、指标和目标应用达成共识,对于理解解决BICA挑战的总体使命同样重要。
{"title":"Schema formalism for the common model of cognition","authors":"Alexei V. Samsonovich","doi":"10.1016/j.bica.2018.10.008","DOIUrl":"10.1016/j.bica.2018.10.008","url":null,"abstract":"<div><p><span><span>Common Model of Cognition (CMC) is a collective attempt to develop a consensus on cognitive architectures. The model needs to be extended to include components and functions that are vital to achieving the goals of Humanlike AI, supporting humanlike learnability, </span>social acceptability and humanlike creativity. Being biologically grounded, together these components will enable social-emotional character reasoning in artifacts and support emotionally-driven </span>behavior<span> generation. Historically, cognitive architectures originated from rule-based systems. Their main building block then evolved to a variety of structures, collectively called here schemas. While a schema is an overloaded term, in the field of biologically inspired cognitive architectures (BICA) it can be given a precise and useful meaning, allowing comparison of different models. Here one particular model is used as the main example: emotional BICA, or eBICA (Samsonovich, BICA, 2013) that extends GMU BICA (Samsonovich &amp; De Jong, 2005) and supports human-like socially-emotional intelligence. This becomes possible with the help of so-called moral schemas. Their operation relies on semantic maps and contributes to the functioning of narrative networks. The present work documents the general formalism of schemas of eBICA, defines moral schemas, and explains their usage on examples. This framework is expected to enable a human-level believability and social compatibility in virtual actors and cobots across a variety of practically important domains and paradigms, thereby contributing to the expected breakthrough in humane artificial intelligence. Expected applications include virtual cobots-assistants and actors-partners in a broad spectrum of tasks. Forming a consensus on goals, paradigms, metrics and target applications for the new framework is equally important in understanding the overarching mission of solving the BICA Challenge.</span></p></div>","PeriodicalId":48756,"journal":{"name":"Biologically Inspired Cognitive Architectures","volume":"26 ","pages":"Pages 1-19"},"PeriodicalIF":0.0,"publicationDate":"2018-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1016/j.bica.2018.10.008","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"48202805","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 14
The SOSIEL Platform: Knowledge-based, cognitive, and multi-agent SOSIEL平台:基于知识、认知和多智能体
Q2 Psychology Pub Date : 2018-10-01 DOI: 10.1016/j.bica.2018.09.001
Garry Sotnik

This article describes the open-source cognitive multi-agent knowledge-based SOSIEL (Self-Organizing Social & Inductive Evolutionary Learning) Platform, designed for building the social components of social-ecological decision support systems, consisting of agents empowered with a cognitive architecture. The platform can simulate the cross-generational progression of one or a large number of agents that can interact among themselves and/or with coupled natural and/or technical systems, learn from their and each other’s experience, create new practices, and make decisions about taking and then take (potentially collective) actions. The platform can also be used for conducting hypothetical experiments that are focused on studying the interactions among: (a) cross-generational population dynamics, (b) self-organizing multi-layered social network structures, (c) evolving place-based knowledge, (d) learning, (e) decision-making, (f) collective action and its potential, and (g) social and (when coupled) social-ecological outcomes. The article describes a simple model that was built with the SOSIEL Platform, which simulates the co-evolution of mental models among socially learning agents.

本文描述了基于开源认知多智能体知识的自组织社会(SOSIEL);归纳进化学习)平台,设计用于构建社会生态决策支持系统的社会组件,由具有认知架构的代理组成。该平台可以模拟一个或多个智能体的跨代发展,这些智能体可以在它们之间和/或与耦合的自然和/或技术系统进行交互,从它们和彼此的经验中学习,创建新的实践,并做出关于采取行动的决定,然后采取(可能是集体)行动。该平台还可用于进行假设实验,重点研究以下方面的相互作用:(a)跨代人口动态,(b)自组织多层社会网络结构,(c)不断发展的基于地点的知识,(d)学习,(e)决策,(f)集体行动及其潜力,以及(g)社会和(耦合时)社会生态结果。本文描述了一个使用SOSIEL平台构建的简单模型,该模型模拟了社会学习主体之间心理模型的共同进化。
{"title":"The SOSIEL Platform: Knowledge-based, cognitive, and multi-agent","authors":"Garry Sotnik","doi":"10.1016/j.bica.2018.09.001","DOIUrl":"10.1016/j.bica.2018.09.001","url":null,"abstract":"<div><p>This article describes the open-source cognitive multi-agent knowledge-based SOSIEL (Self-Organizing Social &amp; Inductive Evolutionary Learning) Platform, designed for building the social components of social-ecological decision support systems, consisting of agents empowered with a cognitive architecture. The platform can simulate the cross-generational progression of one or a large number of agents that can interact among themselves and/or with coupled natural and/or technical systems, learn from their and each other’s experience, create new practices, and make decisions about taking and then take (potentially collective) actions. The platform can also be used for conducting hypothetical experiments that are focused on studying the interactions among: (a) cross-generational population dynamics, (b) self-organizing multi-layered social network structures, (c) evolving place-based knowledge, (d) learning, (e) decision-making, (f) collective action and its potential, and (g) social and (when coupled) social-ecological outcomes. The article describes a simple model that was built with the SOSIEL Platform, which simulates the co-evolution of mental models among socially learning agents.</p></div>","PeriodicalId":48756,"journal":{"name":"Biologically Inspired Cognitive Architectures","volume":"26 ","pages":"Pages 103-117"},"PeriodicalIF":0.0,"publicationDate":"2018-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1016/j.bica.2018.09.001","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"47901471","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 14
A biological brain-inspired fuzzy neural network: Fuzzy emotional neural network 一个生物脑启发的模糊神经网络:模糊情感神经网络
Q2 Psychology Pub Date : 2018-10-01 DOI: 10.1016/j.bica.2018.07.019
Ehsan Zamirpour, Mohammad Mosleh

In this paper, a brain-inspired fuzzy emotional neural network (FUZZ-ENN) is proposed for uncertainty prediction tasks in real world applications. In the proposed FUZZ-ENN, amygdala connections are modeled by fuzzy IF-THEN behavioral rules and orbitofrontal module inhibits the amygdala responses in order to decrease the uncertainty. This computational model is based on the inhibitory connections in the human emotional brain’s nervous system inhibiting the uncertainty. In this paper, genetic algorithm is applied for optimal tuning of crisp numerical and fuzzy parameters of the proposed model. A traditional neural model and a two layered emotional neural network (ENN) are also implemented for comparison purposes on the electrical load and wind power forecasting problem and the prediction of geomagnetic activity indices as two real world case studies. Numerical results indicate the superiority of the proposed approach in term of lower uncertainty in the prediction.

本文提出了一种脑启发模糊情感神经网络(fuzzy - enn),用于现实应用中的不确定性预测任务。在本文提出的fuzzy - enn中,杏仁核连接采用模糊IF-THEN行为规则建模,眶额模块抑制杏仁核反应以降低不确定性。该计算模型是基于人类情绪大脑神经系统抑制不确定性的抑制性连接。本文采用遗传算法对模型的清晰数值参数和模糊参数进行最优整定。并将传统神经网络模型和两层情感神经网络(ENN)作为两个实际案例,对电力负荷和风电预测问题以及地磁活动指数预测问题进行了比较。数值结果表明,该方法具有预测不确定性小的优越性。
{"title":"A biological brain-inspired fuzzy neural network: Fuzzy emotional neural network","authors":"Ehsan Zamirpour,&nbsp;Mohammad Mosleh","doi":"10.1016/j.bica.2018.07.019","DOIUrl":"10.1016/j.bica.2018.07.019","url":null,"abstract":"<div><p><span>In this paper, a brain-inspired fuzzy emotional neural network (FUZZ-ENN) is proposed for uncertainty prediction tasks in </span>real world applications<span><span><span>. In the proposed FUZZ-ENN, amygdala connections are modeled by fuzzy IF-THEN behavioral rules and orbitofrontal module inhibits the amygdala responses in order to decrease the uncertainty. This </span>computational model is based on the </span>inhibitory connections<span> in the human emotional brain’s nervous system<span><span> inhibiting the uncertainty. In this paper, genetic algorithm is applied for optimal tuning of crisp numerical and fuzzy parameters of the proposed model. A traditional </span>neural model and a two layered emotional neural network (ENN) are also implemented for comparison purposes on the electrical load and wind power forecasting problem and the prediction of geomagnetic activity indices as two real world case studies. Numerical results indicate the superiority of the proposed approach in term of lower uncertainty in the prediction.</span></span></span></p></div>","PeriodicalId":48756,"journal":{"name":"Biologically Inspired Cognitive Architectures","volume":"26 ","pages":"Pages 80-90"},"PeriodicalIF":0.0,"publicationDate":"2018-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1016/j.bica.2018.07.019","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"46831985","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 13
Model of interaction between learning and evolution. Computer simulation and analytical results 学习和进化相互作用的模型。计算机模拟及分析结果
Q2 Psychology Pub Date : 2018-10-01 DOI: 10.1016/j.bica.2018.09.002
David B. Saakian , Vladimir G. Red'ko

The current work develops the previous model of interaction between learning and evolution (Red’ko, 2017). The previous model investigated this interaction by means of computer simulation. The mechanisms of the main properties of the interaction between learning and evolution (the genetic assimilation, the hiding effect, the influence of the learning load on the interaction between learning and evolution) were analyzed. The results were obtained for the finite size of the population. Fortunately, there is the possibility to analyze the same effect analytically for the case of the infinite size of the population. The current article considers sufficiently large sizes of population. Computer simulation demonstrates that the essential results of the model do not depend on the population size if this size is sufficiently large. Moreover, at such large population size, the results of computer simulation actually coincide with the results of analytical estimations. We consider the processes of learning and evolution for the population of modeled organisms that have genotype and genotype. Genotypes are modified during evolution, phenotypes are optimized by means of learning. At the end of the generation, organisms are selected in accordance with their final phenotype. The main attention is paid to the hiding effect. This effect means that learning can suppress the evolutionary optimization of genotypes: the optimal phenotype can be found by means of learning for a rather large set of different genotypes, so there is no need to find the optimal genotype. The hiding effect is analyzed by both computer simulation and analytically.

目前的工作发展了先前的学习和进化之间相互作用的模型(Red 'ko, 2017)。先前的模型通过计算机模拟研究了这种相互作用。分析了学习与进化交互作用的主要特性(遗传同化、隐藏效应、学习负荷对学习与进化交互作用的影响)的机制。这些结果是在有限的总体规模下得到的。幸运的是,有可能对无限大的人口进行同样的分析。本文考虑了足够大的人口规模。计算机模拟表明,如果种群规模足够大,该模型的基本结果不依赖于种群规模。此外,在如此大的种群规模下,计算机模拟的结果与分析估计的结果实际上是一致的。我们考虑具有基因型和基因型的模拟生物种群的学习和进化过程。基因型在进化过程中被修改,表型通过学习得到优化。在一代结束时,生物根据其最终表型被选择。主要注意的是隐藏效果。这种效应意味着学习可以抑制基因型的进化优化:对于相当大的一组不同的基因型,通过学习可以找到最优的表型,因此不需要寻找最优的基因型。通过计算机仿真和解析两种方法对隐藏效果进行了分析。
{"title":"Model of interaction between learning and evolution. Computer simulation and analytical results","authors":"David B. Saakian ,&nbsp;Vladimir G. Red'ko","doi":"10.1016/j.bica.2018.09.002","DOIUrl":"10.1016/j.bica.2018.09.002","url":null,"abstract":"<div><p>The current work develops the previous model of interaction between learning and evolution (Red’ko, 2017). The previous model investigated this interaction by means of computer simulation. The mechanisms of the main properties of the interaction between learning and evolution (the genetic assimilation<span>, the hiding effect, the influence of the learning load on the interaction between learning and evolution) were analyzed. The results were obtained for the finite size of the population. Fortunately, there is the possibility to analyze the same effect analytically for the case of the infinite size of the population. The current article considers sufficiently large sizes of population. Computer simulation demonstrates that the essential results of the model do not depend on the population size if this size is sufficiently large. Moreover, at such large population size, the results of computer simulation actually coincide with the results of analytical estimations. We consider the processes of learning and evolution for the population of modeled organisms that have genotype and genotype. Genotypes are modified during evolution, phenotypes are optimized by means of learning. At the end of the generation, organisms are selected in accordance with their final phenotype. The main attention is paid to the hiding effect. This effect means that learning can suppress the evolutionary optimization of genotypes: the optimal phenotype can be found by means of learning for a rather large set of different genotypes, so there is no need to find the optimal genotype. The hiding effect is analyzed by both computer simulation and analytically.</span></p></div>","PeriodicalId":48756,"journal":{"name":"Biologically Inspired Cognitive Architectures","volume":"26 ","pages":"Pages 96-102"},"PeriodicalIF":0.0,"publicationDate":"2018-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1016/j.bica.2018.09.002","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"44461687","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Episodic memory transfer for multi-task reinforcement learning 情景记忆在多任务强化学习中的迁移
Q2 Psychology Pub Date : 2018-10-01 DOI: 10.1016/j.bica.2018.09.003
Artyom Y. Sorokin, Mikhail S. Burtsev

Episodic memory plays important role in animal behavior. It allows to reuse general skills for solution of specific tasks in changing environment. This beneficial feature of biological cognitive systems is still not incorporated successfully in an artificial neural architectures. In this paper we propose a neural architecture with shared episodic memory for multi-task reinforcement learning (SEM-PAAC). This architecture extends Parallel Advantage Actor Critic (PAAC) with two recurrent sub-networks for separate tracking of environment and task states. The first subnetwork store episodic memory and the second one allows task specific execution of policy. Experiments in the Taxi domain demonstrated that SEM-PAAC has the same performance as PAAC when subtasks are solved separately. On the other hand when subtasks are solved jointly for completing full Taxi task SEM-PAAC is significantly better due to reuse of episodic memory. Proposed architecture also successfully learned to predict task completion. This is a step towards more autonomous agents for multitask problems.

情景记忆在动物行为中起着重要的作用。它允许在不断变化的环境中重用通用技能来解决特定任务。生物认知系统的这一有益特征仍未成功地纳入人工神经体系结构。本文提出了一种基于共享情景记忆的多任务强化学习(SEM-PAAC)神经结构。该体系结构扩展了并行优势参与者批评(PAAC),使用两个循环子网络分别跟踪环境和任务状态。第一子网存储情景记忆,第二子网允许特定于任务的策略执行。Taxi领域的实验表明,SEM-PAAC在单独求解子任务时具有与PAAC相同的性能。另一方面,由于情景记忆的重用,当子任务联合解决以完成完整的出租车任务时,SEM-PAAC显著更好。提出的架构也成功地学会了预测任务的完成。这是向多任务问题的更自主代理迈出的一步。
{"title":"Episodic memory transfer for multi-task reinforcement learning","authors":"Artyom Y. Sorokin,&nbsp;Mikhail S. Burtsev","doi":"10.1016/j.bica.2018.09.003","DOIUrl":"10.1016/j.bica.2018.09.003","url":null,"abstract":"<div><p><span><span>Episodic memory plays important role in animal </span>behavior. It allows to reuse general skills for solution of specific tasks in changing environment. This beneficial feature of biological cognitive systems is still not incorporated successfully in an artificial neural architectures. In this paper we propose a neural architecture with shared episodic memory for multi-task </span>reinforcement learning<span> (SEM-PAAC). This architecture extends Parallel Advantage Actor Critic (PAAC) with two recurrent<span> sub-networks for separate tracking of environment and task states. The first subnetwork store episodic memory and the second one allows task specific execution of policy. Experiments in the Taxi domain demonstrated that SEM-PAAC has the same performance as PAAC when subtasks are solved separately. On the other hand when subtasks are solved jointly for completing full Taxi task SEM-PAAC is significantly better due to reuse of episodic memory. Proposed architecture also successfully learned to predict task completion. This is a step towards more autonomous agents for multitask problems.</span></span></p></div>","PeriodicalId":48756,"journal":{"name":"Biologically Inspired Cognitive Architectures","volume":"26 ","pages":"Pages 91-95"},"PeriodicalIF":0.0,"publicationDate":"2018-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1016/j.bica.2018.09.003","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"48457212","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
Approaches to cognitive architecture of autonomous intelligent agent 自主智能体的认知体系结构研究
Q2 Psychology Pub Date : 2018-10-01 DOI: 10.1016/j.bica.2018.10.004
Yuriy Dyachenko , Nayden Nenkov , Mariana Petrova , Inna Skarga-Bandurova , Oleg Soloviov

Taking into account that the human intelligence is the only available intelligence we will find the functional relationship between neuronal processes and psychic phenomena to reproduce intelligence in artificial system. The autonomous behavior of an agent may be the consequence of a gap between physical processes and self-referential meaningful processing of information which is related but not determined by physical processes. This indeterminism can be reproduced in a cognitive architecture through the self-referential processing of information with consideration of itself as a meaningful model. We propose embodiment of cognitive architecture of autonomous intelligent agent as an artificial neural network with a feedback loop in meaningful processing of information.

考虑到人类智能是唯一可用的智能,我们将发现神经过程和心理现象之间的功能关系,以在人工系统中再现智能。主体的自主行为可能是物理过程与自我参照的有意义的信息处理之间的差距的结果,这些信息处理与物理过程相关,但不是由物理过程决定的。这种不确定性可以通过信息的自我参照处理在认知架构中再现,并将其视为有意义的模型。我们提出将自主智能体的认知架构体现为具有反馈回路的人工神经网络,用于有意义的信息处理。
{"title":"Approaches to cognitive architecture of autonomous intelligent agent","authors":"Yuriy Dyachenko ,&nbsp;Nayden Nenkov ,&nbsp;Mariana Petrova ,&nbsp;Inna Skarga-Bandurova ,&nbsp;Oleg Soloviov","doi":"10.1016/j.bica.2018.10.004","DOIUrl":"10.1016/j.bica.2018.10.004","url":null,"abstract":"<div><p><span><span>Taking into account that the human intelligence is the only available intelligence we will find the functional relationship between neuronal processes and psychic phenomena to reproduce intelligence in artificial system. The autonomous </span>behavior of an agent may be the consequence of a gap between physical processes and self-referential meaningful processing of information which is related but not determined by physical processes. This indeterminism can be reproduced in a cognitive architecture through the self-referential processing of information with consideration of itself as a meaningful model. We propose embodiment of cognitive architecture of </span>autonomous intelligent agent<span> as an artificial neural network with a feedback loop in meaningful processing of information.</span></p></div>","PeriodicalId":48756,"journal":{"name":"Biologically Inspired Cognitive Architectures","volume":"26 ","pages":"Pages 130-135"},"PeriodicalIF":0.0,"publicationDate":"2018-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1016/j.bica.2018.10.004","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"42374331","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 28
期刊
Biologically Inspired Cognitive Architectures
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1