首页 > 最新文献

2019 Conference on Cognitive Computational Neuroscience最新文献

英文 中文
Mechanisms of the non-linear interactions between the neuronal and neurotransmitter systems explained by causal whole-brain modeling 神经元和神经递质系统之间非线性相互作用的机制由因果全脑模型解释
Pub Date : 2019-09-01 DOI: 10.32470/ccn.2019.1095-0
Josephine Cruzat, J. Cabral, G. Knudsen, R. Carhart-Harris, P. Whybrow, N. Logothetis, M. Kringelbach, G. Deco
Although a variety of studies have shown the role of neurotransmitters at the neuronal level, their impact on the dynamics of the system at a macroscopic scale is poorly understood. Here, we provide a causal explanation using the ​first ​ whole-brain model integrating multimodal imaging in healthy human participants undergoing manipulation of the serotonin system. Specifically, we combined anatomical and functional data with a detailed map of the serotonin 2A receptor (5-HT​2A​R) densities obtained with positron emission tomography (PET). This allowed us to model the resting state and mechanistically explain the functional effects of 5-HT​2A​R stimulation with lysergic acid diethylamide (LSD). The whole-brain model used a dynamical mean-field quantitative description of populations of excitatory and inhibitory neurons as well as the associated synaptic dynamics, where the neuronal gain function of the model is modulated by the 5-HT​2A​R density. The results show that the precise distribution of 5-HT​2A​R is crucial to predict the neuromodulatory effects of LSD. The model identified the causative mechanisms for the non-linear interactions between the neuronal and neurotransmitter system, which are uniquely linked to the underlying neuroanatomical network, the modulation by the specific brain-wide distribution of neurotransmitter receptors, and the non-linear interactions between the two. Keywords​: Whole-Brain Model; Mean Field Model; Neurotransmitters; Serotonin; Psychedelics.
尽管各种研究表明神经递质在神经元水平上的作用,但它们在宏观尺度上对系统动力学的影响却知之甚少。在这里,我们提供了一个因果解释,使用第一个全脑模型整合多模态成像的健康人类参与者进行操纵血清素系统。具体来说,我们将解剖和功能数据与正电子发射断层扫描(PET)获得的5-羟色胺2A受体(5-HT 2A R)密度的详细图结合起来。这使我们能够模拟静息状态,并从机制上解释麦角酸二乙胺(LSD)刺激5-HT 2A R的功能影响。全脑模型使用了兴奋性和抑制性神经元种群的动态平均场定量描述以及相关的突触动力学,其中模型的神经元增益函数由5-HT 2A R密度调节。结果表明,5-HT 2A R的精确分布对预测LSD的神经调节作用至关重要。该模型确定了神经元和神经递质系统之间非线性相互作用的致病机制,这与潜在的神经解剖学网络、神经递质受体的特定脑范围分布的调节以及两者之间的非线性相互作用有着独特的联系。关键词:全脑模型;平均场模型;神经递质;5 -羟色胺;致幻剂。
{"title":"Mechanisms of the non-linear interactions between the neuronal and neurotransmitter systems explained by causal whole-brain modeling","authors":"Josephine Cruzat, J. Cabral, G. Knudsen, R. Carhart-Harris, P. Whybrow, N. Logothetis, M. Kringelbach, G. Deco","doi":"10.32470/ccn.2019.1095-0","DOIUrl":"https://doi.org/10.32470/ccn.2019.1095-0","url":null,"abstract":"Although a variety of studies have shown the role of neurotransmitters at the neuronal level, their impact on the dynamics of the system at a macroscopic scale is poorly understood. Here, we provide a causal explanation using the ​first ​ whole-brain model integrating multimodal imaging in healthy human participants undergoing manipulation of the serotonin system. Specifically, we combined anatomical and functional data with a detailed map of the serotonin 2A receptor (5-HT​2A​R) densities obtained with positron emission tomography (PET). This allowed us to model the resting state and mechanistically explain the functional effects of 5-HT​2A​R stimulation with lysergic acid diethylamide (LSD). The whole-brain model used a dynamical mean-field quantitative description of populations of excitatory and inhibitory neurons as well as the associated synaptic dynamics, where the neuronal gain function of the model is modulated by the 5-HT​2A​R density. The results show that the precise distribution of 5-HT​2A​R is crucial to predict the neuromodulatory effects of LSD. The model identified the causative mechanisms for the non-linear interactions between the neuronal and neurotransmitter system, which are uniquely linked to the underlying neuroanatomical network, the modulation by the specific brain-wide distribution of neurotransmitter receptors, and the non-linear interactions between the two. Keywords​: Whole-Brain Model; Mean Field Model; Neurotransmitters; Serotonin; Psychedelics.","PeriodicalId":281121,"journal":{"name":"2019 Conference on Cognitive Computational Neuroscience","volume":"78 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132379594","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Temporal Pattern Models for Physiological Arousal During a Steering Task 操纵任务中生理唤醒的时间模式模型
Pub Date : 2019-09-01 DOI: 10.32470/ccn.2019.1249-0
Tuisku Tammi, Noora Lehtonen, B. Cowley
Physiological arousal can be a signal of attention, reflecting predictability and significance of stimuli or events. We explored temporal patterns in task-related physiological arousal and their connection to performance in repeated trials of a visuomotor steering task. Participants (N = 9) played a total of forty trials of a high-speed steering task in eight sessions over a period of 2-3 weeks. Temporal changes in electrodermal activity during task performance were modelled as habituation, and connections between performance, perceived importance and individual differences in habituation rate were examined. Additionally, withinsubject changes in habituation were compared to deviations from predicted performance. We found that sustained task-related arousal (slow habituation) was connected to better performance both between groups and within participants. Slow habituation was also related to higher subjective reports of perceived importance. Taken together, these results suggest that temporal changes in task-related arousal during learning are related to the processing of task-relevant cues and may reflect motivational states that direct selective attention.
生理唤醒可以是注意力的信号,反映刺激或事件的可预测性和重要性。我们在视觉运动控制任务的重复实验中探索了任务相关生理唤醒的时间模式及其与表现的联系。参与者(N = 9)在2-3周的时间里,分8个阶段共玩了40次高速驾驶任务。在任务执行过程中,皮电活动的时间变化被建模为习惯化,并检验了绩效、感知重要性和习惯化率的个体差异之间的联系。此外,在受试者内部,习惯化的变化与预测表现的偏差进行了比较。我们发现,持续的与任务相关的唤醒(缓慢的习惯化)与小组之间和参与者内部的更好表现有关。缓慢的习惯化也与较高的主观感知重要性报告有关。综上所述,这些结果表明,学习过程中任务相关唤醒的时间变化与任务相关线索的处理有关,可能反映了指导选择性注意的动机状态。
{"title":"Temporal Pattern Models for Physiological Arousal During a Steering Task","authors":"Tuisku Tammi, Noora Lehtonen, B. Cowley","doi":"10.32470/ccn.2019.1249-0","DOIUrl":"https://doi.org/10.32470/ccn.2019.1249-0","url":null,"abstract":"Physiological arousal can be a signal of attention, reflecting predictability and significance of stimuli or events. We explored temporal patterns in task-related physiological arousal and their connection to performance in repeated trials of a visuomotor steering task. Participants (N = 9) played a total of forty trials of a high-speed steering task in eight sessions over a period of 2-3 weeks. Temporal changes in electrodermal activity during task performance were modelled as habituation, and connections between performance, perceived importance and individual differences in habituation rate were examined. Additionally, withinsubject changes in habituation were compared to deviations from predicted performance. We found that sustained task-related arousal (slow habituation) was connected to better performance both between groups and within participants. Slow habituation was also related to higher subjective reports of perceived importance. Taken together, these results suggest that temporal changes in task-related arousal during learning are related to the processing of task-relevant cues and may reflect motivational states that direct selective attention.","PeriodicalId":281121,"journal":{"name":"2019 Conference on Cognitive Computational Neuroscience","volume":"53 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124741001","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
The relational structure of a reinforcement learning task is represented and generalised in the entorhinal cortex 强化学习任务的关系结构在内嗅皮层中得到表征和概括
Pub Date : 2019-09-01 DOI: 10.32470/ccn.2019.1193-0
A. Baram, Timothy H. Muller, H. Nili, M. Garvert, Timothy Edward John Behrens
The ability to appropriately generalise previously acquired knowledge to novel situations is a hallmark of human intelligence. A possible neural solution to this problem is to devote pools of neurons to represent the relations between entities in the environment explicitly, in a manner that is divorced from the entities themselves. Such an explicit representation can generalise to novel situations with the same relational structure. Grid cells, originally found in the entorhinal cortex, have been proposed as such an explicit representation of the relations between different locations in physical space. However, the neural representations underlying the generalisation of relational structures in abstract tasks remain poorly understood. Here we use fMRI in humans to show that the entorhinal cortex explicitly represents the relations between reward-predicting stimuli in a reinforcement learning task with different underlying correlation structures between the reward probabilities associated with different stimuli. Our results demonstrate that the same brain regions, perhaps with the same mechanisms, represent the relational structure of the task in both spatial and abstract decision-making tasks. This suggests that the brain uses a common coding framework for the structure of tasks across a wide range of domains.
将先前获得的知识适当地概括到新情况的能力是人类智力的一个标志。这个问题的一个可能的神经解决方案是用神经元池来明确地表示环境中实体之间的关系,以一种与实体本身分离的方式。这种显式表示可以推广到具有相同关系结构的新情况。网格细胞,最初发现于内嗅皮层,被认为是物理空间中不同位置之间关系的明确表示。然而,抽象任务中关系结构泛化的神经表征仍然知之甚少。在这里,我们使用功能磁共振成像(fMRI)在人类中显示,内嗅皮层明确表示强化学习任务中奖励预测刺激之间的关系,不同刺激相关的奖励概率之间存在不同的潜在相关结构。我们的研究结果表明,在空间和抽象决策任务中,相同的大脑区域,可能具有相同的机制,代表了任务的关系结构。这表明大脑使用一个共同的编码框架来处理跨广泛领域的任务结构。
{"title":"The relational structure of a reinforcement learning task is represented and generalised in the entorhinal cortex","authors":"A. Baram, Timothy H. Muller, H. Nili, M. Garvert, Timothy Edward John Behrens","doi":"10.32470/ccn.2019.1193-0","DOIUrl":"https://doi.org/10.32470/ccn.2019.1193-0","url":null,"abstract":"The ability to appropriately generalise previously acquired knowledge to novel situations is a hallmark of human intelligence. A possible neural solution to this problem is to devote pools of neurons to represent the relations between entities in the environment explicitly, in a manner that is divorced from the entities themselves. Such an explicit representation can generalise to novel situations with the same relational structure. Grid cells, originally found in the entorhinal cortex, have been proposed as such an explicit representation of the relations between different locations in physical space. However, the neural representations underlying the generalisation of relational structures in abstract tasks remain poorly understood. Here we use fMRI in humans to show that the entorhinal cortex explicitly represents the relations between reward-predicting stimuli in a reinforcement learning task with different underlying correlation structures between the reward probabilities associated with different stimuli. Our results demonstrate that the same brain regions, perhaps with the same mechanisms, represent the relational structure of the task in both spatial and abstract decision-making tasks. This suggests that the brain uses a common coding framework for the structure of tasks across a wide range of domains.","PeriodicalId":281121,"journal":{"name":"2019 Conference on Cognitive Computational Neuroscience","volume":"2021 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130846685","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Adding biological constraints to CNNs makes image classification more human-like and robust 在cnn中加入生物约束使得图像分类更像人类和鲁棒性
Pub Date : 2019-09-01 DOI: 10.32470/ccn.2019.1212-0
Gaurav Malhotra, B. D. Evans, J. Bowers
In this study, we show that when standard convolutional neural networks (CNNs) are trained end-to-end on datasets containing low-level and spatially high-frequency features, they are susceptible to learning these potentially idiosyncratic features if they are predictive of the output class. Such features are extremely unlikely to play a major role in human object recognition, where instead a strong preference for shape is observed. Through a series of empirical studies, we show that standard CNNs cannot overcome this reliance on non-shape features merely by making training more ecologically plausible or using standard regularisation methods. However, we show that these problems can be ameliorated by forgoing end-to-end learning and processing images initially with Gabor filters, in a manner that more closely resembles biological vision.
在这项研究中,我们表明,当标准卷积神经网络(cnn)在包含低水平和空间高频特征的数据集上进行端到端训练时,如果它们预测输出类别,它们很容易学习这些潜在的特质特征。这些特征不太可能在人类物体识别中发挥主要作用,相反,人们观察到对形状的强烈偏好。通过一系列的实证研究,我们表明标准cnn不能仅仅通过使训练更加生态可信或使用标准正则化方法来克服对非形状特征的依赖。然而,我们表明,这些问题可以通过放弃端到端学习和最初使用Gabor过滤器处理图像来改善,以一种更接近于生物视觉的方式。
{"title":"Adding biological constraints to CNNs makes image classification more human-like and robust","authors":"Gaurav Malhotra, B. D. Evans, J. Bowers","doi":"10.32470/ccn.2019.1212-0","DOIUrl":"https://doi.org/10.32470/ccn.2019.1212-0","url":null,"abstract":"In this study, we show that when standard convolutional neural networks (CNNs) are trained end-to-end on datasets containing low-level and spatially high-frequency features, they are susceptible to learning these potentially idiosyncratic features if they are predictive of the output class. Such features are extremely unlikely to play a major role in human object recognition, where instead a strong preference for shape is observed. Through a series of empirical studies, we show that standard CNNs cannot overcome this reliance on non-shape features merely by making training more ecologically plausible or using standard regularisation methods. However, we show that these problems can be ameliorated by forgoing end-to-end learning and processing images initially with Gabor filters, in a manner that more closely resembles biological vision.","PeriodicalId":281121,"journal":{"name":"2019 Conference on Cognitive Computational Neuroscience","volume":"52 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126387997","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Searching for rewards in graph-structured spaces 在图形结构空间中搜索奖励
Pub Date : 2019-08-17 DOI: 10.31234/osf.io/vey38
Charley M. Wu, Eric Schulz, S. Gershman
How do people generalize and explore structured spaces? We study human behavior on a multi-armed bandit task, where rewards are influenced by the connectivity structure of a graph. A detailed predictive model comparison shows that a Gaussian Process regression model using a diffusion kernel is able to best describe participant choices, and also predict judgments about expected reward and confidence. This model unifies psychological models of function learning with the Successor Representation used in reinforcement learning, thereby building a bridge between different models of generalization.
人们是如何概括和探索结构化空间的?我们研究了人类在多手强盗任务中的行为,其中奖励受图的连通性结构的影响。详细的预测模型比较表明,使用扩散核的高斯过程回归模型能够最好地描述参与者的选择,并预测对期望奖励和信心的判断。该模型将功能学习的心理模型与强化学习中使用的后继表示相结合,从而在不同的泛化模型之间建立了一座桥梁。
{"title":"Searching for rewards in graph-structured spaces","authors":"Charley M. Wu, Eric Schulz, S. Gershman","doi":"10.31234/osf.io/vey38","DOIUrl":"https://doi.org/10.31234/osf.io/vey38","url":null,"abstract":"How do people generalize and explore structured spaces? We study human behavior on a multi-armed bandit task, where rewards are influenced by the connectivity structure of a graph. A detailed predictive model comparison shows that a Gaussian Process regression model using a diffusion kernel is able to best describe participant choices, and also predict judgments about expected reward and confidence. This model unifies psychological models of function learning with the Successor Representation used in reinforcement learning, thereby building a bridge between different models of generalization.","PeriodicalId":281121,"journal":{"name":"2019 Conference on Cognitive Computational Neuroscience","volume":"3 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-08-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133151321","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Probabilistic reasoning in schizophrenia is volatile but not biased 精神分裂症的概率推理是反复无常的,但没有偏见
Pub Date : 2019-06-04 DOI: 10.31219/osf.io/r69km
G. Pfuhl, H. Tjelmeland
We update our beliefs based on evidence. Aberrant belief updating has been linked to schizophrenia and autism. It is not clear whether the faulty updating is due to reducedgeneral cognitive abilities, overweighting of recent information, or lower thresholds for switching from one belief to another. A common task to assess belief updating isthe beads task. Patients with schizophrenia show hasty decision-making.We here present a model describing the deviations from an ideal Bayesian observer and apply the model to three independent datasets, totalling n=176 healthy controlsand n=128 patients with schizophrenia. The parameters describe a) the number of beads considered (memory), b) systematic deviation and c) unsystematic deviations (volatility) from probability estimates.We find that, on average, patients use fewer beads and or more volatile responding. However, patients have, on average, probability estimates that are closer to the true probabilities. Closer investigations yielded relevant differences among the datasets and sequences used. Morechallenging sequences improve the performance of patients.Our model captures well the cognitive mechanisms proposed to contribute to the performance differences in the beads task.
我们根据证据更新我们的信念。异常的信念更新与精神分裂症和自闭症有关。目前尚不清楚错误的更新是由于一般认知能力的降低,对最近信息的过度重视,还是从一种信念转换到另一种信念的阈值较低。评估信念更新的一个常见任务是珠子任务。精神分裂症患者表现出草率的决策。本文提出了一个模型,描述了与理想贝叶斯观察者的偏差,并将该模型应用于三个独立的数据集,共n=176名健康对照和n=128名精神分裂症患者。参数描述了a)考虑的珠子数量(内存),b)系统偏差和c)概率估计的非系统偏差(波动性)。我们发现,平均而言,患者使用较少的珠子和或更不稳定的反应。然而,平均而言,患者的概率估计更接近真实概率。更深入的调查发现了所使用的数据集和序列之间的相关差异。更具挑战性的序列可以提高患者的表现。我们的模型很好地捕捉了导致珠子任务中表现差异的认知机制。
{"title":"Probabilistic reasoning in schizophrenia is volatile but not biased","authors":"G. Pfuhl, H. Tjelmeland","doi":"10.31219/osf.io/r69km","DOIUrl":"https://doi.org/10.31219/osf.io/r69km","url":null,"abstract":"We update our beliefs based on evidence. Aberrant belief updating has been linked to schizophrenia and autism. It is not clear whether the faulty updating is due to reducedgeneral cognitive abilities, overweighting of recent information, or lower thresholds for switching from one belief to another. A common task to assess belief updating isthe beads task. Patients with schizophrenia show hasty decision-making.We here present a model describing the deviations from an ideal Bayesian observer and apply the model to three independent datasets, totalling n=176 healthy controlsand n=128 patients with schizophrenia. The parameters describe a) the number of beads considered (memory), b) systematic deviation and c) unsystematic deviations (volatility) from probability estimates.We find that, on average, patients use fewer beads and or more volatile responding. However, patients have, on average, probability estimates that are closer to the true probabilities. Closer investigations yielded relevant differences among the datasets and sequences used. Morechallenging sequences improve the performance of patients.Our model captures well the cognitive mechanisms proposed to contribute to the performance differences in the beads task.","PeriodicalId":281121,"journal":{"name":"2019 Conference on Cognitive Computational Neuroscience","volume":"55 s191","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-06-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"113953443","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Ergodicity-Breaking Reveals Time Optimal Economic Behavior in Humans 遍历性破坏揭示了人类时间最优经济行为
Pub Date : 2019-06-01 DOI: 10.32470/ccn.2019.1089-0
David Meder, Finn Rabe, Tobias Morville, Kristoffer Hougaard Madsen, Magnus T. Koudahl, R. Dolan, H. Siebner, O. Hulme
Ergodicity describes an equivalence between the expectation value and the time average of observables. Applied to human behaviour, ergodic theory reveals how individuals should tolerate risk in different environments. To optimise wealth over time, agents should adapt their utility function according to the dynamical setting they face. Linear utility is optimal for additive dynamics, whereas logarithmic utility is optimal for multiplicative dynamics. Whether humans approximate time optimal behavior across different dynamics is unknown. Here we compare the effects of additive versus multiplicative gamble dynamics on risky choice. We show that utility functions are modulated by gamble dynamics in ways not explained by prevailing economic theory. Instead, as predicted by time optimality, risk aversion increases under multiplicative dynamics, distributing close to the values that maximise the time average growth of wealth. We suggest that our findings motivate a need for explicitly grounding theories of decision-making on ergodic considerations.
遍历性描述了可观测值的期望值和时间平均值之间的等价性。将遍历理论应用于人类行为,揭示了个体在不同环境中应该如何承受风险。为了使财富随着时间的推移而优化,代理人应该根据他们所面临的动态环境来调整他们的效用函数。线性效用是最优的加法动力学,而对数效用是最优的乘法动力学。人类是否在不同的动力学中近似时间最优行为是未知的。在这里,我们比较了累加性和乘法赌博动力学对风险选择的影响。我们表明效用函数是由赌博动力学调节的,其方式无法被主流经济理论所解释。相反,正如时间最优性所预测的那样,风险厌恶在乘法动态下增加,分布在使财富时间平均增长最大化的值附近。我们认为,我们的研究结果激发了对基于遍历考虑的明确的决策理论的需求。
{"title":"Ergodicity-Breaking Reveals Time Optimal Economic Behavior in Humans","authors":"David Meder, Finn Rabe, Tobias Morville, Kristoffer Hougaard Madsen, Magnus T. Koudahl, R. Dolan, H. Siebner, O. Hulme","doi":"10.32470/ccn.2019.1089-0","DOIUrl":"https://doi.org/10.32470/ccn.2019.1089-0","url":null,"abstract":"Ergodicity describes an equivalence between the expectation value and the time average of observables. Applied to human behaviour, ergodic theory reveals how individuals should tolerate risk in different environments. To optimise wealth over time, agents should adapt their utility function according to the dynamical setting they face. Linear utility is optimal for additive dynamics, whereas logarithmic utility is optimal for multiplicative dynamics. Whether humans approximate time optimal behavior across different dynamics is unknown. Here we compare the effects of additive versus multiplicative gamble dynamics on risky choice. We show that utility functions are modulated by gamble dynamics in ways not explained by prevailing economic theory. Instead, as predicted by time optimality, risk aversion increases under multiplicative dynamics, distributing close to the values that maximise the time average growth of wealth. We suggest that our findings motivate a need for explicitly grounding theories of decision-making on ergodic considerations.","PeriodicalId":281121,"journal":{"name":"2019 Conference on Cognitive Computational Neuroscience","volume":"97 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114855332","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 7
Uncertainty through Sampling: The Correspondence of Monte Carlo Dropout and Spiking in Artificial Neural Networks 抽样的不确定性:人工神经网络中蒙特卡罗Dropout和尖峰的对应关系
Pub Date : 1900-01-01 DOI: 10.32470/ccn.2019.1215-0
K. Standvoss, Lukas Großberger
Any organism that senses its environment only has an incomplete and noisy perspective on the world, which creates a necessity for nervous systems to represent uncertainty. While the principles of encoding uncertainty in biological neural ensembles are still under investigation, deep learning became a popular and effective machine learning method. In these models, sampling through dropout has been proposed as a mechanism to encode uncertainty. Moreover, dropout has previously been linked to variability in spiking networks under specific assumptions. We compare the relationship between dropout and spiking neuron models by means of the variation ratio over their output. We demonstrate that in cases of incomplete world knowledge (epistemic uncertainty) as well as for noisy observations (aleatoric uncertainty) both neuron models show similar uncertainty representations. These findings provide evidence that sampling could play a fundamental role in representing uncertainties in neural systems.
任何能感知环境的有机体对世界的看法都是不完整和嘈杂的,这就需要神经系统来代表不确定性。虽然生物神经系统的不确定性编码原理仍在研究中,但深度学习已成为一种流行而有效的机器学习方法。在这些模型中,通过dropout进行采样已被提出作为一种编码不确定性的机制。此外,在特定的假设下,辍学与尖峰网络的可变性有关。我们通过输出的变化率来比较dropout和spike神经元模型之间的关系。我们证明,在不完全世界知识(认知不确定性)和噪声观测(任意不确定性)的情况下,两个神经元模型都显示出类似的不确定性表示。这些发现提供了证据,证明采样可以在神经系统的不确定性中发挥基本作用。
{"title":"Uncertainty through Sampling: The Correspondence of Monte Carlo Dropout and Spiking in Artificial Neural Networks","authors":"K. Standvoss, Lukas Großberger","doi":"10.32470/ccn.2019.1215-0","DOIUrl":"https://doi.org/10.32470/ccn.2019.1215-0","url":null,"abstract":"Any organism that senses its environment only has an incomplete and noisy perspective on the world, which creates a necessity for nervous systems to represent uncertainty. While the principles of encoding uncertainty in biological neural ensembles are still under investigation, deep learning became a popular and effective machine learning method. In these models, sampling through dropout has been proposed as a mechanism to encode uncertainty. Moreover, dropout has previously been linked to variability in spiking networks under specific assumptions. We compare the relationship between dropout and spiking neuron models by means of the variation ratio over their output. We demonstrate that in cases of incomplete world knowledge (epistemic uncertainty) as well as for noisy observations (aleatoric uncertainty) both neuron models show similar uncertainty representations. These findings provide evidence that sampling could play a fundamental role in representing uncertainties in neural systems.","PeriodicalId":281121,"journal":{"name":"2019 Conference on Cognitive Computational Neuroscience","volume":"66 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1900-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115671048","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
From episodic to semantic memory: A computational model 从情景记忆到语义记忆:一个计算模型
Pub Date : 1900-01-01 DOI: 10.32470/ccn.2019.1434-0
Denis Alevi, R. Kempter, Henning Sprekeler
Systems memory consolidation describes the process of transferring and transforming initially hippocampusdependent declarative memories into stable representations in the neocortex. Experimental evidence indicates that neural replay during sleep is linked to this process. While multiple phenomenological theories of systems consolidation have been proposed, a mechanistic theory on the level of neurons and synapses is missing. Here, we study how episodic memories change over time in a recently suggested computational model for the neuronal basis of systems memory consolidation. We implement the proposed mechanism in artificial neural networks and show that memory transfer in the model facilitates the forgetting of episodic detail in memories and enhances the extraction of semantic generalizations. Moreover, we show that neural replay enhances the speed of consolidation and can in certain situations be necessary for the extraction of semantic memories. The latter appears to be the case specifically for the extraction of semantic content from a rapidly learning hippocampal system.
系统记忆巩固描述了最初依赖海马体的陈述性记忆在新皮层转移和转化为稳定表征的过程。实验证据表明,睡眠期间的神经重放与这一过程有关。虽然已经提出了多种系统巩固的现象学理论,但缺乏神经元和突触水平的机制理论。在这里,我们研究情景记忆如何随着时间的推移,在最近提出的系统记忆巩固的神经元基础的计算模型。我们在人工神经网络中实现了所提出的机制,并表明该模型中的记忆转移促进了记忆中情景细节的遗忘,增强了语义概括的提取。此外,我们表明神经重放提高了巩固的速度,并且在某些情况下对于提取语义记忆是必要的。后者似乎特别适用于从快速学习的海马体系统中提取语义内容。
{"title":"From episodic to semantic memory: A computational model","authors":"Denis Alevi, R. Kempter, Henning Sprekeler","doi":"10.32470/ccn.2019.1434-0","DOIUrl":"https://doi.org/10.32470/ccn.2019.1434-0","url":null,"abstract":"Systems memory consolidation describes the process of transferring and transforming initially hippocampusdependent declarative memories into stable representations in the neocortex. Experimental evidence indicates that neural replay during sleep is linked to this process. While multiple phenomenological theories of systems consolidation have been proposed, a mechanistic theory on the level of neurons and synapses is missing. Here, we study how episodic memories change over time in a recently suggested computational model for the neuronal basis of systems memory consolidation. We implement the proposed mechanism in artificial neural networks and show that memory transfer in the model facilitates the forgetting of episodic detail in memories and enhances the extraction of semantic generalizations. Moreover, we show that neural replay enhances the speed of consolidation and can in certain situations be necessary for the extraction of semantic memories. The latter appears to be the case specifically for the extraction of semantic content from a rapidly learning hippocampal system.","PeriodicalId":281121,"journal":{"name":"2019 Conference on Cognitive Computational Neuroscience","volume":"13 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1900-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123109319","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Choice History Biases Depend on Environmental Stability and State Uncertainty 选择历史偏差取决于环境稳定性和状态不确定性
Pub Date : 1900-01-01 DOI: 10.32470/ccn.2019.1237-0
A. Braun, Anne E. Urai, T. Donner
Perceptual decisions under uncertainty are often biased by the history of preceding events. For example, observers tend to repeat (or alternate) their judgments of the sensory environment more often than expected by chance (Braun, Urai, & Donner, 2018; Frund, Wichmann, & Macke, 2014). We test the idea that such choice history biases arise from the context-dependent accumulation of internal decision signals across trials (Glaze, Kable, & Gold, 2015). Observers performed a standard visual random dot motion discrimination task near psychophysical threshold in several different environments. Those were made up of different levels of auto-correlation between the stimulus categories in successive trials (Repetitive, Random, or Alternating), and the absence or presence of single-trial outcome feedback. Participants adjusted both the strength and the sign of their history biases to the environment. When no feedback was available this adjustment was driven by previous choices modulated by confidence. When feedback was provided the adjustment was predominantly based on previous stimuli.
在不确定的情况下,感知决策往往会受到之前事件的历史影响。例如,观察者倾向于重复(或交替)他们对感官环境的判断,而不是偶然的预期(Braun, Urai, & Donner, 2018;Frund, Wichmann, & Macke, 2014)。我们测试了这样一种观点,即这种选择历史偏差源于试验中内部决策信号的上下文依赖积累(Glaze, Kable, & Gold, 2015)。在不同的环境下,观察者在心理物理阈值附近进行标准的视觉随机点运动辨别任务。这些是由连续试验(重复、随机或交替)中刺激类别之间不同程度的自相关性以及单次试验结果反馈的缺失或存在组成的。参与者根据环境调整了他们的历史偏见的强度和标志。当没有反馈时,这种调整是由先前的选择驱动的,并受到信心的调节。当提供反馈时,调整主要基于先前的刺激。
{"title":"Choice History Biases Depend on Environmental Stability and State Uncertainty","authors":"A. Braun, Anne E. Urai, T. Donner","doi":"10.32470/ccn.2019.1237-0","DOIUrl":"https://doi.org/10.32470/ccn.2019.1237-0","url":null,"abstract":"Perceptual decisions under uncertainty are often biased by the history of preceding events. For example, observers tend to repeat (or alternate) their judgments of the sensory environment more often than expected by chance (Braun, Urai, & Donner, 2018; Frund, Wichmann, & Macke, 2014). We test the idea that such choice history biases arise from the context-dependent accumulation of internal decision signals across trials (Glaze, Kable, & Gold, 2015). Observers performed a standard visual random dot motion discrimination task near psychophysical threshold in several different environments. Those were made up of different levels of auto-correlation between the stimulus categories in successive trials (Repetitive, Random, or Alternating), and the absence or presence of single-trial outcome feedback. Participants adjusted both the strength and the sign of their history biases to the environment. When no feedback was available this adjustment was driven by previous choices modulated by confidence. When feedback was provided the adjustment was predominantly based on previous stimuli.","PeriodicalId":281121,"journal":{"name":"2019 Conference on Cognitive Computational Neuroscience","volume":"314 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1900-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124459575","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
2019 Conference on Cognitive Computational Neuroscience
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1