首页 > 最新文献

2019 Conference on Cognitive Computational Neuroscience最新文献

英文 中文
Bayesian inference for an exploration-exploitation model of human gaze control 人类凝视控制探索-开发模型的贝叶斯推理
Pub Date : 1900-01-01 DOI: 10.32470/ccn.2019.1246-0
Noa Malem-Shinitski, S. Seelig, S. Reich, Ralf Engbert
Understanding human gaze, and the saccadic selection process underlying it, is an important question in cognitive-neuroscience with many interesting applications in areas from psychology to computer vision. One way to advance our understanding is to develop generative models that capture the spatial interaction between fixations and the temporal structure of a sequence of fixations, known as scanpaths. Such models are scarce in the literature and even fewer attempt to model inter-subject variability. In this work, we present a new parametric model for scanpath generation. We develop a discrete-time probabilistic generative model, with a Markovian structure, where at each step the next fixation location is selected using one of two strategies exploitation or exploration. We implement efficient Bayesian inference for hyperparameter estimation using an HMC within Gibbs approach. Our model is able to capture interobserver variability in terms of saccade length and direction as demonstrated by fitting the model to a dataset of scanpaths from 35 subjects performing a task of free viewing of 30 natural scene image.
理解人类的凝视及其背后的眼球选择过程,是认知神经科学中的一个重要问题,在从心理学到计算机视觉的许多领域都有有趣的应用。促进我们理解的一种方法是开发生成模型,捕捉注视和一系列注视的时间结构之间的空间相互作用,称为扫描路径。这样的模型在文献中是稀缺的,甚至更少尝试建模主体间的可变性。在这项工作中,我们提出了一种新的扫描路径生成参数模型。我们开发了一个离散时间概率生成模型,具有马尔可夫结构,在每个步骤中,下一个固定位置是使用两种策略中的一种来选择的。我们使用Gibbs方法内的HMC实现了超参数估计的高效贝叶斯推理。我们的模型能够捕捉观察者之间在扫视长度和方向方面的变化,通过将模型拟合到35名受试者的扫描路径数据集来证明这一点,这些受试者执行自由观看30幅自然场景图像的任务。
{"title":"Bayesian inference for an exploration-exploitation model of human gaze control","authors":"Noa Malem-Shinitski, S. Seelig, S. Reich, Ralf Engbert","doi":"10.32470/ccn.2019.1246-0","DOIUrl":"https://doi.org/10.32470/ccn.2019.1246-0","url":null,"abstract":"Understanding human gaze, and the saccadic selection process underlying it, is an important question in cognitive-neuroscience with many interesting applications in areas from psychology to computer vision. One way to advance our understanding is to develop generative models that capture the spatial interaction between fixations and the temporal structure of a sequence of fixations, known as scanpaths. Such models are scarce in the literature and even fewer attempt to model inter-subject variability. In this work, we present a new parametric model for scanpath generation. We develop a discrete-time probabilistic generative model, with a Markovian structure, where at each step the next fixation location is selected using one of two strategies exploitation or exploration. We implement efficient Bayesian inference for hyperparameter estimation using an HMC within Gibbs approach. Our model is able to capture interobserver variability in terms of saccade length and direction as demonstrated by fitting the model to a dataset of scanpaths from 35 subjects performing a task of free viewing of 30 natural scene image.","PeriodicalId":281121,"journal":{"name":"2019 Conference on Cognitive Computational Neuroscience","volume":"19 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1900-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"134490792","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A mechanistic account of transferring structural knowledge across cognitive maps 跨认知地图转移结构性知识的机制解释
Pub Date : 1900-01-01 DOI: 10.32470/ccn.2019.1324-0
Shirley Mark, R. Moran, Thomas Parr, S. Kennerley, Timothy Edward John Behrens
Animals can transfer knowledge that was learnt previously and infer when this knowledge is relevant. Frequently, the relations between elements in an environment or task follow hidden underlying structure. We suggest that animals represent these underlying structures using abstract basis sets that are generalized over particularities of the current environment, such as its stimuli and size. We show that this type of representation allows inference of important task states, correct behavioural policy and the existence of unobserved routes. We further conducted two experiments in which participants learned three maps during two successive days and asked how the structural knowledge that was acquire during the first day affect participants behaviour during the second day. In line with our model, we show that participants who have a correct structural prior are able to infer the existence of unobserved routes and are able to infer appropriate behavioural policy. Therefore supporting the idea that abstract structural knowledge can be acquired and generalised across different cognitive maps.
动物可以转移以前学到的知识,并推断出这些知识何时与之相关。通常,环境或任务中元素之间的关系遵循隐藏的底层结构。我们建议动物使用抽象的基础集来表示这些潜在的结构,这些基础集概括了当前环境的特殊性,如刺激和大小。我们表明,这种类型的表示允许推断重要的任务状态,正确的行为策略和未观察到的路线的存在。我们进一步进行了两个实验,参与者在连续两天学习了三张地图,并询问第一天获得的结构知识如何影响参与者在第二天的行为。根据我们的模型,我们表明,具有正确结构先验的参与者能够推断出未观察到的路线的存在,并能够推断出适当的行为策略。因此,支持抽象结构知识可以通过不同的认知地图获得和概括的观点。
{"title":"A mechanistic account of transferring structural knowledge across cognitive maps","authors":"Shirley Mark, R. Moran, Thomas Parr, S. Kennerley, Timothy Edward John Behrens","doi":"10.32470/ccn.2019.1324-0","DOIUrl":"https://doi.org/10.32470/ccn.2019.1324-0","url":null,"abstract":"Animals can transfer knowledge that was learnt previously and infer when this knowledge is relevant. Frequently, the relations between elements in an environment or task follow hidden underlying structure. We suggest that animals represent these underlying structures using abstract basis sets that are generalized over particularities of the current environment, such as its stimuli and size. We show that this type of representation allows inference of important task states, correct behavioural policy and the existence of unobserved routes. We further conducted two experiments in which participants learned three maps during two successive days and asked how the structural knowledge that was acquire during the first day affect participants behaviour during the second day. In line with our model, we show that participants who have a correct structural prior are able to infer the existence of unobserved routes and are able to infer appropriate behavioural policy. Therefore supporting the idea that abstract structural knowledge can be acquired and generalised across different cognitive maps.","PeriodicalId":281121,"journal":{"name":"2019 Conference on Cognitive Computational Neuroscience","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1900-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"134492961","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A Calculus for Brain Computation 大脑计算的微积分
Pub Date : 1900-01-01 DOI: 10.32470/ccn.2019.1381-0
C. Papadimitriou, S. Vempala, Daniel Mitropolsky, Michael Collins, W. Maass, L. Abbott
Do brains compute? How do brains learn? How are intelligence and language achieved in the human brain? In this pursuit, we develop a formal calculus and associated programming language for brain computation, based on the assembly hypothesis, first proposed by Hebb: the basic unit of memory and computation in the brain is an assembly, a sparse distribution over neurons. We show that assemblies can be realized efficiently and neuroplausibly by using random projection, inhibition, and plasticity. Repeated applications of this RP&C primitive (random projection and cap) lead to (1) stable assembly creation through projection; (2) association and pattern completion; and finally (3) merge, where two assemblies form a higher-level assembly and, eventually, hierarchies. Further, these operations are composable, allowing the creation of stable computational circuits and structures. We argue that this functionality, in the presence of merge in particular, might underlie language and syntax in humans.
大脑会计算吗?大脑是如何学习的?智力和语言是如何在人脑中形成的?在这一追求中,我们开发了一种形式演算和相关的大脑计算编程语言,基于装配假设,首先由Hebb提出:大脑中记忆和计算的基本单位是一个装配,在神经元上的稀疏分布。我们表明,通过使用随机投射、抑制和可塑性,组装可以有效地和神经似然地实现。重复应用这个RP&C原语(随机投影和帽)导致(1)通过投影创建稳定的装配;(2)联想和模式补全;最后(3)合并,两个程序集形成一个更高级别的程序集,并最终形成层次结构。此外,这些操作是可组合的,允许创建稳定的计算电路和结构。我们认为,这种功能,特别是在合并的情况下,可能是人类语言和语法的基础。
{"title":"A Calculus for Brain Computation","authors":"C. Papadimitriou, S. Vempala, Daniel Mitropolsky, Michael Collins, W. Maass, L. Abbott","doi":"10.32470/ccn.2019.1381-0","DOIUrl":"https://doi.org/10.32470/ccn.2019.1381-0","url":null,"abstract":"Do brains compute? How do brains learn? How are intelligence and language achieved in the human brain? In this pursuit, we develop a formal calculus and associated programming language for brain computation, based on the assembly hypothesis, first proposed by Hebb: the basic unit of memory and computation in the brain is an assembly, a sparse distribution over neurons. We show that assemblies can be realized efficiently and neuroplausibly by using random projection, inhibition, and plasticity. Repeated applications of this RP&C primitive (random projection and cap) lead to (1) stable assembly creation through projection; (2) association and pattern completion; and finally (3) merge, where two assemblies form a higher-level assembly and, eventually, hierarchies. Further, these operations are composable, allowing the creation of stable computational circuits and structures. We argue that this functionality, in the presence of merge in particular, might underlie language and syntax in humans.","PeriodicalId":281121,"journal":{"name":"2019 Conference on Cognitive Computational Neuroscience","volume":"6 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1900-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"134283830","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Extreme Translation Tolerance in Humans and Machines 人类和机器的极端翻译容忍
Pub Date : 1900-01-01 DOI: 10.32470/ccn.2019.1091-0
R. Blything, Ivan I. Vankov, Casimir J. H. Ludwig, J. Bowers
What mechanism supports our ability to recognize objects over a wide range of different retinal locations? Most research in psychology and neuroscience suggests that learning to identify a novel object at one retinal location only supports the ability to identify that object at nearby retinal locations, and to date, neural network models of object identification show a similar restriction in generalization. As a consequence, it is widely assumed that objects need to be learned at multiple locations. We challenge this view and show the capacity to generalize across retinal locations (what we call on-line translation tolerance) has been underestimated in humans and artificial neural networks. Two eye tracking studies demonstrate that novel objects can be recognized following translations of 9° and even 18°. Additionally, computational studies showed that convolutional neural networks can achieve similarly robust generalization when a mechanism (Global Average Pooling) was built in to generate larger receptive fields.
什么机制支持我们在不同的视网膜位置上识别物体的能力?心理学和神经科学的大多数研究表明,学习在一个视网膜位置识别新物体只支持在附近的视网膜位置识别该物体的能力,到目前为止,物体识别的神经网络模型在泛化方面显示出类似的限制。因此,人们普遍认为物体需要在多个位置学习。我们挑战这一观点,并表明在人类和人工神经网络中,跨视网膜位置的泛化能力(我们称之为在线翻译容忍度)被低估了。两项眼动追踪研究表明,在翻译9°甚至18°后,可以识别新物体。此外,计算研究表明,当构建一种机制(全局平均池化)来产生更大的接受域时,卷积神经网络可以实现类似的鲁棒泛化。
{"title":"Extreme Translation Tolerance in Humans and Machines","authors":"R. Blything, Ivan I. Vankov, Casimir J. H. Ludwig, J. Bowers","doi":"10.32470/ccn.2019.1091-0","DOIUrl":"https://doi.org/10.32470/ccn.2019.1091-0","url":null,"abstract":"What mechanism supports our ability to recognize objects over a wide range of different retinal locations? Most research in psychology and neuroscience suggests that learning to identify a novel object at one retinal location only supports the ability to identify that object at nearby retinal locations, and to date, neural network models of object identification show a similar restriction in generalization. As a consequence, it is widely assumed that objects need to be learned at multiple locations. We challenge this view and show the capacity to generalize across retinal locations (what we call on-line translation tolerance) has been underestimated in humans and artificial neural networks. Two eye tracking studies demonstrate that novel objects can be recognized following translations of 9° and even 18°. Additionally, computational studies showed that convolutional neural networks can achieve similarly robust generalization when a mechanism (Global Average Pooling) was built in to generate larger receptive fields.","PeriodicalId":281121,"journal":{"name":"2019 Conference on Cognitive Computational Neuroscience","volume":"31 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1900-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132130537","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Models of allocentric coding for reaching in naturalistic visual scenes 自然视觉场景中伸手的异中心编码模型
Pub Date : 1900-01-01 DOI: 10.32470/ccn.2019.1372-0
Parisa Abedi Khoozani, Paul R. Schrater, Dominik M. Endres, K. Fiehler, Gunnar Blohm
To reach to objects, humans rely on relative positions of target objects to surrounding objects (allocentric) as well as to their own bodies (egocentric). Previous studies demonstrated that scene configuration and object relevancy to the task modulates the combination weights of allocentric and egocentric information. Egocentric coding for reaching is studied extensively; however, how allocentric information is coupled and used in reaching is unknown. Using a computational approach, we show that clustering mechanisms for allocentric coding combined with causal Bayesian integration of allocentric and egocentric information can account for the observed reaching behavior. To further understand allocentric coding, we propose two strategies, global vs. distributed landmark clustering (GLC vs. DLC). Both models can replicate the current data but each has distinct implications. GLC efficiently encodes the scene relative to a single virtual reference but loses all the local structure information. In contrary, DLC stores more redundant inter-object relationship information. Consequently, DLC is more sensitive to the changes of the scene. Further experiments must differentiate between the two proposed strategies.
为了接触到物体,人类依靠目标物体与周围物体的相对位置(非中心)以及与自己身体的相对位置(自我中心)。先前的研究表明,场景配置和目标与任务的相关性调节了非中心和自我中心信息的组合权重。以自我为中心的伸手编码得到了广泛的研究;然而,非中心信息是如何耦合和使用在到达是未知的。通过计算方法,我们证明了非中心编码的聚类机制与非中心和自我中心信息的因果贝叶斯整合可以解释观察到的到达行为。为了进一步理解非中心编码,我们提出了两种策略,全局与分布式地标聚类(GLC vs. DLC)。这两种模型都可以复制当前的数据,但每种模型都有不同的含义。相对于单个虚拟参考,GLC有效地对场景进行编码,但丢失了所有的局部结构信息。相反,DLC存储了更多冗余的对象间关系信息。因此,DLC对场景的变化更加敏感。进一步的实验必须区分这两种策略。
{"title":"Models of allocentric coding for reaching in naturalistic visual scenes","authors":"Parisa Abedi Khoozani, Paul R. Schrater, Dominik M. Endres, K. Fiehler, Gunnar Blohm","doi":"10.32470/ccn.2019.1372-0","DOIUrl":"https://doi.org/10.32470/ccn.2019.1372-0","url":null,"abstract":"To reach to objects, humans rely on relative positions of target objects to surrounding objects (allocentric) as well as to their own bodies (egocentric). Previous studies demonstrated that scene configuration and object relevancy to the task modulates the combination weights of allocentric and egocentric information. Egocentric coding for reaching is studied extensively; however, how allocentric information is coupled and used in reaching is unknown. Using a computational approach, we show that clustering mechanisms for allocentric coding combined with causal Bayesian integration of allocentric and egocentric information can account for the observed reaching behavior. To further understand allocentric coding, we propose two strategies, global vs. distributed landmark clustering (GLC vs. DLC). Both models can replicate the current data but each has distinct implications. GLC efficiently encodes the scene relative to a single virtual reference but loses all the local structure information. In contrary, DLC stores more redundant inter-object relationship information. Consequently, DLC is more sensitive to the changes of the scene. Further experiments must differentiate between the two proposed strategies.","PeriodicalId":281121,"journal":{"name":"2019 Conference on Cognitive Computational Neuroscience","volume":"64 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1900-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132290922","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Novel Object Scale Differences in Deep Convolutional Neural Networks versus Human Object Recognition Areas 深度卷积神经网络与人类物体识别领域的新目标尺度差异
Pub Date : 1900-01-01 DOI: 10.32470/ccn.2019.1075-0
Astrid Zeman, C. V. Meel, H. O. D. Beeck
Deep Convolutional Neural Networks (CNNs) are lauded for their high accuracy in object classification, as well as their striking similarity to human brain and behaviour. Both humans and CNNs maintain high classification accuracy despite changes in the scale, rotation, and translation of objects. In this study, we present images of novel objects at different scales and compare representational similarity in the human brain versus CNNs. We measure human fMRI responses in primary visual cortex (V1) and the object selective lateral occipital complex (LOC). We also measure the internal representations of CNNs that have been trained for largescale object recognition. Novel objects lack consensus on their name and identity, and therefore do not clearly belong to any specific object category. These novel objects are individuated in LOC, but not V1. V1 and LOC both significantly represent size and pixel information. In contrast, the late layers of CNNs show they are able to individuate objects but do not retain size information. Thus, while the human brain and CNNs are both able to recognise objects in spite of changes to their size, only the human brain retains this size information throughout the later stages of information processing.
深度卷积神经网络(cnn)因其在对象分类方面的高准确性以及与人类大脑和行为的惊人相似性而受到称赞。尽管物体的尺度、旋转和平移发生了变化,但人类和cnn都保持了很高的分类精度。在这项研究中,我们呈现了不同尺度的新物体图像,并比较了人类大脑与cnn的表征相似性。我们测量了人类初级视觉皮层(V1)和客体选择性枕侧复合体(LOC)的fMRI反应。我们还测量了经过大规模目标识别训练的cnn的内部表示。新奇的物体在其名称和身份上缺乏共识,因此不清楚地属于任何特定的物体类别。这些新奇的对象在LOC中是个性化的,而不是V1。V1和LOC都能很好地表示尺寸和像素信息。相比之下,cnn的后期层显示它们能够个性化对象,但不能保留大小信息。因此,虽然人类大脑和cnn都能够在物体大小变化的情况下识别物体,但只有人类大脑在信息处理的后期阶段保留了这个大小信息。
{"title":"Novel Object Scale Differences in Deep Convolutional Neural Networks versus Human Object Recognition Areas","authors":"Astrid Zeman, C. V. Meel, H. O. D. Beeck","doi":"10.32470/ccn.2019.1075-0","DOIUrl":"https://doi.org/10.32470/ccn.2019.1075-0","url":null,"abstract":"Deep Convolutional Neural Networks (CNNs) are lauded for their high accuracy in object classification, as well as their striking similarity to human brain and behaviour. Both humans and CNNs maintain high classification accuracy despite changes in the scale, rotation, and translation of objects. In this study, we present images of novel objects at different scales and compare representational similarity in the human brain versus CNNs. We measure human fMRI responses in primary visual cortex (V1) and the object selective lateral occipital complex (LOC). We also measure the internal representations of CNNs that have been trained for largescale object recognition. Novel objects lack consensus on their name and identity, and therefore do not clearly belong to any specific object category. These novel objects are individuated in LOC, but not V1. V1 and LOC both significantly represent size and pixel information. In contrast, the late layers of CNNs show they are able to individuate objects but do not retain size information. Thus, while the human brain and CNNs are both able to recognise objects in spite of changes to their size, only the human brain retains this size information throughout the later stages of information processing.","PeriodicalId":281121,"journal":{"name":"2019 Conference on Cognitive Computational Neuroscience","volume":"56 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1900-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132619615","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Using deep neural network features to predict voxelwise activity in ultra-high field fMRI 利用深度神经网络特征预测超高场功能磁共振成像的体向活动
Pub Date : 1900-01-01 DOI: 10.32470/ccn.2019.1165-0
Rebekka Heinen, Lorena Deuker, Thomas Naselaris, N. Axmacher
Deep neural network features can be used to train encoding models that accurately predict brain activity from the visual cortex. Using these features together with ultrahigh field fMRI could open a new set of opportunities ranging from human vision to areas such as learning and memory consolidation. Is it possible to apply encoding models based on deep neural network features to high-resolution fMRI data? We investigated this using the feature-weighted receptive field (fwrf) model on ultra-high field fMRI during a natural image viewing task. Applying the fwrf model to our data we were able to predict brain activity along the ventral visual stream (VVS). In line with previous studies, we found a shift from low to high network layers while predicting brain activity in early visual areas compared to higher regions of the VVS. We conclude that encoding models based on neural network features can be applied to ultra-high field fMRI data, suggesting similar processing of visual scenes in neural networks and the human visual association cortex. Our results suggest that these models cannot only be used to study vision but other processes such as memory and imagination.
深度神经网络的特征可以用来训练编码模型,从而准确地从视觉皮层预测大脑活动。将这些特征与超高场功能磁共振成像相结合,可以为从人类视觉到学习和记忆巩固等领域开辟一系列新的机会。是否有可能将基于深度神经网络特征的编码模型应用于高分辨率fMRI数据?我们在自然图像观看任务中使用超高场功能磁共振成像的特征加权接受野(fwrf)模型研究了这一点。将fwrf模型应用到我们的数据中,我们能够预测沿腹侧视觉流(VVS)的大脑活动。与之前的研究一致,我们在预测早期视觉区域的大脑活动时发现了从低到高的网络层的转变,而不是VVS的高区域。我们得出结论,基于神经网络特征的编码模型可以应用于超高场fMRI数据,表明神经网络与人类视觉关联皮层对视觉场景的处理相似。我们的研究结果表明,这些模型不仅可以用于研究视觉,还可以用于研究记忆和想象等其他过程。
{"title":"Using deep neural network features to predict voxelwise activity in ultra-high field fMRI","authors":"Rebekka Heinen, Lorena Deuker, Thomas Naselaris, N. Axmacher","doi":"10.32470/ccn.2019.1165-0","DOIUrl":"https://doi.org/10.32470/ccn.2019.1165-0","url":null,"abstract":"Deep neural network features can be used to train encoding models that accurately predict brain activity from the visual cortex. Using these features together with ultrahigh field fMRI could open a new set of opportunities ranging from human vision to areas such as learning and memory consolidation. Is it possible to apply encoding models based on deep neural network features to high-resolution fMRI data? We investigated this using the feature-weighted receptive field (fwrf) model on ultra-high field fMRI during a natural image viewing task. Applying the fwrf model to our data we were able to predict brain activity along the ventral visual stream (VVS). In line with previous studies, we found a shift from low to high network layers while predicting brain activity in early visual areas compared to higher regions of the VVS. We conclude that encoding models based on neural network features can be applied to ultra-high field fMRI data, suggesting similar processing of visual scenes in neural networks and the human visual association cortex. Our results suggest that these models cannot only be used to study vision but other processes such as memory and imagination.","PeriodicalId":281121,"journal":{"name":"2019 Conference on Cognitive Computational Neuroscience","volume":"40 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1900-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132710663","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Modeling the N400 brain potential as Semantic Bayesian Surprise 基于语义贝叶斯惊喜的N400脑电位建模
Pub Date : 1900-01-01 DOI: 10.32470/ccn.2019.1184-0
Lea Musiolek, F. Blankenburg, D. Ostwald, Milena Rabovsky
In research on human language comprehension, the N400 component of the event-related brain potential (ERP) has attracted attention as an electrophysiological indicator of meaning processing in the brain. However, despite much research, the specific functional basis of the N400 remains widely debated. Recent neural network modeling work suggests that N400 amplitudes can be simulated as the stimulus-induced change in internally represented probabilities of aspects of meaning (Rabovsky, Hansen, & McClelland, 2018). Here, we assess this idea based on single-trial N400 amplitudes measured in an oddball-like roving paradigm with written words from different semantic categories varying in semantic feature overlap. We model the N400 as Semantic Surprise, the change in the probability distribution of a stimulus’s semantic features for each trial. Simple condition-based analyses produced a significant effect of category switch on N400 amplitude, and the trial-by-trial modeling similarly revealed negative effects of Semantic Surprise on N400 amplitude. From fitting a forgetting parameter for each participant, we also gleaned insights into the rates of forgetting of past input to the semantic system. Thus, we provide a computationally explicit account of N400 amplitudes, which links the N400 and thus the neurocognitive processes involved in human language comprehension to the Bayesian brain hypothesis.
在人类语言理解研究中,事件相关脑电位(event- correlation brain potential, ERP)的N400分量作为脑意义加工的电生理指标受到了广泛关注。然而,尽管进行了大量研究,N400的具体功能基础仍存在广泛争议。最近的神经网络建模工作表明,N400振幅可以模拟为刺激引起的意义方面内部表示概率的变化(Rabovsky, Hansen, & McClelland, 2018)。在这里,我们基于在一个古怪的漫游范式中测量的单次试验N400振幅来评估这一想法,该范式使用来自不同语义类别的书面单词,语义特征重叠不同。我们将N400建模为语义惊喜,即每次试验中刺激语义特征概率分布的变化。简单的基于条件的分析显示类别转换对N400振幅有显著影响,逐次模型同样揭示了语义惊奇对N400振幅的负影响。通过为每个参与者拟合遗忘参数,我们还收集了对过去输入到语义系统的遗忘率的见解。因此,我们提供了N400振幅的计算明确说明,将N400以及涉及人类语言理解的神经认知过程与贝叶斯大脑假设联系起来。
{"title":"Modeling the N400 brain potential as Semantic Bayesian Surprise","authors":"Lea Musiolek, F. Blankenburg, D. Ostwald, Milena Rabovsky","doi":"10.32470/ccn.2019.1184-0","DOIUrl":"https://doi.org/10.32470/ccn.2019.1184-0","url":null,"abstract":"In research on human language comprehension, the N400 component of the event-related brain potential (ERP) has attracted attention as an electrophysiological indicator of meaning processing in the brain. However, despite much research, the specific functional basis of the N400 remains widely debated. Recent neural network modeling work suggests that N400 amplitudes can be simulated as the stimulus-induced change in internally represented probabilities of aspects of meaning (Rabovsky, Hansen, & McClelland, 2018). Here, we assess this idea based on single-trial N400 amplitudes measured in an oddball-like roving paradigm with written words from different semantic categories varying in semantic feature overlap. We model the N400 as Semantic Surprise, the change in the probability distribution of a stimulus’s semantic features for each trial. Simple condition-based analyses produced a significant effect of category switch on N400 amplitude, and the trial-by-trial modeling similarly revealed negative effects of Semantic Surprise on N400 amplitude. From fitting a forgetting parameter for each participant, we also gleaned insights into the rates of forgetting of past input to the semantic system. Thus, we provide a computationally explicit account of N400 amplitudes, which links the N400 and thus the neurocognitive processes involved in human language comprehension to the Bayesian brain hypothesis.","PeriodicalId":281121,"journal":{"name":"2019 Conference on Cognitive Computational Neuroscience","volume":"62 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1900-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116588768","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 6
Synchronized and Propagating States of Human Auditory Processing 人类听觉加工的同步和传播状态
Pub Date : 1900-01-01 DOI: 10.32470/ccn.2019.1306-0
Joon-Young Moon, K. Müsch, C. Schroeder, C. Honey
Human brain dynamics combine external drivers (e.g. sensory information) and internal drivers (e.g. expectations and memories). How do the patterns of inter-regional coupling change when the balance of external and internal information is altered? To investigate this question, we analyzed intracranial (ECoG) recordings from human listeners exposed to an auditory narrative. We measured the latencies of coupling across consecutive stages of cortical auditory processing and we investigated if and how the latencies varied as a function of stimulus drive. We found that the latencies along the auditory pathway vary between no delay (“synchronized state”) and a small, nonzero delay (~20 ms, “propagating state”) depending on the external stimulation. The long-latency propagating state was most often observed in the absence of external information, during the silent boundaries between sentences. Moreover, propagating states were associated with transient increases in alpha-band (8-12 Hz) oscillatory processes. Both synchronized and propagating states were reproduced in a coupled oscillator model by altering the strength of the external drive. The data and model suggest that cortical networks transition between i) synchronized dynamics driven by an external stimulus, and ii) long-latency propagating dynamics in the absence of an external stimulus.
人脑动力学结合了外部驱动因素(如感觉信息)和内部驱动因素(如期望和记忆)。当外部和内部信息的平衡发生变化时,区域间耦合的模式是如何变化的?为了研究这个问题,我们分析了暴露于听觉叙述的人类听众的颅内(ECoG)记录。我们测量了皮层听觉处理连续阶段的耦合潜伏期,并研究了潜伏期作为刺激驱动的函数是否以及如何变化。我们发现,听觉通路的潜伏期根据外界刺激的不同,在无延迟(“同步状态”)和小的非零延迟(~20毫秒,“传播状态”)之间变化。长潜伏期传播状态通常在没有外部信息的情况下观察到,在句子之间的沉默边界期间。此外,传播状态与α波段(8-12 Hz)振荡过程的瞬态增加有关。通过改变外部驱动的强度,在耦合振荡器模型中再现了同步状态和传播状态。数据和模型表明,皮层网络在i)由外部刺激驱动的同步动态和ii)在没有外部刺激的情况下的长潜伏期传播动态之间转换。
{"title":"Synchronized and Propagating States of Human Auditory Processing","authors":"Joon-Young Moon, K. Müsch, C. Schroeder, C. Honey","doi":"10.32470/ccn.2019.1306-0","DOIUrl":"https://doi.org/10.32470/ccn.2019.1306-0","url":null,"abstract":"Human brain dynamics combine external drivers (e.g. sensory information) and internal drivers (e.g. expectations and memories). How do the patterns of inter-regional coupling change when the balance of external and internal information is altered? To investigate this question, we analyzed intracranial (ECoG) recordings from human listeners exposed to an auditory narrative. We measured the latencies of coupling across consecutive stages of cortical auditory processing and we investigated if and how the latencies varied as a function of stimulus drive. We found that the latencies along the auditory pathway vary between no delay (“synchronized state”) and a small, nonzero delay (~20 ms, “propagating state”) depending on the external stimulation. The long-latency propagating state was most often observed in the absence of external information, during the silent boundaries between sentences. Moreover, propagating states were associated with transient increases in alpha-band (8-12 Hz) oscillatory processes. Both synchronized and propagating states were reproduced in a coupled oscillator model by altering the strength of the external drive. The data and model suggest that cortical networks transition between i) synchronized dynamics driven by an external stimulus, and ii) long-latency propagating dynamics in the absence of an external stimulus.","PeriodicalId":281121,"journal":{"name":"2019 Conference on Cognitive Computational Neuroscience","volume":"32 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1900-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124200373","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
The orbitofrontal cortex as a negative feedback control system: computational modeling and fMRI 眼窝额叶皮层作为负反馈控制系统:计算模型和功能磁共振成像
Pub Date : 1900-01-01 DOI: 10.32470/ccn.2019.1070-0
N. Zarr, Joshua W. Brown
In this work we address two inter-related issues. First, the computational roles of the orbitofrontal cortex (OFC) and hippocampus in value-based decision-making have been unclear, with various proposed roles in value representation, cognitive maps, and prospection. Second, reinforcement learning models have been slow to adapt to more general problems in which the reward values of states may change over time, thus requiring different Q values for a given state at different times. We have developed a model of artificial general intelligence that treats much of the brain as a high dimensional control system in the framework of control theory. We show with computational modeling and combined fMRI and representational similarity analysis (RSA) that the model can autonomously learn to solve problems and provides a clear computational account of how a number of brain regions, particularly the OFC, interact to guide behavior to achieve arbitrary goals.
在这项工作中,我们解决了两个相互关联的问题。首先,眼窝前额皮质(OFC)和海马体在基于价值的决策中的计算作用尚不清楚,在价值表征、认知地图和前景方面有各种各样的作用。其次,强化学习模型在适应更普遍的问题时速度很慢,在这些问题中,状态的奖励值可能会随着时间的推移而变化,因此在不同的时间,给定的状态需要不同的Q值。我们已经开发了一个人工通用智能模型,在控制理论的框架下,将大脑的大部分视为一个高维控制系统。我们通过计算建模,结合fMRI和表征相似性分析(RSA)表明,该模型可以自主学习解决问题,并提供了一个清晰的计算说明,说明一些大脑区域,特别是OFC,如何相互作用,指导行为以实现任意目标。
{"title":"The orbitofrontal cortex as a negative feedback control system: computational modeling and fMRI","authors":"N. Zarr, Joshua W. Brown","doi":"10.32470/ccn.2019.1070-0","DOIUrl":"https://doi.org/10.32470/ccn.2019.1070-0","url":null,"abstract":"In this work we address two inter-related issues. First, the computational roles of the orbitofrontal cortex (OFC) and hippocampus in value-based decision-making have been unclear, with various proposed roles in value representation, cognitive maps, and prospection. Second, reinforcement learning models have been slow to adapt to more general problems in which the reward values of states may change over time, thus requiring different Q values for a given state at different times. We have developed a model of artificial general intelligence that treats much of the brain as a high dimensional control system in the framework of control theory. We show with computational modeling and combined fMRI and representational similarity analysis (RSA) that the model can autonomously learn to solve problems and provides a clear computational account of how a number of brain regions, particularly the OFC, interact to guide behavior to achieve arbitrary goals.","PeriodicalId":281121,"journal":{"name":"2019 Conference on Cognitive Computational Neuroscience","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1900-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125496322","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
2019 Conference on Cognitive Computational Neuroscience
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1