Analogy-Related Information Can Be Accessed by Simple Addition and Subtraction of fMRI Activation Patterns, Without Participants Performing any Analogy Task.

IF 3.6 Q1 LINGUISTICS Neurobiology of Language Pub Date : 2022-01-01 DOI:10.1162/nol_a_00045
Meng-Huan Wu, Andrew J Anderson, Robert A Jacobs, Rajeev D S Raizada
{"title":"Analogy-Related Information Can Be Accessed by Simple Addition and Subtraction of fMRI Activation Patterns, Without Participants Performing any Analogy Task.","authors":"Meng-Huan Wu,&nbsp;Andrew J Anderson,&nbsp;Robert A Jacobs,&nbsp;Rajeev D S Raizada","doi":"10.1162/nol_a_00045","DOIUrl":null,"url":null,"abstract":"<p><p>Analogical reasoning, for example, inferring that <i>teacher</i> is to <i>chalk</i> as <i>mechanic</i> is to <i>wrench</i>, plays a fundamental role in human cognition. However, whether brain activity patterns of individual words are encoded in a way that could facilitate analogical reasoning is unclear. Recent advances in computational linguistics have shown that information about analogical problems can be accessed by simple addition and subtraction of word embeddings (e.g., <i>wrench</i> = <i>mechanic</i> + <i>chalk</i> - <i>teacher</i>). Critically, this property emerges in artificial neural networks that were not trained to produce analogies but instead were trained to produce general-purpose semantic representations. Here, we test whether such emergent property can be observed in representations in human brains, as well as in artificial neural networks. fMRI activation patterns were recorded while participants viewed isolated words but did not perform analogical reasoning tasks. Analogy relations were constructed from word pairs that were categorically or thematically related, and we tested whether the predicted fMRI pattern calculated with simple arithmetic was more correlated with the pattern of the target word than other words. We observed that the predicted fMRI patterns contain information about not only the identity of the target word but also its category and theme (e.g., teaching-related). In summary, this study demonstrated that information about analogy questions can be reliably accessed with the addition and subtraction of fMRI patterns, and that, similar to word embeddings, this property holds for task-general patterns elicited when participants were not explicitly told to perform analogical reasoning.</p>","PeriodicalId":34845,"journal":{"name":"Neurobiology of Language","volume":null,"pages":null},"PeriodicalIF":3.6000,"publicationDate":"2022-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10158578/pdf/","citationCount":"3","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Neurobiology of Language","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1162/nol_a_00045","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"LINGUISTICS","Score":null,"Total":0}
引用次数: 3

Abstract

Analogical reasoning, for example, inferring that teacher is to chalk as mechanic is to wrench, plays a fundamental role in human cognition. However, whether brain activity patterns of individual words are encoded in a way that could facilitate analogical reasoning is unclear. Recent advances in computational linguistics have shown that information about analogical problems can be accessed by simple addition and subtraction of word embeddings (e.g., wrench = mechanic + chalk - teacher). Critically, this property emerges in artificial neural networks that were not trained to produce analogies but instead were trained to produce general-purpose semantic representations. Here, we test whether such emergent property can be observed in representations in human brains, as well as in artificial neural networks. fMRI activation patterns were recorded while participants viewed isolated words but did not perform analogical reasoning tasks. Analogy relations were constructed from word pairs that were categorically or thematically related, and we tested whether the predicted fMRI pattern calculated with simple arithmetic was more correlated with the pattern of the target word than other words. We observed that the predicted fMRI patterns contain information about not only the identity of the target word but also its category and theme (e.g., teaching-related). In summary, this study demonstrated that information about analogy questions can be reliably accessed with the addition and subtraction of fMRI patterns, and that, similar to word embeddings, this property holds for task-general patterns elicited when participants were not explicitly told to perform analogical reasoning.

查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
类比相关的信息可以通过fMRI激活模式的简单加法和减法来获取,而不需要参与者执行任何类比任务。
例如,类推推理,即教师之于粉笔,如同机械师之于扳手,在人类认知中起着基本作用。然而,单个单词的大脑活动模式是否以一种促进类比推理的方式进行编码尚不清楚。计算语言学的最新进展表明,关于类比问题的信息可以通过简单的词嵌入的加法和减法来获取(例如,扳手=机械师+粉笔-教师)。关键的是,这种特性出现在人工神经网络中,这些神经网络没有被训练来产生类比,而是被训练来产生通用的语义表示。在这里,我们测试这种涌现特性是否可以在人类大脑的表征中观察到,以及在人工神经网络中。当参与者观看孤立的单词但不执行类比推理任务时,fMRI的激活模式被记录下来。类比关系是由类别或主题相关的词对构建的,我们测试了用简单算法计算的预测fMRI模式是否比其他词更与目标词的模式相关。我们观察到,预测的fMRI模式不仅包含目标词的身份信息,还包含其类别和主题(例如,与教学相关)。总之,本研究表明,类比问题的信息可以通过fMRI模式的加法和减法可靠地获取,并且,类似于词嵌入,当参与者没有被明确告知进行类比推理时,这一特性适用于任务一般模式。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
Neurobiology of Language
Neurobiology of Language Social Sciences-Linguistics and Language
CiteScore
5.90
自引率
6.20%
发文量
32
审稿时长
17 weeks
期刊最新文献
The Domain-Specific Neural Basis of Auditory Statistical Learning in 5-7-Year-Old Children. A Comparison of Denoising Approaches for Spoken Word Production Related Artefacts in Continuous Multiband fMRI Data. Neural Mechanisms of Learning and Consolidation of Morphologically Derived Words in a Novel Language: Evidence From Hebrew Speakers. Cerebellar Atrophy and Language Processing in Chronic Left-Hemisphere Stroke. Cortico-Cerebellar Monitoring of Speech Sequence Production.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1