Neural Generative Models and the Parallel Architecture of Language: A Critical Review and Outlook

IF 2.9 2区 心理学 Q1 PSYCHOLOGY, EXPERIMENTAL Topics in Cognitive Science Pub Date : 2024-04-18 DOI:10.1111/tops.12733
Giulia Rambelli, Emmanuele Chersoni, Davide Testa, Philippe Blache, Alessandro Lenci
{"title":"Neural Generative Models and the Parallel Architecture of Language: A Critical Review and Outlook","authors":"Giulia Rambelli, Emmanuele Chersoni, Davide Testa, Philippe Blache, Alessandro Lenci","doi":"10.1111/tops.12733","DOIUrl":null,"url":null,"abstract":"According to the parallel architecture, syntactic and semantic information processing are two separate streams that interact selectively during language comprehension. While considerable effort is put into psycho‐ and neurolinguistics to understand the interchange of processing mechanisms in human comprehension, the nature of this interaction in recent neural Large Language Models remains elusive. In this article, we revisit influential linguistic and behavioral experiments and evaluate the ability of a large language model, GPT‐3, to perform these tasks. The model can solve semantic tasks autonomously from syntactic realization in a manner that resembles human behavior. However, the outcomes present a complex and variegated picture, leaving open the question of how Language Models could learn structured conceptual representations.","PeriodicalId":47822,"journal":{"name":"Topics in Cognitive Science","volume":"11 1","pages":""},"PeriodicalIF":2.9000,"publicationDate":"2024-04-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Topics in Cognitive Science","FirstCategoryId":"102","ListUrlMain":"https://doi.org/10.1111/tops.12733","RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"PSYCHOLOGY, EXPERIMENTAL","Score":null,"Total":0}
引用次数: 0

Abstract

According to the parallel architecture, syntactic and semantic information processing are two separate streams that interact selectively during language comprehension. While considerable effort is put into psycho‐ and neurolinguistics to understand the interchange of processing mechanisms in human comprehension, the nature of this interaction in recent neural Large Language Models remains elusive. In this article, we revisit influential linguistic and behavioral experiments and evaluate the ability of a large language model, GPT‐3, to perform these tasks. The model can solve semantic tasks autonomously from syntactic realization in a manner that resembles human behavior. However, the outcomes present a complex and variegated picture, leaving open the question of how Language Models could learn structured conceptual representations.
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
神经生成模型与语言的并行结构:批判性评论与展望
根据并行结构,句法和语义信息处理是两个独立的信息流,在语言理解过程中有选择地相互作用。虽然心理语言学和神经语言学投入了大量精力来理解人类理解过程中处理机制的相互影响,但在最近的神经大语言模型中,这种相互作用的性质仍然难以捉摸。在本文中,我们重温了有影响力的语言学和行为学实验,并评估了大型语言模型 GPT-3 执行这些任务的能力。该模型能以类似人类行为的方式自主解决语义任务和句法实现问题。然而,实验结果却呈现出复杂多变的局面,这也为语言模型如何学习结构化概念表征留下了悬念。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
Topics in Cognitive Science
Topics in Cognitive Science PSYCHOLOGY, EXPERIMENTAL-
CiteScore
8.50
自引率
10.00%
发文量
52
期刊介绍: Topics in Cognitive Science (topiCS) is an innovative new journal that covers all areas of cognitive science including cognitive modeling, cognitive neuroscience, cognitive anthropology, and cognitive science and philosophy. topiCS aims to provide a forum for: -New communities of researchers- New controversies in established areas- Debates and commentaries- Reflections and integration The publication features multiple scholarly papers dedicated to a single topic. Some of these topics will appear together in one issue, but others may appear across several issues or develop into a regular feature. Controversies or debates started in one issue may be followed up by commentaries in a later issue, etc. However, the format and origin of the topics will vary greatly.
期刊最新文献
Language Production and Prediction in a Parallel Activation Model. Homesign Research, Gesture Studies, and Sign Language Linguistics: The Bigger Picture of Homesign and Homesigners. Simultaneous Hypotheses in Cognitive Agents: Commentary on Paxton, Necaise et al., and the Dynamical Hypothesis in Cognitive Science. Measuring Beyond the Standard: Informal Measurement Systems as Cognitive Technologies. Modality Matters: Evidence for the Benefits of Speech-Based Adaptive Retrieval Practice in Learners with Dyslexia.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1