Repeatedly experiencing the McGurk effect induces long-lasting changes in auditory speech perception

John F. Magnotti, Anastasia Lado, Yue Zhang, Arnt Maasø, Audrey Nath, Michael S. Beauchamp
{"title":"Repeatedly experiencing the McGurk effect induces long-lasting changes in auditory speech perception","authors":"John F. Magnotti, Anastasia Lado, Yue Zhang, Arnt Maasø, Audrey Nath, Michael S. Beauchamp","doi":"10.1038/s44271-024-00073-w","DOIUrl":null,"url":null,"abstract":"In the McGurk effect, presentation of incongruent auditory and visual speech evokes a fusion percept different than either component modality. We show that repeatedly experiencing the McGurk effect for 14 days induces a change in auditory-only speech perception: the auditory component of the McGurk stimulus begins to evoke the fusion percept, even when presented on its own without accompanying visual speech. This perceptual change, termed fusion-induced recalibration (FIR), was talker-specific and syllable-specific and persisted for a year or more in some participants without any additional McGurk exposure. Participants who did not experience the McGurk effect did not experience FIR, showing that recalibration was driven by multisensory prediction error. A causal inference model of speech perception incorporating multisensory cue conflict accurately predicted individual differences in FIR. Just as the McGurk effect demonstrates that visual speech can alter the perception of auditory speech, FIR shows that these alterations can persist for months or years. The ability to induce seemingly permanent changes in auditory speech perception will be useful for studying plasticity in brain networks for language and may provide new strategies for improving language learning. In the McGurk effect, seeing the talker’s face changes perception of auditory speech. Repeatedly experiencing the effect produces long-lasting changes in auditory perception, so that the McGurk fusion percept is evoked even without seeing the face.","PeriodicalId":501698,"journal":{"name":"Communications Psychology","volume":" ","pages":"1-10"},"PeriodicalIF":0.0000,"publicationDate":"2024-04-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.nature.com/articles/s44271-024-00073-w.pdf","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Communications Psychology","FirstCategoryId":"1085","ListUrlMain":"https://www.nature.com/articles/s44271-024-00073-w","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

In the McGurk effect, presentation of incongruent auditory and visual speech evokes a fusion percept different than either component modality. We show that repeatedly experiencing the McGurk effect for 14 days induces a change in auditory-only speech perception: the auditory component of the McGurk stimulus begins to evoke the fusion percept, even when presented on its own without accompanying visual speech. This perceptual change, termed fusion-induced recalibration (FIR), was talker-specific and syllable-specific and persisted for a year or more in some participants without any additional McGurk exposure. Participants who did not experience the McGurk effect did not experience FIR, showing that recalibration was driven by multisensory prediction error. A causal inference model of speech perception incorporating multisensory cue conflict accurately predicted individual differences in FIR. Just as the McGurk effect demonstrates that visual speech can alter the perception of auditory speech, FIR shows that these alterations can persist for months or years. The ability to induce seemingly permanent changes in auditory speech perception will be useful for studying plasticity in brain networks for language and may provide new strategies for improving language learning. In the McGurk effect, seeing the talker’s face changes perception of auditory speech. Repeatedly experiencing the effect produces long-lasting changes in auditory perception, so that the McGurk fusion percept is evoked even without seeing the face.

Abstract Image

查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
反复体验麦格克效应会诱发听觉言语感知的持久变化
在麦格克效应中,呈现不一致的听觉和视觉语言会唤起不同于任何一种模式的融合感知。我们的研究表明,连续 14 天反复体验麦格克效应会诱发纯听觉言语感知的变化:麦格克刺激的听觉成分开始唤起融合感知,即使是在没有视觉言语伴随的情况下单独呈现时也是如此。这种感知变化被称为融合诱导的重新校准(FIR),针对特定的说话者和特定的音节,在一些参与者身上持续一年或更长时间,而无需额外的麦格克暴露。没有经历过麦格克效应的参与者也没有经历过 FIR,这表明重新校准是由多感官预测错误驱动的。包含多感官线索冲突的语音感知因果推理模型可以准确预测 FIR 的个体差异。正如麦格克效应表明视觉语言可以改变听觉语言的感知一样,FIR 表明这些改变可以持续数月或数年。诱导听觉言语感知发生看似永久性变化的能力将有助于研究大脑语言网络的可塑性,并可能为改善语言学习提供新的策略。在麦格克效应中,看到说话者的脸会改变对听觉语言的感知。反复体验这种效应会使听觉知觉产生持久的变化,因此即使没有看到说话者的脸,也会唤起麦格克融合知觉。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
自引率
0.00%
发文量
0
期刊最新文献
A dissociation between the use of implicit and explicit priors in perceptual inference. Adaptive empathic response selection is sensitive to multiple dimensions of social interaction. Parent-child relationship quality predicts higher subjective well-being in adulthood across a diverse group of countries Sensory stimulation enhances visual working memory capacity Psychoacoustic and Archeoacoustic nature of ancient Aztec skull whistles
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1