Temporal neural dynamics of understanding communicative intentions from speech prosody

IF 4.5 2区 医学 Q1 NEUROIMAGING NeuroImage Pub Date : 2024-09-06 DOI:10.1016/j.neuroimage.2024.120830
Panke Gao , Zhufang Jiang , Yufang Yang , Yuanyi Zheng , Gangyi Feng , Xiaoqing Li
{"title":"Temporal neural dynamics of understanding communicative intentions from speech prosody","authors":"Panke Gao ,&nbsp;Zhufang Jiang ,&nbsp;Yufang Yang ,&nbsp;Yuanyi Zheng ,&nbsp;Gangyi Feng ,&nbsp;Xiaoqing Li","doi":"10.1016/j.neuroimage.2024.120830","DOIUrl":null,"url":null,"abstract":"<div><p>Understanding the correct intention of a speaker is critical for social interaction. Speech prosody is an important source for understanding speakers' intentions during verbal communication. However, the neural dynamics by which the human brain translates the prosodic cues into a mental representation of communicative intentions in real time remains unclear. Here, we recorded EEG (electroencephalograph) while participants listened to dialogues. The prosodic features of the critical words at the end of sentences were manipulated to signal either <em>suggestion, warning</em>, or <em>neutral</em> intentions. The results showed that suggestion and warning intentions evoked enhanced late positive event-related potentials (ERPs) compared to the neutral condition. Linear mixed-effects model (LMEM) regression and representational similarity analysis (RSA) analyses revealed that these ERP effects were distinctively correlated with prosodic acoustic analysis, emotional valence evaluation, and intention interpretation in different time windows; The onset latency significantly increased as the processing level of abstractness and communicative intentionality increased. Neural representations of intention and emotional information emerged and parallelly persisted over a long time window, guiding the correct identification of communicative intention. These results provide new insights into understanding the structural components of intention processing and their temporal neural dynamics underlying communicative intention comprehension from speech prosody in online social interactions.</p></div>","PeriodicalId":19299,"journal":{"name":"NeuroImage","volume":"299 ","pages":"Article 120830"},"PeriodicalIF":4.5000,"publicationDate":"2024-09-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S1053811924003276/pdfft?md5=3a2be359d2b2a925eb22e28d4fb95e9e&pid=1-s2.0-S1053811924003276-main.pdf","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"NeuroImage","FirstCategoryId":"3","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1053811924003276","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"NEUROIMAGING","Score":null,"Total":0}
引用次数: 0

Abstract

Understanding the correct intention of a speaker is critical for social interaction. Speech prosody is an important source for understanding speakers' intentions during verbal communication. However, the neural dynamics by which the human brain translates the prosodic cues into a mental representation of communicative intentions in real time remains unclear. Here, we recorded EEG (electroencephalograph) while participants listened to dialogues. The prosodic features of the critical words at the end of sentences were manipulated to signal either suggestion, warning, or neutral intentions. The results showed that suggestion and warning intentions evoked enhanced late positive event-related potentials (ERPs) compared to the neutral condition. Linear mixed-effects model (LMEM) regression and representational similarity analysis (RSA) analyses revealed that these ERP effects were distinctively correlated with prosodic acoustic analysis, emotional valence evaluation, and intention interpretation in different time windows; The onset latency significantly increased as the processing level of abstractness and communicative intentionality increased. Neural representations of intention and emotional information emerged and parallelly persisted over a long time window, guiding the correct identification of communicative intention. These results provide new insights into understanding the structural components of intention processing and their temporal neural dynamics underlying communicative intention comprehension from speech prosody in online social interactions.

查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
从语音前奏理解交际意图的时空神经动态。
理解说话者的正确意图对于社会交往至关重要。在语言交流中,语音前奏是理解说话者意图的一个重要来源。然而,人脑将前音线索实时转化为交际意图的心理表征的神经动态仍不清楚。在这里,我们记录了参与者聆听对话时的脑电图(EEG)。我们对句末关键词语的前音特征进行了处理,使其成为暗示、警告或中性意图的信号。结果表明,与中性条件相比,暗示和警告意图唤起的晚期正事件相关电位(ERPs)增强。线性混合效应模型(LMEM)回归和表征相似性分析(RSA)显示,这些ERP效应与不同时间窗口中的前音分析、情绪价值评估和意图解释明显相关;随着抽象性和交流意图性处理水平的提高,起始潜伏期显著增加。意向和情感信息的神经表征出现了,并在较长的时间窗口内平行持续,从而引导了对交际意向的正确识别。这些结果为理解在线社交互动中通过语音前奏理解交际意图所依赖的意图加工结构成分及其时间神经动态提供了新的视角。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
NeuroImage
NeuroImage 医学-核医学
CiteScore
11.30
自引率
10.50%
发文量
809
审稿时长
63 days
期刊介绍: NeuroImage, a Journal of Brain Function provides a vehicle for communicating important advances in acquiring, analyzing, and modelling neuroimaging data and in applying these techniques to the study of structure-function and brain-behavior relationships. Though the emphasis is on the macroscopic level of human brain organization, meso-and microscopic neuroimaging across all species will be considered if informative for understanding the aforementioned relationships.
期刊最新文献
Multimodal MRI data fusion reveals distinct structural, functional and neurochemical correlates of depression in patients with Parkinson's disease. A nap can recalibrate homeostatic and associative synaptic plasticity in the human cortex. Virtual body ownership affects the processing of sensorimotor contingencies and goal-oriented information extraction, but not semantics. Localization of the Berger effect in human posterior brain regions with simultaneous electroencephalogram (EEG) and stereo-EEG (SEEG) recordings. Intrinsic divergence, repeatability, and distributional fingerprints of VFA, ME-SE, MDME, and MRF: a comparative evaluation of quantitative T1/T2 relaxometry in phantom and human brain at 3 T.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1