Does Timbre Modulate Visual Perception? Exploring Crossmodal Interactions

IF 1.3 2区 心理学 0 MUSIC Music Perception Pub Date : 2021-09-01 DOI:10.1525/mp.2021.39.1.1
Zachary Wallmark, L. Nghiem, L. Marks
{"title":"Does Timbre Modulate Visual Perception? Exploring Crossmodal Interactions","authors":"Zachary Wallmark, L. Nghiem, L. Marks","doi":"10.1525/mp.2021.39.1.1","DOIUrl":null,"url":null,"abstract":"Musical timbre is often described using terms from non-auditory senses, mainly vision and touch; but it is not clear whether crossmodality in timbre semantics reflects multisensory processing or simply linguistic convention. If multisensory processing is involved in timbre perception, the mechanism governing the interaction remains unknown. To investigate whether timbres commonly perceived as “bright-dark” facilitate or interfere with visual perception (darkness-brightness), we designed two speeded classification experiments. Participants were presented consecutive images of slightly varying (or the same) brightness along with task-irrelevant auditory primes (“bright” or “dark” tones) and asked to quickly identify whether the second image was brighter/darker than the first. Incongruent prime-stimulus combinations produced significantly more response errors compared to congruent combinations but choice reaction time was unaffected. Furthermore, responses in a deceptive identical-image condition indicated subtle semantically congruent response bias. Additionally, in Experiment 2 (which also incorporated a spatial texture task), measures of reaction time (RT) and accuracy were used to construct speed-accuracy tradeoff functions (SATFs) in order to critically compare two hypothesized mechanisms for timbre-based crossmodal interactions, sensory response change vs. shift in response criterion. Results of the SATF analysis are largely consistent with the response criterion hypothesis, although without conclusively ruling out sensory change.","PeriodicalId":47786,"journal":{"name":"Music Perception","volume":" ","pages":""},"PeriodicalIF":1.3000,"publicationDate":"2021-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"7","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Music Perception","FirstCategoryId":"102","ListUrlMain":"https://doi.org/10.1525/mp.2021.39.1.1","RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"0","JCRName":"MUSIC","Score":null,"Total":0}
引用次数: 7

Abstract

Musical timbre is often described using terms from non-auditory senses, mainly vision and touch; but it is not clear whether crossmodality in timbre semantics reflects multisensory processing or simply linguistic convention. If multisensory processing is involved in timbre perception, the mechanism governing the interaction remains unknown. To investigate whether timbres commonly perceived as “bright-dark” facilitate or interfere with visual perception (darkness-brightness), we designed two speeded classification experiments. Participants were presented consecutive images of slightly varying (or the same) brightness along with task-irrelevant auditory primes (“bright” or “dark” tones) and asked to quickly identify whether the second image was brighter/darker than the first. Incongruent prime-stimulus combinations produced significantly more response errors compared to congruent combinations but choice reaction time was unaffected. Furthermore, responses in a deceptive identical-image condition indicated subtle semantically congruent response bias. Additionally, in Experiment 2 (which also incorporated a spatial texture task), measures of reaction time (RT) and accuracy were used to construct speed-accuracy tradeoff functions (SATFs) in order to critically compare two hypothesized mechanisms for timbre-based crossmodal interactions, sensory response change vs. shift in response criterion. Results of the SATF analysis are largely consistent with the response criterion hypothesis, although without conclusively ruling out sensory change.
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
音色调节视觉知觉吗?探索跨模态相互作用
音乐音色通常用非听觉感官来描述,主要是视觉和触觉;但尚不清楚音色语义中的交叉模态是多感官加工的结果还是单纯的语言约定。如果多感官加工参与了音色感知,那么控制这种相互作用的机制仍然未知。为了研究通常被认为是“明暗”的音色是否促进或干扰视觉感知(暗-明),我们设计了两个快速分类实验。研究人员向参与者展示了亮度略有不同(或相同)的连续图像,以及与任务无关的听觉启动(“明亮”或“黑暗”色调),并要求他们快速识别第二张图像是否比第一张图像更亮/更暗。不一致启动刺激组合比一致启动刺激组合产生更多的反应误差,但选择反应时间不受影响。此外,在欺骗性相同图像条件下的反应显示出微妙的语义一致反应偏差。此外,在实验2(也包含空间纹理任务)中,使用反应时间(RT)和准确性的测量来构建速度-准确性权衡函数(SATFs),以便批判性地比较基于音色的跨模态相互作用的两种假设机制,即感觉反应变化与反应标准的转移。SATF分析的结果在很大程度上与反应标准假设一致,尽管没有最终排除感觉变化。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
Music Perception
Music Perception Multiple-
CiteScore
3.70
自引率
4.30%
发文量
22
期刊介绍: Music Perception charts the ongoing scholarly discussion and study of musical phenomena. Publishing original empirical and theoretical papers, methodological articles and critical reviews from renowned scientists and musicians, Music Perception is a repository of insightful research. The broad range of disciplines covered in the journal includes: •Psychology •Psychophysics •Linguistics •Neurology •Neurophysiology •Artificial intelligence •Computer technology •Physical and architectural acoustics •Music theory
期刊最新文献
The Perceptual and Emotional Consequences of Articulation in Music Cognitive Mechanisms in Temporally Controlled Rhythm Reading No Heightened Musical Pitch Weighting For Tone Language Speakers in Early Childhood Timbre Semantic Associations Vary Both Between and Within Instruments The Whole is Not Different From its Parts
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1