Alexandre Sayal;Ana Gabriela Guedes;Inês Almeida;Daniela Jardim Pereira;César F. Lima;Renato Panda;Rui Pedro Paiva;Teresa Sousa;Miguel Castelo-Branco;Inês Bernardino;Bruno Direito
{"title":"Decoding Musical Valence and Arousal: Exploring the Neural Correlates of Music-Evoked Emotions and the Role of Expressivity Features","authors":"Alexandre Sayal;Ana Gabriela Guedes;Inês Almeida;Daniela Jardim Pereira;César F. Lima;Renato Panda;Rui Pedro Paiva;Teresa Sousa;Miguel Castelo-Branco;Inês Bernardino;Bruno Direito","doi":"10.1109/TAFFC.2024.3507192","DOIUrl":null,"url":null,"abstract":"Music conveys both basic emotions, like joy and sadness, and complex ones, such as tenderness and nostalgia. Its effects on emotion regulation and reward have attracted much research attention, as the neural correlates of music-evoked emotions may inform neurorehabilitation interventions. Here, we used fMRI to decode and examine the neural correlates of perceived valence and arousal in music excerpts. Twenty participants were scanned while listening to 96 music excerpts, classified beforehand into four categories varying in valence and arousal. Music modulated activity in cortical regions, most noticeably in music-specific subregions of the auditory cortex, thalamus, and regions of the reward network such as the amygdala. Using multivoxel pattern analysis, we created a computational model to decode the perceived valence and arousal of the music excerpts with above-chance accuracy. We further explored associations between musical features and brain activity in valence-, arousal-, reward-, and auditory-related networks. The results emphasize the involvement of distinct musical features, notably expressive features such as vibrato and tonal and spectral dissonance in valence, arousal, and reward brain networks. Using ecologically valid music stimuli, we contribute to delineating the neural correlates of music-evoked emotions with potential implications in the development of novel music-based neurorehabilitation strategies.","PeriodicalId":13131,"journal":{"name":"IEEE Transactions on Affective Computing","volume":"16 2","pages":"1247-1259"},"PeriodicalIF":9.8000,"publicationDate":"2024-11-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Affective Computing","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/10768986/","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0
Abstract
Music conveys both basic emotions, like joy and sadness, and complex ones, such as tenderness and nostalgia. Its effects on emotion regulation and reward have attracted much research attention, as the neural correlates of music-evoked emotions may inform neurorehabilitation interventions. Here, we used fMRI to decode and examine the neural correlates of perceived valence and arousal in music excerpts. Twenty participants were scanned while listening to 96 music excerpts, classified beforehand into four categories varying in valence and arousal. Music modulated activity in cortical regions, most noticeably in music-specific subregions of the auditory cortex, thalamus, and regions of the reward network such as the amygdala. Using multivoxel pattern analysis, we created a computational model to decode the perceived valence and arousal of the music excerpts with above-chance accuracy. We further explored associations between musical features and brain activity in valence-, arousal-, reward-, and auditory-related networks. The results emphasize the involvement of distinct musical features, notably expressive features such as vibrato and tonal and spectral dissonance in valence, arousal, and reward brain networks. Using ecologically valid music stimuli, we contribute to delineating the neural correlates of music-evoked emotions with potential implications in the development of novel music-based neurorehabilitation strategies.
期刊介绍:
The IEEE Transactions on Affective Computing is an international and interdisciplinary journal. Its primary goal is to share research findings on the development of systems capable of recognizing, interpreting, and simulating human emotions and related affective phenomena. The journal publishes original research on the underlying principles and theories that explain how and why affective factors shape human-technology interactions. It also focuses on how techniques for sensing and simulating affect can enhance our understanding of human emotions and processes. Additionally, the journal explores the design, implementation, and evaluation of systems that prioritize the consideration of affect in their usability. We also welcome surveys of existing work that provide new perspectives on the historical and future directions of this field.