With multichannel sound rendering systems, an immersive sound can be experienced by a broader audience. Rendering of a stationary source is widely studied in the literature. However, a dynamic sound, where the source’s position is continuously changing, provides improved source localization and a listener experience more immersed in the rendered sound. This paper investigates the multichannel sound rendering of a dynamic sound source using a wave field synthesis method in a reverberant shoe-box room model. Finite difference time domain is employed to visualize the reproduced sound field in the time domain. To address the challenge of room echo-induced degradation in sound quality, a method is presented in which the reflected sound is compensated by rendering the primary source’s images from the auxiliary actuators, enhancing SNR by approximately 2–3.5 dB.
{"title":"Multichannel Dynamic Sound Rendering and Echo Suppression in a Room Using Wave Field Synthesis","authors":"Akash Kumar, Amrita Puri","doi":"10.17743/jaes.2022.0149","DOIUrl":"https://doi.org/10.17743/jaes.2022.0149","url":null,"abstract":"With multichannel sound rendering systems, an immersive sound can be experienced by a broader audience. Rendering of a stationary source is widely studied in the literature. However, a dynamic sound, where the source’s position is continuously changing, provides improved source localization and a listener experience more immersed in the rendered sound. This paper investigates the multichannel sound rendering of a dynamic sound source using a wave field synthesis method in a reverberant shoe-box room model. Finite difference time domain is employed to visualize the reproduced sound field in the time domain. To address the challenge of room echo-induced degradation in sound quality, a method is presented in which the reflected sound is compensated by rendering the primary source’s images from the auxiliary actuators, enhancing SNR by approximately 2–3.5 dB.","PeriodicalId":50008,"journal":{"name":"Journal of the Audio Engineering Society","volume":null,"pages":null},"PeriodicalIF":1.4,"publicationDate":"2024-05-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141016299","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
The large ecosystem of observations generated by major space telescope missions can be remotely analyzed using interoperable virtual observatory technologies. In this context of astronomical big data analysis, sonification has the potential of adding a complementary dimension to visualization, enhancing the accessibility of the archives, and offering an alternative strategy to be used when overlapping issues are found in purely graphical representations. This article presents a collection of sonification and musification prototypes that explore the case studies of the MILES and STELIB stellar libraries from the Spanish Virtual Observatory and the Kepler and TESS light curve databases from the Space Telescope Science Institute archive. Using automation and deep learning algorithms, it offers a “palette” of resources that could be used in future developments oriented toward an auditory virtual observatory proposal. The work includes a user study with quantitative and qualitative feedback from specialized and nonspecialized users analyzing the use of sine waves and musical instrument mappings for revealing overlapped lines in galaxy transmission spectra, confirming the need for training and prior knowledge for the correct interpretation of accurate sonifications, and providing potential guidelines to inspire future designs of widely accepted auditory representations for outreach purposes.
{"title":"Toward an Auditory Virtual Observatory","authors":"Adrián García Riber, Francisco Serradilla","doi":"10.17743/jaes.2022.0146","DOIUrl":"https://doi.org/10.17743/jaes.2022.0146","url":null,"abstract":"The large ecosystem of observations generated by major space telescope missions can be remotely analyzed using interoperable virtual observatory technologies. In this context of astronomical big data analysis, sonification has the potential of adding a complementary dimension to visualization, enhancing the accessibility of the archives, and offering an alternative strategy to be used when overlapping issues are found in purely graphical representations. This article presents a collection of sonification and musification prototypes that explore the case studies of the MILES and STELIB stellar libraries from the Spanish Virtual Observatory and the Kepler and TESS light curve databases from the Space Telescope Science Institute archive. Using automation and deep learning algorithms, it offers a “palette” of resources that could be used in future developments oriented toward an auditory virtual observatory proposal. The work includes a user study with quantitative and qualitative feedback from specialized and nonspecialized users analyzing the use of sine waves and musical instrument mappings for revealing overlapped lines in galaxy transmission spectra, confirming the need for training and prior knowledge for the correct interpretation of accurate sonifications, and providing potential guidelines to inspire future designs of widely accepted auditory representations for outreach purposes.","PeriodicalId":50008,"journal":{"name":"Journal of the Audio Engineering Society","volume":null,"pages":null},"PeriodicalIF":1.4,"publicationDate":"2024-05-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141017125","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Sonification and sonic interaction design aim to create meaningful displays and digital interactions using data and information from the most disparate fields (astronomy, finance, health, and security, for example) as the basis of the design. To date, there are no standards and conventions on how to meaningfully link data to sound; therefore, designers develop these connections on a case-by-case basis. Participatory workshops that target end users and domain experts are a way for sound designers to find meaningful connections between data and sounds at the start of the design process so that final outcomes are more likely to be effective and accepted by users. In this paper, the authors present and discuss the participatory workshop methods they have developed within the Sound for Energy project. In particular, they will highlight the aspects that can be easily transferable to other target domains. With this, the authors contribute to the effort of making sonification and sonic interaction design a more viable and accepted alternative to traditional, usually visual, displays.
{"title":"Connecting Sound to Data: Sonification Workshop Methods With Expert and Non-Expert Participants","authors":"Sandra Pauletto, Yann Seznec","doi":"10.17743/jaes.2022.0143","DOIUrl":"https://doi.org/10.17743/jaes.2022.0143","url":null,"abstract":"Sonification and sonic interaction design aim to create meaningful displays and digital interactions using data and information from the most disparate fields (astronomy, finance, health, and security, for example) as the basis of the design. To date, there are no standards and conventions on how to meaningfully link data to sound; therefore, designers develop these connections on a case-by-case basis. Participatory workshops that target end users and domain experts are a way for sound designers to find meaningful connections between data and sounds at the start of the design process so that final outcomes are more likely to be effective and accepted by users. In this paper, the authors present and discuss the participatory workshop methods they have developed within the Sound for Energy project. In particular, they will highlight the aspects that can be easily transferable to other target domains. With this, the authors contribute to the effort of making sonification and sonic interaction design a more viable and accepted alternative to traditional, usually visual, displays.","PeriodicalId":50008,"journal":{"name":"Journal of the Audio Engineering Society","volume":null,"pages":null},"PeriodicalIF":1.4,"publicationDate":"2024-05-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141015905","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
In this article, data relating to Hawaii’s 2019 coral bleaching are auditorily displayed using parameter mapping sonification and ambisonics. Although primarily an explorative endeavor, this undertaking is conceptually rooted in ecological sound art and neutrally positioned on an established Cartesian framework known as Aesthetic Perspective Space. Through iterative design, different versions are implemented using sound surrogates of coral reefs’ natural soundscapes derived from either (a) real undersea recordings of reef environments or (b) modeling via means of sound synthesis. These audio surrogates correspond to data clusters aggregated by geographical location and, after being represented as sound sources on an ambisonic sphere, all contribute to a final sonic environment in which each cluster is progressively altered as the corresponding coral location undergoes bleaching. To assess both the perceived aesthetic placement of these experiments and their potential for public engagement in the discourse around climate change, evaluation studies are carried out. Results align with the aesthetic goals of the author, while consecutive versions manage to improve on critical fronts relating to climate awareness, providing further motivation toward more immersive implementations in future editions to come.
{"title":"Spatial Audio and Parameter Mapping Experiments for the Auditory Display of Coral Bleaching Data","authors":"Stefano Kalonaris","doi":"10.17743/jaes.2022.0131","DOIUrl":"https://doi.org/10.17743/jaes.2022.0131","url":null,"abstract":"In this article, data relating to Hawaii’s 2019 coral bleaching are auditorily displayed using parameter mapping sonification and ambisonics. Although primarily an explorative endeavor, this undertaking is conceptually rooted in ecological sound art and neutrally positioned on an established Cartesian framework known as Aesthetic Perspective Space. Through iterative design, different versions are implemented using sound surrogates of coral reefs’ natural soundscapes derived from either (a) real undersea recordings of reef environments or (b) modeling via means of sound synthesis. These audio surrogates correspond to data clusters aggregated by geographical location and, after being represented as sound sources on an ambisonic sphere, all contribute to a final sonic environment in which each cluster is progressively altered as the corresponding coral location undergoes bleaching. To assess both the perceived aesthetic placement of these experiments and their potential for public engagement in the discourse around climate change, evaluation studies are carried out. Results align with the aesthetic goals of the author, while consecutive versions manage to improve on critical fronts relating to climate awareness, providing further motivation toward more immersive implementations in future editions to come.","PeriodicalId":50008,"journal":{"name":"Journal of the Audio Engineering Society","volume":null,"pages":null},"PeriodicalIF":1.4,"publicationDate":"2024-05-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141016428","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Toward a Standard Listener-Independent HRTF to Facilitate Long-Term Adaptation","authors":"Pedro Lladó, Katharina Pollack, Nils Meyer-Kahlen","doi":"10.17743/jaes.2022.0134","DOIUrl":"https://doi.org/10.17743/jaes.2022.0134","url":null,"abstract":"","PeriodicalId":50008,"journal":{"name":"Journal of the Audio Engineering Society","volume":null,"pages":null},"PeriodicalIF":1.4,"publicationDate":"2024-04-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140723823","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Spatial Matrix synthesis is presented in this paper. This modulation synthesis technique creates acoustic velocity fields from acoustic pressure signals by using spatial transformation matrices, thus generating complete sound fields for spatial audio. The analysis presented here focuses on orthogonal rotation matrices in both two and three dimensions and compares the results in each scenario with other sound modulation synthesis methods, including amplitude and frequency modulation. As an alternative method for spatial sound synthesis that exclusively modifies the acoustic velocity vector through effects comparable to those created by both amplitude and frequency modulations, Spatial Matrix synthesis is argued to generate inherently spatial sounds, giving this method the potential to become a new musical instrument for spatial music.
{"title":"Spatial Matrix Synthesis","authors":"Timothy Schmele, Adan Garriga","doi":"10.17743/jaes.2022.0130","DOIUrl":"https://doi.org/10.17743/jaes.2022.0130","url":null,"abstract":"Spatial Matrix synthesis is presented in this paper. This modulation synthesis technique creates acoustic velocity fields from acoustic pressure signals by using spatial transformation matrices, thus generating complete sound fields for spatial audio. The analysis presented here focuses on orthogonal rotation matrices in both two and three dimensions and compares the results in each scenario with other sound modulation synthesis methods, including amplitude and frequency modulation. As an alternative method for spatial sound synthesis that exclusively modifies the acoustic velocity vector through effects comparable to those created by both amplitude and frequency modulations, Spatial Matrix synthesis is argued to generate inherently spatial sounds, giving this method the potential to become a new musical instrument for spatial music.","PeriodicalId":50008,"journal":{"name":"Journal of the Audio Engineering Society","volume":null,"pages":null},"PeriodicalIF":1.4,"publicationDate":"2024-04-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140723759","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"A System for Sonic Explorations With Evolutionary Algorithms","authors":"Björn Þór Jónsson, Çağrı Erdem, K. Glette","doi":"10.17743/jaes.2022.0137","DOIUrl":"https://doi.org/10.17743/jaes.2022.0137","url":null,"abstract":"","PeriodicalId":50008,"journal":{"name":"Journal of the Audio Engineering Society","volume":null,"pages":null},"PeriodicalIF":1.4,"publicationDate":"2024-04-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140727041","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Feedforward Headphone Active Noise Control Utilizing Auditory Masking","authors":"P. Zachos, Gavriil Kamaris, J. Mourjopoulos","doi":"10.17743/jaes.2022.0135","DOIUrl":"https://doi.org/10.17743/jaes.2022.0135","url":null,"abstract":"","PeriodicalId":50008,"journal":{"name":"Journal of the Audio Engineering Society","volume":null,"pages":null},"PeriodicalIF":1.4,"publicationDate":"2024-04-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140727084","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Conggan Ma, Yuansheng An, Ende Shen, Donglei Yu, Jiayue Zhang
{"title":"Car Interior Sound Field Zoning Using Optimal Loudspeaker Array and Double Iteration Method","authors":"Conggan Ma, Yuansheng An, Ende Shen, Donglei Yu, Jiayue Zhang","doi":"10.17743/jaes.2022.0127","DOIUrl":"https://doi.org/10.17743/jaes.2022.0127","url":null,"abstract":"","PeriodicalId":50008,"journal":{"name":"Journal of the Audio Engineering Society","volume":null,"pages":null},"PeriodicalIF":1.4,"publicationDate":"2024-04-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140724625","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
The Shepard-tone sequence and Shepard–Risset glissando are classic auditory illusions in which pitch seems to inexhaustibly ascend or descend. Such stimuli have been used in scientific research, as well as for artistic purposes. This paper demonstrates several variations of those illusions, some of which do not appear to have been previously discussed in the literature. Most notably, hybrids of the two illusions are demonstrated, in which discrete Shepard-tone steps are connected by continuous glissandi. It is shown, using a sample of 91 listeners, that such hybrids can disambiguate the perceived direction of motion between two Shepard tones that are a tritone apart, thus overriding what has been called the tritone paradox . In other demonstrations, multiple layers of monaural and binaural beats are embedded into a Shepard– Risset glissando to produce Risset rhythms . Audio files for these and other examples are provided and discussed. Two original MATLAB functions (and equivalent functions in R) are also provided, which can be used to replicate the examples and explore additional variations.
谢帕德音序和谢帕德-里赛特滑音是典型的听觉幻觉，在这些幻觉中，音高似乎在不停地上升或下降。这种刺激曾被用于科学研究和艺术创作。本文展示了这些幻觉的几种变体，其中一些在以前的文献中似乎没有讨论过。最值得注意的是，本文展示了这两种幻觉的混合体，其中离散的谢帕德音阶由连续的滑音连接。通过对 91 名听者的抽样调查表明，这种混合幻觉可以分辨出相差三度音的两个谢泼德音之间的运动方向，从而克服了所谓的三度音悖论。在其他演示中，多层单声道和双声道节拍被嵌入到谢帕德-里赛特滑音中，以产生里赛特节奏。我们提供并讨论了这些例子和其他例子的音频文件。此外，还提供了两个原始 MATLAB 函数（以及 R 中的等效函数），可用于复制示例和探索其他变化。
{"title":"\"Revitalizing Classic Illusions: Shepard-Tone Sequences and Shepard–Risset Glissandi, With Various Modifications\"","authors":"Andrew V. Frane","doi":"10.17743/jaes.2022.0132","DOIUrl":"https://doi.org/10.17743/jaes.2022.0132","url":null,"abstract":"The Shepard-tone sequence and Shepard–Risset glissando are classic auditory illusions in which pitch seems to inexhaustibly ascend or descend. Such stimuli have been used in scientific research, as well as for artistic purposes. This paper demonstrates several variations of those illusions, some of which do not appear to have been previously discussed in the literature. Most notably, hybrids of the two illusions are demonstrated, in which discrete Shepard-tone steps are connected by continuous glissandi. It is shown, using a sample of 91 listeners, that such hybrids can disambiguate the perceived direction of motion between two Shepard tones that are a tritone apart, thus overriding what has been called the tritone paradox . In other demonstrations, multiple layers of monaural and binaural beats are embedded into a Shepard– Risset glissando to produce Risset rhythms . Audio files for these and other examples are provided and discussed. Two original MATLAB functions (and equivalent functions in R) are also provided, which can be used to replicate the examples and explore additional variations.","PeriodicalId":50008,"journal":{"name":"Journal of the Audio Engineering Society","volume":null,"pages":null},"PeriodicalIF":1.4,"publicationDate":"2024-04-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140724841","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
京公网安备 11010802042870号
京ICP备2023020795号-1
扫码关注我们
求助内容：
应助结果提醒方式：