超人类 Ansambl - 超越语言的声音

Lucija Ivsic, Jon McCormack, Vince Dziekan
{"title":"超人类 Ansambl - 超越语言的声音","authors":"Lucija Ivsic, Jon McCormack, Vince Dziekan","doi":"arxiv-2405.03134","DOIUrl":null,"url":null,"abstract":"In this paper we present the design and development of the Transhuman\nAnsambl, a novel interactive singing-voice interface which senses its\nenvironment and responds to vocal input with vocalisations using human voice.\nDesigned for live performance with a human performer and as a standalone sound\ninstallation, the ansambl consists of sixteen bespoke virtual singers arranged\nin a circle. When performing live, the virtual singers listen to the human\nperformer and respond to their singing by reading pitch, intonation and volume\ncues. In a standalone sound installation mode, singers use ultrasonic distance\nsensors to sense audience presence. Developed as part of the 1st author's\npractice-based PhD and artistic practice as a live performer, this work employs\nthe singing-voice to explore voice interactions in HCI beyond language, and\ninnovative ways of live performing. How is technology supporting the effect of\nintimacy produced through voice? Does the act of surrounding the audience with\nresponsive virtual singers challenge the traditional roles of\nperformer-listener? To answer these questions, we draw upon the 1st author's\nexperience with the system, and the interdisciplinary field of voice studies\nthat consider the voice as the sound medium independent of language, capable of\nenacting a reciprocal connection between bodies.","PeriodicalId":501178,"journal":{"name":"arXiv - CS - Sound","volume":null,"pages":null},"PeriodicalIF":0.0000,"publicationDate":"2024-05-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Transhuman Ansambl - Voice Beyond Language\",\"authors\":\"Lucija Ivsic, Jon McCormack, Vince Dziekan\",\"doi\":\"arxiv-2405.03134\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"In this paper we present the design and development of the Transhuman\\nAnsambl, a novel interactive singing-voice interface which senses its\\nenvironment and responds to vocal input with vocalisations using human voice.\\nDesigned for live performance with a human performer and as a standalone sound\\ninstallation, the ansambl consists of sixteen bespoke virtual singers arranged\\nin a circle. When performing live, the virtual singers listen to the human\\nperformer and respond to their singing by reading pitch, intonation and volume\\ncues. In a standalone sound installation mode, singers use ultrasonic distance\\nsensors to sense audience presence. Developed as part of the 1st author's\\npractice-based PhD and artistic practice as a live performer, this work employs\\nthe singing-voice to explore voice interactions in HCI beyond language, and\\ninnovative ways of live performing. How is technology supporting the effect of\\nintimacy produced through voice? Does the act of surrounding the audience with\\nresponsive virtual singers challenge the traditional roles of\\nperformer-listener? To answer these questions, we draw upon the 1st author's\\nexperience with the system, and the interdisciplinary field of voice studies\\nthat consider the voice as the sound medium independent of language, capable of\\nenacting a reciprocal connection between bodies.\",\"PeriodicalId\":501178,\"journal\":{\"name\":\"arXiv - CS - Sound\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-05-06\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"arXiv - CS - Sound\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/arxiv-2405.03134\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"arXiv - CS - Sound","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/arxiv-2405.03134","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

在本文中,我们介绍了 "超人类"(TranshumanAnsambl)的设计和开发,这是一种新颖的交互式歌唱语音界面,它能感知周围环境,并通过人声对语音输入做出响应。"超人类 "设计用于与人类表演者一起进行现场表演,也可作为独立的声音装置,它由十六位定制的虚拟歌手组成,他们围成一圈。在现场表演时,虚拟歌手会聆听人类表演者的演唱,并通过读取音高、音调和音量来回应他们的演唱。在独立的声音装置模式下,歌手使用超声波距离感应器来感知观众的存在。作为第一作者基于实践的博士论文和现场表演艺术实践的一部分,该作品利用歌声探索人机交互中超越语言的语音交互,以及创新的现场表演方式。技术是如何支持通过声音产生的亲密效果的?用反应灵敏的虚拟歌手围绕观众的行为是否挑战了表演者-听众的传统角色?为了回答这些问题,我们借鉴了第一作者使用该系统的经验,以及将声音视为独立于语言的声音媒介、能够在身体之间建立互惠联系的跨学科声音研究领域。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
Transhuman Ansambl - Voice Beyond Language
In this paper we present the design and development of the Transhuman Ansambl, a novel interactive singing-voice interface which senses its environment and responds to vocal input with vocalisations using human voice. Designed for live performance with a human performer and as a standalone sound installation, the ansambl consists of sixteen bespoke virtual singers arranged in a circle. When performing live, the virtual singers listen to the human performer and respond to their singing by reading pitch, intonation and volume cues. In a standalone sound installation mode, singers use ultrasonic distance sensors to sense audience presence. Developed as part of the 1st author's practice-based PhD and artistic practice as a live performer, this work employs the singing-voice to explore voice interactions in HCI beyond language, and innovative ways of live performing. How is technology supporting the effect of intimacy produced through voice? Does the act of surrounding the audience with responsive virtual singers challenge the traditional roles of performer-listener? To answer these questions, we draw upon the 1st author's experience with the system, and the interdisciplinary field of voice studies that consider the voice as the sound medium independent of language, capable of enacting a reciprocal connection between bodies.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
期刊最新文献
Explaining Deep Learning Embeddings for Speech Emotion Recognition by Predicting Interpretable Acoustic Features ESPnet-EZ: Python-only ESPnet for Easy Fine-tuning and Integration Prevailing Research Areas for Music AI in the Era of Foundation Models Egocentric Speaker Classification in Child-Adult Dyadic Interactions: From Sensing to Computational Modeling The T05 System for The VoiceMOS Challenge 2024: Transfer Learning from Deep Image Classifier to Naturalness MOS Prediction of High-Quality Synthetic Speech
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1