Web-Based Networked Music Performances via WebRTC: A Low-Latency PCM Audio Solution

IF 1.1 4区 工程技术 Q3 ACOUSTICS Journal of the Audio Engineering Society Pub Date : 2022-12-12 DOI:10.17743/jaes.2022.0021
Matteo Sacchetto, P. Gastaldi, C. Chafe, C. Rottondi, A. Servetti
{"title":"Web-Based Networked Music Performances via WebRTC: A Low-Latency PCM Audio Solution","authors":"Matteo Sacchetto, P. Gastaldi, C. Chafe, C. Rottondi, A. Servetti","doi":"10.17743/jaes.2022.0021","DOIUrl":null,"url":null,"abstract":"Nowadays, widely used videoconferencing software has been diffused even further by the social distancing measures adopted during the SARS-CoV-2 pandemic. However, none of the Web-based solutions currently available support high-fidelity stereo audio streaming, which is a fundamental prerequisite for networked music applications. This is mainly because of the fact that the WebRTC RTCPeerConnection standard or Web-based audio streaming do not handle uncompressed audio formats. To overcome that limitation, an implementation of 16-bit pulse code modulation (PCM) stereo audio transmission on top of the WebRTC RTCDataChannel, leveraging Web Audio and AudioWorklets, is discussed. Results obtained with multiple configurations, browsers, and operating systems show that the proposed approach outperforms the WebRTC RTCPeerConnection standard in terms of audio quality and latency, which in the authors' best case to date has been reduced to only 40 ms between two MacBooks on a local area network. © 2022 Audio Engineering Society. All rights reserved.","PeriodicalId":50008,"journal":{"name":"Journal of the Audio Engineering Society","volume":" ","pages":""},"PeriodicalIF":1.1000,"publicationDate":"2022-12-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"6","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of the Audio Engineering Society","FirstCategoryId":"5","ListUrlMain":"https://doi.org/10.17743/jaes.2022.0021","RegionNum":4,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"ACOUSTICS","Score":null,"Total":0}
引用次数: 6

Abstract

Nowadays, widely used videoconferencing software has been diffused even further by the social distancing measures adopted during the SARS-CoV-2 pandemic. However, none of the Web-based solutions currently available support high-fidelity stereo audio streaming, which is a fundamental prerequisite for networked music applications. This is mainly because of the fact that the WebRTC RTCPeerConnection standard or Web-based audio streaming do not handle uncompressed audio formats. To overcome that limitation, an implementation of 16-bit pulse code modulation (PCM) stereo audio transmission on top of the WebRTC RTCDataChannel, leveraging Web Audio and AudioWorklets, is discussed. Results obtained with multiple configurations, browsers, and operating systems show that the proposed approach outperforms the WebRTC RTCPeerConnection standard in terms of audio quality and latency, which in the authors' best case to date has been reduced to only 40 ms between two MacBooks on a local area network. © 2022 Audio Engineering Society. All rights reserved.
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
基于WebRTC的网络音乐表演:一种低延迟PCM音频解决方案
如今,由于严重急性呼吸系统综合征冠状病毒2型疫情期间采取的社交距离措施,广泛使用的视频会议软件得到了进一步推广。然而,目前可用的基于Web的解决方案都不支持高保真立体声音频流,这是网络音乐应用程序的基本前提。这主要是因为WebRTC RTCPeerConnection标准或基于Web的音频流不处理未压缩的音频格式。为了克服这一限制,讨论了利用Web audio和AudioWorklets在WebRTC RTCDataChannel之上实现16位脉冲编码调制(PCM)立体声音频传输。使用多种配置、浏览器和操作系统获得的结果表明,所提出的方法在音频质量和延迟方面优于WebRTC RTCPeerConnection标准,在作者迄今为止的最佳情况下,局域网上两台MacBook之间的延迟已降至仅40毫秒。©2022音频工程学会。保留所有权利。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
Journal of the Audio Engineering Society
Journal of the Audio Engineering Society 工程技术-工程:综合
CiteScore
3.50
自引率
14.30%
发文量
53
审稿时长
1 months
期刊介绍: The Journal of the Audio Engineering Society — the official publication of the AES — is the only peer-reviewed journal devoted exclusively to audio technology. Published 10 times each year, it is available to all AES members and subscribers. The Journal contains state-of-the-art technical papers and engineering reports; feature articles covering timely topics; pre and post reports of AES conventions and other society activities; news from AES sections around the world; Standards and Education Committee work; membership news, patents, new products, and newsworthy developments in the field of audio.
期刊最新文献
Distributing Generative Music With Alternator Orchestra: A Toolbox for Live Music Performances in a Web-Based Metaverse Hack the Show: Design and Analysis of Three Interaction Modes for Audience Participation Rocking the Web With Browser-Based Simulations of Tube Guitar Amplifiers The Web Audio API as a Standardized Interface Beyond Web Browsers
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1