{"title":"AR Mobile Video Calling System Based on WebRTC API","authors":"Jiayi Xu, Lei Yang, Meng Guo","doi":"10.1109/CCET55412.2022.9906395","DOIUrl":null,"url":null,"abstract":"During the COVID-19 pandemic, the demand for video calling and video conferencing is at peak and continues to grow. Integrating Augmented Reality (AR) with a regular video call can deliver a more interactive, immersive, and collaborative communication experience. This paper presents an AR video calling system that uses WebRTC protocol for establishing real-time video communication and uses AR SDK such as Google AR Core for adding AR features over the lively streaming video feed. To evaluate the performance and feasibility of the proposed AR video calling system, we implemented it on an Android mobile device and measured the relevant performance data, such as frame rate, CPU usage and network usage. The experimental results suggest that the proposed system is practicable and stable.","PeriodicalId":329327,"journal":{"name":"2022 IEEE 5th International Conference on Computer and Communication Engineering Technology (CCET)","volume":"290 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-08-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2022 IEEE 5th International Conference on Computer and Communication Engineering Technology (CCET)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/CCET55412.2022.9906395","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 1
Abstract
During the COVID-19 pandemic, the demand for video calling and video conferencing is at peak and continues to grow. Integrating Augmented Reality (AR) with a regular video call can deliver a more interactive, immersive, and collaborative communication experience. This paper presents an AR video calling system that uses WebRTC protocol for establishing real-time video communication and uses AR SDK such as Google AR Core for adding AR features over the lively streaming video feed. To evaluate the performance and feasibility of the proposed AR video calling system, we implemented it on an Android mobile device and measured the relevant performance data, such as frame rate, CPU usage and network usage. The experimental results suggest that the proposed system is practicable and stable.
新冠肺炎疫情期间,视频通话和视频会议需求达到高峰并持续增长。将增强现实(AR)与常规视频通话集成可以提供更具互动性、沉浸式和协作性的通信体验。本文提出了一种AR视频通话系统,该系统使用WebRTC协议建立实时视频通信,并使用Google AR Core等AR SDK在实时流媒体视频馈送上添加AR功能。为了评估所提出的AR视频通话系统的性能和可行性,我们在Android移动设备上实现了该系统,并测量了相关的性能数据,如帧速率、CPU使用率和网络使用率。实验结果表明,该系统是可行的、稳定的。