Hao Yang;Tao Lin;Yuan Zhang;Yin Xu;Zhe Chen;Jinyao Yan
{"title":"增强多设备视频传输的 QoE:新颖的数据集和模型视角","authors":"Hao Yang;Tao Lin;Yuan Zhang;Yin Xu;Zhe Chen;Jinyao Yan","doi":"10.1109/TBC.2024.3443544","DOIUrl":null,"url":null,"abstract":"Multi-device video streaming applications enable seamless playback across various devices, including large-screen TVs, tablets, and smartphones, revolutionizing digital content consumption and enhancing user experience. However, ensuring consistently high quality of experience (QoE) across these heterogeneous devices remains a substantial challenge due to intrinsic differences in screen sizes and viewing conditions. In this paper, we first build an open-source, multi-device, and time-continuous QoE dataset named <italic>MCQoE</i> by conducting a large-scale subjective experiment to analyze QoE variations among different screen-size devices. Then, we thoroughly investigate the dataset and observe that video quality and rebuffering impact on TVs is more significant than on other devices, such as middle-size PC monitors and small-screen smartphones, emphasizing the importance of building specific QoE models for different devices. Furthermore, we propose a novel low-complexity but effective QoE model denoted as <italic>LiteDC</i>, integrating a temporal dilated convolution network with a targeted pruning technique to align with the computational constraints of embedded platforms. Extensive results show that compared to a state-of-the-art baseline algorithm, <italic>LiteDC</i> achieves a remarkable 20.9-fold improvement in execution speed while increasing prediction accuracy by 6.4%. The <italic>MCQoE</i> dataset is available for download at <uri>https://github.com/yanghaocuc/mcqoe</uri>.","PeriodicalId":13159,"journal":{"name":"IEEE Transactions on Broadcasting","volume":"71 1","pages":"277-290"},"PeriodicalIF":3.2000,"publicationDate":"2024-08-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Enhancing QoE for Multi-Device Video Delivery: A Novel Dataset and Model Perspective\",\"authors\":\"Hao Yang;Tao Lin;Yuan Zhang;Yin Xu;Zhe Chen;Jinyao Yan\",\"doi\":\"10.1109/TBC.2024.3443544\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Multi-device video streaming applications enable seamless playback across various devices, including large-screen TVs, tablets, and smartphones, revolutionizing digital content consumption and enhancing user experience. However, ensuring consistently high quality of experience (QoE) across these heterogeneous devices remains a substantial challenge due to intrinsic differences in screen sizes and viewing conditions. In this paper, we first build an open-source, multi-device, and time-continuous QoE dataset named <italic>MCQoE</i> by conducting a large-scale subjective experiment to analyze QoE variations among different screen-size devices. Then, we thoroughly investigate the dataset and observe that video quality and rebuffering impact on TVs is more significant than on other devices, such as middle-size PC monitors and small-screen smartphones, emphasizing the importance of building specific QoE models for different devices. Furthermore, we propose a novel low-complexity but effective QoE model denoted as <italic>LiteDC</i>, integrating a temporal dilated convolution network with a targeted pruning technique to align with the computational constraints of embedded platforms. Extensive results show that compared to a state-of-the-art baseline algorithm, <italic>LiteDC</i> achieves a remarkable 20.9-fold improvement in execution speed while increasing prediction accuracy by 6.4%. The <italic>MCQoE</i> dataset is available for download at <uri>https://github.com/yanghaocuc/mcqoe</uri>.\",\"PeriodicalId\":13159,\"journal\":{\"name\":\"IEEE Transactions on Broadcasting\",\"volume\":\"71 1\",\"pages\":\"277-290\"},\"PeriodicalIF\":3.2000,\"publicationDate\":\"2024-08-28\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Transactions on Broadcasting\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10654321/\",\"RegionNum\":1,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"ENGINEERING, ELECTRICAL & ELECTRONIC\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Broadcasting","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/10654321/","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
Enhancing QoE for Multi-Device Video Delivery: A Novel Dataset and Model Perspective
Multi-device video streaming applications enable seamless playback across various devices, including large-screen TVs, tablets, and smartphones, revolutionizing digital content consumption and enhancing user experience. However, ensuring consistently high quality of experience (QoE) across these heterogeneous devices remains a substantial challenge due to intrinsic differences in screen sizes and viewing conditions. In this paper, we first build an open-source, multi-device, and time-continuous QoE dataset named MCQoE by conducting a large-scale subjective experiment to analyze QoE variations among different screen-size devices. Then, we thoroughly investigate the dataset and observe that video quality and rebuffering impact on TVs is more significant than on other devices, such as middle-size PC monitors and small-screen smartphones, emphasizing the importance of building specific QoE models for different devices. Furthermore, we propose a novel low-complexity but effective QoE model denoted as LiteDC, integrating a temporal dilated convolution network with a targeted pruning technique to align with the computational constraints of embedded platforms. Extensive results show that compared to a state-of-the-art baseline algorithm, LiteDC achieves a remarkable 20.9-fold improvement in execution speed while increasing prediction accuracy by 6.4%. The MCQoE dataset is available for download at https://github.com/yanghaocuc/mcqoe.
期刊介绍:
The Society’s Field of Interest is “Devices, equipment, techniques and systems related to broadcast technology, including the production, distribution, transmission, and propagation aspects.” In addition to this formal FOI statement, which is used to provide guidance to the Publications Committee in the selection of content, the AdCom has further resolved that “broadcast systems includes all aspects of transmission, propagation, and reception.”