Minseok Choi;Won Joon Yun;Seok Bin Son;Soohyun Park;Joongheon Kim
{"title":"利用自适应超分辨率实现动态视频流的联合延迟敏感和高能效质量控制","authors":"Minseok Choi;Won Joon Yun;Seok Bin Son;Soohyun Park;Joongheon Kim","doi":"10.1109/TGCN.2023.3319437","DOIUrl":null,"url":null,"abstract":"As mobile devices exhibit exceptional processing capabilities, super-resolution (SR) technology for video quality enhancement has developed. However, SR is still computationally-intensive, and the integration of SR into video streaming systems remains a nascent domain, with limited recent studies. To address this concern, we design an adaptive SR model that can dynamically control quality enhancement and computational demands in response to the available computational resources and input quality. Furthermore, we propose an integrated strategy for video segment delivery and resource allocation within video streaming systems aided by adaptive SR. This technique optimizes key parameters encompassing transmitter decisions (e.g., transcoding rate, the number of delivering segments, and transmit power) and receiver decisions (e.g., quality enhancement rate and computing resources). Our data-intensive simulation results demonstrate the adaptive SR-centric video streaming system that strikes a harmonious balance across diverse performance metrics. These metrics encompass average video quality, playback stall rates, transmission power, and computational resource consumption.","PeriodicalId":13052,"journal":{"name":"IEEE Transactions on Green Communications and Networking","volume":null,"pages":null},"PeriodicalIF":5.3000,"publicationDate":"2023-09-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Joint Delay-Sensitive and Power-Efficient Quality Control of Dynamic Video Streaming Using Adaptive Super-Resolution\",\"authors\":\"Minseok Choi;Won Joon Yun;Seok Bin Son;Soohyun Park;Joongheon Kim\",\"doi\":\"10.1109/TGCN.2023.3319437\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"As mobile devices exhibit exceptional processing capabilities, super-resolution (SR) technology for video quality enhancement has developed. However, SR is still computationally-intensive, and the integration of SR into video streaming systems remains a nascent domain, with limited recent studies. To address this concern, we design an adaptive SR model that can dynamically control quality enhancement and computational demands in response to the available computational resources and input quality. Furthermore, we propose an integrated strategy for video segment delivery and resource allocation within video streaming systems aided by adaptive SR. This technique optimizes key parameters encompassing transmitter decisions (e.g., transcoding rate, the number of delivering segments, and transmit power) and receiver decisions (e.g., quality enhancement rate and computing resources). Our data-intensive simulation results demonstrate the adaptive SR-centric video streaming system that strikes a harmonious balance across diverse performance metrics. These metrics encompass average video quality, playback stall rates, transmission power, and computational resource consumption.\",\"PeriodicalId\":13052,\"journal\":{\"name\":\"IEEE Transactions on Green Communications and Networking\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":5.3000,\"publicationDate\":\"2023-09-26\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Transactions on Green Communications and Networking\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10263990/\",\"RegionNum\":2,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"TELECOMMUNICATIONS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Green Communications and Networking","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/10263990/","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"TELECOMMUNICATIONS","Score":null,"Total":0}
引用次数: 0
摘要
随着移动设备显示出卓越的处理能力,用于提高视频质量的超分辨率(SR)技术得到了发展。然而,超分辨率仍然是计算密集型技术,而且将超分辨率整合到视频流系统中仍然是一个新兴领域,近期的研究也很有限。针对这一问题,我们设计了一种自适应 SR 模型,该模型可根据可用计算资源和输入质量动态控制质量增强和计算需求。此外,我们还在自适应 SR 的帮助下,为视频流系统中的视频片段交付和资源分配提出了一种综合策略。该技术优化了关键参数,包括发射器决策(如转码率、传输段数量和发射功率)和接收器决策(如质量增强率和计算资源)。我们的数据密集型仿真结果表明,以 SR 为中心的自适应视频流系统在各种性能指标之间取得了和谐的平衡。这些指标包括平均视频质量、播放停滞率、传输功率和计算资源消耗。
Joint Delay-Sensitive and Power-Efficient Quality Control of Dynamic Video Streaming Using Adaptive Super-Resolution
As mobile devices exhibit exceptional processing capabilities, super-resolution (SR) technology for video quality enhancement has developed. However, SR is still computationally-intensive, and the integration of SR into video streaming systems remains a nascent domain, with limited recent studies. To address this concern, we design an adaptive SR model that can dynamically control quality enhancement and computational demands in response to the available computational resources and input quality. Furthermore, we propose an integrated strategy for video segment delivery and resource allocation within video streaming systems aided by adaptive SR. This technique optimizes key parameters encompassing transmitter decisions (e.g., transcoding rate, the number of delivering segments, and transmit power) and receiver decisions (e.g., quality enhancement rate and computing resources). Our data-intensive simulation results demonstrate the adaptive SR-centric video streaming system that strikes a harmonious balance across diverse performance metrics. These metrics encompass average video quality, playback stall rates, transmission power, and computational resource consumption.