首页 > 最新文献

Eurasip Journal on Image and Video Processing最新文献

英文 中文
Reduced reference image and video quality assessments: review of methods 减少参考图像和视频质量评估:方法综述
IF 2.4 4区 计算机科学 Pub Date : 2022-01-12 DOI: 10.1186/s13640-021-00578-y
Shahi Dost, Faryal Saud, Maham Shabbir, Muhammad Gufran Khan, M. Shahid, B. Lovstrom
{"title":"Reduced reference image and video quality assessments: review of methods","authors":"Shahi Dost, Faryal Saud, Maham Shabbir, Muhammad Gufran Khan, M. Shahid, B. Lovstrom","doi":"10.1186/s13640-021-00578-y","DOIUrl":"https://doi.org/10.1186/s13640-021-00578-y","url":null,"abstract":"","PeriodicalId":49322,"journal":{"name":"Eurasip Journal on Image and Video Processing","volume":null,"pages":null},"PeriodicalIF":2.4,"publicationDate":"2022-01-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"49389304","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 7
A study on implementation of real-time intelligent video surveillance system based on embedded module 基于嵌入式模块的实时智能视频监控系统的实现研究
IF 2.4 4区 计算机科学 Pub Date : 2021-11-21 DOI: 10.1186/s13640-021-00576-0
Kim, Jin Su, Kim, Min-Gu, Pan, Sung Bum

Conventional surveillance systems for preventing accidents and incidents do not identify 95% thereof after 22 min when one person monitors a plurality of closed circuit televisions (CCTV). To address this issue, while computer-based intelligent video surveillance systems have been studied to notify users of abnormal situations when they happen, it is not commonly used in real environment because of weakness of personal information leaks and high power consumption. To address this issue, intelligent video surveillance systems based on small devices have been studied. This paper suggests implement an intelligent video surveillance system based on embedded modules for intruder detection based on information learning, fire detection based on color and motion information, and loitering and fall detection based on human body motion. Moreover, an algorithm and an embedded module optimization method are applied for real-time processing. The implemented algorithm showed performance of 88.51% for intruder detection, 92.63% for fire detection, 80% for loitering detection and 93.54% for fall detection. The result of comparison before and after optimization about the algorithm processing time showed 50.53% of decrease, implying potential real-time driving of the intelligent image monitoring system based on embedded modules.

当一个人监视多个闭路电视(CCTV)时,用于防止事故和事件的传统监视系统在22分钟后不能识别95%的事故。针对这一问题,虽然已经研究了基于计算机的智能视频监控系统,可以在发生异常情况时通知用户,但由于个人信息泄露的弱点和高功耗,在实际环境中并不常用。为了解决这一问题,人们开始研究基于小型设备的智能视频监控系统。本文提出了一种基于嵌入式模块的智能视频监控系统,实现了基于信息学习的入侵者检测、基于颜色和运动信息的火灾检测、基于人体运动的徘徊和跌倒检测。此外,还采用了一种算法和嵌入式模块优化方法进行实时处理。实现的算法对入侵者的检测性能为88.51%,对火灾的检测性能为92.63%,对游荡的检测性能为80%,对跌倒的检测性能为93.54%。优化前后算法处理时间的对比结果显示,优化前后算法处理时间减少了50.53%,表明基于嵌入式模块的智能图像监控系统具有实时驱动的潜力。
{"title":"A study on implementation of real-time intelligent video surveillance system based on embedded module","authors":"Kim, Jin Su, Kim, Min-Gu, Pan, Sung Bum","doi":"10.1186/s13640-021-00576-0","DOIUrl":"https://doi.org/10.1186/s13640-021-00576-0","url":null,"abstract":"<p>Conventional surveillance systems for preventing accidents and incidents do not identify 95% thereof after 22 min when one person monitors a plurality of closed circuit televisions (CCTV). To address this issue, while computer-based intelligent video surveillance systems have been studied to notify users of abnormal situations when they happen, it is not commonly used in real environment because of weakness of personal information leaks and high power consumption. To address this issue, intelligent video surveillance systems based on small devices have been studied. This paper suggests implement an intelligent video surveillance system based on embedded modules for intruder detection based on information learning, fire detection based on color and motion information, and loitering and fall detection based on human body motion. Moreover, an algorithm and an embedded module optimization method are applied for real-time processing. The implemented algorithm showed performance of 88.51% for intruder detection, 92.63% for fire detection, 80% for loitering detection and 93.54% for fall detection. The result of comparison before and after optimization about the algorithm processing time showed 50.53% of decrease, implying potential real-time driving of the intelligent image monitoring system based on embedded modules.</p>","PeriodicalId":49322,"journal":{"name":"Eurasip Journal on Image and Video Processing","volume":null,"pages":null},"PeriodicalIF":2.4,"publicationDate":"2021-11-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138518849","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
Perceptual hashing method for video content authentication with maximized robustness 鲁棒性最大化的视频内容认证感知哈希方法
IF 2.4 4区 计算机科学 Pub Date : 2021-11-21 DOI: 10.1186/s13640-021-00577-z
Qiang Ma, Ling Xing
{"title":"Perceptual hashing method for video content authentication with maximized robustness","authors":"Qiang Ma, Ling Xing","doi":"10.1186/s13640-021-00577-z","DOIUrl":"https://doi.org/10.1186/s13640-021-00577-z","url":null,"abstract":"","PeriodicalId":49322,"journal":{"name":"Eurasip Journal on Image and Video Processing","volume":null,"pages":null},"PeriodicalIF":2.4,"publicationDate":"2021-11-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"65719083","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
HR-MPF: high-resolution representation network with multi-scale progressive fusion for pulmonary nodule segmentation and classification HR-MPF:用于肺结节分割和分类的多尺度渐进融合的高分辨率表示网络
IF 2.4 4区 计算机科学 Pub Date : 2021-11-13 DOI: 10.1186/s13640-021-00574-2
Ling Zhu, Hongqing Zhu, Suyi Yang, Pengyu Wang, Yang Yu
{"title":"HR-MPF: high-resolution representation network with multi-scale progressive fusion for pulmonary nodule segmentation and classification","authors":"Ling Zhu, Hongqing Zhu, Suyi Yang, Pengyu Wang, Yang Yu","doi":"10.1186/s13640-021-00574-2","DOIUrl":"https://doi.org/10.1186/s13640-021-00574-2","url":null,"abstract":"","PeriodicalId":49322,"journal":{"name":"Eurasip Journal on Image and Video Processing","volume":null,"pages":null},"PeriodicalIF":2.4,"publicationDate":"2021-11-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"65718801","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Fatigue driving detection based on electrooculography: a review 基于眼电成像的疲劳驾驶检测研究进展
IF 2.4 4区 计算机科学 Pub Date : 2021-11-02 DOI: 10.1186/s13640-021-00575-1
Yuan-Qing Tian, Jingyu Cao
{"title":"Fatigue driving detection based on electrooculography: a review","authors":"Yuan-Qing Tian, Jingyu Cao","doi":"10.1186/s13640-021-00575-1","DOIUrl":"https://doi.org/10.1186/s13640-021-00575-1","url":null,"abstract":"","PeriodicalId":49322,"journal":{"name":"Eurasip Journal on Image and Video Processing","volume":null,"pages":null},"PeriodicalIF":2.4,"publicationDate":"2021-11-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"65718865","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 8
An image-guided network for depth edge enhancement 一种用于深度边缘增强的图像引导网络
IF 2.4 4区 计算机科学 Pub Date : 2021-10-18 DOI: 10.21203/rs.3.rs-958953/v1
Kuan-Ting Lee, Enyu Liu, J. Yang, Li Hong
With the rapid development of 3D coding and display technologies, numerous applications are emerging to target human immersive entertainments. To achieve a prime 3D visual experience, high accuracy depth maps play a crucial role. However, depth maps retrieved from most devices still suffer inaccuracies at object boundaries. Therefore, a depth enhancement system is usually needed to correct the error. Recent developments by applying deep learning to deep enhancement have shown their promising improvement. In this paper, we propose a deep depth enhancement network system that effectively corrects the inaccurate depth using color images as a guide. The proposed network contains both depth and image branches, where we combine a new set of features from the image branch with those from the depth branch. Experimental results show that the proposed system achieves a better depth correction performance than state of the art advanced networks. The ablation study reveals that the proposed loss functions in use of image information can enhance depth map accuracy effectively.
随着3D编码和显示技术的快速发展,许多针对人类沉浸式娱乐的应用正在出现。为了获得最佳的3D视觉体验,高精度深度图起着至关重要的作用。然而,从大多数设备检索到的深度图在对象边界处仍然存在不精确性。因此,通常需要深度增强系统来校正误差。将深度学习应用于深度增强的最新进展显示出了很有希望的改进。在本文中,我们提出了一种深度增强网络系统,该系统以彩色图像为指导,有效地校正了不准确的深度。所提出的网络包含深度和图像分支,其中我们将来自图像分支的一组新特征与来自深度分支的特征相结合。实验结果表明,该系统比现有技术的先进网络具有更好的深度校正性能。消融研究表明,所提出的损失函数在使用图像信息时可以有效地提高深度图的精度。
{"title":"An image-guided network for depth edge enhancement","authors":"Kuan-Ting Lee, Enyu Liu, J. Yang, Li Hong","doi":"10.21203/rs.3.rs-958953/v1","DOIUrl":"https://doi.org/10.21203/rs.3.rs-958953/v1","url":null,"abstract":"With the rapid development of 3D coding and display technologies, numerous applications are emerging to target human immersive entertainments. To achieve a prime 3D visual experience, high accuracy depth maps play a crucial role. However, depth maps retrieved from most devices still suffer inaccuracies at object boundaries. Therefore, a depth enhancement system is usually needed to correct the error. Recent developments by applying deep learning to deep enhancement have shown their promising improvement. In this paper, we propose a deep depth enhancement network system that effectively corrects the inaccurate depth using color images as a guide. The proposed network contains both depth and image branches, where we combine a new set of features from the image branch with those from the depth branch. Experimental results show that the proposed system achieves a better depth correction performance than state of the art advanced networks. The ablation study reveals that the proposed loss functions in use of image information can enhance depth map accuracy effectively.","PeriodicalId":49322,"journal":{"name":"Eurasip Journal on Image and Video Processing","volume":null,"pages":null},"PeriodicalIF":2.4,"publicationDate":"2021-10-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"49411132","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Palpation localization of radial artery based on 3-dimensional convolutional neural networks 基于三维卷积神经网络的桡动脉触觉定位
IF 2.4 4区 计算机科学 Pub Date : 2021-10-18 DOI: 10.21203/rs.3.rs-965158/v1
Qiliang Chen, Yulin Huang, Xing Zhu, Hong Lu, Zhongzhi Ji, Jiacheng Yang, Jingjing Luo
Palpation localization is essential for detecting physiological parameters of the radial artery for pulse diagnosis of Traditional Chinese Medicine (TCM). Detecting signal or applying pressure at the wrong location can seriously affect the measurement of pulse waves and result in misdiagnosis. In this paper, we propose an effective and high accuracy regression model using 3-dimensional convolution neural networks (CNN) processing near-infrared picture sequences to locate radial artery upon radius at the wrist. Comparing with early studies using 2-dimensional models, 3Dcnn introduces temporal features with the third dimension to leverage pulsation rhythms, and had achieved superior performance accuracy as 0.87 within 50 pixels at testing resolution of 1024 × 544. Model visualization shows that the additional dimension of the temporal convolution highlights dynamic changes within image sequences. This study presents the great potential of our constructed model to be applied in real wrist palpation location scenarios to bring the key convenience for pulse diagnosis.
触诊定位是检测桡动脉生理参数对中医脉诊的重要依据。在错误的位置检测信号或施加压力会严重影响脉搏波的测量并导致误诊。在本文中,我们提出了一种有效且高精度的回归模型,该模型使用三维卷积神经网络(CNN)处理近红外图像序列来定位手腕桡骨上的桡动脉。与早期使用二维模型的研究相比,3Dcnn引入了三维的时间特征来利用脉动节奏,并在1024×544的测试分辨率下,在50个像素内实现了0.87的卓越性能精度。模型可视化显示,时间卷积的附加维度突出了图像序列内的动态变化。这项研究展示了我们构建的模型在真实手腕触诊定位场景中的巨大潜力,为脉搏诊断带来了关键的便利。
{"title":"Palpation localization of radial artery based on 3-dimensional convolutional neural networks","authors":"Qiliang Chen, Yulin Huang, Xing Zhu, Hong Lu, Zhongzhi Ji, Jiacheng Yang, Jingjing Luo","doi":"10.21203/rs.3.rs-965158/v1","DOIUrl":"https://doi.org/10.21203/rs.3.rs-965158/v1","url":null,"abstract":"Palpation localization is essential for detecting physiological parameters of the radial artery for pulse diagnosis of Traditional Chinese Medicine (TCM). Detecting signal or applying pressure at the wrong location can seriously affect the measurement of pulse waves and result in misdiagnosis. In this paper, we propose an effective and high accuracy regression model using 3-dimensional convolution neural networks (CNN) processing near-infrared picture sequences to locate radial artery upon radius at the wrist. Comparing with early studies using 2-dimensional models, 3Dcnn introduces temporal features with the third dimension to leverage pulsation rhythms, and had achieved superior performance accuracy as 0.87 within 50 pixels at testing resolution of 1024 × 544. Model visualization shows that the additional dimension of the temporal convolution highlights dynamic changes within image sequences. This study presents the great potential of our constructed model to be applied in real wrist palpation location scenarios to bring the key convenience for pulse diagnosis.","PeriodicalId":49322,"journal":{"name":"Eurasip Journal on Image and Video Processing","volume":null,"pages":null},"PeriodicalIF":2.4,"publicationDate":"2021-10-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"44158328","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Recognition of printed small texture modules based on dictionary learning 基于字典学习的印刷小纹理模块识别
IF 2.4 4区 计算机科学 Pub Date : 2021-09-29 DOI: 10.1186/s13640-021-00573-3
Yu, Lifang, Cao, Gang, Tian, Huawei, Cao, Peng, Zhang, Zhenzhen, Shi, Yun Q.

Quick Response (QR) codes are designed for information storage and high-speed reading applications. To store additional information, Two-Level QR (2LQR) codes replace black modules in standard QR codes with specific texture patterns. When the 2LQR code is printed, texture patterns are blurred and their sizes are smaller than(0.5{mathrm{cm}}^{2}). Recognizing small-sized blurred texture patterns is challenging. In original 2LQR literature, recognition of texture patterns is based on maximizing the correlation between print-and-scanned texture patterns and the original digital ones. When employing desktop printers with large pixel extensions and low-resolution capture devices, the recognition accuracy of texture patterns greatly reduces. To improve the recognition accuracy under this situation, our work presents a dictionary learning based scheme to recognize printed texture patterns. To our best knowledge, it is the first attempt to use dictionary learning to promote the recognition accuracy of printed texture patterns. In our scheme, dictionaries for all kinds of texture patterns are learned from print-and-scanned texture modules in the training stage. And these learned dictionaries are employed to represent each texture module in the testing stage (extracting process) to recognize their texture pattern. Experimental results show that our proposed algorithm significantly reduces the recognition error of small-sized printed texture patterns.

QR码是为信息存储和高速读取应用而设计的。为了存储额外的信息,二级QR码(2LQR)用特定的纹理图案取代了标准QR码中的黑色模块。2LQR码打印时,纹理图案模糊,尺寸小于(0.5{mathrm{cm}}^{2})。识别小尺寸的模糊纹理图案具有挑战性。在原始的2LQR文献中,纹理模式的识别是基于最大化打印和扫描纹理模式与原始数字纹理模式之间的相关性。当使用大像素扩展的桌面打印机和低分辨率捕获设备时,纹理图案的识别精度大大降低。为了提高这种情况下的识别精度,本文提出了一种基于字典学习的印刷纹理模式识别方案。据我们所知,这是第一次尝试使用字典学习来提高印刷纹理图案的识别精度。在我们的方案中,在训练阶段从打印和扫描纹理模块中学习各种纹理模式的字典。在测试阶段(提取过程)使用这些学习到的字典来表示每个纹理模块,以识别它们的纹理模式。实验结果表明,该算法显著降低了小尺寸印刷纹理图案的识别误差。
{"title":"Recognition of printed small texture modules based on dictionary learning","authors":"Yu, Lifang, Cao, Gang, Tian, Huawei, Cao, Peng, Zhang, Zhenzhen, Shi, Yun Q.","doi":"10.1186/s13640-021-00573-3","DOIUrl":"https://doi.org/10.1186/s13640-021-00573-3","url":null,"abstract":"<p>Quick Response (QR) codes are designed for information storage and high-speed reading applications. To store additional information, Two-Level QR (2LQR) codes replace black modules in standard QR codes with specific texture patterns. When the 2LQR code is printed, texture patterns are blurred and their sizes are smaller than<span>(0.5{mathrm{cm}}^{2})</span>. Recognizing small-sized blurred texture patterns is challenging. In original 2LQR literature, recognition of texture patterns is based on maximizing the correlation between print-and-scanned texture patterns and the original digital ones. When employing desktop printers with large pixel extensions and low-resolution capture devices, the recognition accuracy of texture patterns greatly reduces. To improve the recognition accuracy under this situation, our work presents a dictionary learning based scheme to recognize printed texture patterns. To our best knowledge, it is the first attempt to use dictionary learning to promote the recognition accuracy of printed texture patterns. In our scheme, dictionaries for all kinds of texture patterns are learned from print-and-scanned texture modules in the training stage. And these learned dictionaries are employed to represent each texture module in the testing stage (extracting process) to recognize their texture pattern. Experimental results show that our proposed algorithm significantly reduces the recognition error of small-sized printed texture patterns.</p>","PeriodicalId":49322,"journal":{"name":"Eurasip Journal on Image and Video Processing","volume":null,"pages":null},"PeriodicalIF":2.4,"publicationDate":"2021-09-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138518862","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Performance enhancement method for multiple license plate recognition in challenging environments 具有挑战性环境下的多车牌识别性能增强方法
IF 2.4 4区 计算机科学 Pub Date : 2021-09-17 DOI: 10.1186/s13640-021-00572-4
Khurram Khan, A. Imran, H. A. U. Rehman, A. Fazil, Muhammad Zakwan, Z. Mahmood
{"title":"Performance enhancement method for multiple license plate recognition in challenging environments","authors":"Khurram Khan, A. Imran, H. A. U. Rehman, A. Fazil, Muhammad Zakwan, Z. Mahmood","doi":"10.1186/s13640-021-00572-4","DOIUrl":"https://doi.org/10.1186/s13640-021-00572-4","url":null,"abstract":"","PeriodicalId":49322,"journal":{"name":"Eurasip Journal on Image and Video Processing","volume":null,"pages":null},"PeriodicalIF":2.4,"publicationDate":"2021-09-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"46315851","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 6
Buffer evaluation model and scheduling strategy for video streaming services in 5G-powered drone using machine learning 基于机器学习的5g无人机视频流服务缓冲评估模型及调度策略
IF 2.4 4区 计算机科学 Pub Date : 2021-08-23 DOI: 10.1186/s13640-021-00570-6
Su, Yu, Wang, Shuijie, Cheng, Qianqian, Qiu, Yuhe

With regard to video streaming services under wireless networks, how to improve the quality of experience (QoE) has always been a challenging task. Especially after the arrival of the 5G era, more attention has been paid to analyze the experience quality of video streaming in more complex network scenarios (such as 5G-powered drone video transmission). Insufficient buffer in the video stream transmission process will cause the playback to freeze [1]. In order to cope with this defect, this paper proposes a buffer starvation evaluation model based on deep learning and a video stream scheduling model based on reinforcement learning. This approach uses the method of machine learning to extract the correlation between the buffer starvation probability distribution and the traffic load, thereby obtaining the explicit evaluation results of buffer starvation events and a series of resource allocation strategies that optimize long-term QoE. In order to deal with the noise problem caused by the random environment, the model introduces an internal reward mechanism in the scheduling process, so that the agent can fully explore the environment. Experiments have proved that our framework can effectively evaluate and improve the video service quality of 5G-powered UAV.

对于无线网络下的视频流服务,如何提高体验质量一直是一个具有挑战性的课题。特别是在5G时代到来之后,人们更加关注在更复杂的网络场景(如5G驱动的无人机视频传输)下分析视频流的体验质量。视频流传输过程中缓冲区不足会导致回放冻结[1]。为了解决这一缺陷,本文提出了一种基于深度学习的缓冲区饥饿评估模型和一种基于强化学习的视频流调度模型。该方法利用机器学习的方法提取缓冲区饥饿概率分布与流量负载之间的相关性,从而得到缓冲区饥饿事件的显式评价结果和一系列优化长期QoE的资源分配策略。为了解决随机环境带来的噪声问题,该模型在调度过程中引入了内部奖励机制,使agent能够充分探索环境。实验证明,我们的框架可以有效地评估和提高5g无人机的视频服务质量。
{"title":"Buffer evaluation model and scheduling strategy for video streaming services in 5G-powered drone using machine learning","authors":"Su, Yu, Wang, Shuijie, Cheng, Qianqian, Qiu, Yuhe","doi":"10.1186/s13640-021-00570-6","DOIUrl":"https://doi.org/10.1186/s13640-021-00570-6","url":null,"abstract":"<p>With regard to video streaming services under wireless networks, how to improve the quality of experience (QoE) has always been a challenging task. Especially after the arrival of the 5G era, more attention has been paid to analyze the experience quality of video streaming in more complex network scenarios (such as 5G-powered drone video transmission). Insufficient buffer in the video stream transmission process will cause the playback to freeze [1]. In order to cope with this defect, this paper proposes a buffer starvation evaluation model based on deep learning and a video stream scheduling model based on reinforcement learning. This approach uses the method of machine learning to extract the correlation between the buffer starvation probability distribution and the traffic load, thereby obtaining the explicit evaluation results of buffer starvation events and a series of resource allocation strategies that optimize long-term QoE. In order to deal with the noise problem caused by the random environment, the model introduces an internal reward mechanism in the scheduling process, so that the agent can fully explore the environment. Experiments have proved that our framework can effectively evaluate and improve the video service quality of 5G-powered UAV.</p>","PeriodicalId":49322,"journal":{"name":"Eurasip Journal on Image and Video Processing","volume":null,"pages":null},"PeriodicalIF":2.4,"publicationDate":"2021-08-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138518866","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
期刊
Eurasip Journal on Image and Video Processing
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1