首页 > 最新文献

2012 Fourth International Workshop on Quality of Multimedia Experience最新文献

英文 中文
A new perceptual-based no-reference contrast metric for natural images based on human attention and image dynamic 基于人的注意力和图像动态的自然图像无参考对比度量
Pub Date : 2012-07-05 DOI: 10.1109/QoMEX.2012.6263887
Mohan Liu, P. Ndjiki-Nya
Contrast measurement is one of the most important tasks in image quality assessment and image enhancement. However, a generic metric to evaluate contrast quality is difficult to design because different applications have different definitions of contrast. In this paper, a new perceptual-based contrast metric for natural images is proposed. Departing from traditional metrics, the proposed measure is based on both the luminance and chrominance information of images. The technical assessment of luminance contrast is mapped onto a perceptualbased measure via a human attention model. Local luminance contrast is also measured to overcome the limitations of the global measure. The CSIQ and the TID2008 databases are used for evaluating the performance of the proposed metric. It is shown that the proposed approach yields a significant improvement in comparison to the state-of-the-art.
对比度测量是图像质量评估和图像增强的重要任务之一。然而,由于不同的应用程序对对比度有不同的定义,很难设计一个通用的度量来评估对比度质量。本文提出了一种新的基于感知的自然图像对比度度量。与传统度量不同,该度量同时基于图像的亮度和色度信息。亮度对比的技术评估通过人类注意力模型映射到基于感知的测量上。为了克服全局测量的局限性,还测量了局部亮度对比。CSIQ和TID2008数据库用于评估所建议的度量标准的性能。结果表明,与最先进的方法相比,拟议的方法产生了重大改进。
{"title":"A new perceptual-based no-reference contrast metric for natural images based on human attention and image dynamic","authors":"Mohan Liu, P. Ndjiki-Nya","doi":"10.1109/QoMEX.2012.6263887","DOIUrl":"https://doi.org/10.1109/QoMEX.2012.6263887","url":null,"abstract":"Contrast measurement is one of the most important tasks in image quality assessment and image enhancement. However, a generic metric to evaluate contrast quality is difficult to design because different applications have different definitions of contrast. In this paper, a new perceptual-based contrast metric for natural images is proposed. Departing from traditional metrics, the proposed measure is based on both the luminance and chrominance information of images. The technical assessment of luminance contrast is mapped onto a perceptualbased measure via a human attention model. Local luminance contrast is also measured to overcome the limitations of the global measure. The CSIQ and the TID2008 databases are used for evaluating the performance of the proposed metric. It is shown that the proposed approach yields a significant improvement in comparison to the state-of-the-art.","PeriodicalId":6303,"journal":{"name":"2012 Fourth International Workshop on Quality of Multimedia Experience","volume":"43 1","pages":"254-259"},"PeriodicalIF":0.0,"publicationDate":"2012-07-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"90321800","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 5
A system for subjective evaluation of audio, video and audiovisual quality using MUSHRA and SAMVIQ methods 使用MUSHRA和SAMVIQ方法对音频、视频和视听质量进行主观评价的系统
Pub Date : 2012-07-05 DOI: 10.1109/QoMEX.2012.6263877
Herbert Thoma
This paper presents a system for the subjective evaluation of audio, video and audiovisual quality. The system combines the well known MUSHRA and SAMVIQ methods for evaluation of audio and video quality. The implementation of the system uses inexpensive commercial of the shelf hardware.
本文提出了一个音视频质量主观评价系统。该系统结合了众所周知的MUSHRA和SAMVIQ方法来评估音频和视频质量。该系统的实现采用了廉价的商用货架硬件。
{"title":"A system for subjective evaluation of audio, video and audiovisual quality using MUSHRA and SAMVIQ methods","authors":"Herbert Thoma","doi":"10.1109/QoMEX.2012.6263877","DOIUrl":"https://doi.org/10.1109/QoMEX.2012.6263877","url":null,"abstract":"This paper presents a system for the subjective evaluation of audio, video and audiovisual quality. The system combines the well known MUSHRA and SAMVIQ methods for evaluation of audio and video quality. The implementation of the system uses inexpensive commercial of the shelf hardware.","PeriodicalId":6303,"journal":{"name":"2012 Fourth International Workshop on Quality of Multimedia Experience","volume":"111 1","pages":"31-32"},"PeriodicalIF":0.0,"publicationDate":"2012-07-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"87281732","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 4
Defining aesthetic principles for automatic media gallery layout for visual and audial event summarization based on social networks 定义了基于社交网络的视觉和听觉事件摘要的自动媒体画廊布局的美学原则
Pub Date : 2012-07-05 DOI: 10.1109/QoMEX.2012.6263875
T. Steiner, R. Verborgh, J. Gabarró, R. Walle
In this paper, we present and define aesthetic principles for the automatic generation of media galleries based on media items retrieved from social networks that-after a ranking and pruning step-can serve to authentically summarize events and their atmosphere from a visual and an audial standpoint.
在本文中,我们提出并定义了基于从社交网络中检索的媒体项目自动生成媒体画廊的美学原则,这些媒体画廊在经过排名和修剪步骤之后,可以从视觉和听觉的角度真实地总结事件及其氛围。
{"title":"Defining aesthetic principles for automatic media gallery layout for visual and audial event summarization based on social networks","authors":"T. Steiner, R. Verborgh, J. Gabarró, R. Walle","doi":"10.1109/QoMEX.2012.6263875","DOIUrl":"https://doi.org/10.1109/QoMEX.2012.6263875","url":null,"abstract":"In this paper, we present and define aesthetic principles for the automatic generation of media galleries based on media items retrieved from social networks that-after a ranking and pruning step-can serve to authentically summarize events and their atmosphere from a visual and an audial standpoint.","PeriodicalId":6303,"journal":{"name":"2012 Fourth International Workshop on Quality of Multimedia Experience","volume":"33 1","pages":"27-28"},"PeriodicalIF":0.0,"publicationDate":"2012-07-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"88391113","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 4
Waiting times in quality of experience for web based services 基于web的服务体验质量的等待时间
Pub Date : 2012-07-05 DOI: 10.1109/QoMEX.2012.6263888
S. Egger, T. Hossfeld, R. Schatz, M. Fiedler
A considerable share of applications such as web or e-mail browsing, online picture viewing and file downloads imply waiting times for their users, which is due to the turn-taking of information requests by the user and correspoding response times until each request is fulfilled. Thus, end-user quality perception in the context of interactive data services is dominated by waiting times; the longer the latter, the less satisfied the user becomes. As opposed to heavily researched multimedia experience, perception of waiting times is still not strongly explored in the context of Quality of Experience (QoE). This tutorial will contribute to closing this gap. In its first part, it addresses perception principles and discusses their applicability towards fundamental relationships between waiting times and resulting QoE. It then investigates to which extent the same relationships can also be used to describe QoE for more complex services such as web browsing. Finally, it discusses applications where waiting times determine QoE, amongst other factors. For example, the past shift from UDP media streaming to TCP media streaming (e.g. youtube.com) has extended the relevance of waiting times also to the domain of online video services. In particular, user-perceived quality suffers from initial delays when applications are launched, as well as from freezes during the delivery of the stream. These aspects, which have to be traded against each other to some extent, will be discussed mainly for HTTP video streaming in the last part of this tutorial.
相当大一部分应用程序,如web或电子邮件浏览、在线图片查看和文件下载,都意味着用户需要等待时间,这是由于用户轮流请求信息和相应的响应时间,直到每个请求都得到满足。因此,在交互式数据服务的背景下,终端用户的质量感知是由等待时间主导的;后者的时间越长,用户的满意度就越低。与多媒体体验的大量研究相反,在体验质量(QoE)的背景下,等待时间的感知仍然没有得到强烈的探索。本教程将有助于缩小这一差距。在第一部分中,它讨论了感知原则,并讨论了它们对等待时间和最终QoE之间基本关系的适用性。然后研究在何种程度上相同的关系也可以用于描述更复杂的服务(如web浏览)的QoE。最后,讨论了等待时间决定QoE以及其他因素的应用程序。例如,过去从UDP媒体流到TCP媒体流(例如youtube.com)的转变已经将等待时间的相关性扩展到在线视频服务领域。特别是,当应用程序启动时,用户感知的质量受到初始延迟的影响,以及流交付期间的冻结。这些方面在某种程度上必须相互权衡,本教程的最后一部分将主要讨论HTTP视频流。
{"title":"Waiting times in quality of experience for web based services","authors":"S. Egger, T. Hossfeld, R. Schatz, M. Fiedler","doi":"10.1109/QoMEX.2012.6263888","DOIUrl":"https://doi.org/10.1109/QoMEX.2012.6263888","url":null,"abstract":"A considerable share of applications such as web or e-mail browsing, online picture viewing and file downloads imply waiting times for their users, which is due to the turn-taking of information requests by the user and correspoding response times until each request is fulfilled. Thus, end-user quality perception in the context of interactive data services is dominated by waiting times; the longer the latter, the less satisfied the user becomes. As opposed to heavily researched multimedia experience, perception of waiting times is still not strongly explored in the context of Quality of Experience (QoE). This tutorial will contribute to closing this gap. In its first part, it addresses perception principles and discusses their applicability towards fundamental relationships between waiting times and resulting QoE. It then investigates to which extent the same relationships can also be used to describe QoE for more complex services such as web browsing. Finally, it discusses applications where waiting times determine QoE, amongst other factors. For example, the past shift from UDP media streaming to TCP media streaming (e.g. youtube.com) has extended the relevance of waiting times also to the domain of online video services. In particular, user-perceived quality suffers from initial delays when applications are launched, as well as from freezes during the delivery of the stream. These aspects, which have to be traded against each other to some extent, will be discussed mainly for HTTP video streaming in the last part of this tutorial.","PeriodicalId":6303,"journal":{"name":"2012 Fourth International Workshop on Quality of Multimedia Experience","volume":"35 1","pages":"86-96"},"PeriodicalIF":0.0,"publicationDate":"2012-07-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"77946748","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 173
Sensory effect dataset and test setups 感官效果数据集和测试设置
Pub Date : 2012-07-05 DOI: 10.1109/QoMEX.2012.6263841
Markus Waltl, C. Timmerer, Benjamin Rainer, H. Hellwagner
Additional constituents for the representation of multimedia content gained more and more attention. For example, the amount of cinemas equipped with additional devices (e.g., ambient light, vibrating seats, wind generators, water sprayers, heater/coolers) that stimulate senses going beyond audition and vision increases. On the content side the MPEG-V standard specifies - among others - Sensory Effect Metadata (SEM) which provides means to describe sensory effects such as wind, vibration, light, etc. to be attached to audio-visual content and, thus, offering an enhanced and immersive experience for the user. However, there is a lack of a common set of test content allowing for various subjective user studies and verification across different test sites. In this paper we provide our dataset comprising a number of videos from different genres enriched with MPEG-V compliant Sensory Effect Metadata descriptions. Furthermore, we describe possible test setups using off-the-shelf hardware for conducting subjective quality assessments.
多媒体内容表示的附加组件越来越受到关注。例如,越来越多的电影院配备了额外的设备(如环境光、振动座椅、风力发电机、喷水器、加热器/冷却器)来刺激听觉和视觉以外的感官。在内容方面,MPEG-V标准规定了感官效果元数据(SEM),它提供了描述附加在视听内容上的风、振动、光等感官效果的方法,从而为用户提供增强的沉浸式体验。然而,缺乏一套通用的测试内容,允许不同的主观用户研究和跨不同测试站点的验证。在本文中,我们提供了我们的数据集,其中包括来自不同类型的视频,这些视频丰富了符合MPEG-V标准的感官效果元数据描述。此外,我们描述了使用现成硬件进行主观质量评估的可能的测试设置。
{"title":"Sensory effect dataset and test setups","authors":"Markus Waltl, C. Timmerer, Benjamin Rainer, H. Hellwagner","doi":"10.1109/QoMEX.2012.6263841","DOIUrl":"https://doi.org/10.1109/QoMEX.2012.6263841","url":null,"abstract":"Additional constituents for the representation of multimedia content gained more and more attention. For example, the amount of cinemas equipped with additional devices (e.g., ambient light, vibrating seats, wind generators, water sprayers, heater/coolers) that stimulate senses going beyond audition and vision increases. On the content side the MPEG-V standard specifies - among others - Sensory Effect Metadata (SEM) which provides means to describe sensory effects such as wind, vibration, light, etc. to be attached to audio-visual content and, thus, offering an enhanced and immersive experience for the user. However, there is a lack of a common set of test content allowing for various subjective user studies and verification across different test sites. In this paper we provide our dataset comprising a number of videos from different genres enriched with MPEG-V compliant Sensory Effect Metadata descriptions. Furthermore, we describe possible test setups using off-the-shelf hardware for conducting subjective quality assessments.","PeriodicalId":6303,"journal":{"name":"2012 Fourth International Workshop on Quality of Multimedia Experience","volume":"50 1","pages":"115-120"},"PeriodicalIF":0.0,"publicationDate":"2012-07-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"78175966","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 25
A visibility model for quality assessment of dimmed images 一种用于模糊图像质量评估的可见性模型
Pub Date : 2012-07-05 DOI: 10.1109/QoMEX.2012.6263872
Tai-Hsiang Huang, Chen-Tai Kao, Yi-Chia Chen, Su-Ling Yeh, Homer H. Chen
Dimming the backlight of a liquid crystal display (LCD) reduces the dynamic range and intensity of a displayed image and hence has a profound impact on the perceived image quality. To reflect the actual degradation of image quality perceived by human eye, we take visibility in addition to contrast into account and develop a visibility model for image quality assessment. The proposed visibility model also considers factors related to the display and the ambient light to accommodate the viewing condition. Experimental results are shown to demonstrate the performance of the proposed model.
调暗液晶显示器(LCD)的背光会降低显示图像的动态范围和强度,从而对感知图像质量产生深远影响。为了反映人眼感知到的图像质量的实际退化情况,我们在考虑对比度的同时考虑了可见性,并建立了图像质量评估的可见性模型。所提出的可视性模型还考虑了与显示器和环境光有关的因素,以适应观看条件。实验结果验证了该模型的有效性。
{"title":"A visibility model for quality assessment of dimmed images","authors":"Tai-Hsiang Huang, Chen-Tai Kao, Yi-Chia Chen, Su-Ling Yeh, Homer H. Chen","doi":"10.1109/QoMEX.2012.6263872","DOIUrl":"https://doi.org/10.1109/QoMEX.2012.6263872","url":null,"abstract":"Dimming the backlight of a liquid crystal display (LCD) reduces the dynamic range and intensity of a displayed image and hence has a profound impact on the perceived image quality. To reflect the actual degradation of image quality perceived by human eye, we take visibility in addition to contrast into account and develop a visibility model for image quality assessment. The proposed visibility model also considers factors related to the display and the ambient light to accommodate the viewing condition. Experimental results are shown to demonstrate the performance of the proposed model.","PeriodicalId":6303,"journal":{"name":"2012 Fourth International Workshop on Quality of Multimedia Experience","volume":"113 1","pages":"206-211"},"PeriodicalIF":0.0,"publicationDate":"2012-07-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"79387372","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
Electroencephalogram alterations during perception of pleasant and unpleasant odors 感知愉快气味和不愉快气味时的脑电图改变
Pub Date : 2012-07-05 DOI: 10.1109/QoMEX.2012.6263860
A. Yazdani, E. Kroupi, J. Vesin, T. Ebrahimi
The olfactory system enables humans and many animals recognize and categorize different odors and can determine many behavioral and social reactions. For human beings, odor stimuli are highly associated with many processes such as emotions, attraction, mood, etc. One approach to understanding the olfaction is to monitor and analyze human brain activity during perception of odors. In this paper, we analyze electroencephalogram (EEG) of five participants during perception of unpleasant and pleasant odor stimuli. We identify the regions of the brain cortex that are active during discrimination of unpleasant and pleasant odor stimuli. We also show that, classification of EEG signals during perception of odors can reveal the pleasantness of the odor with relatively high accuracy.
嗅觉系统使人类和许多动物能够识别和分类不同的气味,并能决定许多行为和社会反应。对于人类来说,气味刺激与情感、吸引力、情绪等许多过程密切相关。了解嗅觉的一种方法是监测和分析人类在感知气味时的大脑活动。本文分析了五名被试在感知气味刺激和气味刺激时的脑电图。我们确定大脑皮层的区域是活跃的,在辨别不愉快和愉快的气味刺激。我们还发现,对气味感知过程中的脑电信号进行分类,可以较准确地揭示气味的愉悦性。
{"title":"Electroencephalogram alterations during perception of pleasant and unpleasant odors","authors":"A. Yazdani, E. Kroupi, J. Vesin, T. Ebrahimi","doi":"10.1109/QoMEX.2012.6263860","DOIUrl":"https://doi.org/10.1109/QoMEX.2012.6263860","url":null,"abstract":"The olfactory system enables humans and many animals recognize and categorize different odors and can determine many behavioral and social reactions. For human beings, odor stimuli are highly associated with many processes such as emotions, attraction, mood, etc. One approach to understanding the olfaction is to monitor and analyze human brain activity during perception of odors. In this paper, we analyze electroencephalogram (EEG) of five participants during perception of unpleasant and pleasant odor stimuli. We identify the regions of the brain cortex that are active during discrimination of unpleasant and pleasant odor stimuli. We also show that, classification of EEG signals during perception of odors can reveal the pleasantness of the odor with relatively high accuracy.","PeriodicalId":6303,"journal":{"name":"2012 Fourth International Workshop on Quality of Multimedia Experience","volume":"16 1","pages":"272-277"},"PeriodicalIF":0.0,"publicationDate":"2012-07-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"85642552","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 35
Examining subjective evaluation methods used in multimedia Quality of Experience research 探讨多媒体体验质量研究中使用的主观评价方法
Pub Date : 2012-07-05 DOI: 10.1109/QoMEX.2012.6263838
K. Kunze, D. Strohmeier
Many different evaluation methods for assessing the Quality of Experience (QoE) of multimedia systems nowadays exist in official QoE recommendations and methodological publications as well as related areas of research like User experience (UX) and usability. Although the goal of each method is to evaluate QoE in user studies either quantitatively or qualitatively, our first approach to classify these methods beyond results is complex. In this paper, we extend the previously developed comparison model, which was based on literature review only with an evaluation of the developed classes by expert interviews. The interviews deepened our understanding of method comparison and guided method selection process. The results show that different levels of importance can be assigned to the comparison criteria of the first model. Based on the experts' contributions in the interview, we propose a revised comparison model, which is more suitable for adaptation towards its operationalization and the further comparison tool development.
目前,在官方的体验质量建议和方法论出版物以及用户体验(UX)和可用性等相关研究领域中,存在许多用于评估多媒体系统体验质量(QoE)的不同评估方法。尽管每种方法的目标都是定量或定性地评估用户研究中的QoE,但除了结果之外,我们对这些方法进行分类的第一种方法是复杂的。在本文中,我们扩展了先前开发的比较模型,该模型仅基于文献综述,通过专家访谈对开发类进行评估。访谈加深了我们对方法比较和指导方法选择过程的理解。结果表明,第一种模型的比较标准可以划分不同的重要程度。根据专家在访谈中的贡献,我们提出了一个修正的比较模型,该模型更适合于其运作和进一步的比较工具开发。
{"title":"Examining subjective evaluation methods used in multimedia Quality of Experience research","authors":"K. Kunze, D. Strohmeier","doi":"10.1109/QoMEX.2012.6263838","DOIUrl":"https://doi.org/10.1109/QoMEX.2012.6263838","url":null,"abstract":"Many different evaluation methods for assessing the Quality of Experience (QoE) of multimedia systems nowadays exist in official QoE recommendations and methodological publications as well as related areas of research like User experience (UX) and usability. Although the goal of each method is to evaluate QoE in user studies either quantitatively or qualitatively, our first approach to classify these methods beyond results is complex. In this paper, we extend the previously developed comparison model, which was based on literature review only with an evaluation of the developed classes by expert interviews. The interviews deepened our understanding of method comparison and guided method selection process. The results show that different levels of importance can be assigned to the comparison criteria of the first model. Based on the experts' contributions in the interview, we propose a revised comparison model, which is more suitable for adaptation towards its operationalization and the further comparison tool development.","PeriodicalId":6303,"journal":{"name":"2012 Fourth International Workshop on Quality of Multimedia Experience","volume":"48 1","pages":"51-56"},"PeriodicalIF":0.0,"publicationDate":"2012-07-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"86041712","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 9
Microworkers vs. facebook: The impact of crowdsourcing platform choice on experimental results 微工vs. facebook:众包平台选择对实验结果的影响
Pub Date : 2012-07-05 DOI: 10.1109/QoMEX.2012.6263885
B. Gardlo, M. Ries, T. Hossfeld, R. Schatz
Subjective laboratory tests represent a proven, reliable approach towards multimedia quality assessment. Nonetheless, in certain cases novel progressive quality of experience (QoE) assessment methods can lead to better results or enable test execution in more cost-effective ways. In this respect, crowdsourcing can be considered as emerging method enabling researchers to better explore end-user quality perception when requiring a large panel of subjects, particularly for Web application usage scenarios. However, the crowdsourcing platform chosen for recruiting participants can have an impact on the experimental results. In this paper, we examine the platform's influence on QoE results by comparing MOS scores of two otherwise identical subjective HD video quality experiments executed on one paid and one non-paid crowdsourcing platform.
主观实验室测试是评估多媒体质量的可靠方法。尽管如此,在某些情况下,新颖的渐进式经验质量(QoE)评估方法可以产生更好的结果,或者以更具成本效益的方式执行测试。在这方面,众包可以被认为是一种新兴的方法,它使研究人员能够在需要大量主题时更好地探索最终用户的质量感知,特别是在Web应用程序使用场景中。然而,选择招募参与者的众包平台会对实验结果产生影响。在本文中,我们通过比较在一个付费和一个非付费众包平台上进行的两个完全相同的主观高清视频质量实验的MOS分数,来检验平台对QoE结果的影响。
{"title":"Microworkers vs. facebook: The impact of crowdsourcing platform choice on experimental results","authors":"B. Gardlo, M. Ries, T. Hossfeld, R. Schatz","doi":"10.1109/QoMEX.2012.6263885","DOIUrl":"https://doi.org/10.1109/QoMEX.2012.6263885","url":null,"abstract":"Subjective laboratory tests represent a proven, reliable approach towards multimedia quality assessment. Nonetheless, in certain cases novel progressive quality of experience (QoE) assessment methods can lead to better results or enable test execution in more cost-effective ways. In this respect, crowdsourcing can be considered as emerging method enabling researchers to better explore end-user quality perception when requiring a large panel of subjects, particularly for Web application usage scenarios. However, the crowdsourcing platform chosen for recruiting participants can have an impact on the experimental results. In this paper, we examine the platform's influence on QoE results by comparing MOS scores of two otherwise identical subjective HD video quality experiments executed on one paid and one non-paid crowdsourcing platform.","PeriodicalId":6303,"journal":{"name":"2012 Fourth International Workshop on Quality of Multimedia Experience","volume":"95 1","pages":"35-36"},"PeriodicalIF":0.0,"publicationDate":"2012-07-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"90525793","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 20
Peak signal-to-noise ratio revisited: Is simple beautiful? 峰值信噪比:简单美吗?
Pub Date : 2012-07-05 DOI: 10.1109/QoMEX.2012.6263880
J. Korhonen, Junyong You
Heavy criticism has been directed against using peak signal-to-noise ratio (PSNR) as a full reference quality metric for digitally processed images and video, since many studies have shown a weak correlation between subjective quality scores and the respective PSNR values. In this paper, we show that the low performance of PSNR is often related to a content dependent systematic shift of PSNR values. In scenarios with fixed content and distortion types that are typical for visual communications applications, PSNR may perform closely as well, or in some cases even better than the more complex objective quality models known from the literature. Therefore, the use of PSNR may be justified for comparative quality assessment with fixed content.
使用峰值信噪比(PSNR)作为数字处理图像和视频的完整参考质量指标受到了严厉的批评,因为许多研究表明主观质量分数与各自的PSNR值之间存在弱相关性。在本文中,我们证明了PSNR的低性能通常与PSNR值的内容依赖的系统移位有关。在具有固定内容和典型视觉通信应用的失真类型的场景中,PSNR也可以表现得很好,或者在某些情况下甚至比文献中已知的更复杂的客观质量模型更好。因此,使用PSNR可能是合理的比较质量评估与固定内容。
{"title":"Peak signal-to-noise ratio revisited: Is simple beautiful?","authors":"J. Korhonen, Junyong You","doi":"10.1109/QoMEX.2012.6263880","DOIUrl":"https://doi.org/10.1109/QoMEX.2012.6263880","url":null,"abstract":"Heavy criticism has been directed against using peak signal-to-noise ratio (PSNR) as a full reference quality metric for digitally processed images and video, since many studies have shown a weak correlation between subjective quality scores and the respective PSNR values. In this paper, we show that the low performance of PSNR is often related to a content dependent systematic shift of PSNR values. In scenarios with fixed content and distortion types that are typical for visual communications applications, PSNR may perform closely as well, or in some cases even better than the more complex objective quality models known from the literature. Therefore, the use of PSNR may be justified for comparative quality assessment with fixed content.","PeriodicalId":6303,"journal":{"name":"2012 Fourth International Workshop on Quality of Multimedia Experience","volume":"21 1","pages":"37-38"},"PeriodicalIF":0.0,"publicationDate":"2012-07-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"81751965","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 112
期刊
2012 Fourth International Workshop on Quality of Multimedia Experience
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1