Pub Date : 2012-07-05DOI: 10.1109/QoMEX.2012.6263887
Mohan Liu, P. Ndjiki-Nya
Contrast measurement is one of the most important tasks in image quality assessment and image enhancement. However, a generic metric to evaluate contrast quality is difficult to design because different applications have different definitions of contrast. In this paper, a new perceptual-based contrast metric for natural images is proposed. Departing from traditional metrics, the proposed measure is based on both the luminance and chrominance information of images. The technical assessment of luminance contrast is mapped onto a perceptualbased measure via a human attention model. Local luminance contrast is also measured to overcome the limitations of the global measure. The CSIQ and the TID2008 databases are used for evaluating the performance of the proposed metric. It is shown that the proposed approach yields a significant improvement in comparison to the state-of-the-art.
{"title":"A new perceptual-based no-reference contrast metric for natural images based on human attention and image dynamic","authors":"Mohan Liu, P. Ndjiki-Nya","doi":"10.1109/QoMEX.2012.6263887","DOIUrl":"https://doi.org/10.1109/QoMEX.2012.6263887","url":null,"abstract":"Contrast measurement is one of the most important tasks in image quality assessment and image enhancement. However, a generic metric to evaluate contrast quality is difficult to design because different applications have different definitions of contrast. In this paper, a new perceptual-based contrast metric for natural images is proposed. Departing from traditional metrics, the proposed measure is based on both the luminance and chrominance information of images. The technical assessment of luminance contrast is mapped onto a perceptualbased measure via a human attention model. Local luminance contrast is also measured to overcome the limitations of the global measure. The CSIQ and the TID2008 databases are used for evaluating the performance of the proposed metric. It is shown that the proposed approach yields a significant improvement in comparison to the state-of-the-art.","PeriodicalId":6303,"journal":{"name":"2012 Fourth International Workshop on Quality of Multimedia Experience","volume":"43 1","pages":"254-259"},"PeriodicalIF":0.0,"publicationDate":"2012-07-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"90321800","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2012-07-05DOI: 10.1109/QoMEX.2012.6263877
Herbert Thoma
This paper presents a system for the subjective evaluation of audio, video and audiovisual quality. The system combines the well known MUSHRA and SAMVIQ methods for evaluation of audio and video quality. The implementation of the system uses inexpensive commercial of the shelf hardware.
{"title":"A system for subjective evaluation of audio, video and audiovisual quality using MUSHRA and SAMVIQ methods","authors":"Herbert Thoma","doi":"10.1109/QoMEX.2012.6263877","DOIUrl":"https://doi.org/10.1109/QoMEX.2012.6263877","url":null,"abstract":"This paper presents a system for the subjective evaluation of audio, video and audiovisual quality. The system combines the well known MUSHRA and SAMVIQ methods for evaluation of audio and video quality. The implementation of the system uses inexpensive commercial of the shelf hardware.","PeriodicalId":6303,"journal":{"name":"2012 Fourth International Workshop on Quality of Multimedia Experience","volume":"111 1","pages":"31-32"},"PeriodicalIF":0.0,"publicationDate":"2012-07-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"87281732","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2012-07-05DOI: 10.1109/QoMEX.2012.6263875
T. Steiner, R. Verborgh, J. Gabarró, R. Walle
In this paper, we present and define aesthetic principles for the automatic generation of media galleries based on media items retrieved from social networks that-after a ranking and pruning step-can serve to authentically summarize events and their atmosphere from a visual and an audial standpoint.
{"title":"Defining aesthetic principles for automatic media gallery layout for visual and audial event summarization based on social networks","authors":"T. Steiner, R. Verborgh, J. Gabarró, R. Walle","doi":"10.1109/QoMEX.2012.6263875","DOIUrl":"https://doi.org/10.1109/QoMEX.2012.6263875","url":null,"abstract":"In this paper, we present and define aesthetic principles for the automatic generation of media galleries based on media items retrieved from social networks that-after a ranking and pruning step-can serve to authentically summarize events and their atmosphere from a visual and an audial standpoint.","PeriodicalId":6303,"journal":{"name":"2012 Fourth International Workshop on Quality of Multimedia Experience","volume":"33 1","pages":"27-28"},"PeriodicalIF":0.0,"publicationDate":"2012-07-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"88391113","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2012-07-05DOI: 10.1109/QoMEX.2012.6263888
S. Egger, T. Hossfeld, R. Schatz, M. Fiedler
A considerable share of applications such as web or e-mail browsing, online picture viewing and file downloads imply waiting times for their users, which is due to the turn-taking of information requests by the user and correspoding response times until each request is fulfilled. Thus, end-user quality perception in the context of interactive data services is dominated by waiting times; the longer the latter, the less satisfied the user becomes. As opposed to heavily researched multimedia experience, perception of waiting times is still not strongly explored in the context of Quality of Experience (QoE). This tutorial will contribute to closing this gap. In its first part, it addresses perception principles and discusses their applicability towards fundamental relationships between waiting times and resulting QoE. It then investigates to which extent the same relationships can also be used to describe QoE for more complex services such as web browsing. Finally, it discusses applications where waiting times determine QoE, amongst other factors. For example, the past shift from UDP media streaming to TCP media streaming (e.g. youtube.com) has extended the relevance of waiting times also to the domain of online video services. In particular, user-perceived quality suffers from initial delays when applications are launched, as well as from freezes during the delivery of the stream. These aspects, which have to be traded against each other to some extent, will be discussed mainly for HTTP video streaming in the last part of this tutorial.
{"title":"Waiting times in quality of experience for web based services","authors":"S. Egger, T. Hossfeld, R. Schatz, M. Fiedler","doi":"10.1109/QoMEX.2012.6263888","DOIUrl":"https://doi.org/10.1109/QoMEX.2012.6263888","url":null,"abstract":"A considerable share of applications such as web or e-mail browsing, online picture viewing and file downloads imply waiting times for their users, which is due to the turn-taking of information requests by the user and correspoding response times until each request is fulfilled. Thus, end-user quality perception in the context of interactive data services is dominated by waiting times; the longer the latter, the less satisfied the user becomes. As opposed to heavily researched multimedia experience, perception of waiting times is still not strongly explored in the context of Quality of Experience (QoE). This tutorial will contribute to closing this gap. In its first part, it addresses perception principles and discusses their applicability towards fundamental relationships between waiting times and resulting QoE. It then investigates to which extent the same relationships can also be used to describe QoE for more complex services such as web browsing. Finally, it discusses applications where waiting times determine QoE, amongst other factors. For example, the past shift from UDP media streaming to TCP media streaming (e.g. youtube.com) has extended the relevance of waiting times also to the domain of online video services. In particular, user-perceived quality suffers from initial delays when applications are launched, as well as from freezes during the delivery of the stream. These aspects, which have to be traded against each other to some extent, will be discussed mainly for HTTP video streaming in the last part of this tutorial.","PeriodicalId":6303,"journal":{"name":"2012 Fourth International Workshop on Quality of Multimedia Experience","volume":"35 1","pages":"86-96"},"PeriodicalIF":0.0,"publicationDate":"2012-07-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"77946748","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2012-07-05DOI: 10.1109/QoMEX.2012.6263841
Markus Waltl, C. Timmerer, Benjamin Rainer, H. Hellwagner
Additional constituents for the representation of multimedia content gained more and more attention. For example, the amount of cinemas equipped with additional devices (e.g., ambient light, vibrating seats, wind generators, water sprayers, heater/coolers) that stimulate senses going beyond audition and vision increases. On the content side the MPEG-V standard specifies - among others - Sensory Effect Metadata (SEM) which provides means to describe sensory effects such as wind, vibration, light, etc. to be attached to audio-visual content and, thus, offering an enhanced and immersive experience for the user. However, there is a lack of a common set of test content allowing for various subjective user studies and verification across different test sites. In this paper we provide our dataset comprising a number of videos from different genres enriched with MPEG-V compliant Sensory Effect Metadata descriptions. Furthermore, we describe possible test setups using off-the-shelf hardware for conducting subjective quality assessments.
{"title":"Sensory effect dataset and test setups","authors":"Markus Waltl, C. Timmerer, Benjamin Rainer, H. Hellwagner","doi":"10.1109/QoMEX.2012.6263841","DOIUrl":"https://doi.org/10.1109/QoMEX.2012.6263841","url":null,"abstract":"Additional constituents for the representation of multimedia content gained more and more attention. For example, the amount of cinemas equipped with additional devices (e.g., ambient light, vibrating seats, wind generators, water sprayers, heater/coolers) that stimulate senses going beyond audition and vision increases. On the content side the MPEG-V standard specifies - among others - Sensory Effect Metadata (SEM) which provides means to describe sensory effects such as wind, vibration, light, etc. to be attached to audio-visual content and, thus, offering an enhanced and immersive experience for the user. However, there is a lack of a common set of test content allowing for various subjective user studies and verification across different test sites. In this paper we provide our dataset comprising a number of videos from different genres enriched with MPEG-V compliant Sensory Effect Metadata descriptions. Furthermore, we describe possible test setups using off-the-shelf hardware for conducting subjective quality assessments.","PeriodicalId":6303,"journal":{"name":"2012 Fourth International Workshop on Quality of Multimedia Experience","volume":"50 1","pages":"115-120"},"PeriodicalIF":0.0,"publicationDate":"2012-07-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"78175966","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2012-07-05DOI: 10.1109/QoMEX.2012.6263872
Tai-Hsiang Huang, Chen-Tai Kao, Yi-Chia Chen, Su-Ling Yeh, Homer H. Chen
Dimming the backlight of a liquid crystal display (LCD) reduces the dynamic range and intensity of a displayed image and hence has a profound impact on the perceived image quality. To reflect the actual degradation of image quality perceived by human eye, we take visibility in addition to contrast into account and develop a visibility model for image quality assessment. The proposed visibility model also considers factors related to the display and the ambient light to accommodate the viewing condition. Experimental results are shown to demonstrate the performance of the proposed model.
{"title":"A visibility model for quality assessment of dimmed images","authors":"Tai-Hsiang Huang, Chen-Tai Kao, Yi-Chia Chen, Su-Ling Yeh, Homer H. Chen","doi":"10.1109/QoMEX.2012.6263872","DOIUrl":"https://doi.org/10.1109/QoMEX.2012.6263872","url":null,"abstract":"Dimming the backlight of a liquid crystal display (LCD) reduces the dynamic range and intensity of a displayed image and hence has a profound impact on the perceived image quality. To reflect the actual degradation of image quality perceived by human eye, we take visibility in addition to contrast into account and develop a visibility model for image quality assessment. The proposed visibility model also considers factors related to the display and the ambient light to accommodate the viewing condition. Experimental results are shown to demonstrate the performance of the proposed model.","PeriodicalId":6303,"journal":{"name":"2012 Fourth International Workshop on Quality of Multimedia Experience","volume":"113 1","pages":"206-211"},"PeriodicalIF":0.0,"publicationDate":"2012-07-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"79387372","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2012-07-05DOI: 10.1109/QoMEX.2012.6263860
A. Yazdani, E. Kroupi, J. Vesin, T. Ebrahimi
The olfactory system enables humans and many animals recognize and categorize different odors and can determine many behavioral and social reactions. For human beings, odor stimuli are highly associated with many processes such as emotions, attraction, mood, etc. One approach to understanding the olfaction is to monitor and analyze human brain activity during perception of odors. In this paper, we analyze electroencephalogram (EEG) of five participants during perception of unpleasant and pleasant odor stimuli. We identify the regions of the brain cortex that are active during discrimination of unpleasant and pleasant odor stimuli. We also show that, classification of EEG signals during perception of odors can reveal the pleasantness of the odor with relatively high accuracy.
{"title":"Electroencephalogram alterations during perception of pleasant and unpleasant odors","authors":"A. Yazdani, E. Kroupi, J. Vesin, T. Ebrahimi","doi":"10.1109/QoMEX.2012.6263860","DOIUrl":"https://doi.org/10.1109/QoMEX.2012.6263860","url":null,"abstract":"The olfactory system enables humans and many animals recognize and categorize different odors and can determine many behavioral and social reactions. For human beings, odor stimuli are highly associated with many processes such as emotions, attraction, mood, etc. One approach to understanding the olfaction is to monitor and analyze human brain activity during perception of odors. In this paper, we analyze electroencephalogram (EEG) of five participants during perception of unpleasant and pleasant odor stimuli. We identify the regions of the brain cortex that are active during discrimination of unpleasant and pleasant odor stimuli. We also show that, classification of EEG signals during perception of odors can reveal the pleasantness of the odor with relatively high accuracy.","PeriodicalId":6303,"journal":{"name":"2012 Fourth International Workshop on Quality of Multimedia Experience","volume":"16 1","pages":"272-277"},"PeriodicalIF":0.0,"publicationDate":"2012-07-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"85642552","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2012-07-05DOI: 10.1109/QoMEX.2012.6263838
K. Kunze, D. Strohmeier
Many different evaluation methods for assessing the Quality of Experience (QoE) of multimedia systems nowadays exist in official QoE recommendations and methodological publications as well as related areas of research like User experience (UX) and usability. Although the goal of each method is to evaluate QoE in user studies either quantitatively or qualitatively, our first approach to classify these methods beyond results is complex. In this paper, we extend the previously developed comparison model, which was based on literature review only with an evaluation of the developed classes by expert interviews. The interviews deepened our understanding of method comparison and guided method selection process. The results show that different levels of importance can be assigned to the comparison criteria of the first model. Based on the experts' contributions in the interview, we propose a revised comparison model, which is more suitable for adaptation towards its operationalization and the further comparison tool development.
{"title":"Examining subjective evaluation methods used in multimedia Quality of Experience research","authors":"K. Kunze, D. Strohmeier","doi":"10.1109/QoMEX.2012.6263838","DOIUrl":"https://doi.org/10.1109/QoMEX.2012.6263838","url":null,"abstract":"Many different evaluation methods for assessing the Quality of Experience (QoE) of multimedia systems nowadays exist in official QoE recommendations and methodological publications as well as related areas of research like User experience (UX) and usability. Although the goal of each method is to evaluate QoE in user studies either quantitatively or qualitatively, our first approach to classify these methods beyond results is complex. In this paper, we extend the previously developed comparison model, which was based on literature review only with an evaluation of the developed classes by expert interviews. The interviews deepened our understanding of method comparison and guided method selection process. The results show that different levels of importance can be assigned to the comparison criteria of the first model. Based on the experts' contributions in the interview, we propose a revised comparison model, which is more suitable for adaptation towards its operationalization and the further comparison tool development.","PeriodicalId":6303,"journal":{"name":"2012 Fourth International Workshop on Quality of Multimedia Experience","volume":"48 1","pages":"51-56"},"PeriodicalIF":0.0,"publicationDate":"2012-07-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"86041712","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2012-07-05DOI: 10.1109/QoMEX.2012.6263885
B. Gardlo, M. Ries, T. Hossfeld, R. Schatz
Subjective laboratory tests represent a proven, reliable approach towards multimedia quality assessment. Nonetheless, in certain cases novel progressive quality of experience (QoE) assessment methods can lead to better results or enable test execution in more cost-effective ways. In this respect, crowdsourcing can be considered as emerging method enabling researchers to better explore end-user quality perception when requiring a large panel of subjects, particularly for Web application usage scenarios. However, the crowdsourcing platform chosen for recruiting participants can have an impact on the experimental results. In this paper, we examine the platform's influence on QoE results by comparing MOS scores of two otherwise identical subjective HD video quality experiments executed on one paid and one non-paid crowdsourcing platform.
{"title":"Microworkers vs. facebook: The impact of crowdsourcing platform choice on experimental results","authors":"B. Gardlo, M. Ries, T. Hossfeld, R. Schatz","doi":"10.1109/QoMEX.2012.6263885","DOIUrl":"https://doi.org/10.1109/QoMEX.2012.6263885","url":null,"abstract":"Subjective laboratory tests represent a proven, reliable approach towards multimedia quality assessment. Nonetheless, in certain cases novel progressive quality of experience (QoE) assessment methods can lead to better results or enable test execution in more cost-effective ways. In this respect, crowdsourcing can be considered as emerging method enabling researchers to better explore end-user quality perception when requiring a large panel of subjects, particularly for Web application usage scenarios. However, the crowdsourcing platform chosen for recruiting participants can have an impact on the experimental results. In this paper, we examine the platform's influence on QoE results by comparing MOS scores of two otherwise identical subjective HD video quality experiments executed on one paid and one non-paid crowdsourcing platform.","PeriodicalId":6303,"journal":{"name":"2012 Fourth International Workshop on Quality of Multimedia Experience","volume":"95 1","pages":"35-36"},"PeriodicalIF":0.0,"publicationDate":"2012-07-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"90525793","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2012-07-05DOI: 10.1109/QoMEX.2012.6263880
J. Korhonen, Junyong You
Heavy criticism has been directed against using peak signal-to-noise ratio (PSNR) as a full reference quality metric for digitally processed images and video, since many studies have shown a weak correlation between subjective quality scores and the respective PSNR values. In this paper, we show that the low performance of PSNR is often related to a content dependent systematic shift of PSNR values. In scenarios with fixed content and distortion types that are typical for visual communications applications, PSNR may perform closely as well, or in some cases even better than the more complex objective quality models known from the literature. Therefore, the use of PSNR may be justified for comparative quality assessment with fixed content.
{"title":"Peak signal-to-noise ratio revisited: Is simple beautiful?","authors":"J. Korhonen, Junyong You","doi":"10.1109/QoMEX.2012.6263880","DOIUrl":"https://doi.org/10.1109/QoMEX.2012.6263880","url":null,"abstract":"Heavy criticism has been directed against using peak signal-to-noise ratio (PSNR) as a full reference quality metric for digitally processed images and video, since many studies have shown a weak correlation between subjective quality scores and the respective PSNR values. In this paper, we show that the low performance of PSNR is often related to a content dependent systematic shift of PSNR values. In scenarios with fixed content and distortion types that are typical for visual communications applications, PSNR may perform closely as well, or in some cases even better than the more complex objective quality models known from the literature. Therefore, the use of PSNR may be justified for comparative quality assessment with fixed content.","PeriodicalId":6303,"journal":{"name":"2012 Fourth International Workshop on Quality of Multimedia Experience","volume":"21 1","pages":"37-38"},"PeriodicalIF":0.0,"publicationDate":"2012-07-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"81751965","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}