Open Profiling of Quality: Probing the method in the context of use

Abstract

Descriptive quality evaluations have become an important extension to traditional quantitative psychoperceptual quality evaluation tools in multimedia quality assessments. They allow identifying individual quality factors and complement quantitative satisfaction ratings with this knowledge. The goal of this paper is the validation of the Open Profiling of Quality method in application in the real context of use. We compare the results obtained from evaluations in controlled laboratory environment and a café in which we evaluated the overall quality of mobile 3D videos. The results show that both data sets deliver comparable results for both settings although we were also able to identify differences between the results. The results contribute to the external validity of the OPQ method.