Pub Date : 2020-01-10DOI: 10.1007/s41233-020-00037-y
H. Men, Vlad Hosu, Hanhe Lin, Andrés Bruhn, D. Saupe
{"title":"Subjective annotation for a frame interpolation benchmark using artefact amplification","authors":"H. Men, Vlad Hosu, Hanhe Lin, Andrés Bruhn, D. Saupe","doi":"10.1007/s41233-020-00037-y","DOIUrl":"https://doi.org/10.1007/s41233-020-00037-y","url":null,"abstract":"","PeriodicalId":74625,"journal":{"name":"Quality and user experience","volume":" ","pages":""},"PeriodicalIF":0.0,"publicationDate":"2020-01-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1007/s41233-020-00037-y","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"43192167","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2020-01-01Epub Date: 2020-10-04DOI: 10.1007/s41233-020-00039-w
Alexandre De Masi, Katarzyna Wac
Progressively, smartphones have become the pocket Swiss army knife for everyone. They support their users needs to accomplish tasks in numerous contexts. However, the applications executing those tasks are regularly not performing as they should, and the user-perceived experience is altered. In this paper, we present our approach to model and predict the Quality of Experience (QoE) of mobile applications used over WiFi or cellular network. We aimed to create predictive QoE models and to derive recommendations for mobile application developers to create QoE aware applications. Previous works on smartphone applications' QoE prediction only focus on qualitative or quantitative data. We collected both qualitative and quantitative data "in the wild" through our living lab. We ran a 4-week-long study with 38 Android phone users. We focused on frequently used and highly interactive applications. The participants rated their mobile applications' expectation and QoE and in various contexts resulting in a total of 6086 ratings. Simultaneously, our smartphone logger (mQoL-Log) collected background information such as network information, user physical activity, battery statistics, and more. We apply various data aggregation approaches and features selection processes to train multiple predictive QoE models. We obtain better model performances using ratings acquired within 14.85 minutes after the application usage. Additionally, we boost our models' performance with the users expectation as a new feature. We create an on-device prediction model with on-smartphone only features. We compare its performance metrics against the previous model. The on-device model performs below the full features models. Surprisingly, among the following top three features: the intended task to accomplish with the app, application's name (e.g., WhatsApp, Spotify), and network Quality of Service (QoS), the user physical activity is the most important feature (e.g., if walking). Finally, we share our recommendations with the application developers, and we discuss the implications of QoE and expectations in mobile application design.
{"title":"Towards accurate models for predicting smartphone applications' QoE with data from a living lab study.","authors":"Alexandre De Masi, Katarzyna Wac","doi":"10.1007/s41233-020-00039-w","DOIUrl":"https://doi.org/10.1007/s41233-020-00039-w","url":null,"abstract":"<p><p>Progressively, smartphones have become the pocket Swiss army knife for everyone. They support their users needs to accomplish tasks in numerous contexts. However, the applications executing those tasks are regularly not performing as they should, and the user-perceived experience is altered. In this paper, we present our approach to model and predict the Quality of Experience (QoE) of mobile applications used over WiFi or cellular network. We aimed to create predictive QoE models and to derive recommendations for mobile application developers to create QoE aware applications. Previous works on smartphone applications' QoE prediction only focus on qualitative or quantitative data. We collected both qualitative and quantitative data \"in the wild\" through our living lab. We ran a 4-week-long study with 38 Android phone users. We focused on frequently used and highly interactive applications. The participants rated their mobile applications' expectation and QoE and in various contexts resulting in a total of 6086 ratings. Simultaneously, our smartphone logger (mQoL-Log) collected background information such as network information, user physical activity, battery statistics, and more. We apply various data aggregation approaches and features selection processes to train multiple predictive QoE models. We obtain better model performances using ratings acquired within 14.85 minutes after the application usage. Additionally, we boost our models' performance with the users expectation as a new feature. We create an on-device prediction model with on-smartphone only features. We compare its performance metrics against the previous model. The on-device model performs below the full features models. Surprisingly, among the following top three features: the intended task to accomplish with the app, application's name (e.g., WhatsApp, Spotify), and network Quality of Service (QoS), the user physical activity is the most important feature (e.g., if walking). Finally, we share our recommendations with the application developers, and we discuss the implications of QoE and expectations in mobile application design.</p>","PeriodicalId":74625,"journal":{"name":"Quality and user experience","volume":"5 1","pages":"10"},"PeriodicalIF":0.0,"publicationDate":"2020-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1007/s41233-020-00039-w","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"38619392","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2019-12-10DOI: 10.1007/s41233-019-0030-8
C. Diaz, Marisa Ponti, P. Haikka, R. V. Basaiawmoit, J. Sherson
{"title":"More than data gatherers: exploring player experience in a citizen science game","authors":"C. Diaz, Marisa Ponti, P. Haikka, R. V. Basaiawmoit, J. Sherson","doi":"10.1007/s41233-019-0030-8","DOIUrl":"https://doi.org/10.1007/s41233-019-0030-8","url":null,"abstract":"","PeriodicalId":74625,"journal":{"name":"Quality and user experience","volume":"5 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2019-12-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1007/s41233-019-0030-8","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"53128366","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2019-11-05DOI: 10.1007/s41233-019-0028-2
Jeehoon Cha, Jan-Niklas Voigt-Antons, Carola Trahms, J. L. O’Sullivan, P. Gellert, A. Kuhlmey, Sebastian Möller, J. Nordheim
{"title":"Finding critical features for predicting quality of life in tablet-based serious games for dementia","authors":"Jeehoon Cha, Jan-Niklas Voigt-Antons, Carola Trahms, J. L. O’Sullivan, P. Gellert, A. Kuhlmey, Sebastian Möller, J. Nordheim","doi":"10.1007/s41233-019-0028-2","DOIUrl":"https://doi.org/10.1007/s41233-019-0028-2","url":null,"abstract":"","PeriodicalId":74625,"journal":{"name":"Quality and user experience","volume":"4 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2019-11-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1007/s41233-019-0028-2","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"53127993","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2019-10-30DOI: 10.1007/s41233-019-0029-1
Georg Regal, Jan-Niklas Voigt-Antons, Steven Schmidt, Johann Schrammel, Tanja Kojić, M. Tscheligi, S. Möller
{"title":"Questionnaires embedded in virtual environments: reliability and positioning of rating scales in virtual environments","authors":"Georg Regal, Jan-Niklas Voigt-Antons, Steven Schmidt, Johann Schrammel, Tanja Kojić, M. Tscheligi, S. Möller","doi":"10.1007/s41233-019-0029-1","DOIUrl":"https://doi.org/10.1007/s41233-019-0029-1","url":null,"abstract":"","PeriodicalId":74625,"journal":{"name":"Quality and user experience","volume":"4 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2019-10-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1007/s41233-019-0029-1","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"53128117","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2019-09-03DOI: 10.1007/s41233-019-0027-3
P. A. Kara, W. Robitza, Nikolett Pinter, M. Martini, A. Raake, Anikó Simon
{"title":"Comparison of HD and UHD video quality with and without the influence of the labeling effect","authors":"P. A. Kara, W. Robitza, Nikolett Pinter, M. Martini, A. Raake, Anikó Simon","doi":"10.1007/s41233-019-0027-3","DOIUrl":"https://doi.org/10.1007/s41233-019-0027-3","url":null,"abstract":"","PeriodicalId":74625,"journal":{"name":"Quality and user experience","volume":" ","pages":""},"PeriodicalIF":0.0,"publicationDate":"2019-09-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1007/s41233-019-0027-3","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"42560640","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2019-06-25DOI: 10.1007/s41233-019-0026-4
L. Janowski, L. Malfait, M. Pinson
{"title":"Evaluating experiment design with unrepeated scenes for video quality subjective assessment","authors":"L. Janowski, L. Malfait, M. Pinson","doi":"10.1007/s41233-019-0026-4","DOIUrl":"https://doi.org/10.1007/s41233-019-0026-4","url":null,"abstract":"","PeriodicalId":74625,"journal":{"name":"Quality and user experience","volume":" ","pages":""},"PeriodicalIF":0.0,"publicationDate":"2019-06-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1007/s41233-019-0026-4","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"47494390","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2018-05-02DOI: 10.1007/s41233-018-0019-8
Stamos Katsigiannis, James J. Scovell, N. Ramzan, L. Janowski, P. Corriveau, Michele A. Saad, G. Van Wallendael
{"title":"Interpreting MOS scores, when can users see a difference? Understanding user experience differences for photo quality","authors":"Stamos Katsigiannis, James J. Scovell, N. Ramzan, L. Janowski, P. Corriveau, Michele A. Saad, G. Van Wallendael","doi":"10.1007/s41233-018-0019-8","DOIUrl":"https://doi.org/10.1007/s41233-018-0019-8","url":null,"abstract":"","PeriodicalId":74625,"journal":{"name":"Quality and user experience","volume":"3 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2018-05-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1007/s41233-018-0019-8","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"53127889","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2018-01-13DOI: 10.1007/s41233-017-0015-4
Tim Walton, Michael Evans
{"title":"The role of human influence factors on overall listening experience","authors":"Tim Walton, Michael Evans","doi":"10.1007/s41233-017-0015-4","DOIUrl":"https://doi.org/10.1007/s41233-017-0015-4","url":null,"abstract":"","PeriodicalId":74625,"journal":{"name":"Quality and user experience","volume":"3 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2018-01-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1007/s41233-017-0015-4","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"53128260","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2017-07-18DOI: 10.1007/s41233-017-0009-2
Sabina Baraković, L. Skorin-Kapov
{"title":"Survey of research on Quality of Experience modelling for web browsing","authors":"Sabina Baraković, L. Skorin-Kapov","doi":"10.1007/s41233-017-0009-2","DOIUrl":"https://doi.org/10.1007/s41233-017-0009-2","url":null,"abstract":"","PeriodicalId":74625,"journal":{"name":"Quality and user experience","volume":"2 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2017-07-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1007/s41233-017-0009-2","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"53127715","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}