Automatic QoE Evaluation of DASH Streaming using ITU-T Standard P.1203 and Google Puppeteer

Abstract

This document presents a framework for the evaluation of DASH (Dynamic Adaptive Streaming over HTTP) systems, which allows performance measurements to be carried out in an automated and systematic way. We have used Puppeteer, the Node.js library developed by Google, which provides a high level API. This API allows us to automate actions on Chrome Devtools Protocol, such as: start playback, make bandwidth changes and save results of quality change processes, timestamps, stalls and so on. From this data, a processing is made to allow the reconstruction of the visualized video, as well as the extraction of quality metrics and the automated evaluation of the QoE (Quality of Experience) using the ITU-T P.1203 standard.