Performance comparison of subjective assessment methods for 3D video quality

Many subjective assessment methods for video quality have been standardized. Although the performance of individual subjective assessment methods of 2D video quality has been studied to compare their stability, the performance per subjective assessment method for stereoscopic 3D video quality has not been sufficiently studied. To compare this performance, we conducted subjective quality assessments of 3D video using the double stimulus continuous quality-scale (DSCQS), absolute category rating (ACR), and degradation category rating (DCR) methods. As a result, the Pearson's and Spearman's rank correlations between two of the four methods (i.e., DSCQS, ACR, DCR, and ACR with hidden reference (ACR-HR)) were high. In terms of stability, the DCR method performed better than the others. However, in terms of both stability and assessment time, we found that the ACR method was most effective.