Perceptually Optimized Loss Function for Image Super-Resolution

Abstract

Most of the learning based single image super-resolution networks employ intensity loss which measures pixel-wise difference between the estimated high resolution image and the ground truth. Since image components are different with respect to their saliency for HVS, it is desired to weight their impact on the loss functions accordingly. In this paper, a simple perceptual loss function is introduced based on the JPEG compression algorithm. In fact, the two compared images are transformed into DCT domain and then divided by the weighted quantization matrix. The difference between the resultant DCT coefficients shows the most effective components for HVS and can be considered as a perceptual loss function. The experimental results illustrate that employing the proposed loss promotes the convergence speed, and also, provides better outputs in terms of qualitative and quantitative measures.