Trilateral filtering-based hybrid up-sampling in dual domains for single video frame super resolution

Abstract

Up-sampling has been one of the key techniques for multimedia processing. Higher resolution videos are always the pursuit goal of major customers. Pervasive applications of multimedia processing starve for this technique to solve mismatch problems in display resolutions between senders and receivers. The hybrid DCT-Wiener-based interpolation method designs a powerful framework to interpolate video frames by mining the information in both spatial and DCT domain briefly. It can provide better objective as well as visual qualities with low complexity than many existing well studied interpolation methods. This paper presents an analysis about the bottleneck of hybrid DCT-Wiener-based interpolation method firstly. And then, proposes a trilateral filtering-based hybrid up-sampling algorithm in dual domains, which has dug the information in spatial and frequency domains more deeply. The proposed spatial domain interpolation scheme is an adaptive Wiener filter with a trilateral filtering enhancement, which possess capability to overcome the quarter-pixel shift mismatch of hybrid DCT-Wiener-based interpolation method and achieve much more accurate detail information estimation. Furthermore, flexible block size chosen mechanism in frequency domain enables the whole proposed up-sampling algorithm achieve further advantages in high frequency coefficients retaining. Experiments have been carried out to demonstrate that the proposed algorithm is able to achieve noticeable gains over state of art methods in both objective and visual qualities measurements.