Quaternion-based deep image prior with regularization by denoising for color image restoration

Abstract

Deep image prior (DIP) has demonstrated remarkable efficacy in addressing various imaging inverse problems by capitalizing on the inherent biases of deep convolutional architectures to implicitly regularize the solutions. However, its application to color images has been hampered by the conventional DIP method’s treatment of color channels in isolation, ignoring their important inter-channel correlations. To mitigate this limitation, we extend the DIP framework from the real domain to the quaternion domain, introducing a novel quaternion-based deep image prior (QDIP) model specifically tailored for color image restoration. Moreover, to enhance the recovery performance of QDIP and alleviate its susceptibility to the unfavorable overfitting issue, we propose incorporating the concept of regularization by denoising (RED). This approach leverages existing denoisers to regularize inverse problems and integrates the RED scheme into our QDIP model. Extensive experiments on color image denoising, deblurring, and super-resolution demonstrate that the proposed QDIP and QDIP-RED algorithms perform competitively with many state-of-the-art alternatives, both in quantitative and qualitative assessments. The code and data are available at the website: https://github.com/qiuxuanzhizi/QDIP-RED.