Learning to Compress Using Deep AutoEncoder

Abstract

A novel deep learning framework for lossy compression is proposed. The framework is based on Deep AutoEncoder (DAE) stacked of Restricted Boltzmann Machines (RBMs), which form Deep Belief Networks (DBNs). The proposed DAE compression scheme is one variant of the known fixed-distortion scheme, where the distortion is fixed and the compression rate is left to optimize. The fixed distortion is achieved by the DBN Blahut-Arimoto algorithm to approximate the Nth-order rate distortion approximating posterior. The trained DBNs are then unrolled to create a DAE, which produces an encoder and a reproducer. The unrolled DAE is fine-tuned with back-propagation through the whole autoencoder to minimize reconstruction errors.