Using autoencoder to facilitate information retention for data dimension reduction

Abstract

Due to the development of internet, plentiful different data appear rapidly. The amounts of features also increase when the technique for collecting data becomes mature. Observation of different data is usually not an easy task because it needs some background related to data pre-processing. Therefore, dimensionality reduction (DR) becomes a familiar method to reduce the amount of features and keep the critical information. However, the loss of information during the processing of dimensionality reduction is unavoidable. When the targeted dimension is far lower than original dimension, the loss is too high to be endurable. To solve this problem, we use the encoder structure from autoencoder to compare to some common dimensionality reduction methods. We use the simplest autoencoder structure as the preprocessing of Support Vector Machine (SVM) to see the result.