A New Spectral-Spatial Network for Feature Fusion and Classification of Hyperspectral Images

Hyperspectral image (HSI) classification is one of the most important applications among all types of classification fields. Proper classification of spectral data leads to discovery of important land covers. In recent years, many methods have been introduced to increase the HSI classification accuracy. Methods based on neural networks show superior results compared to other methods. Among them, the two-dimensional convolutional neural networks (2D-CNNs) inspired by the human eye retina have achieved higher accuracy in classification. In most cases, HSI classifiers use only spectral features. In this paper, the spectral-spatial feature fusion and HSI classification using 2D-CNN are focused. For this purpose, the first 2D-convolutional layer of CNN is substituted by two combined 2D-Gabor-Shapelet filter banks. This layer extracts contextual information and provides valuable joint spectral-spatial features. The experimental results on real HSI (including the urban and agricultural areas and their mixture) show that the proposed method improves the overall classification performance. Compared to several famous HSI classification based on neural networks, the proposed method has higher speed and classification accuracy.