A novel spectral-spatial 3D auxiliary conditional GAN integrated convolutional LSTM for hyperspectral image classification

Abstract

Hyperspectral Imaging (HSI) has revolutionized earth observation through advanced remote sensing technology, providing rich spectral and spatial information across multiple bands. However, this wealth of data introduces significant challenges for classification, including high spectral correlation, the curse of dimensionality due to limited labeled data, the need to model long-term dependencies, and the impact of sample input on deep learning performance. These challenges are further exacerbated by the costly and complex acquisition of HSI data, resulting in limited availability of labeled samples and class imbalances. To address these critical issues, our study proposes a novel approach for generating high-quality synthetic hyperspectral data cubes using an advanced Generative Adversarial Network (GAN) integrated with the Wasserstein loss and gradient penalty phenomenon (WGAN-GP). This approach aims to augment real-world data, mitigating the scarcity of labeled samples that has long been a bottleneck in hyperspectral image analysis and classification. To fully leverage both the synthetic and real data, we introduce a novel Convolutional LSTM classifier designed to process the intricate spatial and spectral correlations inherent in hyperspectral data. This classifier excels in modeling multi-dimensional relationships within the data, effectively capturing long-term dependencies and improving feature extraction and classification accuracy. The performance of our proposed model, termed 3D-ACWGAN-ConvLSTM, is rigorously validated using benchmark hyperspectral datasets, demonstrating its effectiveness in augmenting real-world data and enhancing classification performance. This research contributes to addressing the critical need for robust data augmentation techniques in hyperspectral imaging, potentially opening new avenues for applications in areas constrained by limited data availability and complex spectral-spatial relationships.