Volcanic disaster scene classification of remote sensing image based on deep multi-instance network

Abstract

Due to the varieties, random distributions, and rich visual characteristics of the volcanic disaster scene, traditional methods fail to fully express the complex features of volcanic disaster scenes in remote sensing images. To tackle this problem, a new multi-instance network framework with the Shift Windows Transformer (i.e., Swin-T) and attention mechanism is used to classify the volcanic disaster scene from remote sensing images (MI-STA). Firstly, via aggregating the global contextual information of remote sensing image features, the Swin-T extracts the multi-scale hierarchical features of volcano disaster scenes from remote sensing images. Secondly, the channel attention module and spatial attention module fuse to extract the features of volcanic disaster scene to enhance the description and representation for the local details and global information in volcanic disaster scenes. Last, the importance weight of different example characteristics is scored to calculate the attributive probabilities of each instance. This study elaborates an experiment on the xBD dataset and gives comparisons with the commonly used deep network models. The results show that the overall classification accuracy of the proposed method achieves 92.46% and has good performance on the test dataset. Then, we further utilize our model to classify the volcanic disaster scenes of the specific Hunga Tonga-Hunga Ha’apai on January 15, 2022, and the classification images have good consistency with the existing literature. It provides a new approach for volcanic disaster monitoring by means of remote sensing image and has broad application prospects.