{"title":"基于高分辨率图像和隐含知识的无监督地震滑坡识别深度聚类方法","authors":"Xuewen Wang;Xianmin Wang;Haixiang Guo;Aomei Zhang","doi":"10.1109/TGRS.2024.3491789","DOIUrl":null,"url":null,"abstract":"Rapid identification of numerous coseismic landslides following a major earthquake is essential for emergency response and postdisaster recovery. While convolutional neural networks (CNNs) and vision transformers (ViTs) have shown excellent capability in automatic recognition of coseismic landslides, these models require large amounts of training data and computational resources. In addition, there is a lack of additional constraints to restrict the high false alarms of coseismic landslides. To address these challenges, this study proposes an unsupervised deep clustering method coupling remote sensing and implicit knowledge (UC-RSIK) for the recognition of coseismic landslides. The UC-RSIK model integrates a remote sensing feature extraction branch for image reconstruction and an implicit knowledge branch that derives insights from normalized difference vegetation index (NDVI), seismological, geological, topographic, and geographic data. These extracted features are fused and then processed by a self-training adaptive clustering optimization module. This module incorporates hierarchical clustering and autonomously determines the optimal number of image categories, enhancing the effectiveness and robustness of the clustering process. Tested on datasets from the Iburi, Haiti, and Luding earthquakes, UC-RSIK outperformed the state-of-the-art methods such as K-means, Mini-batch K-means, FCM, FSECSGL, and CAE in key metrics like mean Intersection over Union (mIoU) and \n<inline-formula> <tex-math>$F1$ </tex-math></inline-formula>\n values. Furthermore, t-SNE visualization confirmed that UC-RSIK effectively separates landslides and no-landslides in the feature space, demonstrating superior clustering and category discriminating abilities. The results highlight UC-RSIK’s potential as a highly accurate, robust, and adaptable tool for coseismic landslide identification in diverse terrain conditions.","PeriodicalId":13213,"journal":{"name":"IEEE Transactions on Geoscience and Remote Sensing","volume":"62 ","pages":"1-14"},"PeriodicalIF":9.4000,"publicationDate":"2024-11-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Unsupervised Deep Clustering Method for Coseismic Landslide Recognition Based on High-Resolution Images and Implicit Knowledge\",\"authors\":\"Xuewen Wang;Xianmin Wang;Haixiang Guo;Aomei Zhang\",\"doi\":\"10.1109/TGRS.2024.3491789\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Rapid identification of numerous coseismic landslides following a major earthquake is essential for emergency response and postdisaster recovery. While convolutional neural networks (CNNs) and vision transformers (ViTs) have shown excellent capability in automatic recognition of coseismic landslides, these models require large amounts of training data and computational resources. In addition, there is a lack of additional constraints to restrict the high false alarms of coseismic landslides. To address these challenges, this study proposes an unsupervised deep clustering method coupling remote sensing and implicit knowledge (UC-RSIK) for the recognition of coseismic landslides. The UC-RSIK model integrates a remote sensing feature extraction branch for image reconstruction and an implicit knowledge branch that derives insights from normalized difference vegetation index (NDVI), seismological, geological, topographic, and geographic data. These extracted features are fused and then processed by a self-training adaptive clustering optimization module. This module incorporates hierarchical clustering and autonomously determines the optimal number of image categories, enhancing the effectiveness and robustness of the clustering process. Tested on datasets from the Iburi, Haiti, and Luding earthquakes, UC-RSIK outperformed the state-of-the-art methods such as K-means, Mini-batch K-means, FCM, FSECSGL, and CAE in key metrics like mean Intersection over Union (mIoU) and \\n<inline-formula> <tex-math>$F1$ </tex-math></inline-formula>\\n values. Furthermore, t-SNE visualization confirmed that UC-RSIK effectively separates landslides and no-landslides in the feature space, demonstrating superior clustering and category discriminating abilities. The results highlight UC-RSIK’s potential as a highly accurate, robust, and adaptable tool for coseismic landslide identification in diverse terrain conditions.\",\"PeriodicalId\":13213,\"journal\":{\"name\":\"IEEE Transactions on Geoscience and Remote Sensing\",\"volume\":\"62 \",\"pages\":\"1-14\"},\"PeriodicalIF\":9.4000,\"publicationDate\":\"2024-11-05\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Transactions on Geoscience and Remote Sensing\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10744418/\",\"RegionNum\":1,\"RegionCategory\":\"地球科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENGINEERING, ELECTRICAL & ELECTRONIC\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Geoscience and Remote Sensing","FirstCategoryId":"5","ListUrlMain":"https://ieeexplore.ieee.org/document/10744418/","RegionNum":1,"RegionCategory":"地球科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
Unsupervised Deep Clustering Method for Coseismic Landslide Recognition Based on High-Resolution Images and Implicit Knowledge
Rapid identification of numerous coseismic landslides following a major earthquake is essential for emergency response and postdisaster recovery. While convolutional neural networks (CNNs) and vision transformers (ViTs) have shown excellent capability in automatic recognition of coseismic landslides, these models require large amounts of training data and computational resources. In addition, there is a lack of additional constraints to restrict the high false alarms of coseismic landslides. To address these challenges, this study proposes an unsupervised deep clustering method coupling remote sensing and implicit knowledge (UC-RSIK) for the recognition of coseismic landslides. The UC-RSIK model integrates a remote sensing feature extraction branch for image reconstruction and an implicit knowledge branch that derives insights from normalized difference vegetation index (NDVI), seismological, geological, topographic, and geographic data. These extracted features are fused and then processed by a self-training adaptive clustering optimization module. This module incorporates hierarchical clustering and autonomously determines the optimal number of image categories, enhancing the effectiveness and robustness of the clustering process. Tested on datasets from the Iburi, Haiti, and Luding earthquakes, UC-RSIK outperformed the state-of-the-art methods such as K-means, Mini-batch K-means, FCM, FSECSGL, and CAE in key metrics like mean Intersection over Union (mIoU) and
$F1$
values. Furthermore, t-SNE visualization confirmed that UC-RSIK effectively separates landslides and no-landslides in the feature space, demonstrating superior clustering and category discriminating abilities. The results highlight UC-RSIK’s potential as a highly accurate, robust, and adaptable tool for coseismic landslide identification in diverse terrain conditions.
期刊介绍:
IEEE Transactions on Geoscience and Remote Sensing (TGRS) is a monthly publication that focuses on the theory, concepts, and techniques of science and engineering as applied to sensing the land, oceans, atmosphere, and space; and the processing, interpretation, and dissemination of this information.