Zhuotong Du , Haigang Sui , Qiming Zhou , Mingting Zhou , Weiyue Shi , Jianxun Wang , Junyi Liu
{"title":"利用空间认知图卷积模型从高分辨率遥感图像中提取矢量化建筑物","authors":"Zhuotong Du , Haigang Sui , Qiming Zhou , Mingting Zhou , Weiyue Shi , Jianxun Wang , Junyi Liu","doi":"10.1016/j.isprsjprs.2024.05.015","DOIUrl":null,"url":null,"abstract":"<div><p>Traditional approach from source image to application vectors in building extraction needs additional complex regularization of converted intermediate raster results. While in conversion, the lost detailed artifacts, unnecessary nodes, and messy paths would be labor-intensive to repair errors and topological issues, even aside the inherent problems of blob-like objects and blurry, jagged edges in first-stage extraction. This research explores new graph convolution-driven solution, the spatial-cognitive shaping model (SCShaping), to directly access vectorization form of individual buildings through spatial cognitive approximation to coordinates that form building boundaries. To strengthen graph nodes expressivity, this method enriches topological feature embedding travelling along the model architecture along with features contributed from convolutional neural network (CNN) extractor. To stimulate the neighboring aggregation in graphs, Graph-Encoder-Decoder mechanism is introduced to augment feature reuse integrating complementary graph convolution layers. The strong embedding guarantees effective feature tapping and the robust structure guarantees the feature mining. Comparative studies have been conducted between the proposed approach with five other methods on three challenging datasets. The results demonstrate the proposed approach yields unanimous and significant improvements in mask-wise metrics, which evaluate object integrity and accuracy, as well as edge-wise metrics, which assess contour regularity and precision. The outperformance also indicates better multi-scale object adaptability of SCShaping. The obtain-and-play SCShaping commands a pleasurable implementation way to advance ideal <em>man</em>–<em>machine</em> collaboration.</p></div>","PeriodicalId":50269,"journal":{"name":"ISPRS Journal of Photogrammetry and Remote Sensing","volume":null,"pages":null},"PeriodicalIF":10.6000,"publicationDate":"2024-05-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Vectorized building extraction from high-resolution remote sensing images using spatial cognitive graph convolution model\",\"authors\":\"Zhuotong Du , Haigang Sui , Qiming Zhou , Mingting Zhou , Weiyue Shi , Jianxun Wang , Junyi Liu\",\"doi\":\"10.1016/j.isprsjprs.2024.05.015\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><p>Traditional approach from source image to application vectors in building extraction needs additional complex regularization of converted intermediate raster results. While in conversion, the lost detailed artifacts, unnecessary nodes, and messy paths would be labor-intensive to repair errors and topological issues, even aside the inherent problems of blob-like objects and blurry, jagged edges in first-stage extraction. This research explores new graph convolution-driven solution, the spatial-cognitive shaping model (SCShaping), to directly access vectorization form of individual buildings through spatial cognitive approximation to coordinates that form building boundaries. To strengthen graph nodes expressivity, this method enriches topological feature embedding travelling along the model architecture along with features contributed from convolutional neural network (CNN) extractor. To stimulate the neighboring aggregation in graphs, Graph-Encoder-Decoder mechanism is introduced to augment feature reuse integrating complementary graph convolution layers. The strong embedding guarantees effective feature tapping and the robust structure guarantees the feature mining. Comparative studies have been conducted between the proposed approach with five other methods on three challenging datasets. The results demonstrate the proposed approach yields unanimous and significant improvements in mask-wise metrics, which evaluate object integrity and accuracy, as well as edge-wise metrics, which assess contour regularity and precision. The outperformance also indicates better multi-scale object adaptability of SCShaping. The obtain-and-play SCShaping commands a pleasurable implementation way to advance ideal <em>man</em>–<em>machine</em> collaboration.</p></div>\",\"PeriodicalId\":50269,\"journal\":{\"name\":\"ISPRS Journal of Photogrammetry and Remote Sensing\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":10.6000,\"publicationDate\":\"2024-05-31\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"ISPRS Journal of Photogrammetry and Remote Sensing\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0924271624002119\",\"RegionNum\":1,\"RegionCategory\":\"地球科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"GEOGRAPHY, PHYSICAL\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"ISPRS Journal of Photogrammetry and Remote Sensing","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0924271624002119","RegionNum":1,"RegionCategory":"地球科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"GEOGRAPHY, PHYSICAL","Score":null,"Total":0}
Vectorized building extraction from high-resolution remote sensing images using spatial cognitive graph convolution model
Traditional approach from source image to application vectors in building extraction needs additional complex regularization of converted intermediate raster results. While in conversion, the lost detailed artifacts, unnecessary nodes, and messy paths would be labor-intensive to repair errors and topological issues, even aside the inherent problems of blob-like objects and blurry, jagged edges in first-stage extraction. This research explores new graph convolution-driven solution, the spatial-cognitive shaping model (SCShaping), to directly access vectorization form of individual buildings through spatial cognitive approximation to coordinates that form building boundaries. To strengthen graph nodes expressivity, this method enriches topological feature embedding travelling along the model architecture along with features contributed from convolutional neural network (CNN) extractor. To stimulate the neighboring aggregation in graphs, Graph-Encoder-Decoder mechanism is introduced to augment feature reuse integrating complementary graph convolution layers. The strong embedding guarantees effective feature tapping and the robust structure guarantees the feature mining. Comparative studies have been conducted between the proposed approach with five other methods on three challenging datasets. The results demonstrate the proposed approach yields unanimous and significant improvements in mask-wise metrics, which evaluate object integrity and accuracy, as well as edge-wise metrics, which assess contour regularity and precision. The outperformance also indicates better multi-scale object adaptability of SCShaping. The obtain-and-play SCShaping commands a pleasurable implementation way to advance ideal man–machine collaboration.
期刊介绍:
The ISPRS Journal of Photogrammetry and Remote Sensing (P&RS) serves as the official journal of the International Society for Photogrammetry and Remote Sensing (ISPRS). It acts as a platform for scientists and professionals worldwide who are involved in various disciplines that utilize photogrammetry, remote sensing, spatial information systems, computer vision, and related fields. The journal aims to facilitate communication and dissemination of advancements in these disciplines, while also acting as a comprehensive source of reference and archive.
P&RS endeavors to publish high-quality, peer-reviewed research papers that are preferably original and have not been published before. These papers can cover scientific/research, technological development, or application/practical aspects. Additionally, the journal welcomes papers that are based on presentations from ISPRS meetings, as long as they are considered significant contributions to the aforementioned fields.
In particular, P&RS encourages the submission of papers that are of broad scientific interest, showcase innovative applications (especially in emerging fields), have an interdisciplinary focus, discuss topics that have received limited attention in P&RS or related journals, or explore new directions in scientific or professional realms. It is preferred that theoretical papers include practical applications, while papers focusing on systems and applications should include a theoretical background.