Pub Date : 2024-05-16DOI: 10.5194/isprs-archives-xlviii-1-2024-943-2024
Yiru Zhang, Tao Wang, Xiangguo Lin, Zihao Zhao, Xiwei Wang
Abstract. 3D building models is crucial for applications in smart cities. Automatic reconstruction of 3D buildings has been investigated based on various data sources. Point clouds from airborne LiDAR scanners can be used to extract buildings data due to its high accuracy and point density. In this paper, we present a methodology to segment buildings and corresponding rooftop structure from point clouds. First, RandLA-Net, which is an efficient and lightweight neural network for semantic segmentation of large-scale point clouds, is revised and adopted for building segmentation. By implementing local feature aggregation of each point, RandLA-Net can effectively preserve geometric details in point clouds. Besides 3D coordinates of point clouds, we incorporated point attributes including pulse intensity and return numbers into the network as additional features. Feature normalizations are applied to the input features. To achieve a better result of the local feature aggregation, hyperparameters of the network are fine-tuned according to the density of points and building size. Based on the classified building point clouds, DBSCAN clustering algorithm is implemented for segmenting individual buildings. Elevation histogram analysis is conducted to determine optimal threshold values for delineating candidate rooftop point clouds of individual buildings. For the buildings with multiple rooftops, multiple elevation threshold values are necessary to extract corresponding rooftops or walls. Then DBSCAN is employed again for segmentation of individual rooftops and denoising of point clouds of each building. Finally, Alpha-shape analysis is applied based on adaptive threshold values to build the envelope of each rooftop. Experiments show that our implementation of building segmentation using RandLA-net achieves higher mean IoU (Intersection over Union) and better classification performance in building segmentation. ISPRS benchmark data was used in our experiment and our methodology produce results with accuracy of 90.79%.
{"title":"Building Extraction from LiDAR Point Clouds Based on Revised RandLA-Net","authors":"Yiru Zhang, Tao Wang, Xiangguo Lin, Zihao Zhao, Xiwei Wang","doi":"10.5194/isprs-archives-xlviii-1-2024-943-2024","DOIUrl":"https://doi.org/10.5194/isprs-archives-xlviii-1-2024-943-2024","url":null,"abstract":"Abstract. 3D building models is crucial for applications in smart cities. Automatic reconstruction of 3D buildings has been investigated based on various data sources. Point clouds from airborne LiDAR scanners can be used to extract buildings data due to its high accuracy and point density. In this paper, we present a methodology to segment buildings and corresponding rooftop structure from point clouds. First, RandLA-Net, which is an efficient and lightweight neural network for semantic segmentation of large-scale point clouds, is revised and adopted for building segmentation. By implementing local feature aggregation of each point, RandLA-Net can effectively preserve geometric details in point clouds. Besides 3D coordinates of point clouds, we incorporated point attributes including pulse intensity and return numbers into the network as additional features. Feature normalizations are applied to the input features. To achieve a better result of the local feature aggregation, hyperparameters of the network are fine-tuned according to the density of points and building size. Based on the classified building point clouds, DBSCAN clustering algorithm is implemented for segmenting individual buildings. Elevation histogram analysis is conducted to determine optimal threshold values for delineating candidate rooftop point clouds of individual buildings. For the buildings with multiple rooftops, multiple elevation threshold values are necessary to extract corresponding rooftops or walls. Then DBSCAN is employed again for segmentation of individual rooftops and denoising of point clouds of each building. Finally, Alpha-shape analysis is applied based on adaptive threshold values to build the envelope of each rooftop. Experiments show that our implementation of building segmentation using RandLA-net achieves higher mean IoU (Intersection over Union) and better classification performance in building segmentation. ISPRS benchmark data was used in our experiment and our methodology produce results with accuracy of 90.79%.\u0000","PeriodicalId":505918,"journal":{"name":"The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences","volume":"113 10","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-05-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140967915","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Abstract. Nowadays, semantic segmentation results of 3D point cloud have been widely applied in the fields of robotics, autonomous driving, and augmented reality etc. Thanks to the development of relevant deep learning models (such as PointNet), supervised training methods have become hotspot, in which two common limitations exists: inferior feature representation of 3D points and massive annotations. To improve 3D point feature, inspired by the idea of transformer, we employ a so-call LCP network that extracts better feature by investigating attentions between target 3D points and its corresponding local neighbors via local context propagation. Training transformer-based network needs amount of training samples, which itself is a labor-intensive, costly and error-prone work, therefore, this work proposes a weakly supervised framework, in particular, pseudo-labels are estimated based on the feature distances between unlabeled points and prototypes, which are calculated based on labeled data. The extensive experimental results show that, the proposed PL-LCP can yield considerable results (67.6% mIOU for indoor and 67.3% for outdoor) even if only using 1% real labels, and comparing to several state-of-the-art method using all labels, we achieve superior results in mIOU, OA for indoor (65.9%, 89.2%).
{"title":"Weakly Supervised Learning Method for Semantic Segmentation of Large-Scale 3D Point Cloud Based on Transformers","authors":"Zhaoning Zhang, Tengfei Wang, Xin Wang, Zongqian Zhan","doi":"10.5194/isprs-archives-xlviii-1-2024-887-2024","DOIUrl":"https://doi.org/10.5194/isprs-archives-xlviii-1-2024-887-2024","url":null,"abstract":"Abstract. Nowadays, semantic segmentation results of 3D point cloud have been widely applied in the fields of robotics, autonomous driving, and augmented reality etc. Thanks to the development of relevant deep learning models (such as PointNet), supervised training methods have become hotspot, in which two common limitations exists: inferior feature representation of 3D points and massive annotations. To improve 3D point feature, inspired by the idea of transformer, we employ a so-call LCP network that extracts better feature by investigating attentions between target 3D points and its corresponding local neighbors via local context propagation. Training transformer-based network needs amount of training samples, which itself is a labor-intensive, costly and error-prone work, therefore, this work proposes a weakly supervised framework, in particular, pseudo-labels are estimated based on the feature distances between unlabeled points and prototypes, which are calculated based on labeled data. The extensive experimental results show that, the proposed PL-LCP can yield considerable results (67.6% mIOU for indoor and 67.3% for outdoor) even if only using 1% real labels, and comparing to several state-of-the-art method using all labels, we achieve superior results in mIOU, OA for indoor (65.9%, 89.2%).\u0000","PeriodicalId":505918,"journal":{"name":"The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences","volume":"121 47","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-05-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140987434","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Abstract. The Ziyuan-1 (ZY-1) 02E launched on December 26, 2021 is equipped with a thermal infrared sensor (IRS), which has a ground resolution of better than 16m and a width priority of 115km, balancing the advantages of high resolution and large wide observation. The geometric performance of image data is the premise of remote sensing application, and the difficulty in evaluating the geometric performance of thermal infrared image data lies in the extraction of well-distributed, reliable and accurate GCPs. To extract GCP from high-precision reference images, it is necessary to overcome the feature differences between images caused by different spectral responses. This paper adopts a phase correlation matching method based on frequency domain to realize the fine registration of the data obtained by the emission thermal spectral band with the data from the reflectance spectral band, which can not only solve the GCP extraction of conventional thermal infrared images collected during the day, but also obtain satisfactory GCP data from thermal infrared data acquired at night. In order to test the GCP method proposed in this paper, three typical areas are selected as the experimental areas, including Yiyang City in Hunan, Nagqu City in Xizang and Hami City in Xinjiang, and the internal geometric accuracy and absolute geolocation accuracy of the thermal infrared data spanning one year are evaluated and analyzed by using the reference data composed of the DOM with an accuracy of 2m and the DEM with an accuracy of 10m. The research results indicate that the internal geometric accuracy of ZY-1 02E IRS satellite image data is better than 1.0 pixels, and the performance is satisfactory. However, its absolute geolocation accuracy needs to be continuously improved, especially there are systematic errors in the ascending data at night that require further research. Overall, it meets the design accuracy indicators of satellites and can meet the application requirements of thermal infrared remote sensing.
{"title":"Geometric accuracy evaluation and analysis of ZY-1 02E IRS thermal infrared image data using GCP extraction based on phase correlation matching method","authors":"Liping Zhao, X. Dou, Fan Mo, Hongmo Li, Fangxu Zhang, Dian Qu, Junfeng Xie","doi":"10.5194/isprs-archives-xlviii-1-2024-895-2024","DOIUrl":"https://doi.org/10.5194/isprs-archives-xlviii-1-2024-895-2024","url":null,"abstract":"Abstract. The Ziyuan-1 (ZY-1) 02E launched on December 26, 2021 is equipped with a thermal infrared sensor (IRS), which has a ground resolution of better than 16m and a width priority of 115km, balancing the advantages of high resolution and large wide observation. The geometric performance of image data is the premise of remote sensing application, and the difficulty in evaluating the geometric performance of thermal infrared image data lies in the extraction of well-distributed, reliable and accurate GCPs. To extract GCP from high-precision reference images, it is necessary to overcome the feature differences between images caused by different spectral responses. This paper adopts a phase correlation matching method based on frequency domain to realize the fine registration of the data obtained by the emission thermal spectral band with the data from the reflectance spectral band, which can not only solve the GCP extraction of conventional thermal infrared images collected during the day, but also obtain satisfactory GCP data from thermal infrared data acquired at night. In order to test the GCP method proposed in this paper, three typical areas are selected as the experimental areas, including Yiyang City in Hunan, Nagqu City in Xizang and Hami City in Xinjiang, and the internal geometric accuracy and absolute geolocation accuracy of the thermal infrared data spanning one year are evaluated and analyzed by using the reference data composed of the DOM with an accuracy of 2m and the DEM with an accuracy of 10m. The research results indicate that the internal geometric accuracy of ZY-1 02E IRS satellite image data is better than 1.0 pixels, and the performance is satisfactory. However, its absolute geolocation accuracy needs to be continuously improved, especially there are systematic errors in the ascending data at night that require further research. Overall, it meets the design accuracy indicators of satellites and can meet the application requirements of thermal infrared remote sensing.\u0000","PeriodicalId":505918,"journal":{"name":"The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences","volume":" 6","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-05-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140988619","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Abstract. In the process of quality inspection of Remote sensing image data results, the reuse of spatial location information of multiple units, multiple projects and multiple sources can not only overcome the problems of long time to obtain control information, high cost and difficulty in obtaining some areas, but also the basis for achieving efficient and high-precision geometric correction. From the perspective of reusability of checkpoints and saving the cost of quality inspection of remote sensing images, this paper discusses the necessity of joint construction of multi-source and multi-resolution image checkpoint database. And put forward the construction principle and management objectives of checkpoint database. At last, this paper briefly introduces and prospects the application of the national multi-source and multi-resolution image checkpoint database.
{"title":"Research on the Joint Construction of a National Multi-source and Multi-resolution image Checkpoint Database","authors":"Qingqing Yan, Chang Liu, Wenchao Gao, Mingying Wan, Xuan Wu, Shuai Dong","doi":"10.5194/isprs-archives-xlviii-1-2024-793-2024","DOIUrl":"https://doi.org/10.5194/isprs-archives-xlviii-1-2024-793-2024","url":null,"abstract":"Abstract. In the process of quality inspection of Remote sensing image data results, the reuse of spatial location information of multiple units, multiple projects and multiple sources can not only overcome the problems of long time to obtain control information, high cost and difficulty in obtaining some areas, but also the basis for achieving efficient and high-precision geometric correction. From the perspective of reusability of checkpoints and saving the cost of quality inspection of remote sensing images, this paper discusses the necessity of joint construction of multi-source and multi-resolution image checkpoint database. And put forward the construction principle and management objectives of checkpoint database. At last, this paper briefly introduces and prospects the application of the national multi-source and multi-resolution image checkpoint database.\u0000","PeriodicalId":505918,"journal":{"name":"The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences","volume":" 7","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-05-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140988710","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-05-11DOI: 10.5194/isprs-archives-xlviii-1-2024-813-2024
Mengshi Yang, Saiwei Li, Hang Yu, Hao Wu, Menghua Li
Abstract. Current multi-epoch InSAR techniques heavily rely on the assumption of linear deformation. This can sometimes overlook crucial deformation signals when using velocities for evaluation. The process of interpreting InSAR time series is not only time-consuming and labor-intensive but also requires a certain level of expertise. This study refines existing InSAR deformation categories, such as stable, linear, step, piecewise linear, power, and undefined, to define 'canonical deformation time series patterns.' We propose an innovative approach for InSAR post-processing using Temporal Convolutional Networks (TCN) and transfer learning. Due to the limited availability of real data, we use simulated data to train a pre-existing model. We then assess the effectiveness of our method in identifying urban deformation patterns. This research could significantly improve our understanding of large-scale InSAR time series deformation and reveal the underlying patterns.
{"title":"Revealing Urban Deformation Patterns through InSAR Time Series Analysis with TCN and Transfer Learning","authors":"Mengshi Yang, Saiwei Li, Hang Yu, Hao Wu, Menghua Li","doi":"10.5194/isprs-archives-xlviii-1-2024-813-2024","DOIUrl":"https://doi.org/10.5194/isprs-archives-xlviii-1-2024-813-2024","url":null,"abstract":"Abstract. Current multi-epoch InSAR techniques heavily rely on the assumption of linear deformation. This can sometimes overlook crucial deformation signals when using velocities for evaluation. The process of interpreting InSAR time series is not only time-consuming and labor-intensive but also requires a certain level of expertise. This study refines existing InSAR deformation categories, such as stable, linear, step, piecewise linear, power, and undefined, to define 'canonical deformation time series patterns.' We propose an innovative approach for InSAR post-processing using Temporal Convolutional Networks (TCN) and transfer learning. Due to the limited availability of real data, we use simulated data to train a pre-existing model. We then assess the effectiveness of our method in identifying urban deformation patterns. This research could significantly improve our understanding of large-scale InSAR time series deformation and reveal the underlying patterns.\u0000","PeriodicalId":505918,"journal":{"name":"The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences","volume":" 410","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-05-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140989839","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-05-11DOI: 10.5194/isprs-archives-xlviii-1-2024-849-2024
Longqi Zhang, Wenwen He, Yunkai Guo, Xiao Teng
Abstract. This study addresses the intricate challenges encountered in the data governance process of Non-grain Production (NGP) on Arable land. This involves managing data from diverse sources, with varying accuracies and formats, and utilizing multiple specialized software tools. An object-oriented approach is adopted to encapsulate experiential knowledge related to the data and associated processing methods, thus creating an Application Knowledge Body Model (AKBM). This model acts as a conduit between users and computational resources, encompassing various types of data and their corresponding processing and analysis methods. Moreover, by employing model inference techniques to devise methods for transitioning from raw data models to target models, a foundation is laid for the accumulation, sharing, and intelligent application of expertise on data, methods, models, and knowledge.The application examples demonstrate that users can directly construct new solutions containing relevant data and associated processing methods, rather than grappling with a multitude of data files and complex specialized software when encountering novel challenges. This promotes collaborative development in data governance on geospatial big data platforms, significantly enhancing governance efficiency, improving the quality of information support in NGP cultivation management, advancing current technological capabilities, and fostering the progression of related technologies.
{"title":"A Smart Application Frame of Remote Sensing in Non-grain Production Data Governance","authors":"Longqi Zhang, Wenwen He, Yunkai Guo, Xiao Teng","doi":"10.5194/isprs-archives-xlviii-1-2024-849-2024","DOIUrl":"https://doi.org/10.5194/isprs-archives-xlviii-1-2024-849-2024","url":null,"abstract":"Abstract. This study addresses the intricate challenges encountered in the data governance process of Non-grain Production (NGP) on Arable land. This involves managing data from diverse sources, with varying accuracies and formats, and utilizing multiple specialized software tools. An object-oriented approach is adopted to encapsulate experiential knowledge related to the data and associated processing methods, thus creating an Application Knowledge Body Model (AKBM). This model acts as a conduit between users and computational resources, encompassing various types of data and their corresponding processing and analysis methods. Moreover, by employing model inference techniques to devise methods for transitioning from raw data models to target models, a foundation is laid for the accumulation, sharing, and intelligent application of expertise on data, methods, models, and knowledge.The application examples demonstrate that users can directly construct new solutions containing relevant data and associated processing methods, rather than grappling with a multitude of data files and complex specialized software when encountering novel challenges. This promotes collaborative development in data governance on geospatial big data platforms, significantly enhancing governance efficiency, improving the quality of information support in NGP cultivation management, advancing current technological capabilities, and fostering the progression of related technologies.\u0000","PeriodicalId":505918,"journal":{"name":"The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences","volume":"115 12","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-05-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140988012","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Abstract. Geometric correction, a pivotal step in the preprocessing of airborne remote sensing imagery, is critical for ensuring the accuracy of subsequent quantitative analyses. Achieving precise and efficient geometric correction for airborne hyperspectral data remains a significant challenge in the field. This study presents a new method for system-level and fine-scale geometric correction of uncontrolled airborne images utilizing DEM data, which integrates forward and inverse transformation algorithms. Furthermore, an optimized workflow is proposed to facilitate the processing of large-scale hyperspectral datasets. The effectiveness of the proposed method is demonstrated through an application analysis using airborne HyMap imagery, with experimental outcomes indicating high application accuracy and enhanced processing efficiency.
摘要几何校正是航空遥感图像预处理的关键步骤，对于确保后续定量分析的准确性至关重要。如何对机载高光谱数据进行精确、高效的几何校正仍是该领域的一项重大挑战。本研究提出了一种利用 DEM 数据对不受控制的机载图像进行系统级和精细尺度几何校正的新方法，该方法集成了正向和反向变换算法。此外，还提出了一个优化的工作流程，以促进大规模高光谱数据集的处理。通过使用机载 HyMap 图像进行应用分析，证明了所提方法的有效性，实验结果表明应用精度高，处理效率更高。
{"title":"Efficient Geometric Correction Workflow for Airborne Hyperspectral Images through DEM-Driven Correction Techniques","authors":"Junchuan Yu, Yichuan Li, Daqing Ge, Yangyang Chen, Qiong Wu, Yanni Ma","doi":"10.5194/isprs-archives-xlviii-1-2024-831-2024","DOIUrl":"https://doi.org/10.5194/isprs-archives-xlviii-1-2024-831-2024","url":null,"abstract":"Abstract. Geometric correction, a pivotal step in the preprocessing of airborne remote sensing imagery, is critical for ensuring the accuracy of subsequent quantitative analyses. Achieving precise and efficient geometric correction for airborne hyperspectral data remains a significant challenge in the field. This study presents a new method for system-level and fine-scale geometric correction of uncontrolled airborne images utilizing DEM data, which integrates forward and inverse transformation algorithms. Furthermore, an optimized workflow is proposed to facilitate the processing of large-scale hyperspectral datasets. The effectiveness of the proposed method is demonstrated through an application analysis using airborne HyMap imagery, with experimental outcomes indicating high application accuracy and enhanced processing efficiency.\u0000","PeriodicalId":505918,"journal":{"name":"The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences","volume":" May","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-05-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140990040","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-05-11DOI: 10.5194/isprs-archives-xlviii-1-2024-855-2024
Wei Zhang, Guanghui Wang, Guoqing Yao, Chen Lu, Yu Liu
Abstract. Rapid access to the operating status of Photovoltaic (PV) panels and troubleshooting can save management and maintenance costs for the development of PV power plants, which is important for PV power plant management and power generation capacity assurance. The use of remote sensing technology to identify the faults of photovoltaic panels has developed rapidly, however, current research usually relies only on a single optical data source to identify and count the area of PV panels in a PV electric field, although there are literature on PV panel fault detection, only the surface fault identification of PV panels is tested, while the internal faults (such as panel bad points or bad lines) cannot be identified because of the limitations of optical remote sensing. In this paper, a photovoltaic panel fault monitoring technology based on multi-source remote sensing is proposed. The optical and thermal infrared hybrid data combined with deep learning technology are used to achieve rapid and accurate fault identification and localization of PV panel arrays. It can not only automatically identify PV panels that are obscured by dust and foreign objects, but also locate PV panels that have bad dots or bad lines, which greatly improves the ability and effectiveness of remote sensing PV panel fault monitoring. The high-resolution unmanned air vehicle (UAV) optical image and thermal infrared image are applied in this experiment. The Mask RCNN algorithm is used to accurately locate and number the photovoltaic panel of the optical image. Then, the fault scene classification model is established for the multi-type fault characteristics of the optical image and thermal infrared image within the panel range, so as to identify five types of faults, such as dust cover, branch cover, bird droppings cover, internal bad points and bad lines of PV panel, which effectively solves the problem that the single optical remote sensing image cannot identify the internal component faults of the photovoltaic panel under normal conditions.
{"title":"Study on Fault Monitoring Technology of Photovoltaic Panel Based on Thermal Infrared and Optical Remote Sensing","authors":"Wei Zhang, Guanghui Wang, Guoqing Yao, Chen Lu, Yu Liu","doi":"10.5194/isprs-archives-xlviii-1-2024-855-2024","DOIUrl":"https://doi.org/10.5194/isprs-archives-xlviii-1-2024-855-2024","url":null,"abstract":"Abstract. Rapid access to the operating status of Photovoltaic (PV) panels and troubleshooting can save management and maintenance costs for the development of PV power plants, which is important for PV power plant management and power generation capacity assurance. The use of remote sensing technology to identify the faults of photovoltaic panels has developed rapidly, however, current research usually relies only on a single optical data source to identify and count the area of PV panels in a PV electric field, although there are literature on PV panel fault detection, only the surface fault identification of PV panels is tested, while the internal faults (such as panel bad points or bad lines) cannot be identified because of the limitations of optical remote sensing. In this paper, a photovoltaic panel fault monitoring technology based on multi-source remote sensing is proposed. The optical and thermal infrared hybrid data combined with deep learning technology are used to achieve rapid and accurate fault identification and localization of PV panel arrays. It can not only automatically identify PV panels that are obscured by dust and foreign objects, but also locate PV panels that have bad dots or bad lines, which greatly improves the ability and effectiveness of remote sensing PV panel fault monitoring. The high-resolution unmanned air vehicle (UAV) optical image and thermal infrared image are applied in this experiment. The Mask RCNN algorithm is used to accurately locate and number the photovoltaic panel of the optical image. Then, the fault scene classification model is established for the multi-type fault characteristics of the optical image and thermal infrared image within the panel range, so as to identify five types of faults, such as dust cover, branch cover, bird droppings cover, internal bad points and bad lines of PV panel, which effectively solves the problem that the single optical remote sensing image cannot identify the internal component faults of the photovoltaic panel under normal conditions.\u0000","PeriodicalId":505918,"journal":{"name":"The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences","volume":"124 38","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-05-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140987143","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Abstract. Stone cultural heritage is exposed to various environments, resulting in a diverse range of weathering types. The identification of these weathering types is vital for targeted conservation efforts. In this paper, a weathering type classification method based on hyperspectral imaging technology is proposed. Firstly, fresh sandstones are collected from Yungang Grottoes to carry out the simulated weathering experiments, including freeze-thaw cycles and wet-dry cycles with acid, alkali and salt solutions. Subsequently, the hyperspectral imaging system was used to collect the visible-near-infrared (VNIR) and short-wave infrared (SWIR) images of the sandstone samples with different weathering types and degrees. The surface spectral reflectance of sandstone samples with different weathering types were used as training data, with weathering types serving as the labels. Support vector machine (SVM), K-nearest neighbour (KNN), linear discriminant analysis (LDA) and random forest (RF) were used to establish weathering type classification models. The results show that the SVM model and LDA model based on both VNIR and SWIR spectra exhibit outstanding performance, with a best accuracy of 0.994. The framework proposed in this paper facilitates rapid and non-contact assessment of the weathering types of the superficial layers of stone cultural heritage, thereby supporting more targeted conservation work.
{"title":"Non-Destructive Assessment of Stone Heritage Weathering Types Based on Machine Learning Method Using Hyperspectral Data","authors":"Xin Wang, Yuan Cheng, Ruoyu Zhang, Yue Zhang, Jizhong Huang, Hongbin Yan","doi":"10.5194/isprs-archives-xlviii-1-2024-713-2024","DOIUrl":"https://doi.org/10.5194/isprs-archives-xlviii-1-2024-713-2024","url":null,"abstract":"Abstract. Stone cultural heritage is exposed to various environments, resulting in a diverse range of weathering types. The identification of these weathering types is vital for targeted conservation efforts. In this paper, a weathering type classification method based on hyperspectral imaging technology is proposed. Firstly, fresh sandstones are collected from Yungang Grottoes to carry out the simulated weathering experiments, including freeze-thaw cycles and wet-dry cycles with acid, alkali and salt solutions. Subsequently, the hyperspectral imaging system was used to collect the visible-near-infrared (VNIR) and short-wave infrared (SWIR) images of the sandstone samples with different weathering types and degrees. The surface spectral reflectance of sandstone samples with different weathering types were used as training data, with weathering types serving as the labels. Support vector machine (SVM), K-nearest neighbour (KNN), linear discriminant analysis (LDA) and random forest (RF) were used to establish weathering type classification models. The results show that the SVM model and LDA model based on both VNIR and SWIR spectra exhibit outstanding performance, with a best accuracy of 0.994. The framework proposed in this paper facilitates rapid and non-contact assessment of the weathering types of the superficial layers of stone cultural heritage, thereby supporting more targeted conservation work.\u0000","PeriodicalId":505918,"journal":{"name":"The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences","volume":"115 14","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-05-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140988010","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-05-11DOI: 10.5194/isprs-archives-xlviii-1-2024-691-2024
Xiaofeng Wang, Lu An, P. Langen, Rongxing Li
Abstract. The firn temperature is a crucial parameter for understanding firn densification processes of the Antarctic Ice Sheet (AIS). Simulations with firn densification models (FDM) can be conceptualized as a function that relies on forcing data, comprising temperature and surface mass balance, together with tuning parameters determined based on measured depth-density profiles from different locations. The simulated firn temperature is obtained in the firn densification models by solving the one-dimensional heat conduction equation. Microwave satellite data on brightness temperature at different frequencies can also provide remote sensing monitoring of firn temperature variations across the AIS (i.e., the L-band up to 1500 meters). The firn temperature can be estimated by the microwave emission model and the regression method, but these two methods need more observations of temperature profiles for correction and validation. Therefore, we compiled a dataset with temperature profiles and temperature observations with depth around 10 meters. In this work, two methods were used to simulate/retrieve firn temperature across the Antarctic ice sheet. One method estimated the temperature profiles by solving the one-dimensional heat conduction equation driven by reanalyses and regional climate models, which are used in the simulation of FDMs. The other one established a relationship between the multi-frequency brightness temperature data from microwave remote sensing satellites and the firn temperature.
摘要冷杉温度是了解南极冰盖（AIS）冷杉致密化过程的关键参数。杉岩致密化模型（FDM）的模拟可以理解为一种函数，它依赖于包括温度和地表质量平衡在内的强迫数据，以及根据不同地点测量的深度-密度剖面确定的调整参数。在冷杉致密化模型中，模拟冷杉温度是通过求解一维热传导方程得到的。不同频率亮度温度的微波卫星数据也可对整个澳大利亚国际空间站（即 L 波段至 1500 米）的杉林温度变化进行遥感监测。杉林温度可通过微波发射模型和回归法估算，但这两种方法需要更多的温度剖面观测数据进行修正和验证。因此，我们编制了一个数据集，其中包含温度曲线和深度在 10 米左右的温度观测数据。在这项工作中，使用了两种方法来模拟/检索南极冰盖上的枞树温度。一种方法是通过求解由再分析和区域气候模型驱动的一维热传导方程来估算温度曲线，这些模型被用于模拟FDM。另一种方法则在微波遥感卫星提供的多频亮度温度数据与杉岩温度之间建立了一种关系。
{"title":"Comparing firn temperature profile retrieval based on the firn densification model and microwave data over the Antarctica","authors":"Xiaofeng Wang, Lu An, P. Langen, Rongxing Li","doi":"10.5194/isprs-archives-xlviii-1-2024-691-2024","DOIUrl":"https://doi.org/10.5194/isprs-archives-xlviii-1-2024-691-2024","url":null,"abstract":"Abstract. The firn temperature is a crucial parameter for understanding firn densification processes of the Antarctic Ice Sheet (AIS). Simulations with firn densification models (FDM) can be conceptualized as a function that relies on forcing data, comprising temperature and surface mass balance, together with tuning parameters determined based on measured depth-density profiles from different locations. The simulated firn temperature is obtained in the firn densification models by solving the one-dimensional heat conduction equation. Microwave satellite data on brightness temperature at different frequencies can also provide remote sensing monitoring of firn temperature variations across the AIS (i.e., the L-band up to 1500 meters). The firn temperature can be estimated by the microwave emission model and the regression method, but these two methods need more observations of temperature profiles for correction and validation. Therefore, we compiled a dataset with temperature profiles and temperature observations with depth around 10 meters. In this work, two methods were used to simulate/retrieve firn temperature across the Antarctic ice sheet. One method estimated the temperature profiles by solving the one-dimensional heat conduction equation driven by reanalyses and regional climate models, which are used in the simulation of FDMs. The other one established a relationship between the multi-frequency brightness temperature data from microwave remote sensing satellites and the firn temperature.\u0000","PeriodicalId":505918,"journal":{"name":"The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences","volume":" 7","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-05-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140988425","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
京公网安备 11010802042870号
京ICP备2023020795号-1
扫码关注我们
求助内容：
应助结果提醒方式：