Joël Jean-François Gabriel De Plaen, E. Koks, Philip J. Ward
{"title":"建立从卫星图像检测关键基础设施的开放管道--荷兰变电站案例研究","authors":"Joël Jean-François Gabriel De Plaen, E. Koks, Philip J. Ward","doi":"10.1088/2634-4505/ad63c9","DOIUrl":null,"url":null,"abstract":"\n Critical infrastructure (CI) are at risk of failure due to the increased frequency and magnitude of climate extremes related to climate change. It is thus essential to include them in a risk management framework to identify risk hotspots, develop risk management policies and support adaptation strategies to enhance their resilience. However, the lack of information on the exposure of CI to natural hazards prevents their incorporation in large-scale risk assessments. This study sets out to improve the representation of CI for risk assessment studies by building a neural network model to detect CI assets from optical remote sensing imagery. We present a pipeline that extracts CI from OpenStreetMap (OSM), processes the imagery and assets’ masks, and trains a Mask R-CNN model that allows for instance segmentation of CI at the asset level. This study provides an overview of the pipeline and tests it with the detection of electrical substations assets in the Netherlands. Several experiments are presented for different under-sampling percentages of the majority class (25 %, 50 % and 100 %) and hyperparameters settings (batch size and learning rate). The highest scoring experiment achieved an Average Precision at an Intersection over Union of 50 % of 30.93 and a tile F-score of 89.88 %. This allows us to confirm the feasibility of the method and invite disaster risk researchers to use this pipeline for other infrastructure types. We conclude by exploring the different avenues to improve the pipeline by addressing the class imbalance, Transfer Learning and Explainable Artificial Intelligence.","PeriodicalId":476263,"journal":{"name":"Environmental research: infrastructure and sustainability","volume":"85 2","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2024-07-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Towards an open pipeline for the detection of Critical Infrastructure from satellite imagery – a case study on electrical substations in the Netherlands\",\"authors\":\"Joël Jean-François Gabriel De Plaen, E. Koks, Philip J. Ward\",\"doi\":\"10.1088/2634-4505/ad63c9\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"\\n Critical infrastructure (CI) are at risk of failure due to the increased frequency and magnitude of climate extremes related to climate change. It is thus essential to include them in a risk management framework to identify risk hotspots, develop risk management policies and support adaptation strategies to enhance their resilience. However, the lack of information on the exposure of CI to natural hazards prevents their incorporation in large-scale risk assessments. This study sets out to improve the representation of CI for risk assessment studies by building a neural network model to detect CI assets from optical remote sensing imagery. We present a pipeline that extracts CI from OpenStreetMap (OSM), processes the imagery and assets’ masks, and trains a Mask R-CNN model that allows for instance segmentation of CI at the asset level. This study provides an overview of the pipeline and tests it with the detection of electrical substations assets in the Netherlands. Several experiments are presented for different under-sampling percentages of the majority class (25 %, 50 % and 100 %) and hyperparameters settings (batch size and learning rate). The highest scoring experiment achieved an Average Precision at an Intersection over Union of 50 % of 30.93 and a tile F-score of 89.88 %. This allows us to confirm the feasibility of the method and invite disaster risk researchers to use this pipeline for other infrastructure types. We conclude by exploring the different avenues to improve the pipeline by addressing the class imbalance, Transfer Learning and Explainable Artificial Intelligence.\",\"PeriodicalId\":476263,\"journal\":{\"name\":\"Environmental research: infrastructure and sustainability\",\"volume\":\"85 2\",\"pages\":\"\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-07-16\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Environmental research: infrastructure and sustainability\",\"FirstCategoryId\":\"0\",\"ListUrlMain\":\"https://doi.org/10.1088/2634-4505/ad63c9\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Environmental research: infrastructure and sustainability","FirstCategoryId":"0","ListUrlMain":"https://doi.org/10.1088/2634-4505/ad63c9","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
摘要
由于与气候变化相关的极端气候发生频率和规模的增加,关键基础设施(CI)面临着失灵的风险。因此,必须将其纳入风险管理框架,以确定风险热点、制定风险管理政策和支持适应战略,从而增强其抗灾能力。然而,由于缺乏有关沿海地区暴露于自然灾害的信息,因此无法将其纳入大规模风险评估。本研究旨在通过建立一个神经网络模型,从光学遥感图像中检测 CI 资产,从而改进 CI 在风险评估研究中的代表性。我们介绍了一个从 OpenStreetMap (OSM) 中提取 CI、处理图像和资产掩码并训练掩码 R-CNN 模型的管道,该模型允许在资产级别对 CI 进行实例分割。本研究概述了该管道,并通过荷兰变电站资产的检测对其进行了测试。针对多数类的不同低采样率(25%、50% 和 100%)和超参数设置(批量大小和学习率)进行了多次实验。得分最高的实验取得了 30.93% 的平均精确度和 89.88% 的瓦片 F 分数。这使我们能够确认该方法的可行性,并邀请灾害风险研究人员将该管道用于其他类型的基础设施。最后,我们探讨了通过解决类不平衡、迁移学习和可解释人工智能来改进管道的不同途径。
Towards an open pipeline for the detection of Critical Infrastructure from satellite imagery – a case study on electrical substations in the Netherlands
Critical infrastructure (CI) are at risk of failure due to the increased frequency and magnitude of climate extremes related to climate change. It is thus essential to include them in a risk management framework to identify risk hotspots, develop risk management policies and support adaptation strategies to enhance their resilience. However, the lack of information on the exposure of CI to natural hazards prevents their incorporation in large-scale risk assessments. This study sets out to improve the representation of CI for risk assessment studies by building a neural network model to detect CI assets from optical remote sensing imagery. We present a pipeline that extracts CI from OpenStreetMap (OSM), processes the imagery and assets’ masks, and trains a Mask R-CNN model that allows for instance segmentation of CI at the asset level. This study provides an overview of the pipeline and tests it with the detection of electrical substations assets in the Netherlands. Several experiments are presented for different under-sampling percentages of the majority class (25 %, 50 % and 100 %) and hyperparameters settings (batch size and learning rate). The highest scoring experiment achieved an Average Precision at an Intersection over Union of 50 % of 30.93 and a tile F-score of 89.88 %. This allows us to confirm the feasibility of the method and invite disaster risk researchers to use this pipeline for other infrastructure types. We conclude by exploring the different avenues to improve the pipeline by addressing the class imbalance, Transfer Learning and Explainable Artificial Intelligence.