首页 > 最新文献

International Journal of Applied Earth Observation and Geoinformation最新文献

英文 中文
Quantifying indoor navigation map information considering the dynamic map elements for scale adaptation 考虑动态地图元素的室内导航地图信息量化比例尺适应
IF 7.5 1区 地球科学 Q1 Earth and Planetary Sciences Pub Date : 2024-12-18 DOI: 10.1016/j.jag.2024.104323
Jingyi Zhou, Jie Shen, Cheng Fu, Robert Weibel, Zhiyong Zhou
The indoor map is an indispensable component to visualize human users’ real-time locations and guided routes to find their destinations in large and complex buildings efficiently. The map design in existing mobile indoor navigation systems mostly considers either the user locations or the route segments but seldom considers the adaptation of the base map scale. Due to uneven densities of spatial elements, the complexity of routes, and the diversity of spatial distribution of navigation decision points, the base map information of indoor navigation maps varies greatly. Hence, it is inevitable to cause an inappropriate amount of map information at different locations and routes. Additionally, existing multi-scale representations of indoor maps are limited to certain scales but not adapted to building locations. Users have to adjust the map scales frequently through multiple interactions with the navigation system. In this study, we propose a method that considers the dynamic elements of indoor maps to quantify the map information for scale adaptation. The indoor navigation map information calculation includes both geometry information and spatial distribution information of static base map elements (area elements, POIs) and dynamic route elements (segments, decision points). The total map information is quantified by setting the weights of the two types of elements. An empirical study on indoor navigation map selection was conducted. Results show that the quantified map information using the proposed method can reflect a user-desired map better than the traditionally used scales.
在大型复杂的建筑物中,室内地图是可视化人类用户实时位置和引导路线的重要组成部分,可以有效地找到他们的目的地。现有移动室内导航系统的地图设计多考虑用户位置或路线段,很少考虑基图比例尺的自适应。由于空间要素密度的不均匀性、路线的复杂性以及导航决策点空间分布的多样性,室内导航地图的底图信息差异很大。因此,不可避免地会在不同的位置和路线上造成不适当的地图信息。此外,现有的室内地图的多比例尺表示仅限于某些比例尺,而不适合建筑位置。用户必须通过与导航系统的多次交互频繁地调整地图比例尺。在本研究中,我们提出了一种考虑室内地图动态元素的方法来量化地图信息以进行比例尺适应。室内导航地图信息计算包括静态底图元素(面积元素、点)和动态路线元素(路段、决策点)的几何信息和空间分布信息。通过设置两类元素的权重来量化总的地图信息。对室内导航地图的选择进行了实证研究。结果表明,与传统的比例尺相比,该方法能更好地反映用户期望的地图信息。
{"title":"Quantifying indoor navigation map information considering the dynamic map elements for scale adaptation","authors":"Jingyi Zhou, Jie Shen, Cheng Fu, Robert Weibel, Zhiyong Zhou","doi":"10.1016/j.jag.2024.104323","DOIUrl":"https://doi.org/10.1016/j.jag.2024.104323","url":null,"abstract":"The indoor map is an indispensable component to visualize human users’ real-time locations and guided routes to find their destinations in large and complex buildings efficiently. The map design in existing mobile indoor navigation systems mostly considers either the user locations or the route segments but seldom considers the adaptation of the base map scale. Due to uneven densities of spatial elements, the complexity of routes, and the diversity of spatial distribution of navigation decision points, the base map information of indoor navigation maps varies greatly. Hence, it is inevitable to cause an inappropriate amount of map information at different locations and routes. Additionally, existing multi-scale representations of indoor maps are limited to certain scales but not adapted to building locations. Users have to adjust the map scales frequently through multiple interactions with the navigation system. In this study, we propose a method that considers the dynamic elements of indoor maps to quantify the map information for scale adaptation. The indoor navigation map information calculation includes both geometry information and spatial distribution information of static base map elements (area elements, POIs) and dynamic route elements (segments, decision points). The total map information is quantified by setting the weights of the two types of elements. An empirical study on indoor navigation map selection was conducted. Results show that the quantified map information using the proposed method can reflect a user-desired map better than the traditionally used scales.","PeriodicalId":50341,"journal":{"name":"International Journal of Applied Earth Observation and Geoinformation","volume":"85 1","pages":""},"PeriodicalIF":7.5,"publicationDate":"2024-12-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142874863","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"地球科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
PCET: Patch Confidence-Enhanced Transformer with efficient spectral–spatial features for hyperspectral image classification ppet:具有高效光谱空间特征的高光谱图像分类补丁置信度增强变压器
IF 7.5 1区 地球科学 Q1 Earth and Planetary Sciences Pub Date : 2024-12-18 DOI: 10.1016/j.jag.2024.104308
Li Fang, Xuanli Lan, Tianyu Li, Huifang Shen
Hyperspectral image (HSI) classification based on deep learning has demonstrated promising performance. In general, using patch-wise samples helps to extract the spatial relationship between pixels and local contextual information. However, the presence of background or other category information in an image patch that is inconsistent with the central target category has a negative effect on classification. To solve this issue, a patch confidence-enhanced transformer (PCET) approach for HSI classification is proposed. To be specific, we design a patch quality assessment (PQA) branch model to evaluate the input patches during training process, which effectively filters out the intrusive non-central pixels. The output confidence of the branch model serves as a quantitative indicator of the contribution degree of the input patch to the overall training efficacy, which is subsequently weighted in the loss function, thereby endowing the model with the capability to dynamically adjust its learning focus based on the qualitative of the inputs. Second, a spectral–spatial multi-feature fusion (SSMF) module is devised to procure scores of representative information simultaneously and fully exploit the potential of multi-scale feature HSI data. Finally, to enhance feature discrimination, global context is efficiently modeled using the efficient additive attention transformer (EA2T) module, which streamlines the attention process and allows the model to learn efficient and robust global representations for accurate classification of the central pixel. A series of experimental results executed on real HSI datasets have substantiated that the proposed PCET can achieve outstanding performance, even when only 10 samples per category are used for training.
基于深度学习的高光谱图像(HSI)分类已经显示出良好的性能。通常,使用逐块采样有助于提取像素和局部上下文信息之间的空间关系。然而,在图像补丁中存在与中心目标类别不一致的背景或其他类别信息会对分类产生负面影响。为了解决这一问题,提出了一种贴片置信度增强变压器(PCET)方法用于HSI分类。具体来说,我们设计了一个patch quality assessment (PQA)分支模型,在训练过程中对输入的patch进行评估,有效滤除了干扰的非中心像素。分支模型的输出置信度作为输入片段对整体训练效果贡献程度的定量指标,随后在损失函数中进行加权,从而使模型具有根据输入的定性动态调整学习重点的能力。其次,设计了光谱-空间多特征融合(SSMF)模块,同时获取大量代表性信息,充分挖掘多尺度特征HSI数据的潜力;最后,为了增强特征识别,使用高效的加性注意转换器(EA2T)模块高效地对全局上下文进行建模,该模块简化了注意过程,并允许模型学习高效和鲁棒的全局表示,以准确分类中心像素。在真实HSI数据集上执行的一系列实验结果证实,即使每个类别仅使用10个样本进行训练,所提出的PCET也可以取得出色的性能。
{"title":"PCET: Patch Confidence-Enhanced Transformer with efficient spectral–spatial features for hyperspectral image classification","authors":"Li Fang, Xuanli Lan, Tianyu Li, Huifang Shen","doi":"10.1016/j.jag.2024.104308","DOIUrl":"https://doi.org/10.1016/j.jag.2024.104308","url":null,"abstract":"Hyperspectral image (HSI) classification based on deep learning has demonstrated promising performance. In general, using patch-wise samples helps to extract the spatial relationship between pixels and local contextual information. However, the presence of background or other category information in an image patch that is inconsistent with the central target category has a negative effect on classification. To solve this issue, a patch confidence-enhanced transformer (PCET) approach for HSI classification is proposed. To be specific, we design a patch quality assessment (PQA) branch model to evaluate the input patches during training process, which effectively filters out the intrusive non-central pixels. The output confidence of the branch model serves as a quantitative indicator of the contribution degree of the input patch to the overall training efficacy, which is subsequently weighted in the loss function, thereby endowing the model with the capability to dynamically adjust its learning focus based on the qualitative of the inputs. Second, a spectral–spatial multi-feature fusion (SSMF) module is devised to procure scores of representative information simultaneously and fully exploit the potential of multi-scale feature HSI data. Finally, to enhance feature discrimination, global context is efficiently modeled using the efficient additive attention transformer (<mml:math altimg=\"si4.svg\" display=\"inline\"><mml:mrow><mml:msup><mml:mrow><mml:mi mathvariant=\"normal\">EA</mml:mi></mml:mrow><mml:mrow><mml:mn>2</mml:mn></mml:mrow></mml:msup><mml:mi mathvariant=\"normal\">T</mml:mi></mml:mrow></mml:math>) module, which streamlines the attention process and allows the model to learn efficient and robust global representations for accurate classification of the central pixel. A series of experimental results executed on real HSI datasets have substantiated that the proposed PCET can achieve outstanding performance, even when only 10 samples per category are used for training.","PeriodicalId":50341,"journal":{"name":"International Journal of Applied Earth Observation and Geoinformation","volume":"32 1","pages":""},"PeriodicalIF":7.5,"publicationDate":"2024-12-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142874812","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"地球科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Plant Phenology Index leveraging over conventional vegetation indices to establish a new remote sensing benchmark of GPP for northern ecosystems 利用植物物候指数取代传统植被指数,建立北方生态系统GPP的新遥感基准
IF 7.5 1区 地球科学 Q1 Earth and Planetary Sciences Pub Date : 2024-12-17 DOI: 10.1016/j.jag.2024.104289
Hanna Marsh, Hongxiao Jin, Zheng Duan, Jutta Holst, Lars Eklundh, Wenxin Zhang
Northern ecosystems, encompassing boreal forests, tundra, and permafrost areas, are increasingly affected by the amplified impacts of climate change. These ecosystems play a crucial role in determining the global carbon budget. To improve our understanding of carbon uptake in these regions, we evaluate the effectiveness of employing the physically-based Plant Phenology Index (PPI) to estimate gross primary productivity across ten different ecosystems. Based on eddy-covariance measurements from 65 sites, the vegetation index (VI)-driven GPP models (six different algorithms) are calibrated and validated. Our findings highlight that the Michaelis–Menten algorithm has the best performance and PPI is superior to the other five VIs, including NDVI, NIRv, EVI-2, NDPI, and NDGI, at predicting gross primary productivity (GPP) rates on a weekly scale (with an average R2 of 0.64 and RMSE of 1.70 g C m2 d1), regardless of short-term environmental constraints on photosynthesis. Through our scaled-up analysis, we estimate the annual GPP of the vast 37 million km2 study region to be around 22 Pg C yr1, aligning with other recently developed products such as GOSIF-GPP, FluxSat-GPP, and FLUXCOM-X GPP. Derived from a climate-independent approach, the PPI-GPP product offers distinct advantages in exploring relationships between climate variables and terrestrial ecosystem productivity and phenology. Furthermore, this product holds significant value for assessing forestry and agricultural production in northern regions and for benchmarking terrestrial biosphere models and Earth system models.
包括北方森林、冻土带和永久冻土区在内的北方生态系统日益受到气候变化放大影响的影响。这些生态系统在决定全球碳收支方面起着至关重要的作用。为了提高我们对这些地区碳吸收的认识,我们评估了使用基于物理的植物物候指数(PPI)来估计10个不同生态系统的总初级生产力的有效性。基于65个站点的涡旋协方差测量,对植被指数驱动的GPP模型(6种不同算法)进行了标定和验证。我们的研究结果强调,Michaelis-Menten算法在预测周尺度的总初级生产力(GPP)率方面表现最好,PPI优于其他5种VIs,包括NDVI、NIRv、EVI-2、NDPI和NDGI(平均R2为0.64,RMSE为1.70 g C m -2 d - 1),而不考虑光合作用的短期环境限制。通过我们的放大分析,我们估计3700万平方公里研究区域的年GPP约为22 Pg C yr - 1,与其他最近开发的产品如GOSIF-GPP, FluxSat-GPP和FLUXCOM-X GPP保持一致。基于与气候无关的方法,PPI-GPP产品在探索气候变量与陆地生态系统生产力和物候之间的关系方面具有明显的优势。此外,该产品对于评估北方地区的林业和农业生产以及陆地生物圈模型和地球系统模型的基准具有重要价值。
{"title":"Plant Phenology Index leveraging over conventional vegetation indices to establish a new remote sensing benchmark of GPP for northern ecosystems","authors":"Hanna Marsh, Hongxiao Jin, Zheng Duan, Jutta Holst, Lars Eklundh, Wenxin Zhang","doi":"10.1016/j.jag.2024.104289","DOIUrl":"https://doi.org/10.1016/j.jag.2024.104289","url":null,"abstract":"Northern ecosystems, encompassing boreal forests, tundra, and permafrost areas, are increasingly affected by the amplified impacts of climate change. These ecosystems play a crucial role in determining the global carbon budget. To improve our understanding of carbon uptake in these regions, we evaluate the effectiveness of employing the physically-based Plant Phenology Index (PPI) to estimate gross primary productivity across ten different ecosystems. Based on eddy-covariance measurements from 65 sites, the vegetation index (VI)-driven GPP models (six different algorithms) are calibrated and validated. Our findings highlight that the Michaelis–Menten algorithm has the best performance and PPI is superior to the other five VIs, including NDVI, NIRv, EVI-2, NDPI, and NDGI, at predicting gross primary productivity (GPP) rates on a weekly scale (with an average R<mml:math altimg=\"si21.svg\" display=\"inline\"><mml:msup><mml:mrow></mml:mrow><mml:mrow><mml:mn>2</mml:mn></mml:mrow></mml:msup></mml:math> of 0.64 and RMSE of 1.70 g C m<mml:math altimg=\"si2.svg\" display=\"inline\"><mml:msup><mml:mrow></mml:mrow><mml:mrow><mml:mo>−</mml:mo><mml:mn>2</mml:mn></mml:mrow></mml:msup></mml:math> d<mml:math altimg=\"si3.svg\" display=\"inline\"><mml:msup><mml:mrow></mml:mrow><mml:mrow><mml:mo>−</mml:mo><mml:mn>1</mml:mn></mml:mrow></mml:msup></mml:math>), regardless of short-term environmental constraints on photosynthesis. Through our scaled-up analysis, we estimate the annual GPP of the vast 37 million km<mml:math altimg=\"si21.svg\" display=\"inline\"><mml:msup><mml:mrow></mml:mrow><mml:mrow><mml:mn>2</mml:mn></mml:mrow></mml:msup></mml:math> study region to be around 22 Pg C yr<mml:math altimg=\"si3.svg\" display=\"inline\"><mml:msup><mml:mrow></mml:mrow><mml:mrow><mml:mo>−</mml:mo><mml:mn>1</mml:mn></mml:mrow></mml:msup></mml:math>, aligning with other recently developed products such as GOSIF-GPP, FluxSat-GPP, and FLUXCOM-X GPP. Derived from a climate-independent approach, the PPI-GPP product offers distinct advantages in exploring relationships between climate variables and terrestrial ecosystem productivity and phenology. Furthermore, this product holds significant value for assessing forestry and agricultural production in northern regions and for benchmarking terrestrial biosphere models and Earth system models.","PeriodicalId":50341,"journal":{"name":"International Journal of Applied Earth Observation and Geoinformation","volume":"125 1","pages":""},"PeriodicalIF":7.5,"publicationDate":"2024-12-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142874859","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"地球科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Accurate estimation of grain number per panicle in winter wheat by synergistic use of UAV imagery and meteorological data 无人机影像与气象数据协同精确估算冬小麦穗粒数
IF 7.5 1区 地球科学 Q1 Earth and Planetary Sciences Pub Date : 2024-12-17 DOI: 10.1016/j.jag.2024.104320
Yapeng Wu, Weiguo Yu, Yangyang Gu, Qi Zhang, Yuan Xiong, Hengbiao Zheng, Chongya Jiang, Xia Yao, Yan Zhu, Weixing Cao, Tao Cheng
Rapid, accurate, and nondestructive estimation of grain number per panicle (GNPP) in winter wheat is crucial to accelerate smart breeding, improve precision crop management, and ensure food security. As two (panicle number per unit ground area and GNPP) of three commonly used yield components, GNPP was much less quantified with remotely sensed data than the former through visual counting. The limited research suffered from either low accuracies with ground canopy spectra or low efficiency with proximal panicle imaging systems. No studies have been reported on estimating GNPP with unmanned aerial vehicle (UAV) imagery, underscoring its strong advantages in high-resolution and efficient monitoring. To address these issues, this study proposed a practical approach for estimating GNPP in winter wheat by integrating UAV imagery and meteorological data with meta-learning ensemble regression. The potential contributions of different variables were examined for understanding the improvement in the spectral estimation of GNPP, including spectral indices (SIs), the optimal canopy height (CH) metric, and absorbed photosynthetic active radiation (APAR).
快速、准确、无损地估算冬小麦每穗粒数(GNPP)对加快智慧育种、提高作物精准管理水平、保障粮食安全具有重要意义。作为3个常用产量要素中的2个要素(单位地面积穗数和GNPP), GNPP的遥感量化效果远不如目测量化。地面冠层光谱的精度较低,近穗成像系统的效率较低。没有关于使用无人机(UAV)图像估计GNPP的研究报道,强调其在高分辨率和高效监测方面的强大优势。为了解决这些问题,本研究提出了一种将无人机图像和气象数据结合元学习集成回归估算冬小麦GNPP的实用方法。研究了光谱指数(SIs)、最佳冠层高度(CH)度量和吸收光合有效辐射(APAR)等不同变量对GNPP光谱估算的潜在贡献。
{"title":"Accurate estimation of grain number per panicle in winter wheat by synergistic use of UAV imagery and meteorological data","authors":"Yapeng Wu, Weiguo Yu, Yangyang Gu, Qi Zhang, Yuan Xiong, Hengbiao Zheng, Chongya Jiang, Xia Yao, Yan Zhu, Weixing Cao, Tao Cheng","doi":"10.1016/j.jag.2024.104320","DOIUrl":"https://doi.org/10.1016/j.jag.2024.104320","url":null,"abstract":"Rapid, accurate, and nondestructive estimation of grain number per panicle (GNPP) in winter wheat is crucial to accelerate smart breeding, improve precision crop management, and ensure food security. As two (panicle number per unit ground area and GNPP) of three commonly used yield components, GNPP was much less quantified with remotely sensed data than the former through visual counting. The limited research suffered from either low accuracies with ground canopy spectra or low efficiency with proximal panicle imaging systems. No studies have been reported on estimating GNPP with unmanned aerial vehicle (UAV) imagery, underscoring its strong advantages in high-resolution and efficient monitoring. To address these issues, this study proposed a practical approach for estimating GNPP in winter wheat by integrating UAV imagery and meteorological data with <ce:italic>meta</ce:italic>-learning ensemble regression. The potential contributions of different variables were examined for understanding the improvement in the spectral estimation of GNPP, including spectral indices (SIs), the optimal canopy height (CH) metric, and absorbed photosynthetic active radiation (APAR).","PeriodicalId":50341,"journal":{"name":"International Journal of Applied Earth Observation and Geoinformation","volume":"28 1","pages":""},"PeriodicalIF":7.5,"publicationDate":"2024-12-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142874817","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"地球科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Low-variance estimation of live fuel moisture content using VIIRS data through radiative transfer model 基于辐射传输模型的VIIRS数据对活燃料含水率的低方差估计
IF 7.5 1区 地球科学 Q1 Earth and Planetary Sciences Pub Date : 2024-12-17 DOI: 10.1016/j.jag.2024.104311
Shuai Yang, Rui Chen, Binbin He, Yiru Zhang
The Canopy Live Fuel Moisture Content (LFMC) is a pivotal factor in wildfire risk assessment within the fire triangle model, representing the ratio of canopy moisture content to its dry weight. Against the backdrop of degraded Moderate Resolution Imaging Spectroradiometer (MODIS) performance and the underutilization of Visible Infrared Imaging Radiometer Suite (VIIRS) in LFMC inversion, this study harnessed the coupled radiative transfer models (RTMs) to probe the spectral sensitivity of the VIIRS to LFMC and pinpoint the optimal band combination for LFMC inversion. To tackle the challenge of ill-posed inversion, we leveraged the correlation coefficient matrix to mitigate erroneous combinations of free parameters in the construction of the lookup table. Results showcase that VIIRS-based LFMC inversion yields marginally superior accuracy (R2= 0.57, R2= 0.32) for both grassland and forest types, with VIIRS-based inversion demonstrating a lower relative root mean square error (rRMSE = 5.84%), compared to results from the MODIS. By scrutinizing LFMC trends alongside precipitation (PP) data in four forest fires spanning from 2019 to 2022 in southwest China, varied degrees of LFMC decrease preceding fire outbreaks. Those results substantiated the validity of the proposed method for wildfire warning. Consequently, our study asserts the reliability of VIIRS in LFMC inversion, positioning it as a viable substitute and extension of MODIS. VIIRS offers continuous and effective product support for wildfire warning assessment, enhancing our ability to monitor and mitigate wildfire risks.
林冠活燃料含水率(LFMC)代表林冠含水率与其干重的比值,是火灾三角模型中野火风险评估的关键因子。在中分辨率成像光谱仪(MODIS)性能下降和可见光红外成像辐射计套件(VIIRS)在LFMC反演中利用不足的背景下,利用耦合辐射传输模型(RTMs)探讨了中分辨率成像辐射计(VIIRS)对LFMC的光谱灵敏度,并确定了LFMC反演的最佳波段组合。为了解决不适定反演的挑战,我们利用相关系数矩阵来减轻查找表构造中自由参数的错误组合。结果表明,与MODIS相比,基于viirs的LFMC反演在草地和森林类型上的精度略高(R2= 0.57, R2= 0.32),基于viirs的反演显示出更低的相对均方根误差(rRMSE = 5.84%)。通过分析2019 - 2022年中国西南地区4次森林火灾的LFMC趋势和降水(PP)数据,发现火灾发生前LFMC有不同程度的下降。这些结果证实了所提出的野火预警方法的有效性。因此,我们的研究证实了VIIRS在LFMC反演中的可靠性,将其定位为MODIS的可行替代品和扩展。VIIRS为野火预警评估提供持续有效的产品支持,增强我们监测和减轻野火风险的能力。
{"title":"Low-variance estimation of live fuel moisture content using VIIRS data through radiative transfer model","authors":"Shuai Yang, Rui Chen, Binbin He, Yiru Zhang","doi":"10.1016/j.jag.2024.104311","DOIUrl":"https://doi.org/10.1016/j.jag.2024.104311","url":null,"abstract":"The Canopy Live Fuel Moisture Content (LFMC) is a pivotal factor in wildfire risk assessment within the fire triangle model, representing the ratio of canopy moisture content to its dry weight. Against the backdrop of degraded Moderate Resolution Imaging Spectroradiometer (MODIS) performance and the underutilization of Visible Infrared Imaging Radiometer Suite (VIIRS) in LFMC inversion, this study harnessed the coupled radiative transfer models (RTMs) to probe the spectral sensitivity of the VIIRS to LFMC and pinpoint the optimal band combination for LFMC inversion. To tackle the challenge of ill-posed inversion, we leveraged the correlation coefficient matrix to mitigate erroneous combinations of free parameters in the construction of the lookup table. Results showcase that VIIRS-based LFMC inversion yields marginally superior accuracy (R<mml:math altimg=\"si106.svg\" display=\"inline\"><mml:mrow><mml:msup><mml:mrow></mml:mrow><mml:mrow><mml:mn>2</mml:mn></mml:mrow></mml:msup><mml:mo>=</mml:mo></mml:mrow></mml:math> 0.57, R<mml:math altimg=\"si106.svg\" display=\"inline\"><mml:mrow><mml:msup><mml:mrow></mml:mrow><mml:mrow><mml:mn>2</mml:mn></mml:mrow></mml:msup><mml:mo>=</mml:mo></mml:mrow></mml:math> 0.32) for both grassland and forest types, with VIIRS-based inversion demonstrating a lower relative root mean square error (rRMSE <mml:math altimg=\"si107.svg\" display=\"inline\"><mml:mo>=</mml:mo></mml:math> 5.84%), compared to results from the MODIS. By scrutinizing LFMC trends alongside precipitation (PP) data in four forest fires spanning from 2019 to 2022 in southwest China, varied degrees of LFMC decrease preceding fire outbreaks. Those results substantiated the validity of the proposed method for wildfire warning. Consequently, our study asserts the reliability of VIIRS in LFMC inversion, positioning it as a viable substitute and extension of MODIS. VIIRS offers continuous and effective product support for wildfire warning assessment, enhancing our ability to monitor and mitigate wildfire risks.","PeriodicalId":50341,"journal":{"name":"International Journal of Applied Earth Observation and Geoinformation","volume":"34 1","pages":""},"PeriodicalIF":7.5,"publicationDate":"2024-12-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142874818","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"地球科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Eliminating geometric distortion with dual-orbit Sentinel-1 SAR fusion for accurate glacial lake extraction in Southeast Tibet Plateau 基于Sentinel-1双轨SAR融合消除几何畸变的青藏高原东南部冰湖精确提取
IF 7.5 1区 地球科学 Q1 Earth and Planetary Sciences Pub Date : 2024-12-17 DOI: 10.1016/j.jag.2024.104329
Renzhe Wu, Guoxiang Liu, Xin Bao, Jichao Lv, Age Shama, Bo Zhang, Wenfei Mao, Jie Chen, Zhihan Yang, Rui Zhang
Glacial lakes (GLs), which serve as natural reservoirs, are also prospective sources of risk, and their risk levels are continuously increasing as a result of global climate warming. Nevertheless, GLs are situated in mountainous and valley regions, which are distinguished by their complex terrain and unpredictable weather conditions. This leads to restricted availability of optical imagery as a consequence of the frequent cloud cover. Synthetic Aperture Radar (SAR), however, encounters issues with geometric distortion. This paper introduces an unsupervised method based on geometric distortion detection (without orbit state information) and historical positioning using dual-orbit SAR imagery to research GL extraction effectively. This method detects low-quality pixels from dual-orbit SAR imagery through geometric distortion. It extracts GLs using a majority voting integration of unsupervised classification algorithms constrained by historical GL center points. The Southeastern Tibetan Plateau (SETP) was chosen as a representative region for the study, and experiments were conducted from July to August 2018 using dual-orbit Sentinel-1 imagery. A total of 600 refined samples were used for comparative verification. The results demonstrate that this method is capable of reliably identifying the active and passive geometric distortions in SAR imagery. The fusion of dual-orbit SAR based on geometric distortion can effectively enhance the classification performance of remote sensing imagery and achieve the acquisition of GL water storage area during the flood season. The geometric distortion rate was reduced from 29.9% to 7.9% after fusion correction, and the accuracy, recall rate, precision, Intersection over Union (IoU), and F1-Score were 0.989, 0.900, 0.908, 0.825, and 0.904, respectively. This serves as a reference for research that investigates the mechanisms of glacier-GL-climate change.
作为天然水库的冰湖也是潜在的风险源,而且由于全球气候变暖,冰湖的风险源水平正在不断提高。然而,GLs位于山区和山谷地区,其特点是地形复杂,天气条件不可预测。由于频繁的云层覆盖,这导致光学图像的可用性受到限制。然而,合成孔径雷达(SAR)会遇到几何畸变的问题。本文提出了一种基于几何畸变检测(无轨道状态信息)和历史定位的无监督方法,利用双轨SAR图像有效地研究了GL提取。该方法通过几何畸变检测双轨SAR图像中的低质量像元。它使用受历史GL中心点约束的无监督分类算法的多数投票集成来提取GL。选择青藏高原东南部(SETP)作为研究的代表区域,于2018年7月至8月利用Sentinel-1双轨图像进行了实验。共使用600个精制样品进行对比验证。结果表明,该方法能够可靠地识别SAR图像中的主动和被动几何畸变。基于几何畸变的双轨SAR融合可以有效提高遥感影像的分类性能,实现汛期GL储水面积的获取。融合校正后的几何畸变率由29.9%降至7.9%,准确率为0.989,查全率为0.900,准确率为0.908,交叉比联合(Intersection over Union, IoU)为0.825,F1-Score为0.904。这为冰川- gl -气候变化机制的研究提供了参考。
{"title":"Eliminating geometric distortion with dual-orbit Sentinel-1 SAR fusion for accurate glacial lake extraction in Southeast Tibet Plateau","authors":"Renzhe Wu, Guoxiang Liu, Xin Bao, Jichao Lv, Age Shama, Bo Zhang, Wenfei Mao, Jie Chen, Zhihan Yang, Rui Zhang","doi":"10.1016/j.jag.2024.104329","DOIUrl":"https://doi.org/10.1016/j.jag.2024.104329","url":null,"abstract":"Glacial lakes (GLs), which serve as natural reservoirs, are also prospective sources of risk, and their risk levels are continuously increasing as a result of global climate warming. Nevertheless, GLs are situated in mountainous and valley regions, which are distinguished by their complex terrain and unpredictable weather conditions. This leads to restricted availability of optical imagery as a consequence of the frequent cloud cover. Synthetic Aperture Radar (SAR), however, encounters issues with geometric distortion. This paper introduces an unsupervised method based on geometric distortion detection (without orbit state information) and historical positioning using dual-orbit SAR imagery to research GL extraction effectively. This method detects low-quality pixels from dual-orbit SAR imagery through geometric distortion. It extracts GLs using a majority voting integration of unsupervised classification algorithms constrained by historical GL center points. The Southeastern Tibetan Plateau (SETP) was chosen as a representative region for the study, and experiments were conducted from July to August 2018 using dual-orbit Sentinel-1 imagery. A total of 600 refined samples were used for comparative verification. The results demonstrate that this method is capable of reliably identifying the active and passive geometric distortions in SAR imagery. The fusion of dual-orbit SAR based on geometric distortion can effectively enhance the classification performance of remote sensing imagery and achieve the acquisition of GL water storage area during the flood season. The geometric distortion rate was reduced from 29.9% to 7.9% after fusion correction, and the accuracy, recall rate, precision, Intersection over Union (IoU), and F1-Score were 0.989, 0.900, 0.908, 0.825, and 0.904, respectively. This serves as a reference for research that investigates the mechanisms of glacier-GL-climate change.","PeriodicalId":50341,"journal":{"name":"International Journal of Applied Earth Observation and Geoinformation","volume":"11 1","pages":""},"PeriodicalIF":7.5,"publicationDate":"2024-12-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142874815","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"地球科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Exploring the potential of regional cloud vertical structure climatology statistical model in estimating surface downwelling longwave radiation 探讨区域云垂直结构气候学统计模式在估算地表下潜长波辐射中的潜力
IF 7.5 1区 地球科学 Q1 Earth and Planetary Sciences Pub Date : 2024-12-17 DOI: 10.1016/j.jag.2024.104324
Shanshan Yu, Xiaozhou Xin, Hailong Zhang, Li Li, Qinhuo Liu
Cloud base height (CBH) is one of the most uncertain parameters in surface downward longwave radiation (SDLR) estimation. Climatology statistical models of cloud vertical structure (CVS), which provide 1-degree grid averages or latitude zone averages of CBH and cloud thickness (CT), have been frequently applied to improve coarse-resolution SDLR estimation. This study aims to develop a regional CVS climatology statistical model containing CT and CBH statistics at a kilometer scale, using CloudSat, CALIPSO, and MODIS data, and to explore its potential in kilometer-scale CBH and SDLR estimations. The RMSE of CBH estimated from the new CVS model ranges from 0.4 to 2.6 km for different cloud types when validated using CloudSat/CALIPSO data. CBH RMSEs are 2.20 km for Terra data and 1.99 km for Aqua data when validated against ground measurements. The simple Minnis CT model greatly overestimated CBH, while the new CVS model produced much better results. Using CBH from the new CVS model, the RMSEs of estimated cloudy SDLR are 26.8 W/m2 and 29.2 W/m2 for the Gupta-SDLR and Diak-SDLR models, respectively. These results are significantly better than those from the Minnis CT model and are comparable to those from the more advanced Yang-Cheng CT model. Moreover, the RMSEs of all-sky SDLR range from 22.6 to 21.5 W/m2 with resolution from 1 km to 20 km. These findings indicate that the regional CVS model is feasible for high-resolution CBH and SDLR estimation and can be effectively combined with other CBH estimation methods. This study provides a novel approach for estimating SDLR by integrating active and passive satellite data.
云底高度(CBH)是地面向下长波辐射(SDLR)估计中最不确定的参数之一。云垂直结构的气候学统计模式(CVS)提供1度网格平均或纬度带平均的CBH和云厚度(CT),已被广泛应用于改进粗分辨率SDLR估计。本研究旨在利用CloudSat、CALIPSO和MODIS数据,建立包含千米尺度CT和CBH统计的区域CVS气候学统计模型,并探讨其在千米尺度CBH和SDLR估计中的潜力。当使用CloudSat/CALIPSO数据进行验证时,从新的CVS模型估计的CBH的RMSE范围为0.4至2.6 km。经地面测量验证,Terra数据的CBH均方根误差为2.20公里,Aqua数据的CBH均方根误差为1.99公里。简单的Minnis CT模型大大高估了CBH,而新的CVS模型得到了更好的结果。使用新CVS模型的CBH, Gupta-SDLR和Diak-SDLR模型估计的多云SDLR的rmse分别为26.8 W/m2和29.2 W/m2。这些结果明显优于Minnis CT模型,并可与更先进的Yang-Cheng CT模型相媲美。全天SDLR的均方根误差在22.6 ~ 21.5 W/m2之间,分辨率在1 ~ 20 km之间。这些结果表明,区域CVS模型对高分辨率CBH和SDLR估计是可行的,并且可以与其他CBH估计方法有效结合。该研究提供了一种利用主被动卫星数据综合估算SDLR的新方法。
{"title":"Exploring the potential of regional cloud vertical structure climatology statistical model in estimating surface downwelling longwave radiation","authors":"Shanshan Yu, Xiaozhou Xin, Hailong Zhang, Li Li, Qinhuo Liu","doi":"10.1016/j.jag.2024.104324","DOIUrl":"https://doi.org/10.1016/j.jag.2024.104324","url":null,"abstract":"Cloud base height (CBH) is one of the most uncertain parameters in surface downward longwave radiation (SDLR) estimation. Climatology statistical models of cloud vertical structure (CVS), which provide 1-degree grid averages or latitude zone averages of CBH and cloud thickness (CT), have been frequently applied to improve coarse-resolution SDLR estimation. This study aims to develop a regional CVS climatology statistical model containing CT and CBH statistics at a kilometer scale, using CloudSat, CALIPSO, and MODIS data, and to explore its potential in kilometer-scale CBH and SDLR estimations. The RMSE of CBH estimated from the new CVS model ranges from 0.4 to 2.6 km for different cloud types when validated using CloudSat/CALIPSO data. CBH RMSEs are 2.20 km for Terra data and 1.99 km for Aqua data when validated against ground measurements. The simple Minnis CT model greatly overestimated CBH, while the new CVS model produced much better results. Using CBH from the new CVS model, the RMSEs of estimated cloudy SDLR are 26.8 W/m<ce:sup loc=\"post\">2</ce:sup> and 29.2 W/m<ce:sup loc=\"post\">2</ce:sup> for the Gupta-SDLR and Diak-SDLR models, respectively. These results are significantly better than those from the Minnis CT model and are comparable to those from the more advanced Yang-Cheng CT model. Moreover, the RMSEs of all-sky SDLR range from 22.6 to 21.5 W/m<ce:sup loc=\"post\">2</ce:sup> with resolution from 1 km to 20 km. These findings indicate that the regional CVS model is feasible for high-resolution CBH and SDLR estimation and can be effectively combined with other CBH estimation methods. This study provides a novel approach for estimating SDLR by integrating active and passive satellite data.","PeriodicalId":50341,"journal":{"name":"International Journal of Applied Earth Observation and Geoinformation","volume":"2 1","pages":""},"PeriodicalIF":7.5,"publicationDate":"2024-12-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142874816","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"地球科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Unsupervised deep depth completion with heterogeneous LiDAR and RGB-D camera depth information 基于非均匀激光雷达和RGB-D相机深度信息的无监督深度完井
IF 7.5 1区 地球科学 Q1 Earth and Planetary Sciences Pub Date : 2024-12-16 DOI: 10.1016/j.jag.2024.104327
Guohua Gou, Han Li, Xuanhao Wang, Hao Zhang, Wei Yang, Haigang Sui
In this work, a depth-only completion method designed to enhance perception in light-deprived environments. We achieve this through LidarDepthNet, a novel end-to-end unsupervised learning framework that fuses heterogeneous depth information captured by two distinct depth sensors: LiDAR and RGB-D cameras. This represents the first unsupervised LiDAR-depth fusion framework for depth completion, demonstrating scalability to diverse real-world subterranean and enclosed environments. To facilitate unsupervised learning, we leverage relative rigid motion transfer (RRMT) to synthesize co-visible depth maps from temporally adjacent frames. This allows us to construct a temporal depth consistency loss, constraining the fused depth to adhere to realistic metric scale. Furthermore, we introduce measurement confidence into the heterogeneous depth fusion model, further refining the fused depth and promoting synergistic complementation between the two depth modalities. Extensive evaluation on both real-world and synthetic datasets, notably a newly proposed LiDAR-depth fusion dataset, LidarDepthSet, demonstrates the significant advantages of our method compared to existing state-of-the-art approaches.
在这项工作中,一种仅深度完成的方法旨在增强在光线不足的环境中的感知。我们通过LidarDepthNet实现了这一目标,这是一种新颖的端到端无监督学习框架,融合了两个不同深度传感器(LiDAR和RGB-D相机)捕获的异构深度信息。这是首个用于深度完井的无监督激光雷达深度融合框架,展示了在各种真实地下和封闭环境下的可扩展性。为了促进无监督学习,我们利用相对刚性运动转移(RRMT)从时间相邻帧合成共可见深度图。这允许我们构建一个时间深度一致性损失,约束融合深度坚持现实的度量尺度。在非均质深度融合模型中引入测量置信度,进一步细化融合深度,促进两种深度模式之间的协同互补。对真实世界和合成数据集的广泛评估,特别是新提出的激光雷达深度融合数据集LidarDepthSet,证明了我们的方法与现有最先进的方法相比具有显着优势。
{"title":"Unsupervised deep depth completion with heterogeneous LiDAR and RGB-D camera depth information","authors":"Guohua Gou, Han Li, Xuanhao Wang, Hao Zhang, Wei Yang, Haigang Sui","doi":"10.1016/j.jag.2024.104327","DOIUrl":"https://doi.org/10.1016/j.jag.2024.104327","url":null,"abstract":"In this work, a depth-only completion method designed to enhance perception in light-deprived environments. We achieve this through LidarDepthNet, a novel end-to-end unsupervised learning framework that fuses heterogeneous depth information captured by two distinct depth sensors: LiDAR and RGB-D cameras. This represents the first unsupervised LiDAR-depth fusion framework for depth completion, demonstrating scalability to diverse real-world subterranean and enclosed environments. To facilitate unsupervised learning, we leverage relative rigid motion transfer (RRMT) to synthesize co-visible depth maps from temporally adjacent frames. This allows us to construct a temporal depth consistency loss, constraining the fused depth to adhere to realistic metric scale. Furthermore, we introduce measurement confidence into the heterogeneous depth fusion model, further refining the fused depth and promoting synergistic complementation between the two depth modalities. Extensive evaluation on both real-world and synthetic datasets, notably a newly proposed LiDAR-depth fusion dataset, LidarDepthSet, demonstrates the significant advantages of our method compared to existing state-of-the-art approaches.","PeriodicalId":50341,"journal":{"name":"International Journal of Applied Earth Observation and Geoinformation","volume":"20 1","pages":""},"PeriodicalIF":7.5,"publicationDate":"2024-12-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142874811","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"地球科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Deep learning change detection techniques for optical remote sensing imagery: Status, perspectives and challenges 光学遥感图像的深度学习变化检测技术:现状、展望和挑战
IF 7.5 1区 地球科学 Q1 Earth and Planetary Sciences Pub Date : 2024-12-16 DOI: 10.1016/j.jag.2024.104282
Daifeng Peng, Xuelian Liu, Yongjun Zhang, Haiyan Guan, Yansheng Li, Lorenzo Bruzzone
Change detection (CD) aims to compare and analyze images of identical geographic areas but different dates, whereby revealing spatio-temporal change patterns of Earth’s surface. With the implementation of the High-Resolution Earth Observation Project, an integrated sky-to-ground observation system has been continuously developed and improved. The accumulation of massive multi-modal, multi-angle, and multi-resolution remote sensing data have greatly enriched the CD data sources. Among them, high-resolution optical remote sensing images contain abundant spatial detail information, making it possible to interpret fine-grained scenes and greatly expand the application breadth and depth of CD. Generally, traditional optical remote sensing CD methods are cumbersome in steps and have a low level of automation. In contrast, artificial intelligence (AI) based CD methods possess powerful feature extraction and non-linear modeling capabilities, thereby gaining advantages that traditional methods cannot match. As a result, they have become the mainstream approaches in the field of CD. This review article systematically summarizes the datasets, theories, and methods of CD for optical remote sensing image. It provides a comprehensive analysis of AI-based CD algorithms based on deep learning paradigms from the perspectives of algorithm granularity. In-depth analysis of the performance of typical algorithms are further conducted. Finally, we summarize the challenges and trends of the CD algorithms in the AI era, aiming to provide important guidelines and insights for relevant researchers.
变化检测(Change detection, CD)旨在对相同地理区域不同日期的图像进行比较分析,从而揭示地球表面的时空变化规律。随着高分辨率对地观测工程的实施,对地综合观测系统不断发展完善。大量多模态、多角度、多分辨率遥感数据的积累,极大地丰富了遥感数据的来源。其中,高分辨率光学遥感影像包含了丰富的空间细节信息,使得对细粒度场景的解读成为可能,极大地拓展了CD的应用广度和深度。传统的光学遥感CD方法一般步骤繁琐,自动化程度较低。而基于人工智能(AI)的CD方法具有强大的特征提取和非线性建模能力,具有传统方法无法比拟的优势。本文系统地综述了光学遥感图像的数据集、理论和方法。从算法粒度的角度全面分析了基于深度学习范式的基于ai的CD算法。进一步深入分析了典型算法的性能。最后,我们总结了人工智能时代CD算法面临的挑战和趋势,旨在为相关研究人员提供重要的指导和见解。
{"title":"Deep learning change detection techniques for optical remote sensing imagery: Status, perspectives and challenges","authors":"Daifeng Peng, Xuelian Liu, Yongjun Zhang, Haiyan Guan, Yansheng Li, Lorenzo Bruzzone","doi":"10.1016/j.jag.2024.104282","DOIUrl":"https://doi.org/10.1016/j.jag.2024.104282","url":null,"abstract":"Change detection (CD) aims to compare and analyze images of identical geographic areas but different dates, whereby revealing spatio-temporal change patterns of Earth’s surface. With the implementation of the High-Resolution Earth Observation Project, an integrated sky-to-ground observation system has been continuously developed and improved. The accumulation of massive multi-modal, multi-angle, and multi-resolution remote sensing data have greatly enriched the CD data sources. Among them, high-resolution optical remote sensing images contain abundant spatial detail information, making it possible to interpret fine-grained scenes and greatly expand the application breadth and depth of CD. Generally, traditional optical remote sensing CD methods are cumbersome in steps and have a low level of automation. In contrast, artificial intelligence (AI) based CD methods possess powerful feature extraction and non-linear modeling capabilities, thereby gaining advantages that traditional methods cannot match. As a result, they have become the mainstream approaches in the field of CD. This review article systematically summarizes the datasets, theories, and methods of CD for optical remote sensing image. It provides a comprehensive analysis of AI-based CD algorithms based on deep learning paradigms from the perspectives of algorithm granularity. In-depth analysis of the performance of typical algorithms are further conducted. Finally, we summarize the challenges and trends of the CD algorithms in the AI era, aiming to provide important guidelines and insights for relevant researchers.","PeriodicalId":50341,"journal":{"name":"International Journal of Applied Earth Observation and Geoinformation","volume":"24 1","pages":""},"PeriodicalIF":7.5,"publicationDate":"2024-12-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142874860","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"地球科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
An enhanced network for extracting tunnel lining defects using transformer encoder and aggregate decoder 基于变压器编码器和聚合解码器的隧道衬砌缺陷提取网络
IF 7.5 1区 地球科学 Q1 Earth and Planetary Sciences Pub Date : 2024-12-16 DOI: 10.1016/j.jag.2024.104259
Bo Guo, Zhihai Huang, Haitao Luo, Perpetual Hope Akwensi, Ruisheng Wang, Bo Huang, Tsz Nam Chan
The tunnel environment is characterized by insufficient ambient light, obstructed view, and complex inner lining construction conditions. These factors frequently result in limited anti-interference capability, reduced recognition accuracy, and suboptimal segmentation results for defect extraction. We propose a deep network model utilizing an encoder–decoder framework that integrates Transformer and convolution for comprehensive defect extraction. The proposed model utilizes an encoder that integrates a hierarchical Transformer backbone with an efficient attention mechanism to fully explore complete information at multi-scale granularities. In the decoder, multi-scale information is initially aggregated using a Multi-Layer Perceptron (MLP) module. Additionally, the Stacking Filters with Atrous Convolutions (SFAC) module are implemented to enhance the perception of the complete defect scope. Furthermore, a Boundary-aware Attention Module (BAM) is implemented to enhance edge information to improve the detection of defects. With this well-designed decoder, the multi-scale information from the encoder can be fully aggregated and exploited for complete defect detection. Experimental findings illustrate the effectiveness of our proposed approach in addressing tunnel lining defects within the image dataset. The outcomes reveal that our proposed network achieves an accuracy (Acc) of 94.4% and a mean intersection over union (mIoU) of 78.14%. Compared to state-of-the-art segmentation networks, our model improves the accuracy of tunnel lining defect extraction, showcasing enhanced extraction effectiveness and anti-interference capability, thus meeting the engineering requirements for defect detection in complex environments of tunnels.
隧道环境具有环境光不足、视野遮挡、衬砌施工条件复杂等特点。这些因素经常导致有限的抗干扰能力,降低识别精度,以及对缺陷提取的次优分割结果。我们提出了一个深度网络模型,利用一个编码器-解码器框架,集成了变压器和卷积,以全面的缺陷提取。该模型利用一种集成了分层Transformer主干和高效关注机制的编码器来充分探索多尺度粒度的完整信息。在解码器中,使用多层感知器(MLP)模块初始聚合多尺度信息。此外,实现了带亚特罗斯卷积的堆叠滤波器(SFAC)模块,以增强对完整缺陷范围的感知。此外,采用边界感知注意模块(BAM)增强边缘信息,提高缺陷的检测效率。利用这种设计良好的解码器,可以将来自编码器的多尺度信息充分聚合并利用于完整的缺陷检测。实验结果证明了我们提出的方法在图像数据集中处理隧道衬砌缺陷的有效性。结果表明,我们提出的网络达到了94.4%的准确率(Acc)和78.14%的平均交联(mIoU)。与现有的分割网络相比,该模型提高了隧道衬砌缺陷提取的精度,增强了提取效果和抗干扰能力,满足了隧道复杂环境下缺陷检测的工程需求。
{"title":"An enhanced network for extracting tunnel lining defects using transformer encoder and aggregate decoder","authors":"Bo Guo, Zhihai Huang, Haitao Luo, Perpetual Hope Akwensi, Ruisheng Wang, Bo Huang, Tsz Nam Chan","doi":"10.1016/j.jag.2024.104259","DOIUrl":"https://doi.org/10.1016/j.jag.2024.104259","url":null,"abstract":"The tunnel environment is characterized by insufficient ambient light, obstructed view, and complex inner lining construction conditions. These factors frequently result in limited anti-interference capability, reduced recognition accuracy, and suboptimal segmentation results for defect extraction. We propose a deep network model utilizing an encoder–decoder framework that integrates Transformer and convolution for comprehensive defect extraction. The proposed model utilizes an encoder that integrates a hierarchical Transformer backbone with an efficient attention mechanism to fully explore complete information at multi-scale granularities. In the decoder, multi-scale information is initially aggregated using a Multi-Layer Perceptron (MLP) module. Additionally, the Stacking Filters with Atrous Convolutions (SFAC) module are implemented to enhance the perception of the complete defect scope. Furthermore, a Boundary-aware Attention Module (BAM) is implemented to enhance edge information to improve the detection of defects. With this well-designed decoder, the multi-scale information from the encoder can be fully aggregated and exploited for complete defect detection. Experimental findings illustrate the effectiveness of our proposed approach in addressing tunnel lining defects within the image dataset. The outcomes reveal that our proposed network achieves an accuracy (Acc) of 94.4% and a mean intersection over union (mIoU) of 78.14%. Compared to state-of-the-art segmentation networks, our model improves the accuracy of tunnel lining defect extraction, showcasing enhanced extraction effectiveness and anti-interference capability, thus meeting the engineering requirements for defect detection in complex environments of tunnels.","PeriodicalId":50341,"journal":{"name":"International Journal of Applied Earth Observation and Geoinformation","volume":"1 1","pages":""},"PeriodicalIF":7.5,"publicationDate":"2024-12-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142874861","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"地球科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
International Journal of Applied Earth Observation and Geoinformation
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1