首页 > 最新文献

International journal of applied earth observation and geoinformation : ITC journal最新文献

英文 中文
A tree crown edge-aware clipping algorithm for airborne LiDAR point clouds
IF 7.6 Q1 REMOTE SENSING Pub Date : 2025-02-01 DOI: 10.1016/j.jag.2025.104381
Shangshu Cai , Yong Pang
Dividing a forest point cloud dataset into tiles is a common practice in point cloud processing (e.g., individual tree segmentation), aimed at addressing memory constraints and optimizing processing efficiency. Existing methods typically utilize automatic regular clipping (e.g., rectangular clipping), which tends to result in splitting tree crowns along the cutting lines. To preserve the completeness of tree crowns within predefined clipping boundaries (e.g., rectangles), we develop a tree crown edge-aware (E-A) point cloud clipping algorithm, named E-A algorithm. Firstly, the crown edge and distance features are enhanced and quantified using mathematical morphology and nearest neighbor pixel methods. Then, these two features are linearly weighted and integrated for cutting line detection. Finally, the optimal cutting lines are detected by exploring a set of edges with the minimum sum of integrated feature values. E-A algorithm was tested with airborne LiDAR point clouds collected from China’s Saihanba Forest Farm, comparing it against regular clipping methods. The results indicate that E-A algorithm can automatically and effectively emphasize preserving tree crown completeness within predefined clipping boundaries. It reduces crown fragmentation errors by 73.29% on average and maintains an average area difference of 6.42% compared to regular clippings. This algorithm provides a crucial tool for forest point cloud applications.
{"title":"A tree crown edge-aware clipping algorithm for airborne LiDAR point clouds","authors":"Shangshu Cai ,&nbsp;Yong Pang","doi":"10.1016/j.jag.2025.104381","DOIUrl":"10.1016/j.jag.2025.104381","url":null,"abstract":"<div><div>Dividing a forest point cloud dataset into tiles is a common practice in point cloud processing (e.g., individual tree segmentation), aimed at addressing memory constraints and optimizing processing efficiency. Existing methods typically utilize automatic regular clipping (e.g., rectangular clipping), which tends to result in splitting tree crowns along the cutting lines. To preserve the completeness of tree crowns within predefined clipping boundaries (e.g., rectangles), we develop a tree crown edge-aware (E-A) point cloud clipping algorithm, named E-A algorithm. Firstly, the crown edge and distance features are enhanced and quantified using mathematical morphology and nearest neighbor pixel methods. Then, these two features are linearly weighted and integrated for cutting line detection. Finally, the optimal cutting lines are detected by exploring a set of edges with the minimum sum of integrated feature values. E-A algorithm was tested with airborne LiDAR point clouds collected from China’s Saihanba Forest Farm, comparing it against regular clipping methods. The results indicate that E-A algorithm can automatically and effectively emphasize preserving tree crown completeness within predefined clipping boundaries. It reduces crown fragmentation errors by 73.29% on average and maintains an average area difference of 6.42% compared to regular clippings. This algorithm provides a crucial tool for forest point cloud applications.</div></div>","PeriodicalId":73423,"journal":{"name":"International journal of applied earth observation and geoinformation : ITC journal","volume":"136 ","pages":"Article 104381"},"PeriodicalIF":7.6,"publicationDate":"2025-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143050024","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
HUTDNet: A joint unmixing and target detection network for underwater hyperspectral imagery HUTDNet:一种水下高光谱图像解混与目标检测联合网络
IF 7.6 Q1 REMOTE SENSING Pub Date : 2025-02-01 DOI: 10.1016/j.jag.2025.104374
Qi Li , Xingyuan Zu , Ming Zhang , Jinghua Li , Yan Feng
Underwater hyperspectral target detection (HTD) technology holds pivotal value in enhancing maritime military power. However, the absorption and scattering properties of the water bodies result in the inevitable issue of mixed pixels in underwater hyperspectral images (HSIs). To address the issue, a joint hyperspectral unmixing and target detection network for underwater HSI is proposed, denoted as HUTDNet, which utilizes the material type and abundance information for downstream semantic tasks. Specifically, a nonlinear underwater unmixing network is designed to extract pure underwater endmembers and their associated abundance information, which is essential in assisting the subsequent target detection task. The network also extracts underwater virtual endmembers and their abundance values to reconstruct a more realistic underwater HSI. Then, the abundance weighting module determines the abundance weighting factor by calculating the spectral distance between a priori target spectra and the estimated underwater pure endmembers, generating a weighted abundance map. Finally, due to the inherent limitations in the characterization capabilities of abundance maps and endmembers, the detection network extracts key spectral feature maps from the input underwater HSI. These feature maps serve as complementary terms, fused with the original and weighted abundance maps. Subsequently, convolutional and fully connected layers are employed to extract deeper features and generate the target detection maps. Experiments on both real and synthetic datasets demonstrate the superior performance and efficiency of the proposed method in this paper compared to other state-of-the-art methods.
水下高光谱目标探测技术在增强海上军事力量中具有举足轻重的价值。然而,水体的吸收和散射特性导致了水下高光谱图像中不可避免的混合像元问题。为了解决这一问题,提出了一种水下高光谱解混和目标检测联合网络,称为HUTDNet,该网络利用材料类型和丰度信息进行下游语义任务。具体而言,设计了一个非线性水下解混网络来提取纯水下端元及其相关丰度信息,这对后续的目标探测任务至关重要。该网络还提取了水下虚拟端元及其丰度值,以重建更真实的水下HSI。然后,丰度加权模块通过计算先验目标光谱与估计的水下纯端元之间的光谱距离来确定丰度加权因子,生成加权丰度图。最后,由于丰度图和端元表征能力的固有局限性,检测网络从输入的水下HSI中提取关键光谱特征图。这些特征图作为补充术语,与原始的和加权的丰度图融合在一起。随后,使用卷积和全连接层提取更深的特征并生成目标检测图。在真实数据集和合成数据集上的实验表明,与其他最新方法相比,本文提出的方法具有优越的性能和效率。
{"title":"HUTDNet: A joint unmixing and target detection network for underwater hyperspectral imagery","authors":"Qi Li ,&nbsp;Xingyuan Zu ,&nbsp;Ming Zhang ,&nbsp;Jinghua Li ,&nbsp;Yan Feng","doi":"10.1016/j.jag.2025.104374","DOIUrl":"10.1016/j.jag.2025.104374","url":null,"abstract":"<div><div>Underwater hyperspectral target detection (HTD) technology holds pivotal value in enhancing maritime military power. However, the absorption and scattering properties of the water bodies result in the inevitable issue of mixed pixels in underwater hyperspectral images (HSIs). To address the issue, a joint hyperspectral unmixing and target detection network for underwater HSI is proposed, denoted as HUTDNet, which utilizes the material type and abundance information for downstream semantic tasks. Specifically, a nonlinear underwater unmixing network is designed to extract pure underwater endmembers and their associated abundance information, which is essential in assisting the subsequent target detection task. The network also extracts underwater virtual endmembers and their abundance values to reconstruct a more realistic underwater HSI. Then, the abundance weighting module determines the abundance weighting factor by calculating the spectral distance between a priori target spectra and the estimated underwater pure endmembers, generating a weighted abundance map. Finally, due to the inherent limitations in the characterization capabilities of abundance maps and endmembers, the detection network extracts key spectral feature maps from the input underwater HSI. These feature maps serve as complementary terms, fused with the original and weighted abundance maps. Subsequently, convolutional and fully connected layers are employed to extract deeper features and generate the target detection maps. Experiments on both real and synthetic datasets demonstrate the superior performance and efficiency of the proposed method in this paper compared to other state-of-the-art methods.</div></div>","PeriodicalId":73423,"journal":{"name":"International journal of applied earth observation and geoinformation : ITC journal","volume":"136 ","pages":"Article 104374"},"PeriodicalIF":7.6,"publicationDate":"2025-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142990287","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Modeling the impact of pandemic on the urban thermal environment over megacities in China: Spatiotemporal analysis from the perspective of heat anomaly variations
IF 7.6 Q1 REMOTE SENSING Pub Date : 2025-02-01 DOI: 10.1016/j.jag.2025.104396
Jianfeng Gao , Qingyan Meng , Linlin Zhang , Xinli Hu , Die Hu , Jiangkang Qian
Influenced by lockdown policies and anomalies in human activities, emergencies such as pandemic significantly altered the urban thermal environment. However, the spatiotemporal heat anomaly changes across and within cities during emergencies and their drivers have not been fully investigated. This study quantified the changes in the urban thermal environment in China before and during the COVID-19 pandemic. Based on z-scores and multiscale geographically weighted regression models, heat anomaly changes and transfer patterns of different land uses in cities with varying degrees of pandemic impact and drivers were estimated. During the entire year, we found that although the pandemic significantly reduced surface urban heat island intensity during 5 % to 35 % of days, it did not change significantly throughout 2020. During the first-level public health emergency response, the land surface temperatures of residential and commercial lands notably affected by the pandemic decreased by −0.195°C and −0.371°C, and the shifting of strong heat anomaly zones in industrial lands increased heat anomaly and no heat anomaly zones by 6.1 % and 1.4 %, respectively. Furthermore, thermal anomalies were highly correlated with changes in biophysical parameters during the pandemic. These findings provide insights and mitigation strategies for the fluctuations in the urban thermal environment caused by emergencies.
{"title":"Modeling the impact of pandemic on the urban thermal environment over megacities in China: Spatiotemporal analysis from the perspective of heat anomaly variations","authors":"Jianfeng Gao ,&nbsp;Qingyan Meng ,&nbsp;Linlin Zhang ,&nbsp;Xinli Hu ,&nbsp;Die Hu ,&nbsp;Jiangkang Qian","doi":"10.1016/j.jag.2025.104396","DOIUrl":"10.1016/j.jag.2025.104396","url":null,"abstract":"<div><div>Influenced by lockdown policies and anomalies in human activities, emergencies such as pandemic significantly altered the urban thermal environment. However, the spatiotemporal heat anomaly changes across and within cities during emergencies and their drivers have not been fully investigated. This study quantified the changes in the urban thermal environment in China before and during the COVID-19 pandemic. Based on z-scores and multiscale geographically weighted regression models, heat anomaly changes and transfer patterns of different land uses in cities with varying degrees of pandemic impact and drivers were estimated. During the entire year, we found that although the pandemic significantly reduced surface urban heat island intensity during 5 % to 35 % of days, it did not change significantly throughout 2020. During the first-level public health emergency response, the land surface temperatures of residential and commercial lands notably affected by the pandemic decreased by −0.195°C and −0.371°C, and the shifting of strong heat anomaly zones in industrial lands increased heat anomaly and no heat anomaly zones by 6.1 % and 1.4 %, respectively. Furthermore, thermal anomalies were highly correlated with changes in biophysical parameters during the pandemic. These findings provide insights and mitigation strategies for the fluctuations in the urban thermal environment caused by emergencies.</div></div>","PeriodicalId":73423,"journal":{"name":"International journal of applied earth observation and geoinformation : ITC journal","volume":"136 ","pages":"Article 104396"},"PeriodicalIF":7.6,"publicationDate":"2025-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143083299","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Investigating heat-related health risks related to local climate zones using SDGSAT-1 high-resolution thermal infrared imagery in an arid megacity 利用SDGSAT-1高分辨率热红外图像在干旱特大城市调查与当地气候带相关的热相关健康风险
IF 7.6 Q1 REMOTE SENSING Pub Date : 2025-02-01 DOI: 10.1016/j.jag.2024.104334
Muhammad Fahad Baqa , Linlin Lu , Huadong Guo , Xiaoning Song , Seyed Kazem Alavipanah , Syed Nawaz-ul-Huda , Qingting Li , Fang Chen
Due to the compounding impacts of urbanization and climate change-induced warming, urban inhabitants face increasing risks of thermal health issues. The use of high-resolution maps that categorize intra-urban thermal environment and Local Climate Zones (LCZ) could enhance the understanding of the correlation between heat-related health risks and microclimates. In this study, a fine-scale heat risk assessment framework was applied in an arid megacity, Karachi, Pakistan. Following Crichton’s Risk Triangle framework, heat health risks were mapped by considering hazard-exposure-vulnerability components at the census ward level. The heat hazard was mapped using SDGSAT-1 thermal infrared data at a 30 m spatial resolution during summer season. Factors contributing most to heat vulnerability were identified as the availability of electricity facilities, bathroom facilities, and housing density, with contribution rates of 47.51 %, 21.86 %, and 8.07 %, respectively. Heat risks were considerably higher for built types (0.16) compared to natural LCZ types (0.07), with 65 % of LCZ 2, 3, 6, and 7 (compact mid-rise, compact low-rise, open low-rise, and lightweight low-rise areas) identified as high-risk areas. To mitigate heat risks, green space should be planned in LCZ2 and LCZ3 characterized by dense population and compact buildings arrangement, and public cooling facilities and infrastructure should be improved in LCZ7 featured with squatter and slum settlements. Urban planners may consider restricting the growth of these areas in newly-developed regions, including encroachments and unplanned settlements, to prevent further exacerbation of heat stress. This study offers a valuable guide for assessing and alleviating heat risks at the community level, thereby promoting the development of heat resilient urban areas.
由于城市化和气候变化引起的气候变暖的综合影响,城市居民面临越来越大的热健康风险。使用高分辨率地图对城市内部热环境和局部气候区(LCZ)进行分类,可以增强对热相关健康风险与小气候之间相关性的理解。在这项研究中,一个精细尺度的热风险评估框架应用于巴基斯坦的一个干旱特大城市卡拉奇。根据克莱顿的风险三角框架,通过考虑人口普查病房层面的危险暴露-脆弱性组成部分,绘制了热健康风险图。利用SDGSAT-1热红外数据在夏季以30 m空间分辨率绘制热危害图。对热脆弱性影响最大的因素是电力设施、卫生间设施和住房密度,贡献率分别为47.51%、21.86%和8.07%。与自然LCZ类型(0.07)相比,建筑类型的热风险(0.16)要高得多,其中65%的LCZ 2、3、6和7(紧凑型中高层、紧凑型低层、开放式低层和轻型低层)被确定为高风险区域。为降低热风险,在人口密集、建筑布局紧凑的LCZ2和LCZ3地区应规划绿地,在棚户区和贫民窟聚居的LCZ7地区应完善公共制冷设施和基础设施。城市规划者可以考虑在新开发地区限制这些区域的增长,包括侵占和计划外的定居点,以防止热应激进一步加剧。该研究为社区热风险评估和缓解提供了有价值的指导,从而促进热韧性城市地区的发展。
{"title":"Investigating heat-related health risks related to local climate zones using SDGSAT-1 high-resolution thermal infrared imagery in an arid megacity","authors":"Muhammad Fahad Baqa ,&nbsp;Linlin Lu ,&nbsp;Huadong Guo ,&nbsp;Xiaoning Song ,&nbsp;Seyed Kazem Alavipanah ,&nbsp;Syed Nawaz-ul-Huda ,&nbsp;Qingting Li ,&nbsp;Fang Chen","doi":"10.1016/j.jag.2024.104334","DOIUrl":"10.1016/j.jag.2024.104334","url":null,"abstract":"<div><div>Due to the compounding impacts of urbanization and climate change-induced warming, urban inhabitants face increasing risks of thermal health issues. The use of high-resolution maps that categorize intra-urban thermal environment and Local Climate Zones (LCZ) could enhance the understanding of the correlation between heat-related health risks and microclimates. In this study, a fine-scale heat risk assessment framework was applied in an arid megacity, Karachi, Pakistan. Following Crichton’s Risk Triangle framework, heat health risks were mapped by considering hazard-exposure-vulnerability components at the census ward level. The heat hazard was mapped using SDGSAT-1 thermal infrared data at a 30 m spatial resolution during summer season. Factors contributing most to heat vulnerability were identified as the availability of electricity facilities, bathroom facilities, and housing density, with contribution rates of 47.51 %, 21.86 %, and 8.07 %, respectively. Heat risks were considerably higher for built types (0.16) compared to natural LCZ types (0.07), with 65 % of LCZ 2, 3, 6, and 7 (compact mid-rise, compact low-rise, open low-rise, and lightweight low-rise areas) identified as high-risk areas. To mitigate heat risks, green space should be planned in LCZ2 and LCZ3 characterized by dense population and compact buildings arrangement, and public cooling facilities and infrastructure should be improved in LCZ7 featured with squatter and slum settlements. Urban planners may consider restricting the growth of these areas in newly-developed regions, including encroachments and unplanned settlements, to prevent further exacerbation of heat stress. This study offers a valuable guide for assessing and alleviating heat risks at the community level, thereby promoting the development of heat resilient urban areas.</div></div>","PeriodicalId":73423,"journal":{"name":"International journal of applied earth observation and geoinformation : ITC journal","volume":"136 ","pages":"Article 104334"},"PeriodicalIF":7.6,"publicationDate":"2025-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142874794","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
InSAR-based estimation of forest above-ground biomass using phase histogram technique 基于insar的森林地上生物量相位直方图估算
IF 7.6 Q1 REMOTE SENSING Pub Date : 2025-02-01 DOI: 10.1016/j.jag.2024.104350
Chuanjun Wu , Peng Shen , Stefano Tebaldini , Mingsheng Liao , Lu Zhang
This paper introduces a method for estimating forest above-ground biomass (AGB) using the Interferometric SAR (InSAR)-based Phase Histogram (PH) technique. This novel technique allows for the extraction of 3D vertical forest structure using only a single interferometric pair to acquire a coarse-resolution backscatter intensity distribution in the height direction. Through 3D backscatter distribution, we can extract forest height, the intensity at predefined height bins and introduce the volume-to-ground intensity ratio (VGR) factor to investigate their sensitivities to forest AGB. To validate the method, we use the airborne fully polarized TomoSense dataset, flight-tested by European Space Agency (ESA) in Kermeter area at Eifel National Park, Germany, in 2020. We adopt both multivariate linear stepwise regression (MLSR) and random forest (RF) models to verify the feasibility of the PH technique in forest AGB estimation. Experimental results show that the PH technique effectively captures the vertical structure of the forest at a certain resolution. The forest height, the PH-derived backscatter intensity at a fixed height and VGR have good positive correlation with AGB. Notably, combining forest height, the intensity at fixed height layers and VGR significantly improves the inversion precision of forest AGB. Specifically, compared with LiDAR-derived AGB, the average root-mean-square error (RMSE) of MLSR and RF models estimates combining P- and L-band 2D + 3D observables are 57.92 ton/ha and 55.11 ton/ha, with Pearson correlation coefficient (PCC) of 0.75 and 0.77, respectively. This study presents a promising alternative approach for current and future SAR Earth observation missions aimed at forest vertical structure construction and AGB estimation when only a few of single-polarization SAR images are available.
本文介绍了一种基于干涉SAR (InSAR)的相位直方图(PH)技术估算森林地上生物量(AGB)的方法。这种新技术允许仅使用单个干涉对提取三维垂直森林结构,以获得在高度方向上的粗分辨率后向散射强度分布。通过三维后向散射分布,提取森林高度、预定义高度仓的强度,并引入体地强度比(VGR)因子,考察其对森林AGB的敏感性。为了验证该方法,我们使用了机载全极化TomoSense数据集,该数据集于2020年由欧洲航天局(ESA)在德国艾菲尔国家公园的Kermeter地区进行了飞行测试。采用多元线性逐步回归(MLSR)和随机森林(RF)模型验证PH技术在森林AGB估计中的可行性。实验结果表明,PH技术在一定分辨率下能有效地捕获森林的垂直结构。森林高度、固定高度ph反演后向散射强度和VGR与AGB呈良好的正相关关系。值得注意的是,结合森林高度、固定高程层强度和VGR显著提高了森林AGB的反演精度。与激光雷达AGB相比,结合P波段和l波段2D + 3D观测数据的MLSR和RF模型估计的平均均方根误差(RMSE)分别为57.92和55.11 t /ha, Pearson相关系数(PCC)分别为0.75和0.77。该研究为当前和未来针对森林垂直结构构建和AGB估算的SAR对地观测任务提供了一种有希望的替代方法。
{"title":"InSAR-based estimation of forest above-ground biomass using phase histogram technique","authors":"Chuanjun Wu ,&nbsp;Peng Shen ,&nbsp;Stefano Tebaldini ,&nbsp;Mingsheng Liao ,&nbsp;Lu Zhang","doi":"10.1016/j.jag.2024.104350","DOIUrl":"10.1016/j.jag.2024.104350","url":null,"abstract":"<div><div>This paper introduces a method for estimating forest above-ground biomass (AGB) using the Interferometric SAR (InSAR)-based Phase Histogram (PH) technique. This novel technique allows for the extraction of 3D vertical forest structure using only a single interferometric pair to acquire a coarse-resolution backscatter intensity distribution in the height direction. Through 3D backscatter distribution, we can extract forest height, the intensity at predefined height bins and introduce the volume-to-ground intensity ratio (VGR) factor to investigate their sensitivities to forest AGB. To validate the method, we use the airborne fully polarized TomoSense dataset, flight-tested by European Space Agency (ESA) in Kermeter area at Eifel National Park, Germany, in 2020. We adopt both multivariate linear stepwise regression (MLSR) and random forest (RF) models to verify the feasibility of the PH technique in forest AGB estimation. Experimental results show that the PH technique effectively captures the vertical structure of the forest at a certain resolution. The forest height, the PH-derived backscatter intensity at a fixed height and VGR have good positive correlation with AGB. Notably, combining forest height, the intensity at fixed height layers and VGR significantly improves the inversion precision of forest AGB. Specifically, compared with LiDAR-derived AGB, the average root-mean-square error (RMSE) of MLSR and RF models estimates combining P- and L-band 2D + 3D observables are 57.92 ton/ha and 55.11 ton/ha, with Pearson correlation coefficient (PCC) of 0.75 and 0.77, respectively. This study presents a promising alternative approach for current and future SAR Earth observation missions aimed at forest vertical structure construction and AGB estimation when only a few of single-polarization SAR images are available.</div></div>","PeriodicalId":73423,"journal":{"name":"International journal of applied earth observation and geoinformation : ITC journal","volume":"136 ","pages":"Article 104350"},"PeriodicalIF":7.6,"publicationDate":"2025-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142929501","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
The impact of spatiotemporal variability of environmental conditions on wheat yield forecasting using remote sensing data and machine learning 基于遥感数据和机器学习的环境条件时空变异性对小麦产量预测的影响
IF 7.6 Q1 REMOTE SENSING Pub Date : 2025-02-01 DOI: 10.1016/j.jag.2025.104367
Keltoum Khechba , Mariana Belgiu , Ahmed Laamrani , Alfred Stein , Abdelhakim Amazirh , Abdelghani Chehbouni
<div><div>Climate change poses significant challenges to food security, especially in semi-arid agriculture areas. Effective monitoring of crop yield is important for establishing food emergency responses and developing long-term sustainable strategies. In Morocco, where cereals are the predominant crops, yield forecasting is important for addressing the yield gap as it enables farmers to take preventive actions before the harvesting period. This study aims to assess the impact of spatial and temporal heterogeneity of environmental conditions on wheat yield forecasting using machine learning models. It compares the 2019–2020 and 2020–2021 agricultural seasons using three sets of variables: (1) spectral indices; (2) weather data; and (3) a combination of both spectral indices and weather data. Weather data, including cumulative monthly precipitation from ERA5 data and average monthly temperature from PERSIANN data, were extracted for the wheat growing season (November to June). Spectral indices including the Normalized Difference Vegetation Index, Moisture Stress Index, and Terrestrial Chlorophyll Index were calculated from Sentinel-2 imagery for the same period and processed using Google Earth Engine. The study area was divided into homogeneous zones based on an existing landform classification, and XGBoost and Random Forest (RF) models were used for yield forecasting in each zone separately. The two models performed equally well across both the zones and the whole study area (SA) when using weather data as the input variable. For instance, across SA, they achieved average R<sup>2</sup> values of 0.60 and 0.81 for all months during the 2019–2020 and 2020–2021 agricultural seasons, respectively. However, when using spectral indices or combining these indices with weather data, RF consistently outperformed XGBoost. For example, in SA during the 2019–2020 season, RF achieved an average R<sup>2</sup> of 0.48 across the growing season, compared to XGBoost’s R<sup>2</sup> of 0.43. Similarly, in the 2020–2021 season, RF achieved an R<sup>2</sup> of 0.35 and an RMSE of 1083 kg ha<sup>-1</sup>, while XGBoost performed slightly lower, with an R<sup>2</sup> of 0.29 and an RMSE of 1137 kg ha<sup>-1</sup>. Comparing the prediction accuracy between the seasons for each set of variables, the RF model performs better when using spectral indices during the relatively dry 2019–2020 season as compared to the wet 2020–2021 season. Incorporating weather data, the model improved its performance for the 2020–2021 season. April showed the highest prediction performance overall, with R<sup>2</sup> values of 0.6 for SA using weather data alone in the 2019–2020 season, and 0.8 for SA using a combination of weather data and spectral indices in the 2020–2021 season. The 2019–2020 season showed strong fluctuations in accuracy throughout the growing season, whereas the 2020–2021 season had a consistent improvement in accuracy over time. These variations in accuracy are due to
气候变化对粮食安全构成重大挑战,特别是在半干旱农业区。有效监测作物产量对于制定粮食应急措施和制定长期可持续战略至关重要。在以谷物为主要作物的摩洛哥,产量预测对于解决产量差距非常重要,因为它使农民能够在收获期之前采取预防行动。本研究旨在利用机器学习模型评估环境条件时空异质性对小麦产量预测的影响。利用三组变量对2019-2020年和2020-2021年的农业季节进行比较:(1)光谱指数;(2)气象资料;(3)光谱指数与气象资料相结合。提取了小麦生长季节(11月至6月)的气象数据,包括ERA5数据的月累积降水量和persann数据的月平均气温。利用同一时期的Sentinel-2遥感影像计算归一化植被指数、水分胁迫指数和陆地叶绿素指数,并使用谷歌Earth Engine进行处理。在现有地貌分类的基础上,将研究区划分为均匀带,分别使用XGBoost和Random Forest (RF)模型对每个带进行产量预测。当使用天气数据作为输入变量时,这两个模型在两个区域和整个研究区域(SA)上都表现得同样好。例如,在整个SA中,2019-2020年和2020-2021年农业季节所有月份的平均R2分别为0.60和0.81。然而,当使用光谱指数或将这些指数与天气数据相结合时,RF的表现始终优于XGBoost。例如,在2019-2020季节,在SA中,RF在整个生长季节的平均R2为0.48,而XGBoost的R2为0.43。同样,在2020-2021赛季,RF的R2为0.35,RMSE为1083 kg ha-1,而XGBoost的R2略低,为0.29,RMSE为1137 kg ha-1。对比各变量季节间的预测精度,RF模型在相对干旱的2019-2020季节比湿润的2020-2021季节表现更好。结合天气数据,该模型提高了其在2020-2021赛季的表现。总体而言,4月份的预测性能最高,2019-2020年季节仅使用天气数据的SA R2值为0.6,2020-2021年季节使用天气数据和光谱指数组合的SA R2值为0.8。2019-2020赛季在整个生长季中准确性波动较大,而2020-2021赛季随着时间的推移准确性持续提高。这些准确性的差异是由于不同的环境条件造成的,为了做出更好和更可靠的产量预测,应将这些环境条件考虑在内。
{"title":"The impact of spatiotemporal variability of environmental conditions on wheat yield forecasting using remote sensing data and machine learning","authors":"Keltoum Khechba ,&nbsp;Mariana Belgiu ,&nbsp;Ahmed Laamrani ,&nbsp;Alfred Stein ,&nbsp;Abdelhakim Amazirh ,&nbsp;Abdelghani Chehbouni","doi":"10.1016/j.jag.2025.104367","DOIUrl":"10.1016/j.jag.2025.104367","url":null,"abstract":"&lt;div&gt;&lt;div&gt;Climate change poses significant challenges to food security, especially in semi-arid agriculture areas. Effective monitoring of crop yield is important for establishing food emergency responses and developing long-term sustainable strategies. In Morocco, where cereals are the predominant crops, yield forecasting is important for addressing the yield gap as it enables farmers to take preventive actions before the harvesting period. This study aims to assess the impact of spatial and temporal heterogeneity of environmental conditions on wheat yield forecasting using machine learning models. It compares the 2019–2020 and 2020–2021 agricultural seasons using three sets of variables: (1) spectral indices; (2) weather data; and (3) a combination of both spectral indices and weather data. Weather data, including cumulative monthly precipitation from ERA5 data and average monthly temperature from PERSIANN data, were extracted for the wheat growing season (November to June). Spectral indices including the Normalized Difference Vegetation Index, Moisture Stress Index, and Terrestrial Chlorophyll Index were calculated from Sentinel-2 imagery for the same period and processed using Google Earth Engine. The study area was divided into homogeneous zones based on an existing landform classification, and XGBoost and Random Forest (RF) models were used for yield forecasting in each zone separately. The two models performed equally well across both the zones and the whole study area (SA) when using weather data as the input variable. For instance, across SA, they achieved average R&lt;sup&gt;2&lt;/sup&gt; values of 0.60 and 0.81 for all months during the 2019–2020 and 2020–2021 agricultural seasons, respectively. However, when using spectral indices or combining these indices with weather data, RF consistently outperformed XGBoost. For example, in SA during the 2019–2020 season, RF achieved an average R&lt;sup&gt;2&lt;/sup&gt; of 0.48 across the growing season, compared to XGBoost’s R&lt;sup&gt;2&lt;/sup&gt; of 0.43. Similarly, in the 2020–2021 season, RF achieved an R&lt;sup&gt;2&lt;/sup&gt; of 0.35 and an RMSE of 1083 kg ha&lt;sup&gt;-1&lt;/sup&gt;, while XGBoost performed slightly lower, with an R&lt;sup&gt;2&lt;/sup&gt; of 0.29 and an RMSE of 1137 kg ha&lt;sup&gt;-1&lt;/sup&gt;. Comparing the prediction accuracy between the seasons for each set of variables, the RF model performs better when using spectral indices during the relatively dry 2019–2020 season as compared to the wet 2020–2021 season. Incorporating weather data, the model improved its performance for the 2020–2021 season. April showed the highest prediction performance overall, with R&lt;sup&gt;2&lt;/sup&gt; values of 0.6 for SA using weather data alone in the 2019–2020 season, and 0.8 for SA using a combination of weather data and spectral indices in the 2020–2021 season. The 2019–2020 season showed strong fluctuations in accuracy throughout the growing season, whereas the 2020–2021 season had a consistent improvement in accuracy over time. These variations in accuracy are due to ","PeriodicalId":73423,"journal":{"name":"International journal of applied earth observation and geoinformation : ITC journal","volume":"136 ","pages":"Article 104367"},"PeriodicalIF":7.6,"publicationDate":"2025-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142975200","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A deep learning approach for SMAP soil moisture downscaling informed by thermal inertia theory 基于热惯性理论的SMAP土壤水分降尺度深度学习方法
IF 7.6 Q1 REMOTE SENSING Pub Date : 2025-02-01 DOI: 10.1016/j.jag.2025.104370
Mengyuan Xu , Haoxuan Yang , Annan Hu , Lee Heng , Linyi Li , Ning Yao , Gang Liu
Deep learning (DL) based methods have recently made remarkable progress in remote sensing (RS) soil moisture (SM) retrieval applications. However, their purely “black box” algorithms suffer from a lack of interpretability, whereas methods based solely on physical mechanisms often underperform in complex scenarios. In this study, we attempt to use an SM downscaling approach that integrates thermal inertia (TI) theory with the DenseNet deep network algorithm. This approach provides partial interpretability of the physical mechanisms while utilizing DenseNet’s superior nonlinear learning ability and feature reuse capability for downscaling the Soil Moisture Active Passive (SMAP) satellite product, generating daily 1 km × 1 km SM. A comprehensive assessment of the downscaled results using in-situ SM acquired from 264 International Soil Moisture Network (ISMN) sites densely distributed across the continental U.S. indicated that this downscaling approach had an overall high accuracy, with an average unbiased root mean square error (ubRMSE) of 0.048 m3/m3. In addition, the downscaled SM exhibited marked improvement in spatial details over the original SMAP SM maps, providing clearer land surface features. The proposed SM downscaling approach is a valuable attempt to adopt DL methods with more practical physical meaning and more interpretability in the current RS Big Data era.
基于深度学习(DL)的方法最近在遥感(RS)土壤湿度(SM)检索应用中取得了显著进展。然而,这些纯粹的 "黑箱 "算法缺乏可解释性,而仅基于物理机制的方法在复杂场景中往往表现不佳。在本研究中,我们尝试使用一种将热惯性(TI)理论与 DenseNet 深度网络算法相结合的 SM 降尺度方法。这种方法提供了物理机制的部分可解释性,同时利用 DenseNet 优越的非线性学习能力和特征重用能力对土壤水分主动被动(SMAP)卫星产品进行降尺度,生成每日 1 km × 1 km 的土壤水分。利用密集分布在美国大陆的 264 个国际土壤水分网络(ISMN)站点获取的原位土壤水分,对降级结果进行了综合评估,结果表明这种降级方法总体精度较高,平均无偏均方根误差(ubRMSE)为 0.048 m3/m3。此外,缩小尺度后的 SM 与原始的 SMAP SM 地图相比,在空间细节方面有明显改善,提供了更清晰的地表特征。所提出的SM降尺度方法是在当前RS大数据时代采用更具实际物理意义和可解释性的DL方法的有益尝试。
{"title":"A deep learning approach for SMAP soil moisture downscaling informed by thermal inertia theory","authors":"Mengyuan Xu ,&nbsp;Haoxuan Yang ,&nbsp;Annan Hu ,&nbsp;Lee Heng ,&nbsp;Linyi Li ,&nbsp;Ning Yao ,&nbsp;Gang Liu","doi":"10.1016/j.jag.2025.104370","DOIUrl":"10.1016/j.jag.2025.104370","url":null,"abstract":"<div><div>Deep learning (DL) based methods have recently made remarkable progress in remote sensing (RS) soil moisture (SM) retrieval applications. However, their purely “black box” algorithms suffer from a lack of interpretability, whereas methods based solely on physical mechanisms often underperform in complex scenarios. In this study, we attempt to use an SM downscaling approach that integrates thermal inertia (TI) theory with the DenseNet deep network algorithm. This approach provides partial interpretability of the physical mechanisms while utilizing DenseNet’s superior nonlinear learning ability and feature reuse capability for downscaling the Soil Moisture Active Passive (SMAP) satellite product, generating daily 1 km × 1 km SM. A comprehensive assessment of the downscaled results using <em>in-situ</em> SM acquired from 264 International Soil Moisture Network (ISMN) sites densely distributed across the continental U.S. indicated that this downscaling approach had an overall high accuracy, with an average unbiased root mean square error (ubRMSE) of 0.048 m<sup>3</sup>/m<sup>3</sup>. In addition, the downscaled SM exhibited marked improvement in spatial details over the original SMAP SM maps, providing clearer land surface features. The proposed SM downscaling approach is a valuable attempt to adopt DL methods with more practical physical meaning and more interpretability in the current RS Big Data era.</div></div>","PeriodicalId":73423,"journal":{"name":"International journal of applied earth observation and geoinformation : ITC journal","volume":"136 ","pages":"Article 104370"},"PeriodicalIF":7.6,"publicationDate":"2025-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142990330","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Metaheuristic-driven enhancement of categorical boosting algorithm for flood-prone areas mapping 洪水易发地区地图分类提升算法的元启发式改进
IF 7.6 Q1 REMOTE SENSING Pub Date : 2025-02-01 DOI: 10.1016/j.jag.2025.104357
Seyed Vahid Razavi-Termeh , Ali Pourzangbar , Abolghasem Sadeghi-Niaraki , Mário J. Franca , Soo-Mi Choi
Managing and controlling costly natural hazards such as floods has been a fundamental and essential issue for decision-makers and planners from the past to the present. Artificial intelligence (AI) has recently proven promising to improve disaster management. There is growing interest in using AI to predict and identify flood-prone areas. However, creating accurate flood susceptibility maps with AI remains a significant challenge. Therefore, the present work endeavors to cope with this gap and produce the most efficient flood susceptibility maps employing Categorical Boosting (CatBoost) algorithms and three system-based metaheuristic methods, including Augmented Artificial Ecosystem Optimization (AAEO), Germinal Center Optimization (GCO), and Water Circle Algorithm (WCA). We selected Jahrom County, Iran, to develop machine learning-based models as our case study. We used 13 flood conditioning geophysical factors as input parameters and flood occurrence (binary classification), derived from satellite imagery, as the output. Our results show that CatBoost-AAEO performs better in flood susceptibility mapping than the other combined models, CatBoost-WCA, CatBoost-GCO, and the basic CatBoost model, which are mentioned in descending order of performance. The partial Dependence Plots (PDP) approach is used to interpret the results of the developed algorithms, highlighting that low slope, low elevation, minimal vegetation cover, flat curvature, and proximity to rivers significantly impact the performance of ML models to predict flood occurrence. The findings of this research can help planners manage and prevent floods and avoid development in sensitive areas to reduce financial losses caused by floods.
从过去到现在,管理和控制洪水等代价高昂的自然灾害一直是决策者和规划者的一个基本和必不可少的问题。人工智能(AI)最近被证明有希望改善灾害管理。人们对使用人工智能来预测和识别洪水易发地区越来越感兴趣。然而,利用人工智能创建准确的洪水易感性地图仍然是一个重大挑战。因此,本研究试图利用分类增强(CatBoost)算法和三种基于系统的元启发式方法,包括增强型人工生态系统优化(AAEO)、生发中心优化(GCO)和水循环算法(WCA),来弥补这一差距,并生成最有效的洪水敏感性图。我们选择伊朗的Jahrom县开发基于机器学习的模型作为我们的案例研究。我们使用13个洪水调节地球物理因子作为输入参数,并使用来自卫星图像的洪水发生率(二元分类)作为输出。结果表明,CatBoost- aaeo在洪水敏感性映射方面的表现优于其他组合模型,即CatBoost- wca、CatBoost- gco和基本CatBoost模型,它们的性能由高到低依次排列。使用部分相关图(PDP)方法来解释开发的算法的结果,强调低坡度,低海拔,最小植被覆盖,平坦曲率和靠近河流显著影响ML模型预测洪水发生的性能。这项研究的发现可以帮助规划者管理和预防洪水,避免在敏感地区开发,以减少洪水造成的经济损失。
{"title":"Metaheuristic-driven enhancement of categorical boosting algorithm for flood-prone areas mapping","authors":"Seyed Vahid Razavi-Termeh ,&nbsp;Ali Pourzangbar ,&nbsp;Abolghasem Sadeghi-Niaraki ,&nbsp;Mário J. Franca ,&nbsp;Soo-Mi Choi","doi":"10.1016/j.jag.2025.104357","DOIUrl":"10.1016/j.jag.2025.104357","url":null,"abstract":"<div><div>Managing and controlling costly natural hazards such as floods has been a fundamental and essential issue for decision-makers and planners from the past to the present. Artificial intelligence (AI) has recently proven promising to improve disaster management. There is growing interest in using AI to predict and identify flood-prone areas. However, creating accurate flood susceptibility maps with AI remains a significant challenge. Therefore, the present work endeavors to cope with this gap and produce the most efficient flood susceptibility maps employing Categorical Boosting (CatBoost) algorithms and three system-based metaheuristic methods, including Augmented Artificial Ecosystem Optimization (AAEO), Germinal Center Optimization (GCO), and Water Circle Algorithm (WCA). We selected Jahrom County, Iran, to develop machine learning-based models as our case study. We used 13 flood conditioning geophysical factors as input parameters and flood occurrence (binary classification), derived from satellite imagery, as the output. Our results show that CatBoost-AAEO performs better in flood susceptibility mapping than the other combined models, CatBoost-WCA, CatBoost-GCO, and the basic CatBoost model, which are mentioned in descending order of performance. The partial Dependence Plots (PDP) approach is used to interpret the results of the developed algorithms, highlighting that low slope, low elevation, minimal vegetation cover, flat curvature, and proximity to rivers significantly impact the performance of ML models to predict flood occurrence. The findings of this research can help planners manage and prevent floods and avoid development in sensitive areas to reduce financial losses caused by floods.</div></div>","PeriodicalId":73423,"journal":{"name":"International journal of applied earth observation and geoinformation : ITC journal","volume":"136 ","pages":"Article 104357"},"PeriodicalIF":7.6,"publicationDate":"2025-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142990331","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
An enhanced network for extracting tunnel lining defects using transformer encoder and aggregate decoder 基于变压器编码器和聚合解码器的隧道衬砌缺陷提取网络
IF 7.6 Q1 REMOTE SENSING Pub Date : 2025-02-01 DOI: 10.1016/j.jag.2024.104259
Bo Guo , Zhihai Huang , Haitao Luo , Perpetual Hope Akwensi , Ruisheng Wang , Bo Huang , Tsz Nam Chan
The tunnel environment is characterized by insufficient ambient light, obstructed view, and complex inner lining construction conditions. These factors frequently result in limited anti-interference capability, reduced recognition accuracy, and suboptimal segmentation results for defect extraction. We propose a deep network model utilizing an encoder–decoder framework that integrates Transformer and convolution for comprehensive defect extraction. The proposed model utilizes an encoder that integrates a hierarchical Transformer backbone with an efficient attention mechanism to fully explore complete information at multi-scale granularities. In the decoder, multi-scale information is initially aggregated using a Multi-Layer Perceptron (MLP) module. Additionally, the Stacking Filters with Atrous Convolutions (SFAC) module are implemented to enhance the perception of the complete defect scope. Furthermore, a Boundary-aware Attention Module (BAM) is implemented to enhance edge information to improve the detection of defects. With this well-designed decoder, the multi-scale information from the encoder can be fully aggregated and exploited for complete defect detection. Experimental findings illustrate the effectiveness of our proposed approach in addressing tunnel lining defects within the image dataset. The outcomes reveal that our proposed network achieves an accuracy (Acc) of 94.4% and a mean intersection over union (mIoU) of 78.14%. Compared to state-of-the-art segmentation networks, our model improves the accuracy of tunnel lining defect extraction, showcasing enhanced extraction effectiveness and anti-interference capability, thus meeting the engineering requirements for defect detection in complex environments of tunnels.
隧道环境具有环境光不足、视野遮挡、衬砌施工条件复杂等特点。这些因素经常导致有限的抗干扰能力,降低识别精度,以及对缺陷提取的次优分割结果。我们提出了一个深度网络模型,利用一个编码器-解码器框架,集成了变压器和卷积,以全面的缺陷提取。该模型利用一种集成了分层Transformer主干和高效关注机制的编码器来充分探索多尺度粒度的完整信息。在解码器中,使用多层感知器(MLP)模块初始聚合多尺度信息。此外,实现了带亚特罗斯卷积的堆叠滤波器(SFAC)模块,以增强对完整缺陷范围的感知。此外,采用边界感知注意模块(BAM)增强边缘信息,提高缺陷的检测效率。利用这种设计良好的解码器,可以将来自编码器的多尺度信息充分聚合并利用于完整的缺陷检测。实验结果证明了我们提出的方法在图像数据集中处理隧道衬砌缺陷的有效性。结果表明,我们提出的网络达到了94.4%的准确率(Acc)和78.14%的平均交联(mIoU)。与现有的分割网络相比,该模型提高了隧道衬砌缺陷提取的精度,增强了提取效果和抗干扰能力,满足了隧道复杂环境下缺陷检测的工程需求。
{"title":"An enhanced network for extracting tunnel lining defects using transformer encoder and aggregate decoder","authors":"Bo Guo ,&nbsp;Zhihai Huang ,&nbsp;Haitao Luo ,&nbsp;Perpetual Hope Akwensi ,&nbsp;Ruisheng Wang ,&nbsp;Bo Huang ,&nbsp;Tsz Nam Chan","doi":"10.1016/j.jag.2024.104259","DOIUrl":"10.1016/j.jag.2024.104259","url":null,"abstract":"<div><div>The tunnel environment is characterized by insufficient ambient light, obstructed view, and complex inner lining construction conditions. These factors frequently result in limited anti-interference capability, reduced recognition accuracy, and suboptimal segmentation results for defect extraction. We propose a deep network model utilizing an encoder–decoder framework that integrates Transformer and convolution for comprehensive defect extraction. The proposed model utilizes an encoder that integrates a hierarchical Transformer backbone with an efficient attention mechanism to fully explore complete information at multi-scale granularities. In the decoder, multi-scale information is initially aggregated using a Multi-Layer Perceptron (MLP) module. Additionally, the Stacking Filters with Atrous Convolutions (SFAC) module are implemented to enhance the perception of the complete defect scope. Furthermore, a Boundary-aware Attention Module (BAM) is implemented to enhance edge information to improve the detection of defects. With this well-designed decoder, the multi-scale information from the encoder can be fully aggregated and exploited for complete defect detection. Experimental findings illustrate the effectiveness of our proposed approach in addressing tunnel lining defects within the image dataset. The outcomes reveal that our proposed network achieves an accuracy (Acc) of 94.4% and a mean intersection over union (mIoU) of 78.14%. Compared to state-of-the-art segmentation networks, our model improves the accuracy of tunnel lining defect extraction, showcasing enhanced extraction effectiveness and anti-interference capability, thus meeting the engineering requirements for defect detection in complex environments of tunnels.</div></div>","PeriodicalId":73423,"journal":{"name":"International journal of applied earth observation and geoinformation : ITC journal","volume":"136 ","pages":"Article 104259"},"PeriodicalIF":7.6,"publicationDate":"2025-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142874861","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Image-point cloud embedding network for simultaneous image-based farmland instance extraction and point cloud-based semantic segmentation 基于图像的农田实例提取和基于点云的语义分割的图像点云嵌入网络
IF 7.6 Q1 REMOTE SENSING Pub Date : 2025-02-01 DOI: 10.1016/j.jag.2025.104361
Jinpeng Li , Yuan Li , Shuhang Zhang , Yiping Chen
Farmland extraction has been a pivotal research challenge for decades in remote sensing. Breakthrough progress has been made by relevant studies due to the advanced deep learning-based techniques. However, existing methods still pay little attention to the simultaneous instance-level farmland extraction and semantic-based 3D attribute analysis, which are essential for enabling more various agricultural applications. Additionally, most bimodal methods apply simple projection to convert high-dimensional features to low-dimensional space for feature interaction, which inevitably underutilizes the advantages of bimodal learning and leads to lamentable information loss. To address this issue, we propose a novel end-to-end bimodal network, named Image-Point Cloud Embedding Network (IPCE-Net), that innovatively employs a dual-stream branch architecture to concurrently perform image-based farmland instance segmentation and point cloud-based semantic segmentation. Furthermore, by leveraging the Heterogeneous Conversion Module (HCM), the IPCE-Net effectively reconciles the modality disparities between images and point clouds and achieves stage-by-stage feature interaction during the bimodal learning process, thus achieving higher performance than unimodal learning. Experiments on two datasets show that IPCE-Net achieves superior performance in both farmland instance extraction and point cloud semantic segmentation tasks. For farmland instance extraction, the instance-level mAP and pixel-level IoU metrics reach 74.9% and 79.6%, respectively, being considerably higher than other classical image-based instance segmentation methods. For the point cloud semantic segmentation, the OA and mIoU metrics are 93.8% and 66.1%, with a remarkable improvement of at least 1.3% and 8.2%, respectively, compared with the state-of-the-art semantic segmentation approaches. Moreover, intelligent analysis based on the interconnection of IPCE-Net and GPT-4 transforms the abstract categorical information into easy-to-understand measurable information, demonstrating its great potential for practical applications in precision and smart agriculture.
几十年来,农田提取一直是遥感研究的关键挑战。由于基于深度学习的先进技术,相关研究取得了突破性进展。然而,现有的方法仍然很少关注实例级农田提取和基于语义的三维属性分析,而这对于实现更多样化的农业应用至关重要。此外,大多数双峰方法采用简单的投影将高维特征转换到低维空间进行特征交互,这不可避免地没有充分利用双峰学习的优势,导致严重的信息丢失。为了解决这一问题,我们提出了一种新的端到端双峰网络,称为图像点云嵌入网络(IPCE-Net),该网络创新地采用双流分支架构同时执行基于图像的农田实例分割和基于点云的语义分割。此外,通过利用异构转换模块(HCM), IPCE-Net有效地协调了图像和点云之间的模态差异,并在双峰学习过程中实现了分阶段的特征交互,从而获得了比单峰学习更高的性能。在两个数据集上的实验表明,IPCE-Net在农田实例提取和点云语义分割任务上都取得了优异的性能。对于农田实例提取,实例级mAP和像素级IoU指标分别达到74.9%和79.6%,明显高于其他经典的基于图像的实例分割方法。对于点云语义分割,OA和mIoU指标分别为93.8%和66.1%,与目前最先进的语义分割方法相比,分别提高了至少1.3%和8.2%。此外,基于IPCE-Net和GPT-4互联的智能分析将抽象的分类信息转化为易于理解的可测量信息,在精准农业和智慧农业的实际应用中显示出巨大的潜力。
{"title":"Image-point cloud embedding network for simultaneous image-based farmland instance extraction and point cloud-based semantic segmentation","authors":"Jinpeng Li ,&nbsp;Yuan Li ,&nbsp;Shuhang Zhang ,&nbsp;Yiping Chen","doi":"10.1016/j.jag.2025.104361","DOIUrl":"10.1016/j.jag.2025.104361","url":null,"abstract":"<div><div>Farmland extraction has been a pivotal research challenge for decades in remote sensing. Breakthrough progress has been made by relevant studies due to the advanced deep learning-based techniques. However, existing methods still pay little attention to the simultaneous instance-level farmland extraction and semantic-based 3D attribute analysis, which are essential for enabling more various agricultural applications. Additionally, most bimodal methods apply simple projection to convert high-dimensional features to low-dimensional space for feature interaction, which inevitably underutilizes the advantages of bimodal learning and leads to lamentable information loss. To address this issue, we propose a novel end-to-end bimodal network, named Image-Point Cloud Embedding Network (IPCE-Net), that innovatively employs a dual-stream branch architecture to concurrently perform image-based farmland instance segmentation and point cloud-based semantic segmentation. Furthermore, by leveraging the Heterogeneous Conversion Module (HCM), the IPCE-Net effectively reconciles the modality disparities between images and point clouds and achieves stage-by-stage feature interaction during the bimodal learning process, thus achieving higher performance than unimodal learning. Experiments on two datasets show that IPCE-Net achieves superior performance in both farmland instance extraction and point cloud semantic segmentation tasks. For farmland instance extraction, the instance-level mAP and pixel-level IoU metrics reach 74.9% and 79.6%, respectively, being considerably higher than other classical image-based instance segmentation methods. For the point cloud semantic segmentation, the OA and mIoU metrics are 93.8% and 66.1%, with a remarkable improvement of at least 1.3% and 8.2%, respectively, compared with the state-of-the-art semantic segmentation approaches. Moreover, intelligent analysis based on the interconnection of IPCE-Net and GPT-4 transforms the abstract categorical information into easy-to-understand measurable information, demonstrating its great potential for practical applications in precision and smart agriculture.</div></div>","PeriodicalId":73423,"journal":{"name":"International journal of applied earth observation and geoinformation : ITC journal","volume":"136 ","pages":"Article 104361"},"PeriodicalIF":7.6,"publicationDate":"2025-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142990325","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
International journal of applied earth observation and geoinformation : ITC journal
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1