首页 > 最新文献

IEEE geoscience and remote sensing letters : a publication of the IEEE Geoscience and Remote Sensing Society最新文献

英文 中文
Dual-Polarization Responses of Microwave Radiation of Diorite in Process of Uniaxial Loading 单轴加载过程中闪长岩的微波辐射双极化响应
Guangrui Dong;Wenfei Mao;Licheng Sun;Tao Zheng;Haofeng Dou;Lixin Wu
The experimental detection of the changes in microwave radiation of rocks under pressure is key to identifying earthquake anomalies through satellite passive microwave remote sensing. However, such changes have not been comprehensively characterized due to the considerable differences in crustal lithology, weak microwave radiation signals, and strong environmental noise. Considering the intrinsic and significant diversity of different polarized microwave radiations of any materials, this study investigated the responses of different polarized microwave radiations during loading the rock materials. Thus, a synchronized detection system including multiple sensors was constructed at outdoor to reveal the stress-induced changes in C-band microwave brightness temperature (MBT) of diorite specimen. Experimental results show that both the horizontal and vertical MBT varied regularly with the changes of pressure; however, the trends of changes of MBT were greatly influenced by the polarization modes. Specifically, a positive correlation was illustrated between the change in vertical polarization MBT and cyclically varied pressure, during which the MBT changed with a rate of 0.033 K/MPa about. In contrast, the changes in horizontal polarization MBT exhibited a negative correlation with the varied pressure, and the MBT change rate was approximately −0.031 K/MPa. Based on the radiative transfer theory, it was found that the opposite MBT changes with respect to h- and v-polarizations are supposed to be caused by the dielectric anisotropy under uniaxial compression conditions. This study illustrates the significant and discernible MBT changes of diorite induced by the stress, which is helpful to identify the detectable microwave radiation anomalies before large earthquake occurrence.
对受压岩石微波辐射变化的实验探测是通过卫星无源微波遥感识别地震异常的关键。然而,由于地壳岩性差异大、微波辐射信号弱、环境噪声强等原因,这种变化尚未得到全面的表征。考虑到任何材料的不同极化微波辐射都具有内在的显著多样性,本研究调查了岩石材料加载过程中不同极化微波辐射的响应。因此,在室外构建了一个包括多个传感器的同步检测系统,以揭示应力引起的闪长岩试样 C 波段微波亮度温度(MBT)的变化。实验结果表明,水平和垂直方向的微波亮度温度随压力的变化而有规律地变化,但微波亮度温度的变化趋势在很大程度上受极化模式的影响。具体而言,垂直极化 MBT 的变化与周期性变化的压力之间呈正相关,其间 MBT 以 0.033 K/MPa 左右的速率变化。相反,水平极化 MBT 的变化与变化的压力呈负相关,MBT 的变化率约为 -0.031 K/MPa。根据辐射传递理论,研究发现在单轴压缩条件下,介电各向异性会导致 h 极化和 v 极化 MBT 发生相反的变化。这项研究说明了应力诱发的闪长岩的显著和可识别的 MBT 变化,有助于在大地震发生前识别可探测到的微波辐射异常。
{"title":"Dual-Polarization Responses of Microwave Radiation of Diorite in Process of Uniaxial Loading","authors":"Guangrui Dong;Wenfei Mao;Licheng Sun;Tao Zheng;Haofeng Dou;Lixin Wu","doi":"10.1109/LGRS.2024.3492325","DOIUrl":"https://doi.org/10.1109/LGRS.2024.3492325","url":null,"abstract":"The experimental detection of the changes in microwave radiation of rocks under pressure is key to identifying earthquake anomalies through satellite passive microwave remote sensing. However, such changes have not been comprehensively characterized due to the considerable differences in crustal lithology, weak microwave radiation signals, and strong environmental noise. Considering the intrinsic and significant diversity of different polarized microwave radiations of any materials, this study investigated the responses of different polarized microwave radiations during loading the rock materials. Thus, a synchronized detection system including multiple sensors was constructed at outdoor to reveal the stress-induced changes in C-band microwave brightness temperature (MBT) of diorite specimen. Experimental results show that both the horizontal and vertical MBT varied regularly with the changes of pressure; however, the trends of changes of MBT were greatly influenced by the polarization modes. Specifically, a positive correlation was illustrated between the change in vertical polarization MBT and cyclically varied pressure, during which the MBT changed with a rate of 0.033 K/MPa about. In contrast, the changes in horizontal polarization MBT exhibited a negative correlation with the varied pressure, and the MBT change rate was approximately −0.031 K/MPa. Based on the radiative transfer theory, it was found that the opposite MBT changes with respect to h- and v-polarizations are supposed to be caused by the dielectric anisotropy under uniaxial compression conditions. This study illustrates the significant and discernible MBT changes of diorite induced by the stress, which is helpful to identify the detectable microwave radiation anomalies before large earthquake occurrence.","PeriodicalId":91017,"journal":{"name":"IEEE geoscience and remote sensing letters : a publication of the IEEE Geoscience and Remote Sensing Society","volume":"21 ","pages":"1-5"},"PeriodicalIF":0.0,"publicationDate":"2024-11-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142645518","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Domain-Invariant Progressive Knowledge Distillation for UAV-Based Object Detection 基于无人机的物体检测的领域不变渐进式知识提炼
Liang Yao;Fan Liu;Chuanyi Zhang;Zhiquan Ou;Ting Wu
Knowledge distillation (KD) is an effective method for compressing models in object detection tasks. Due to limited computational capability, unmanned aerial vehicle-based object detection (UAV-OD) widely adopt the KD technique to obtain lightweight detectors. Existing methods often overlook the significant differences in feature space caused by the large gap in scale between the teacher and student models. This limitation hampers the efficiency of knowledge transfer during the distillation process. Furthermore, the complex backgrounds in aerial images make it challenging for the student model to efficiently learn the object features. In this letter, we propose a novel KD framework for UAV-OD. Specifically, a progressive distillation approach is designed to alleviate the feature gap between teacher and student models. Then, a new feature alignment method is provided to extract object-related features for enhancing the student model’s knowledge reception efficiency. Finally, extensive experiments are conducted to validate the effectiveness of our proposed approach. The results demonstrate that our proposed method achieves state-of-the-art performance on two datasets.
在物体检测任务中,知识蒸馏(KD)是一种压缩模型的有效方法。由于计算能力有限,基于无人机的物体检测(UAV-OD)广泛采用知识蒸馏技术来获得轻量级的检测器。现有的方法往往忽略了教师模型和学生模型在比例上的巨大差距所导致的特征空间的显著差异。这种限制妨碍了提炼过程中知识转移的效率。此外,航空图像中的复杂背景也给学生模型有效学习物体特征带来了挑战。在这封信中,我们提出了一种适用于无人机光学观测的新型 KD 框架。具体来说,我们设计了一种渐进式蒸馏方法来缓解教师模型和学生模型之间的特征差距。然后,提供了一种新的特征对齐方法来提取与物体相关的特征,以提高学生模型的知识接收效率。最后,我们进行了大量实验来验证所提方法的有效性。结果表明,我们提出的方法在两个数据集上取得了最先进的性能。
{"title":"Domain-Invariant Progressive Knowledge Distillation for UAV-Based Object Detection","authors":"Liang Yao;Fan Liu;Chuanyi Zhang;Zhiquan Ou;Ting Wu","doi":"10.1109/LGRS.2024.3492187","DOIUrl":"https://doi.org/10.1109/LGRS.2024.3492187","url":null,"abstract":"Knowledge distillation (KD) is an effective method for compressing models in object detection tasks. Due to limited computational capability, unmanned aerial vehicle-based object detection (UAV-OD) widely adopt the KD technique to obtain lightweight detectors. Existing methods often overlook the significant differences in feature space caused by the large gap in scale between the teacher and student models. This limitation hampers the efficiency of knowledge transfer during the distillation process. Furthermore, the complex backgrounds in aerial images make it challenging for the student model to efficiently learn the object features. In this letter, we propose a novel KD framework for UAV-OD. Specifically, a progressive distillation approach is designed to alleviate the feature gap between teacher and student models. Then, a new feature alignment method is provided to extract object-related features for enhancing the student model’s knowledge reception efficiency. Finally, extensive experiments are conducted to validate the effectiveness of our proposed approach. The results demonstrate that our proposed method achieves state-of-the-art performance on two datasets.","PeriodicalId":91017,"journal":{"name":"IEEE geoscience and remote sensing letters : a publication of the IEEE Geoscience and Remote Sensing Society","volume":"22 ","pages":"1-5"},"PeriodicalIF":0.0,"publicationDate":"2024-11-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142691665","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
MD-NeRF: Enhancing Large-Scale Scene Rendering and Synthesis With Hybrid Point Sampling and Adaptive Scene Decomposition MD-NeRF:利用混合点采样和自适应场景分解增强大规模场景渲染和合成功能
Yichen Zhang;Zhi Gao;Wenbo Sun;Yao Lu;Yuhan Zhu
Neural radiance fields (NeRFs) have gained great success in 3-D representation and novel-view synthesis, which attracted great efforts devoted to this area. However, when rendering large-scale scenes from a drone perspective, existing NeRF methods exhibit pronounced distortions in scene detail including absent textures and blurring of small objects. In this letter, we propose MD-NeRF to mitigate such distortions by integrating a hybrid sampling strategy and an adaptive scene decomposition method. Specifically, an anti-aliasing sampling method combining spiral sampling and sampling along rays is presented to address rendering anomalies. In addition, we decompose a large scene into multiple subscenes using a mixture of expert (MoE) modules. A shared expert is introduced to capture common features and reduce redundancy across the specialized experts. Consequently, the combination of these two methods effectively minimizes distortions when rendering large-scale scenes and enables our model to produce finer textures and more coherent details. We have conducted extensive experiments on several large-scale unbounded scene datasets, and the results demonstrate that our approach has achieved state-of-the-art performance on all datasets, most notably evidenced by a 1-dB enhancement in PSNR metrics on the Mill19 dataset.
神经辐射场(NeRF)在三维表示和新颖视角合成方面取得了巨大成功,吸引了人们对这一领域的极大关注。然而,当从无人机视角渲染大型场景时,现有的神经辐射场方法会对场景细节产生明显的扭曲,包括纹理缺失和小物体模糊。在这封信中,我们提出了 MD-NeRF 方法,通过整合混合采样策略和自适应场景分解方法来减轻这种失真。具体来说,我们提出了一种结合螺旋采样和沿射线采样的抗锯齿采样方法,以解决渲染异常问题。此外,我们还使用混合专家(MoE)模块将大型场景分解为多个子场景。我们引入了共享专家来捕捉共同特征,减少各专业专家之间的冗余。因此,这两种方法的结合能有效减少大型场景渲染时的失真,并使我们的模型能生成更精细的纹理和更连贯的细节。我们在多个大规模无边界场景数据集上进行了广泛的实验,结果表明我们的方法在所有数据集上都取得了最先进的性能,最显著的表现是在 Mill19 数据集上的 PSNR 指标提高了 1 分贝。
{"title":"MD-NeRF: Enhancing Large-Scale Scene Rendering and Synthesis With Hybrid Point Sampling and Adaptive Scene Decomposition","authors":"Yichen Zhang;Zhi Gao;Wenbo Sun;Yao Lu;Yuhan Zhu","doi":"10.1109/LGRS.2024.3492208","DOIUrl":"https://doi.org/10.1109/LGRS.2024.3492208","url":null,"abstract":"Neural radiance fields (NeRFs) have gained great success in 3-D representation and novel-view synthesis, which attracted great efforts devoted to this area. However, when rendering large-scale scenes from a drone perspective, existing NeRF methods exhibit pronounced distortions in scene detail including absent textures and blurring of small objects. In this letter, we propose MD-NeRF to mitigate such distortions by integrating a hybrid sampling strategy and an adaptive scene decomposition method. Specifically, an anti-aliasing sampling method combining spiral sampling and sampling along rays is presented to address rendering anomalies. In addition, we decompose a large scene into multiple subscenes using a mixture of expert (MoE) modules. A shared expert is introduced to capture common features and reduce redundancy across the specialized experts. Consequently, the combination of these two methods effectively minimizes distortions when rendering large-scale scenes and enables our model to produce finer textures and more coherent details. We have conducted extensive experiments on several large-scale unbounded scene datasets, and the results demonstrate that our approach has achieved state-of-the-art performance on all datasets, most notably evidenced by a 1-dB enhancement in PSNR metrics on the Mill19 dataset.","PeriodicalId":91017,"journal":{"name":"IEEE geoscience and remote sensing letters : a publication of the IEEE Geoscience and Remote Sensing Society","volume":"21 ","pages":"1-5"},"PeriodicalIF":0.0,"publicationDate":"2024-11-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142636511","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
LiDAR-Guided Stereo Matching Using Bayesian Optimization With Gaussian Process Regression 利用贝叶斯优化和高斯过程回归进行激光雷达引导的立体匹配
Hao Yi;Bo Liu;Bin Zhao;Enhai Liu
LiDAR-guided stereo matching for high-precision disparity estimation is a very promising task in photogrammetry and remote sensing. Unfortunately, existing methods suffer from the problem that it is difficult to automatically obtain appropriate stereo matching model parameters to ensure satisfactory results. To solve it, this letter proposes a LiDAR-guided stereo matching framework using Bayesian optimization with Gaussian process regression, which aims to automatically infer the stereo matching model parameters by LiDAR data. First, local matching model based on the belief propagation algorithm is designed. Second, the objective function is constructed by minimizing the difference between the local matching results and the LiDAR data. Third, Bayesian optimization with Gaussian process regression is applied to minimize this objective function to infer the model parameters. Finally, experimental results on the GaoFen-7 and UAV Stereo datasets show that the proposed method can effectively infer suitable model parameters from LiDAR data, and our method outperforms the state-of-the-art methods.
利用激光雷达引导的立体匹配进行高精度差异估计是摄影测量和遥感领域一项非常有前景的任务。遗憾的是,现有方法存在一个问题,即很难自动获取适当的立体匹配模型参数,以确保获得令人满意的结果。为解决这一问题,本文提出了一种利用贝叶斯优化与高斯过程回归的激光雷达引导的立体匹配框架,旨在通过激光雷达数据自动推断立体匹配模型参数。首先,设计基于信念传播算法的局部匹配模型。其次,通过最小化局部匹配结果与激光雷达数据之间的差异来构建目标函数。第三,应用贝叶斯优化和高斯过程回归来最小化该目标函数,从而推断出模型参数。最后,在高分七号和无人机立体数据集上的实验结果表明,所提出的方法能有效地从激光雷达数据中推断出合适的模型参数,而且我们的方法优于最先进的方法。
{"title":"LiDAR-Guided Stereo Matching Using Bayesian Optimization With Gaussian Process Regression","authors":"Hao Yi;Bo Liu;Bin Zhao;Enhai Liu","doi":"10.1109/LGRS.2024.3492175","DOIUrl":"https://doi.org/10.1109/LGRS.2024.3492175","url":null,"abstract":"LiDAR-guided stereo matching for high-precision disparity estimation is a very promising task in photogrammetry and remote sensing. Unfortunately, existing methods suffer from the problem that it is difficult to automatically obtain appropriate stereo matching model parameters to ensure satisfactory results. To solve it, this letter proposes a LiDAR-guided stereo matching framework using Bayesian optimization with Gaussian process regression, which aims to automatically infer the stereo matching model parameters by LiDAR data. First, local matching model based on the belief propagation algorithm is designed. Second, the objective function is constructed by minimizing the difference between the local matching results and the LiDAR data. Third, Bayesian optimization with Gaussian process regression is applied to minimize this objective function to infer the model parameters. Finally, experimental results on the GaoFen-7 and UAV Stereo datasets show that the proposed method can effectively infer suitable model parameters from LiDAR data, and our method outperforms the state-of-the-art methods.","PeriodicalId":91017,"journal":{"name":"IEEE geoscience and remote sensing letters : a publication of the IEEE Geoscience and Remote Sensing Society","volume":"21 ","pages":"1-5"},"PeriodicalIF":0.0,"publicationDate":"2024-11-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142636271","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Bistatic SAR Automatic Target Recognition With Multichannel Multiview Feature Fusion Network 利用多通道多视角特征融合网络进行双向合成孔径雷达自动目标识别
Zhe Geng;Wei Li;Xiang Yu;Daiyin Zhu
Bistatic synthetic aperture radar (SAR) with spatially separated transmitter (TX) and receiver (RX) is advantageous over monostatic SAR systems in trajectory flexibility and antistealth/antijamming capability. On the other hand, since bistatic SAR imaging involves more technical complexities and incurs higher cost, the research in the field of bistatic automatic target recognition (ATR) has been mainly relying on simulated SAR imagery. Reckoning with the lack of supporting database in the public domain, the researchers at Nanjing University of Aeronautics and Astronautics (NUAA) constructed a proprietary bistatic SAR database featuring multiple types of representative military vehicles with the self-developed miniSAR system. Moreover, a multichannel multiview feature fusion network (MMFFN) is devised by incorporating the vision transformer (ViT). The simulation results show that the proposed MMFFN offers a classification accuracy improvement of 4.86%–16.63% over the baseline network (i.e., the plain ViT) in a series of experiments featuring small-to-large observation angle deviations between the training and test data.
与单静态合成孔径雷达系统相比,发射器(TX)和接收器(RX)在空间上分离的双静态合成孔径雷达(SAR)在轨迹灵活性和反隐身/反干扰能力方面更具优势。另一方面,由于双稳态合成孔径雷达成像涉及的技术更复杂,成本更高,因此双稳态自动目标识别(ATR)领域的研究主要依赖于模拟合成孔径雷达成像。南京航空航天大学的研究人员利用自主研发的微型合成孔径雷达(miniSAR)系统,建立了具有代表性的多种军用车辆的双曲面合成孔径雷达数据库。此外,还结合视觉变换器(ViT)设计了多通道多视角特征融合网络(MMFFN)。仿真结果表明,在训练数据和测试数据观测角度偏差由小到大的一系列实验中,所提出的 MMFFN 比基线网络(即普通 ViT)的分类准确率提高了 4.86%-16.63%。
{"title":"Bistatic SAR Automatic Target Recognition With Multichannel Multiview Feature Fusion Network","authors":"Zhe Geng;Wei Li;Xiang Yu;Daiyin Zhu","doi":"10.1109/LGRS.2024.3491842","DOIUrl":"https://doi.org/10.1109/LGRS.2024.3491842","url":null,"abstract":"Bistatic synthetic aperture radar (SAR) with spatially separated transmitter (TX) and receiver (RX) is advantageous over monostatic SAR systems in trajectory flexibility and antistealth/antijamming capability. On the other hand, since bistatic SAR imaging involves more technical complexities and incurs higher cost, the research in the field of bistatic automatic target recognition (ATR) has been mainly relying on simulated SAR imagery. Reckoning with the lack of supporting database in the public domain, the researchers at Nanjing University of Aeronautics and Astronautics (NUAA) constructed a proprietary bistatic SAR database featuring multiple types of representative military vehicles with the self-developed miniSAR system. Moreover, a multichannel multiview feature fusion network (MMFFN) is devised by incorporating the vision transformer (ViT). The simulation results show that the proposed MMFFN offers a classification accuracy improvement of 4.86%–16.63% over the baseline network (i.e., the plain ViT) in a series of experiments featuring small-to-large observation angle deviations between the training and test data.","PeriodicalId":91017,"journal":{"name":"IEEE geoscience and remote sensing letters : a publication of the IEEE Geoscience and Remote Sensing Society","volume":"21 ","pages":"1-5"},"PeriodicalIF":0.0,"publicationDate":"2024-11-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142645520","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Dual Branch Masked Transformer for Hyperspectral Image Classification 用于高光谱图像分类的双分支屏蔽变换器
Kuo Li;Yushi Chen;Lingbo Huang
Transformer has been widely used in hyperspectral image (HSI) classification tasks because of its ability to capture long-range dependencies. However, most Transformer-based classification methods lack the extraction of local information or do not combine spatial and spectral information well, resulting in insufficient extraction of features. To address these issues, in this study, a dual-branch masked Transformer (Dual-MTr) model is proposed. Masked Transformer (MTr) is used to pretrain vision transformer (ViT) by reconstruction of both masked spatial image and spectral spectrum, which embeds the local bias by the process of recovering from localized patches to the global original input. Different tokenization methods are used for different types of input data. Patch embedding with overlapping regions is used for 2-D spatial data and group embedding is used for 1-D spectral data. Supervised learning has been added to the pretraining process to enhance strong discriminability. Then, the dual-branch structure is proposed to combine the spatial and spectral features. To strengthen the connection between the two branches better, Kullback-Leibler (KL) divergence is used to measure the differences between the classification results of the two branches, and the loss resulting from the computed differences is incorporated into the training process. Experimental results from two hyperspectral datasets demonstrate the effectiveness of the proposed method compared to other methods.
变换器因其捕捉长距离依赖关系的能力而被广泛应用于高光谱图像(HSI)分类任务中。然而,大多数基于变换器的分类方法缺乏对局部信息的提取,或者不能很好地结合空间和光谱信息,从而导致特征提取不充分。为了解决这些问题,本研究提出了双分支掩蔽变换器(Dual-MTr)模型。屏蔽变换器(MTr)是通过重建屏蔽空间图像和光谱来预训练视觉变换器(ViT)的,它通过从局部斑块恢复到全局原始输入的过程来嵌入局部偏差。不同类型的输入数据采用不同的标记化方法。二维空间数据使用重叠区域的补丁嵌入,一维光谱数据使用组嵌入。在预训练过程中加入了监督学习,以增强识别能力。然后,提出了双分支结构来结合空间和频谱特征。为了更好地加强两个分支之间的联系,使用库尔贝-莱布勒(KL)发散来测量两个分支分类结果之间的差异,并将计算差异产生的损失纳入训练过程。两个高光谱数据集的实验结果表明,与其他方法相比,建议的方法非常有效。
{"title":"Dual Branch Masked Transformer for Hyperspectral Image Classification","authors":"Kuo Li;Yushi Chen;Lingbo Huang","doi":"10.1109/LGRS.2024.3490534","DOIUrl":"https://doi.org/10.1109/LGRS.2024.3490534","url":null,"abstract":"Transformer has been widely used in hyperspectral image (HSI) classification tasks because of its ability to capture long-range dependencies. However, most Transformer-based classification methods lack the extraction of local information or do not combine spatial and spectral information well, resulting in insufficient extraction of features. To address these issues, in this study, a dual-branch masked Transformer (Dual-MTr) model is proposed. Masked Transformer (MTr) is used to pretrain vision transformer (ViT) by reconstruction of both masked spatial image and spectral spectrum, which embeds the local bias by the process of recovering from localized patches to the global original input. Different tokenization methods are used for different types of input data. Patch embedding with overlapping regions is used for 2-D spatial data and group embedding is used for 1-D spectral data. Supervised learning has been added to the pretraining process to enhance strong discriminability. Then, the dual-branch structure is proposed to combine the spatial and spectral features. To strengthen the connection between the two branches better, Kullback-Leibler (KL) divergence is used to measure the differences between the classification results of the two branches, and the loss resulting from the computed differences is incorporated into the training process. Experimental results from two hyperspectral datasets demonstrate the effectiveness of the proposed method compared to other methods.","PeriodicalId":91017,"journal":{"name":"IEEE geoscience and remote sensing letters : a publication of the IEEE Geoscience and Remote Sensing Society","volume":"21 ","pages":"1-5"},"PeriodicalIF":0.0,"publicationDate":"2024-11-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142636351","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Learning Gradient Descent to Optimize DAS Signal Estimation 学习梯度下降法优化 DAS 信号估计
Haitao Ma;Mengyang Yuan;Ning Wu;Yue Li;Yanan Tian
For subsequent seismic data processing and interpretation, it is important to obtain high-quality distributed acoustic sensing (DAS) signals from down-hole DAS data containing various complex noises. Model-based denoising methods mainly treat this signal estimation issue as a maximum a posteriori (MAP) optimization problem, for its relatively transparent mathematical model and wide range of applications. However, the manually designed prior assumption in MAP cannot accurately describe the actual distribution of DAS data, so the optimization parameters for obtaining high-quality solutions are difficult to determine, making it unavailable in DAS signal estimation. To solve these problems, we propose to emulate the optimization process of MAP with neural networks and accomplish the signal estimation task in feature space via some customized optimization modules. Specifically, we first construct an optimization unit (OPTU) to simulate the optimization process. And then, in order to further obtain the signal distribution of DAS data, we design in each OPTU, a multiscale dense feature aggregation (MDFA) module with the idea of back-projection fusion. With the help of OPTU, the optimization estimation process would be implemented more finely and automatically, expanding the application of MAP for accurate DAS signal estimation. Experiments on both synthetic and field DAS data demonstrate that our method can successfully estimate the high-quality signals from DAS data corrupted by complex noises, with less energy loss.
对于后续的地震数据处理和解释而言,从含有各种复杂噪声的井下分布式声学传感(DAS)数据中获取高质量的分布式声学传感(DAS)信号非常重要。基于模型的去噪方法主要将信号估计问题作为最大后验(MAP)优化问题来处理,其数学模型相对透明,应用范围广泛。然而,MAP 中人工设计的先验假设无法准确描述 DAS 数据的实际分布,因此难以确定获得高质量解的优化参数,导致其在 DAS 信号估计中无法使用。为了解决这些问题,我们提出用神经网络模拟 MAP 的优化过程,通过一些定制的优化模块完成特征空间中的信号估计任务。具体来说,我们首先构建一个优化单元(OPTU)来模拟优化过程。然后,为了进一步获得 DAS 数据的信号分布,我们在每个 OPTU 中设计了一个具有反投影融合思想的多尺度密集特征聚合(MDFA)模块。在 OPTU 的帮助下,优化估计过程将更加精细和自动,从而扩大了 MAP 在准确估计 DAS 信号方面的应用。在合成和现场 DAS 数据上的实验表明,我们的方法可以成功地从被复杂噪声干扰的 DAS 数据中估算出高质量信号,而且能量损失较小。
{"title":"Learning Gradient Descent to Optimize DAS Signal Estimation","authors":"Haitao Ma;Mengyang Yuan;Ning Wu;Yue Li;Yanan Tian","doi":"10.1109/LGRS.2024.3490732","DOIUrl":"https://doi.org/10.1109/LGRS.2024.3490732","url":null,"abstract":"For subsequent seismic data processing and interpretation, it is important to obtain high-quality distributed acoustic sensing (DAS) signals from down-hole DAS data containing various complex noises. Model-based denoising methods mainly treat this signal estimation issue as a maximum a posteriori (MAP) optimization problem, for its relatively transparent mathematical model and wide range of applications. However, the manually designed prior assumption in MAP cannot accurately describe the actual distribution of DAS data, so the optimization parameters for obtaining high-quality solutions are difficult to determine, making it unavailable in DAS signal estimation. To solve these problems, we propose to emulate the optimization process of MAP with neural networks and accomplish the signal estimation task in feature space via some customized optimization modules. Specifically, we first construct an optimization unit (OPTU) to simulate the optimization process. And then, in order to further obtain the signal distribution of DAS data, we design in each OPTU, a multiscale dense feature aggregation (MDFA) module with the idea of back-projection fusion. With the help of OPTU, the optimization estimation process would be implemented more finely and automatically, expanding the application of MAP for accurate DAS signal estimation. Experiments on both synthetic and field DAS data demonstrate that our method can successfully estimate the high-quality signals from DAS data corrupted by complex noises, with less energy loss.","PeriodicalId":91017,"journal":{"name":"IEEE geoscience and remote sensing letters : a publication of the IEEE Geoscience and Remote Sensing Society","volume":"21 ","pages":"1-5"},"PeriodicalIF":0.0,"publicationDate":"2024-11-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142636488","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Remote Sensing Framework for Evaluating Forest Landscape Restoration Projects: Enhancing Accuracy and Effectiveness 评估森林景观恢复项目的遥感框架:提高准确性和有效性
Michelle C. A. Picoli;Kenny Helsen
Forest and landscape restoration (FLR) initiatives are essential for combating deforestation, preserving biodiversity, and mitigating climate change. Remote sensing emerges as a key tool in evaluating FLR projects by providing accurate and timely data for monitoring and assessment. This letter presents a framework for generating high-quality maps using remote sensing data to assess the biophysical impact of FLR projects. The framework was applied to evaluate the Katanino FLR Project in Zambia. The results showcase a remarkable increase in forest cover, with a forest classification accuracy exceeding 90%. Such encouraging outcomes underscore the efficacy of the project in achieving its restoration goals and highlight the tangible benefits of employing remote sensing tools in FLR evaluation. Moreover, comprehensive FLR assessment, when complemented with diverse evaluation methodologies, facilitates a holistic understanding of FLR project impacts, enabling informed decision-making for the sustainable management of forest landscapes worldwide.
森林和景观恢复(FLR)计划对于遏制森林砍伐、保护生物多样性和减缓气候变化至关重要。遥感技术为监测和评估提供了准确、及时的数据,因此成为评估森林与景观恢复项目的重要工具。这封信介绍了一个利用遥感数据生成高质量地图的框架,以评估 FLR 项目的生物物理影响。该框架被用于评估赞比亚的 Katanino FLR 项目。结果显示,森林覆盖率显著提高,森林分类准确率超过 90%。这些令人鼓舞的结果突显了该项目在实现其恢复目标方面的功效,并强调了在森林恢复项目评估中采用遥感工具的切实益处。此外,全面的森林覆盖率评估与多种评估方法相辅相成,有助于全面了解森林覆盖率项目的影响,从而为全球森林景观的可持续管理做出明智的决策。
{"title":"Remote Sensing Framework for Evaluating Forest Landscape Restoration Projects: Enhancing Accuracy and Effectiveness","authors":"Michelle C. A. Picoli;Kenny Helsen","doi":"10.1109/LGRS.2024.3491372","DOIUrl":"https://doi.org/10.1109/LGRS.2024.3491372","url":null,"abstract":"Forest and landscape restoration (FLR) initiatives are essential for combating deforestation, preserving biodiversity, and mitigating climate change. Remote sensing emerges as a key tool in evaluating FLR projects by providing accurate and timely data for monitoring and assessment. This letter presents a framework for generating high-quality maps using remote sensing data to assess the biophysical impact of FLR projects. The framework was applied to evaluate the Katanino FLR Project in Zambia. The results showcase a remarkable increase in forest cover, with a forest classification accuracy exceeding 90%. Such encouraging outcomes underscore the efficacy of the project in achieving its restoration goals and highlight the tangible benefits of employing remote sensing tools in FLR evaluation. Moreover, comprehensive FLR assessment, when complemented with diverse evaluation methodologies, facilitates a holistic understanding of FLR project impacts, enabling informed decision-making for the sustainable management of forest landscapes worldwide.","PeriodicalId":91017,"journal":{"name":"IEEE geoscience and remote sensing letters : a publication of the IEEE Geoscience and Remote Sensing Society","volume":"21 ","pages":"1-5"},"PeriodicalIF":0.0,"publicationDate":"2024-11-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142636250","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A Cloud Motion Estimation Method Based on Cloud Image Depth Feature Matching 基于云图像深度特征匹配的云运动估计方法
Lianglin Zou;Ping Tang;Yisen Niu;Zixuan Yan;Xilong Lin;Jifeng Song;Qian Wang
The movement of clouds directly influences fluctuations in solar radiation. Therefore, cloud motion vector (CMV) estimation techniques are widely applied in sequential cloud images to predict solar radiation and study other meteorologically related fields. However, traditional block matching, optical flow, and feature point methods struggle to accurately capture the deformation, multilayered, and mixed cloud types’ motion due to the lack of deep semantic understanding of cloud images. Additionally, without cloud-motion-labeled, deep learning tools such as CNNs are limited in their utility for motion assessment. Therefore, this letter proposes a method of cloud image depth feature matching to assess the CMV in time series, including image enhancement, self-supervised feature extraction, feature matching, feature fusion, and spatiotemporal filtering. Experimental results demonstrate a significant improvement in accuracy compared to traditional CMV estimation techniques, with higher robustness observed across various complex cloud scenarios.
云的运动直接影响太阳辐射的波动。因此,云运动矢量(CMV)估计技术被广泛应用于连续云图像中,以预测太阳辐射和研究其他气象相关领域。然而,由于缺乏对云图像的深入语义理解,传统的块匹配、光流和特征点方法难以准确捕捉变形、多层和混合云类型的运动。此外,如果没有云运动标签,深度学习工具(如 CNN)在运动评估方面的实用性也会受到限制。因此,本文提出了一种云图像深度特征匹配方法来评估时间序列中的 CMV,包括图像增强、自监督特征提取、特征匹配、特征融合和时空滤波。实验结果表明,与传统的 CMV 估算技术相比,该方法的准确性有了显著提高,而且在各种复杂的云场景中都具有更高的鲁棒性。
{"title":"A Cloud Motion Estimation Method Based on Cloud Image Depth Feature Matching","authors":"Lianglin Zou;Ping Tang;Yisen Niu;Zixuan Yan;Xilong Lin;Jifeng Song;Qian Wang","doi":"10.1109/LGRS.2024.3491094","DOIUrl":"https://doi.org/10.1109/LGRS.2024.3491094","url":null,"abstract":"The movement of clouds directly influences fluctuations in solar radiation. Therefore, cloud motion vector (CMV) estimation techniques are widely applied in sequential cloud images to predict solar radiation and study other meteorologically related fields. However, traditional block matching, optical flow, and feature point methods struggle to accurately capture the deformation, multilayered, and mixed cloud types’ motion due to the lack of deep semantic understanding of cloud images. Additionally, without cloud-motion-labeled, deep learning tools such as CNNs are limited in their utility for motion assessment. Therefore, this letter proposes a method of cloud image depth feature matching to assess the CMV in time series, including image enhancement, self-supervised feature extraction, feature matching, feature fusion, and spatiotemporal filtering. Experimental results demonstrate a significant improvement in accuracy compared to traditional CMV estimation techniques, with higher robustness observed across various complex cloud scenarios.","PeriodicalId":91017,"journal":{"name":"IEEE geoscience and remote sensing letters : a publication of the IEEE Geoscience and Remote Sensing Society","volume":"22 ","pages":"1-5"},"PeriodicalIF":0.0,"publicationDate":"2024-11-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142691739","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A Novel PU Method for Mining Area Based on Edge Detection Using the SegNet Model 使用 SegNet 模型基于边缘检测挖掘区域的新型 PU 方法
Baojing Zhang;Zhiyong Wang;Zhenjin Li;Wenfu Yang;Weibing Li
Due to the large deformation gradient caused by mining, it is easy to cause serious incoherence phenomenon in radar interferometry, and the traditional phase unwrapping (PU) method is limited in this case. To solve this problem, a novel PU method for mining area based on edge detection using the SegNet model is proposed for mining subsidence basins with large deformation. First, SegNet network was used to extract the edge information of the subsidence basin in the mining area. Then, the edges were refined and connected by the Zhang-Suen thinning method and regional growth method, respectively. Finally, PU was completed by the determined phase jump variables. Simulated interferograms with different signal-to-noise ratio (SNR) and two real interferograms with different interference qualities are selected for experiments. Compared with the three traditional PU methods and two deep learning PU methods, the proposed model has higher accuracy and better robustness. When the SNR is 1 and 4, the unwrapping error distribution area of the proposed method is the smallest, and the PU result is more close to the real situation in the interferogram of real mining area. The novel two-step PU method effectively solves the problem that the traditional PU method is seriously affected by noise and large deformation.
由于采矿造成的大变形梯度,在雷达干涉测量中容易造成严重的不相干现象,传统的相位解包(PU)方法在这种情况下受到限制。为解决这一问题,针对具有较大变形的采矿沉陷盆地,提出了一种基于边缘检测的 SegNet 模型的新型采空区 PU 方法。首先,使用 SegNet 网络提取采矿区沉陷盆地的边缘信息。然后,分别采用张-孙稀疏法和区域增长法对边缘进行细化和连接。最后,通过确定的相跃变量完成 PU。实验选取了不同信噪比(SNR)的模拟干涉图和两个不同干扰质量的真实干涉图。与三种传统 PU 方法和两种深度学习 PU 方法相比,所提出的模型具有更高的精度和更好的鲁棒性。当信噪比为 1 和 4 时,所提方法的解包误差分布区域最小,在真实矿区干涉图中的 PU 结果更接近真实情况;当信噪比为 1 和 4 时,所提方法的解包误差分布区域最小,在真实矿区干涉图中的 PU 结果更接近真实情况。新颖的两步 PU 方法有效地解决了传统 PU 方法受噪声和大变形影响严重的问题。
{"title":"A Novel PU Method for Mining Area Based on Edge Detection Using the SegNet Model","authors":"Baojing Zhang;Zhiyong Wang;Zhenjin Li;Wenfu Yang;Weibing Li","doi":"10.1109/LGRS.2024.3490552","DOIUrl":"https://doi.org/10.1109/LGRS.2024.3490552","url":null,"abstract":"Due to the large deformation gradient caused by mining, it is easy to cause serious incoherence phenomenon in radar interferometry, and the traditional phase unwrapping (PU) method is limited in this case. To solve this problem, a novel PU method for mining area based on edge detection using the SegNet model is proposed for mining subsidence basins with large deformation. First, SegNet network was used to extract the edge information of the subsidence basin in the mining area. Then, the edges were refined and connected by the Zhang-Suen thinning method and regional growth method, respectively. Finally, PU was completed by the determined phase jump variables. Simulated interferograms with different signal-to-noise ratio (SNR) and two real interferograms with different interference qualities are selected for experiments. Compared with the three traditional PU methods and two deep learning PU methods, the proposed model has higher accuracy and better robustness. When the SNR is 1 and 4, the unwrapping error distribution area of the proposed method is the smallest, and the PU result is more close to the real situation in the interferogram of real mining area. The novel two-step PU method effectively solves the problem that the traditional PU method is seriously affected by noise and large deformation.","PeriodicalId":91017,"journal":{"name":"IEEE geoscience and remote sensing letters : a publication of the IEEE Geoscience and Remote Sensing Society","volume":"21 ","pages":"1-5"},"PeriodicalIF":0.0,"publicationDate":"2024-11-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142645543","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
IEEE geoscience and remote sensing letters : a publication of the IEEE Geoscience and Remote Sensing Society
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1