重新感知遥感图像弱监督目标定位的变压器全局视图

IF 4.7 2区 地球科学 Q1 ENGINEERING, ELECTRICAL & ELECTRONIC IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing Pub Date : 2024-09-11 DOI:10.1109/JSTARS.2024.3459792
Xuran Hu;Mingzhe Zhu;Zhenpeng Feng;Ljubiša Stanković
{"title":"重新感知遥感图像弱监督目标定位的变压器全局视图","authors":"Xuran Hu;Mingzhe Zhu;Zhenpeng Feng;Ljubiša Stanković","doi":"10.1109/JSTARS.2024.3459792","DOIUrl":null,"url":null,"abstract":"In recent decades, weakly supervised object localization (WSOL) has gained increasing attention in remote sensing. However, unlike optical images, remote sensing images (RSIs) often contain more complex scenes, which poses challenges for WSOL. Traditional convolutional neural network (CNN)-based WSOL methods are often limited by a small receptive field and yield unsatisfactory results. Transformer-based methods can obtain global perception, addressing the limitations of receptive fields in CNN-based methods, yet it may also introduce attention diffusion. To address the aforementioned problems, this article proposes a novel WSOL method based on an interpretable vision transformer (ViT), RPGV. We introduce a feature fusion enhancement module to obtain the saliency map that captures global information. Simultaneously, we solve the problem of discrete attention in the traditional ViT and eliminate local distortion in the feature map by introducing a global semantic screening module. We conduct comprehensive experiments on DIOR and HRRSD datasets, demonstrating the superior performance of our method compared to current state-of-the-art methods.","PeriodicalId":13116,"journal":{"name":"IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing","volume":null,"pages":null},"PeriodicalIF":4.7000,"publicationDate":"2024-09-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10678922","citationCount":"0","resultStr":"{\"title\":\"Reperceive Global Vision of Transformer for Remote Sensing Images Weakly Supervised Object Localization\",\"authors\":\"Xuran Hu;Mingzhe Zhu;Zhenpeng Feng;Ljubiša Stanković\",\"doi\":\"10.1109/JSTARS.2024.3459792\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"In recent decades, weakly supervised object localization (WSOL) has gained increasing attention in remote sensing. However, unlike optical images, remote sensing images (RSIs) often contain more complex scenes, which poses challenges for WSOL. Traditional convolutional neural network (CNN)-based WSOL methods are often limited by a small receptive field and yield unsatisfactory results. Transformer-based methods can obtain global perception, addressing the limitations of receptive fields in CNN-based methods, yet it may also introduce attention diffusion. To address the aforementioned problems, this article proposes a novel WSOL method based on an interpretable vision transformer (ViT), RPGV. We introduce a feature fusion enhancement module to obtain the saliency map that captures global information. Simultaneously, we solve the problem of discrete attention in the traditional ViT and eliminate local distortion in the feature map by introducing a global semantic screening module. We conduct comprehensive experiments on DIOR and HRRSD datasets, demonstrating the superior performance of our method compared to current state-of-the-art methods.\",\"PeriodicalId\":13116,\"journal\":{\"name\":\"IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":4.7000,\"publicationDate\":\"2024-09-11\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10678922\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10678922/\",\"RegionNum\":2,\"RegionCategory\":\"地球科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENGINEERING, ELECTRICAL & ELECTRONIC\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing","FirstCategoryId":"5","ListUrlMain":"https://ieeexplore.ieee.org/document/10678922/","RegionNum":2,"RegionCategory":"地球科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0

摘要

近几十年来,弱监督目标定位(WSOL)在遥感领域受到越来越多的关注。然而,与光学图像不同,遥感图像(RSI)通常包含更复杂的场景,这给 WSOL 带来了挑战。传统的基于卷积神经网络(CNN)的 WSOL 方法往往受限于较小的感受野,效果并不理想。基于变换器的方法可以获得全局感知,解决了基于卷积神经网络的方法中感受野的局限性,但也可能引入注意力扩散。为解决上述问题,本文提出了一种基于可解释视觉变换器 RPGV 的新型 WSOL 方法。我们引入了一个特征融合增强模块,以获得捕捉全局信息的显著性地图。同时,我们解决了传统 ViT 中注意力离散的问题,并通过引入全局语义筛选模块消除了特征图的局部失真。我们在 DIOR 和 HRRSD 数据集上进行了全面的实验,证明了我们的方法与目前最先进的方法相比具有更优越的性能。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
Reperceive Global Vision of Transformer for Remote Sensing Images Weakly Supervised Object Localization
In recent decades, weakly supervised object localization (WSOL) has gained increasing attention in remote sensing. However, unlike optical images, remote sensing images (RSIs) often contain more complex scenes, which poses challenges for WSOL. Traditional convolutional neural network (CNN)-based WSOL methods are often limited by a small receptive field and yield unsatisfactory results. Transformer-based methods can obtain global perception, addressing the limitations of receptive fields in CNN-based methods, yet it may also introduce attention diffusion. To address the aforementioned problems, this article proposes a novel WSOL method based on an interpretable vision transformer (ViT), RPGV. We introduce a feature fusion enhancement module to obtain the saliency map that captures global information. Simultaneously, we solve the problem of discrete attention in the traditional ViT and eliminate local distortion in the feature map by introducing a global semantic screening module. We conduct comprehensive experiments on DIOR and HRRSD datasets, demonstrating the superior performance of our method compared to current state-of-the-art methods.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
CiteScore
9.30
自引率
10.90%
发文量
563
审稿时长
4.7 months
期刊介绍: The IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing addresses the growing field of applications in Earth observations and remote sensing, and also provides a venue for the rapidly expanding special issues that are being sponsored by the IEEE Geosciences and Remote Sensing Society. The journal draws upon the experience of the highly successful “IEEE Transactions on Geoscience and Remote Sensing” and provide a complementary medium for the wide range of topics in applied earth observations. The ‘Applications’ areas encompasses the societal benefit areas of the Global Earth Observations Systems of Systems (GEOSS) program. Through deliberations over two years, ministers from 50 countries agreed to identify nine areas where Earth observation could positively impact the quality of life and health of their respective countries. Some of these are areas not traditionally addressed in the IEEE context. These include biodiversity, health and climate. Yet it is the skill sets of IEEE members, in areas such as observations, communications, computers, signal processing, standards and ocean engineering, that form the technical underpinnings of GEOSS. Thus, the Journal attracts a broad range of interests that serves both present members in new ways and expands the IEEE visibility into new areas.
期刊最新文献
Kriging-Based Atmospheric Phase Screen Compensation Incorporating Time-Series Similarity in Ground-Based Radar Interferometry Profile Data Reconstruction for Deep Chl$a$ Maxima in Mediterranean Sea via Improved-MLP Networks Seasonal Dynamics in Land Surface Temperature in Response to Land Use Land Cover Changes Using Google Earth Engine DEPDet: A Cross-Spatial Multiscale Lightweight Network for Ship Detection of SAR Images in Complex Scenes Deep Learning for Mesoscale Eddy Detection With Feature Fusion of Multisatellite Observations
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1