SARATR-X: Toward Building a Foundation Model for SAR Target Recognition

Weijie Li;Wei Yang;Yuenan Hou;Li Liu;Yongxiang Liu;Xiang Li
{"title":"SARATR-X: Toward Building a Foundation Model for SAR Target Recognition","authors":"Weijie Li;Wei Yang;Yuenan Hou;Li Liu;Yongxiang Liu;Xiang Li","doi":"10.1109/TIP.2025.3531988","DOIUrl":null,"url":null,"abstract":"Despite the remarkable progress in synthetic aperture radar automatic target recognition (SAR ATR), recent efforts have concentrated on detecting and classifying a specific category, e.g., vehicles, ships, airplanes, or buildings. One of the fundamental limitations of the top-performing SAR ATR methods is that the learning paradigm is supervised, task-specific, limited-category, closed-world learning, which depends on massive amounts of accurately annotated samples that are expensively labeled by expert SAR analysts and have limited generalization capability and scalability. In this work, we make the first attempt towards building a foundation model for SAR ATR, termed SARATR-X. SARATR-X learns generalizable representations via self-supervised learning (SSL) and provides a cornerstone for label-efficient model adaptation to generic SAR target detection and classification tasks. Specifically, SARATR-X is trained on 0.18 M unlabelled SAR target samples, which are curated by combining contemporary benchmarks and constitute the largest publicly available dataset till now. Considering the characteristics of SAR images, a backbone tailored for SAR ATR is carefully designed, and a two-step SSL method endowed with multi-scale gradient features was applied to ensure the feature diversity and model scalability of SARATR-X. The capabilities of SARATR-X are evaluated on classification under few-shot and robustness settings and detection across various categories and scenes, and impressive performance is achieved, often competitive with or even superior to prior fully supervised, semi-supervised, or self-supervised algorithms. Our SARATR-X and the curated dataset are released at <uri>https://github.com/waterdisappear/SARATR-X</uri> to foster research into foundation models for SAR image interpretation.","PeriodicalId":94032,"journal":{"name":"IEEE transactions on image processing : a publication of the IEEE Signal Processing Society","volume":"34 ","pages":"869-884"},"PeriodicalIF":13.7000,"publicationDate":"2025-01-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10856784","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE transactions on image processing : a publication of the IEEE Signal Processing Society","FirstCategoryId":"1085","ListUrlMain":"https://ieeexplore.ieee.org/document/10856784/","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

Despite the remarkable progress in synthetic aperture radar automatic target recognition (SAR ATR), recent efforts have concentrated on detecting and classifying a specific category, e.g., vehicles, ships, airplanes, or buildings. One of the fundamental limitations of the top-performing SAR ATR methods is that the learning paradigm is supervised, task-specific, limited-category, closed-world learning, which depends on massive amounts of accurately annotated samples that are expensively labeled by expert SAR analysts and have limited generalization capability and scalability. In this work, we make the first attempt towards building a foundation model for SAR ATR, termed SARATR-X. SARATR-X learns generalizable representations via self-supervised learning (SSL) and provides a cornerstone for label-efficient model adaptation to generic SAR target detection and classification tasks. Specifically, SARATR-X is trained on 0.18 M unlabelled SAR target samples, which are curated by combining contemporary benchmarks and constitute the largest publicly available dataset till now. Considering the characteristics of SAR images, a backbone tailored for SAR ATR is carefully designed, and a two-step SSL method endowed with multi-scale gradient features was applied to ensure the feature diversity and model scalability of SARATR-X. The capabilities of SARATR-X are evaluated on classification under few-shot and robustness settings and detection across various categories and scenes, and impressive performance is achieved, often competitive with or even superior to prior fully supervised, semi-supervised, or self-supervised algorithms. Our SARATR-X and the curated dataset are released at https://github.com/waterdisappear/SARATR-X to foster research into foundation models for SAR image interpretation.
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
SARATR-X:建立SAR目标识别的基础模型
尽管在合成孔径雷达自动目标识别(SAR ATR)方面取得了显著进展,但最近的努力主要集中在对特定类别的检测和分类上,例如车辆、船舶、飞机或建筑物。表现最好的SAR ATR方法的一个基本限制是,学习范式是监督的、任务特定的、有限类别的、封闭世界的学习,它依赖于大量准确标注的样本,这些样本由专家SAR分析人员昂贵地标记,并且泛化能力和可扩展性有限。在这项工作中,我们首次尝试建立SARATR的基础模型,称为SARATR-X。SARATR-X通过自监督学习(SSL)学习可泛化表示,并为标签高效模型适应通用SAR目标检测和分类任务提供了基础。具体来说,SARATR-X在0.18 M未标记SAR目标样本上进行训练,这些样本通过结合当代基准进行整理,构成了迄今为止最大的公开可用数据集。考虑到SAR图像的特点,精心设计了适合SARATR的主干网,并采用了赋予多尺度梯度特征的两步SSL方法,保证了SARATR-X的特征多样性和模型可扩展性。SARATR-X的能力在少量拍摄和鲁棒性设置下进行了评估,并在各种类别和场景中进行了检测,取得了令人印象深刻的性能,通常与之前的完全监督、半监督或自监督算法相竞争,甚至优于前者。我们的SARATR-X和整理的数据集在https://github.com/waterdisappear/SARATR-X上发布,以促进对SAR图像解释基础模型的研究。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
自引率
0.00%
发文量
0
期刊最新文献
Dark-EvGS: Event Camera as an Eye for Radiance Field in the Dark. SPAgent: Adaptive Task Decomposition and Model Selection for General Video Generation and Editing. JDPNet: A Network Based on Joint Degradation Processing for Underwater Image Enhancement Long-Tailed and Inter-Class Homogeneity Matters in Multi-Class Weakly Supervised Tissue Segmentation of Histopathology Images DiffLLFace: Learning Alternate Illumination-Diffusion Adaptation for Low-Light Face Super-Resolution and Beyond
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1