Unsupervised Anomaly Detection With Variational Autoencoders Applied to Full-Disk Solar Images

IF 3.7 2区 地球科学 Space Weather Pub Date : 2024-02-22 DOI:10.1029/2023sw003516
Marius Giger, André Csillaghy
{"title":"Unsupervised Anomaly Detection With Variational Autoencoders Applied to Full-Disk Solar Images","authors":"Marius Giger, André Csillaghy","doi":"10.1029/2023sw003516","DOIUrl":null,"url":null,"abstract":"Deep learning is successful in many fields due to its ability to learn strong feature representations without the need for hand-crafted features, resulting in models with high representational power. However, many of these models are based on supervised learning and therefore depend on the availability of large annotated data sets. These are often difficult to obtain because they require human input. A common challenge for researchers in space weather is the sparsity of annotations in many of the available data sets, which are either unlabeled or have ambiguous labels. To alleviate the data bottleneck of loosely annotated data sets, unsupervised deep learning has become an important strategy, with anomaly detection being one of the most prominent applications. Unsupervised models have been successfully applied in various domains, such as medical imaging or video surveillance, to distinguish normal from abnormal data. In this work, we investigate how a purely unsupervised approach can be used to detect and extract solar phenomena in extreme ultraviolet images from the NASA SDO spacecraft. We show how a model based on variational autoencoders can be used to detect out-of-distribution samples and to localize regions of interest for solar activity. By using an unsupervised approach, we hope to contribute to space weather monitoring tools and further improve the understanding of space weather drivers.","PeriodicalId":22181,"journal":{"name":"Space Weather","volume":null,"pages":null},"PeriodicalIF":3.7000,"publicationDate":"2024-02-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Space Weather","FirstCategoryId":"89","ListUrlMain":"https://doi.org/10.1029/2023sw003516","RegionNum":2,"RegionCategory":"地球科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

Deep learning is successful in many fields due to its ability to learn strong feature representations without the need for hand-crafted features, resulting in models with high representational power. However, many of these models are based on supervised learning and therefore depend on the availability of large annotated data sets. These are often difficult to obtain because they require human input. A common challenge for researchers in space weather is the sparsity of annotations in many of the available data sets, which are either unlabeled or have ambiguous labels. To alleviate the data bottleneck of loosely annotated data sets, unsupervised deep learning has become an important strategy, with anomaly detection being one of the most prominent applications. Unsupervised models have been successfully applied in various domains, such as medical imaging or video surveillance, to distinguish normal from abnormal data. In this work, we investigate how a purely unsupervised approach can be used to detect and extract solar phenomena in extreme ultraviolet images from the NASA SDO spacecraft. We show how a model based on variational autoencoders can be used to detect out-of-distribution samples and to localize regions of interest for solar activity. By using an unsupervised approach, we hope to contribute to space weather monitoring tools and further improve the understanding of space weather drivers.
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
将变异自动编码器应用于全磁盘太阳图像的无监督异常检测
深度学习之所以能在许多领域取得成功,是因为它能够学习强大的特征表征,而无需手工创建特征,从而产生具有高表征能力的模型。然而,这些模型中有许多是基于监督学习的,因此依赖于大量注释数据集的可用性。这些数据集通常很难获得,因为它们需要人工输入。空间天气研究人员面临的一个共同挑战是许多可用数据集的注释稀少,这些数据集要么没有标签,要么标签含糊不清。为了缓解松散注释数据集的数据瓶颈,无监督深度学习已成为一种重要策略,异常检测就是其中最突出的应用之一。无监督模型已成功应用于医疗成像或视频监控等多个领域,用于区分正常与异常数据。在这项工作中,我们研究了如何利用纯粹的无监督方法来检测和提取 NASA SDO 航天器极紫外图像中的太阳现象。我们展示了如何利用基于变异自动编码器的模型来检测异常分布样本,并定位太阳活动的相关区域。通过使用无监督方法,我们希望为空间天气监测工具做出贡献,并进一步提高对空间天气驱动因素的理解。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
自引率
29.70%
发文量
166
期刊最新文献
Quantification of Representation Error in the Neutral Winds and Ion Drifts Using Data Assimilation A Novel Ionospheric Inversion Model: PINN-SAMI3 (Physics Informed Neural Network Based on SAMI3) Nowcasting Solar EUV Irradiance With Photospheric Magnetic Fields and the Mg II Index Calculating the High-Latitude Ionospheric Electrodynamics Using a Machine Learning-Based Field-Aligned Current Model Effects of Forbush Decreases on the Global Electric Circuit
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1