Edge-Thresholding: A New Thresholding Based Real-Time RFI-Mitigation Algorithm for Transient Detection

J. Boyle, A. Sclocco
{"title":"Edge-Thresholding: A New Thresholding Based Real-Time RFI-Mitigation Algorithm for Transient Detection","authors":"J. Boyle, A. Sclocco","doi":"10.23919/RFI48793.2019.9111722","DOIUrl":null,"url":null,"abstract":"Unraveling the mystery of fast radio bursts (FRBs) - extremely high-energy events occurring outside the Milky Way that last fractions of a second - is a hot topic topic in radio astronomy. Detecting new FRBs is increasingly complicated by RFI as the radio bandwidth becomes more congested and radio telescopes become more sensitive. In this paper we propose, implement and validate a novel RFI-mitigation algorithm designed for FRB detection called edge-thresholding.Modern radio telescopes produce an immense amount of data that needs to be processed in real-time. This requirement invalidates many RFI-mitigation algorithms based upon techniques such as kurtosis, surface-fitting or Fourier transforms due to their computational complexity. This had led to the development of thresholding methods which are computational simple, well suited to GPU acceleration and provide accurate RFI mitigation.In this paper we propose edge-thresholding, the first thresholding based RFI-mitigation algorithm specifically designed for FRB detection. Edge-thresholding works by flagging data within a window if the points minimum difference to a boundary point is above a computed threshold. Linear time-complexity means it scales to the increasing data rates of radio telescopes.Edge-thresholding takes advantage of two features that FRBs exhibit but RFI does not. First, FRBs are generally wider than deleterious RFI and second FRBs have a pseudo Gaussian profile due to the finite frequency resolution of the telescope causing DM smearing.We combine edge-thresholding with a time-domain sigma cut in a unified pipeline. A GPU accelerated implementation of this pipeline is shown to run in the real-time on WSRT data. Additionally, less than 36.86 additional kilobytes of memory are required for 804 megabytes of input data.Using data from WSRT containing simulated FRBs we shown that our pipeline reduces false-positives and increases the number of detected FRBs. These results are further validated by experiments using data from the Crab-Pulsar. These results show that our pipeline could outperform AO-Flagger, the RFI-mitigation pipeline used for WSRT and LOFAR.","PeriodicalId":111866,"journal":{"name":"2019 RFI Workshop - Coexisting with Radio Frequency Interference (RFI)","volume":"50 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2019-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2019 RFI Workshop - Coexisting with Radio Frequency Interference (RFI)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.23919/RFI48793.2019.9111722","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 1

Abstract

Unraveling the mystery of fast radio bursts (FRBs) - extremely high-energy events occurring outside the Milky Way that last fractions of a second - is a hot topic topic in radio astronomy. Detecting new FRBs is increasingly complicated by RFI as the radio bandwidth becomes more congested and radio telescopes become more sensitive. In this paper we propose, implement and validate a novel RFI-mitigation algorithm designed for FRB detection called edge-thresholding.Modern radio telescopes produce an immense amount of data that needs to be processed in real-time. This requirement invalidates many RFI-mitigation algorithms based upon techniques such as kurtosis, surface-fitting or Fourier transforms due to their computational complexity. This had led to the development of thresholding methods which are computational simple, well suited to GPU acceleration and provide accurate RFI mitigation.In this paper we propose edge-thresholding, the first thresholding based RFI-mitigation algorithm specifically designed for FRB detection. Edge-thresholding works by flagging data within a window if the points minimum difference to a boundary point is above a computed threshold. Linear time-complexity means it scales to the increasing data rates of radio telescopes.Edge-thresholding takes advantage of two features that FRBs exhibit but RFI does not. First, FRBs are generally wider than deleterious RFI and second FRBs have a pseudo Gaussian profile due to the finite frequency resolution of the telescope causing DM smearing.We combine edge-thresholding with a time-domain sigma cut in a unified pipeline. A GPU accelerated implementation of this pipeline is shown to run in the real-time on WSRT data. Additionally, less than 36.86 additional kilobytes of memory are required for 804 megabytes of input data.Using data from WSRT containing simulated FRBs we shown that our pipeline reduces false-positives and increases the number of detected FRBs. These results are further validated by experiments using data from the Crab-Pulsar. These results show that our pipeline could outperform AO-Flagger, the RFI-mitigation pipeline used for WSRT and LOFAR.
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
边缘阈值:一种新的基于阈值的实时rfi暂态检测缓解算法
揭开快速射电暴(FRBs)的神秘面纱是射电天文学的一个热门话题。快速射电暴是发生在银河系外的高能量事件,持续时间不到一秒。随着无线电带宽变得更加拥挤,射电望远镜变得更加敏感,通过RFI探测新的快速射电暴变得越来越复杂。在本文中,我们提出,实现并验证了一种新的rfi缓解算法,该算法设计用于FRB检测,称为边缘阈值。现代射电望远镜会产生大量需要实时处理的数据。由于计算复杂性,这一要求使许多基于峰度、表面拟合或傅立叶变换等技术的射频信号缓解算法失效。这导致了阈值方法的发展,这些方法计算简单,非常适合GPU加速,并提供准确的RFI缓解。在本文中,我们提出了边缘阈值,这是第一个专门为FRB检测设计的基于阈值的rfi缓解算法。如果点与边界点的最小差值高于计算的阈值,则边缘阈值法通过标记窗口内的数据来工作。线性时间复杂度意味着它可以适应射电望远镜不断增长的数据速率。边缘阈值利用了frb所具有而RFI所没有的两个特征。首先,快速射电暴通常比有害的RFI更宽,其次,由于望远镜的有限频率分辨率导致DM涂抹,快速射电暴具有伪高斯分布。我们在一个统一的管道中结合了边缘阈值和时域sigma切割。该管道的GPU加速实现在WSRT数据上实时运行。此外,804兆字节的输入数据只需要36.86千字节的额外内存。使用包含模拟快速射电暴的WSRT数据,我们证明了我们的管道减少了误报并增加了检测到的快速射电暴的数量。利用蟹状脉冲星的实验数据进一步验证了这些结果。这些结果表明,我们的管道可以优于AO-Flagger,用于WSRT和LOFAR的rfi缓解管道。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
自引率
0.00%
发文量
0
期刊最新文献
Modeling of RFI and RFI Mitigation Techniques in SKA1 Mid Telescope A Band Comparison Investigation for RFI Emission Mitigation by a Mobile Radio Communications Network for the SKA Radio Astronomy Project Bustin’ Makes Me Feel Good: A Low-Cost Cell-Phone Buster for the 850 MHz Band An Approach to Address Residual “Hot Spots” in SMAP RFI-Filtered Data Cyclic Imaging for All-Sky Interference Forecasting with Array Radio Telescopes
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1