A new distributional treatment for time series anomaly detection

Kai Ming Ting, Zongyou Liu, Lei Gong, Hang Zhang, Ye Zhu
{"title":"A new distributional treatment for time series anomaly detection","authors":"Kai Ming Ting, Zongyou Liu, Lei Gong, Hang Zhang, Ye Zhu","doi":"10.1007/s00778-023-00832-x","DOIUrl":null,"url":null,"abstract":"<p>Time series is traditionally treated with two main approaches, i.e., the time domain approach and the frequency domain approach. These approaches must rely on a sliding window so that time-shift versions of a sequence can be measured to be similar. Coupled with the use of a root point-to-point measure, existing methods often have quadratic time complexity. We offer the third <span>\\(\\mathbb {R}\\)</span> domain approach. It begins with an <i>insight</i> that sequences in a stationary time series can be treated as sets of independent and identically distributed (iid) points generated from an unknown distribution in <span>\\(\\mathbb {R}\\)</span>. This <span>\\(\\mathbb {R}\\)</span> domain treatment enables two new possibilities: (a) The similarity between two sequences can be computed using a distributional measure such as Wasserstein distance (WD), kernel mean embedding or isolation distributional kernel (<span>\\(\\mathcal {K}_I\\)</span>), and (b) these distributional measures become non-sliding-window-based. Together, they offer an alternative that has more effective similarity measurements and runs significantly faster than the point-to-point and sliding-window-based measures. Our empirical evaluation shows that <span>\\(\\mathcal {K}_I\\)</span> is an effective and efficient distributional measure for time series; and <span>\\(\\mathcal {K}_I\\)</span>-based detectors have better detection accuracy than existing detectors in two tasks: (i) anomalous sequence detection in a stationary time series and (ii) anomalous time series detection in a dataset of non-stationary time series. The <i>insight</i> makes underutilized “old things new again” which gives existing distributional measures and anomaly detectors a new life in time series anomaly detection that would otherwise be impossible.</p>","PeriodicalId":501532,"journal":{"name":"The VLDB Journal","volume":"11 1","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2024-02-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"The VLDB Journal","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1007/s00778-023-00832-x","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

Time series is traditionally treated with two main approaches, i.e., the time domain approach and the frequency domain approach. These approaches must rely on a sliding window so that time-shift versions of a sequence can be measured to be similar. Coupled with the use of a root point-to-point measure, existing methods often have quadratic time complexity. We offer the third \(\mathbb {R}\) domain approach. It begins with an insight that sequences in a stationary time series can be treated as sets of independent and identically distributed (iid) points generated from an unknown distribution in \(\mathbb {R}\). This \(\mathbb {R}\) domain treatment enables two new possibilities: (a) The similarity between two sequences can be computed using a distributional measure such as Wasserstein distance (WD), kernel mean embedding or isolation distributional kernel (\(\mathcal {K}_I\)), and (b) these distributional measures become non-sliding-window-based. Together, they offer an alternative that has more effective similarity measurements and runs significantly faster than the point-to-point and sliding-window-based measures. Our empirical evaluation shows that \(\mathcal {K}_I\) is an effective and efficient distributional measure for time series; and \(\mathcal {K}_I\)-based detectors have better detection accuracy than existing detectors in two tasks: (i) anomalous sequence detection in a stationary time series and (ii) anomalous time series detection in a dataset of non-stationary time series. The insight makes underutilized “old things new again” which gives existing distributional measures and anomaly detectors a new life in time series anomaly detection that would otherwise be impossible.

Abstract Image

查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
时间序列异常检测的新分布处理方法
处理时间序列的传统方法主要有两种,即时域方法和频域方法。这些方法必须依赖于滑动窗口,这样才能测量出序列的时移版本是否相似。再加上使用根点对点测量,现有的方法往往具有二次时间复杂性。我们提供了第三种(\mathbb {R}\)域方法。这种方法的出发点是,静态时间序列中的序列可以被视为由 \(\mathbb {R}\) 中的未知分布生成的独立且同分布(iid)点的集合。这种(\mathbb {R}\)域处理方法带来了两种新的可能性:(a)两个序列之间的相似性可以用分布度量来计算,比如 Wasserstein 距离(WD)、核均值嵌入或隔离分布核(\(\mathcal {K}_I\));(b)这些分布度量不再基于滑动窗口。与基于点对点和滑动窗口的测量方法相比,它们共同提供了一种更有效的相似性测量方法,并且运行速度明显更快。我们的实证评估表明,\(\mathcal {K}_I\)是一种有效且高效的时间序列分布度量;在以下两个任务中,基于\(\mathcal {K}_I\)的检测器比现有的检测器具有更好的检测精度:(i)静态时间序列中的异常序列检测;(ii)非静态时间序列数据集中的异常时间序列检测。这一洞察力使未被充分利用的 "旧事物重新焕发生机",从而使现有的分布测量和异常检测器在时间序列异常检测中焕发出新的活力,而这在其他情况下是不可能实现的。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
自引率
0.00%
发文量
0
期刊最新文献
A versatile framework for attributed network clustering via K-nearest neighbor augmentation Discovering critical vertices for reinforcement of large-scale bipartite networks DumpyOS: A data-adaptive multi-ary index for scalable data series similarity search Enabling space-time efficient range queries with REncoder AutoCTS++: zero-shot joint neural architecture and hyperparameter search for correlated time series forecasting
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1