{"title":"Random Tensor Analysis: Outlier Detection and Sample-Size Determination","authors":"Shih Yu Chang;Hsiao-Chun Wu","doi":"10.1109/LSP.2024.3475909","DOIUrl":null,"url":null,"abstract":"High-dimensional signal processing and data analysis have been appealing to researchers in recent decades. Outlier detection and sample-size determination are two essential pre-processing tasks for many signal processing applications. However, fast outlier detection for tensor data with arbitrary orders is still in high demand. Furthermore, sample-size determination for random tensor data has not been addressed in the literature. To fill this knowledge gap, we first derive new tensor Chernoff tail-bounds for random Hermitian tensors. According to our derived tail-bounds, we propose a novel approach for joint outlier detection and sample-size determination. The mathematical relationship among outlier-threshold (sample-size-threshold) probability, outlier-threshold spectrum, and critical sample-size along with the computational-complexity reduction brought by our proposed new analytic approach over the existing methods is also investigated through numerical evaluation over a variety of real tensor data.","PeriodicalId":13154,"journal":{"name":"IEEE Signal Processing Letters","volume":null,"pages":null},"PeriodicalIF":3.2000,"publicationDate":"2024-10-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Signal Processing Letters","FirstCategoryId":"5","ListUrlMain":"https://ieeexplore.ieee.org/document/10706832/","RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0
Abstract
High-dimensional signal processing and data analysis have been appealing to researchers in recent decades. Outlier detection and sample-size determination are two essential pre-processing tasks for many signal processing applications. However, fast outlier detection for tensor data with arbitrary orders is still in high demand. Furthermore, sample-size determination for random tensor data has not been addressed in the literature. To fill this knowledge gap, we first derive new tensor Chernoff tail-bounds for random Hermitian tensors. According to our derived tail-bounds, we propose a novel approach for joint outlier detection and sample-size determination. The mathematical relationship among outlier-threshold (sample-size-threshold) probability, outlier-threshold spectrum, and critical sample-size along with the computational-complexity reduction brought by our proposed new analytic approach over the existing methods is also investigated through numerical evaluation over a variety of real tensor data.
期刊介绍:
The IEEE Signal Processing Letters is a monthly, archival publication designed to provide rapid dissemination of original, cutting-edge ideas and timely, significant contributions in signal, image, speech, language and audio processing. Papers published in the Letters can be presented within one year of their appearance in signal processing conferences such as ICASSP, GlobalSIP and ICIP, and also in several workshop organized by the Signal Processing Society.