首页 > 最新文献

2023 IEEE Statistical Signal Processing Workshop (SSP)最新文献

英文 中文
Differentiable short-time Fourier transform with respect to the hop length 关于跳长可微分的短时傅里叶变换
Pub Date : 2023-07-02 DOI: 10.1109/SSP53291.2023.10208006
Maxime Leiber, Y. Marnissi, A. Barrau, M. Mohamed el Badaoui
In this paper, we propose a differentiable version of the short-time Fourier transform (STFT) that allows for gradient-based optimization of the hop length or the frame temporal position by making these parameters continuous. Our approach provides improved control over the temporal positioning of frames, as the continuous nature of the hop length allows for a more finely-tuned optimization. Furthermore, our contribution enables the use of optimization methods such as gradient descent, which are more computationally efficient than conventional discrete optimization methods. Our differentiable STFT can also be easily integrated into existing algorithms and neural networks. We present a simulated illustration to demonstrate the efficacy of our approach and to garner interest from the research community.
在本文中,我们提出了短时傅里叶变换(STFT)的可微分版本,该版本允许通过使这些参数连续来对跳长或帧时间位置进行基于梯度的优化。我们的方法提供了对帧时间定位的改进控制,因为跳长的连续性允许更精细的优化。此外,我们的贡献能够使用优化方法,如梯度下降,这比传统的离散优化方法更具计算效率。我们的可微STFT也可以很容易地集成到现有的算法和神经网络中。我们提出了一个模拟的例子来证明我们的方法的有效性,并引起研究界的兴趣。
{"title":"Differentiable short-time Fourier transform with respect to the hop length","authors":"Maxime Leiber, Y. Marnissi, A. Barrau, M. Mohamed el Badaoui","doi":"10.1109/SSP53291.2023.10208006","DOIUrl":"https://doi.org/10.1109/SSP53291.2023.10208006","url":null,"abstract":"In this paper, we propose a differentiable version of the short-time Fourier transform (STFT) that allows for gradient-based optimization of the hop length or the frame temporal position by making these parameters continuous. Our approach provides improved control over the temporal positioning of frames, as the continuous nature of the hop length allows for a more finely-tuned optimization. Furthermore, our contribution enables the use of optimization methods such as gradient descent, which are more computationally efficient than conventional discrete optimization methods. Our differentiable STFT can also be easily integrated into existing algorithms and neural networks. We present a simulated illustration to demonstrate the efficacy of our approach and to garner interest from the research community.","PeriodicalId":296346,"journal":{"name":"2023 IEEE Statistical Signal Processing Workshop (SSP)","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-07-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123894448","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Data-centric AI to Improve Early Detection of Mental Illness 以数据为中心的人工智能改善精神疾病的早期发现
Pub Date : 2023-07-02 DOI: 10.1109/SSP53291.2023.10207938
Alex X. Wang, S. Chukova, Colin Simpson, Binh P. Nguyen
The growth of information technology and advancements in artificial intelligence (AI) have made data creation and usage more prevalent. AI research can be grouped into two categories: model-centric and data-centric. Model-centric AI focuses on using the same data and making changes to model hyper-parameters, architectures, and other configurations. Data-centric AI, on the other hand, prioritizes improving existing data or incorporating new data to improve the performance of machine learning (ML) algorithms. Data-centric AI can greatly improve the performance of machine learning models by improving data quality, increasing data diversity, and using advanced data augmentation methods. The use of ML for early detection of mental health issues is vital due to its ability to identify issues early, provide personalized treatments, detect patterns, and increase accessibility to mental health services. While there have been numerous mental illness detection studies using model-centric approaches, there is a lack of research from a data-centric AI perspective. This study aims to address this gap by comparing established tabular data synthesis methods to explore the impact of synthetic data and data-centric AI on the early detection of mental health issues.
信息技术的发展和人工智能(AI)的进步使数据的创建和使用更加普遍。人工智能研究可以分为两类:以模型为中心和以数据为中心。以模型为中心的AI专注于使用相同的数据并对模型超参数、架构和其他配置进行更改。另一方面,以数据为中心的人工智能优先考虑改进现有数据或合并新数据,以提高机器学习(ML)算法的性能。以数据为中心的人工智能可以通过提高数据质量、增加数据多样性和使用先进的数据增强方法来极大地提高机器学习模型的性能。机器学习用于早期发现心理健康问题是至关重要的,因为它能够及早发现问题,提供个性化治疗,发现模式,并增加获得心理健康服务的机会。虽然有许多使用以模型为中心的方法进行的精神疾病检测研究,但缺乏从数据为中心的人工智能角度进行的研究。本研究旨在通过比较已建立的表格数据合成方法来解决这一差距,探讨合成数据和以数据为中心的人工智能对早期发现心理健康问题的影响。
{"title":"Data-centric AI to Improve Early Detection of Mental Illness","authors":"Alex X. Wang, S. Chukova, Colin Simpson, Binh P. Nguyen","doi":"10.1109/SSP53291.2023.10207938","DOIUrl":"https://doi.org/10.1109/SSP53291.2023.10207938","url":null,"abstract":"The growth of information technology and advancements in artificial intelligence (AI) have made data creation and usage more prevalent. AI research can be grouped into two categories: model-centric and data-centric. Model-centric AI focuses on using the same data and making changes to model hyper-parameters, architectures, and other configurations. Data-centric AI, on the other hand, prioritizes improving existing data or incorporating new data to improve the performance of machine learning (ML) algorithms. Data-centric AI can greatly improve the performance of machine learning models by improving data quality, increasing data diversity, and using advanced data augmentation methods. The use of ML for early detection of mental health issues is vital due to its ability to identify issues early, provide personalized treatments, detect patterns, and increase accessibility to mental health services. While there have been numerous mental illness detection studies using model-centric approaches, there is a lack of research from a data-centric AI perspective. This study aims to address this gap by comparing established tabular data synthesis methods to explore the impact of synthetic data and data-centric AI on the early detection of mental health issues.","PeriodicalId":296346,"journal":{"name":"2023 IEEE Statistical Signal Processing Workshop (SSP)","volume":"33 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-07-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"117136516","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Performance Analysis of DOA Estimation Algorithms Using Physical Parameters in Specific Cases 具体情况下基于物理参数的DOA估计算法性能分析
Pub Date : 2023-07-02 DOI: 10.1109/SSP53291.2023.10208019
Jianwei Zhou, Wenjie Wang, Xi Hong, Ming Yang, Chenhao Zhang
Recent decades have seen substantial research into analytical performance analysis of direction-of-arrival (DOA) estimation algorithms, revealing various statistical properties. However, many analyses fail to fully uncover insights into performance even for specific cases. This paper presents additional performance analysis of several subspace-based DOA estimation algorithms, using highly compact and simplified mean squared error (MSE) formulas for different algorithms, including an extension to the spatial smoothing scheme. All statistics are expressed in terms of physical parameters, fully revealing the relationships between array structures and DOA estimation performance.
近几十年来,对到达方向(DOA)估计算法的分析性能分析进行了大量研究,揭示了各种统计特性。然而,即使是针对特定情况,许多分析也未能充分揭示对性能的洞察。本文对几种基于子空间的DOA估计算法进行了额外的性能分析,对不同算法使用高度紧凑和简化的均方误差(MSE)公式,包括对空间平滑方案的扩展。所有统计数据均以物理参数表示,充分揭示了阵列结构与DOA估计性能之间的关系。
{"title":"Performance Analysis of DOA Estimation Algorithms Using Physical Parameters in Specific Cases","authors":"Jianwei Zhou, Wenjie Wang, Xi Hong, Ming Yang, Chenhao Zhang","doi":"10.1109/SSP53291.2023.10208019","DOIUrl":"https://doi.org/10.1109/SSP53291.2023.10208019","url":null,"abstract":"Recent decades have seen substantial research into analytical performance analysis of direction-of-arrival (DOA) estimation algorithms, revealing various statistical properties. However, many analyses fail to fully uncover insights into performance even for specific cases. This paper presents additional performance analysis of several subspace-based DOA estimation algorithms, using highly compact and simplified mean squared error (MSE) formulas for different algorithms, including an extension to the spatial smoothing scheme. All statistics are expressed in terms of physical parameters, fully revealing the relationships between array structures and DOA estimation performance.","PeriodicalId":296346,"journal":{"name":"2023 IEEE Statistical Signal Processing Workshop (SSP)","volume":"59 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-07-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124678269","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Differential privacy using Gamma distribution 使用伽马分布的差分隐私
Pub Date : 2023-07-02 DOI: 10.1109/SSP53291.2023.10207933
Yongbin Park, Minchul Kim, Jiwon Yoon
The Laplace mechanism is a commonly employed approach that offers privacy guarantees within the framework of differential privacy. Nevertheless, the Laplace mechanism exhibits two limitations. Firstly, the privacy leakage of data can be exacerbated when the general differential private mechanism is accessed repeatedly with the same input owing to the sequential property of differential privacy. Secondly, the Laplace mechanism may not be suitable for some applications that solely involve positive samples as it can yield unwanted negative samples from the Laplace distribution.We address these issues by utilizing the Gamma distribution to handle database entries that must be consist of positive values ranging from 0 to infinity. In our approach, the epsilon parameter of our mechanism is determined by the value with noise according to the definition of differential privacy. Notably, the range of the noise is unbounded on the right thereby epsilon to approach infinity as the value with noise increases. To mitigate this, we impose constraints on the range of the noise in order to reasonably restrict the epsilon value of the mechanism. However, it should be noted that these constraints may impact the probability of ensuring epsilon-differential privacy and necessitate the imposition of a minimum boundary on the values of dataset. Additionally, we propose a new noise parameter that can be used to adjust the probability of ensuring differential privacy for a fixed epsilon.
拉普拉斯机制是一种常用的方法,可在差分隐私框架内提供隐私保证。然而,拉普拉斯机制有两个局限性。首先,由于差分隐私的顺序特性,当重复访问同一输入的一般差分隐私机制时,数据的隐私泄漏可能会加剧。其次,拉普拉斯机制可能不适合某些只涉及正样本的应用,因为它会从拉普拉斯分布中产生不需要的负样本。在我们的方法中,根据差分隐私的定义,我们机制的ε参数由噪声值决定。值得注意的是,噪声的范围在右边是无界的,因此随着噪声值的增加,epsilon 会接近无穷大。为了缓解这一问题,我们对噪声的范围施加了限制,以便合理地限制机制的ε值。不过,需要注意的是,这些限制可能会影响确保ε差隐私的概率,因此有必要对数据集的值施加最小边界。此外,我们还提出了一个新的噪声参数,可用于调整在固定ε条件下确保差分隐私的概率。
{"title":"Differential privacy using Gamma distribution","authors":"Yongbin Park, Minchul Kim, Jiwon Yoon","doi":"10.1109/SSP53291.2023.10207933","DOIUrl":"https://doi.org/10.1109/SSP53291.2023.10207933","url":null,"abstract":"The Laplace mechanism is a commonly employed approach that offers privacy guarantees within the framework of differential privacy. Nevertheless, the Laplace mechanism exhibits two limitations. Firstly, the privacy leakage of data can be exacerbated when the general differential private mechanism is accessed repeatedly with the same input owing to the sequential property of differential privacy. Secondly, the Laplace mechanism may not be suitable for some applications that solely involve positive samples as it can yield unwanted negative samples from the Laplace distribution.We address these issues by utilizing the Gamma distribution to handle database entries that must be consist of positive values ranging from 0 to infinity. In our approach, the epsilon parameter of our mechanism is determined by the value with noise according to the definition of differential privacy. Notably, the range of the noise is unbounded on the right thereby epsilon to approach infinity as the value with noise increases. To mitigate this, we impose constraints on the range of the noise in order to reasonably restrict the epsilon value of the mechanism. However, it should be noted that these constraints may impact the probability of ensuring epsilon-differential privacy and necessitate the imposition of a minimum boundary on the values of dataset. Additionally, we propose a new noise parameter that can be used to adjust the probability of ensuring differential privacy for a fixed epsilon.","PeriodicalId":296346,"journal":{"name":"2023 IEEE Statistical Signal Processing Workshop (SSP)","volume":"21 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-07-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128334207","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Performance analysis of Ethereum smart contracts: A Study on Gas cost and block size impact 以太坊智能合约的性能分析:Gas成本和区块大小影响研究
Pub Date : 2023-07-02 DOI: 10.1109/SSP53291.2023.10207974
Tien Quyet Do, Thanh Ta Minh
Blockchain technology has revolutionized the way transactions are conducted and verified in a decentralized manner. The performance analysis of Ethereum smart contract is crucial in understanding its limitations and potential for various applications. This study aimed to evaluate the gas cost of different sort algorithms and the impact of block size on the throughput of Ethereum network. The results showed that the gas cost of search algorithms such as quick sort and bubble sort varied significantly, with quick sort having a lower cost. Additionally, increasing the block size had a positive impact on the throughput of the Ethereum network, with a higher number of transactions processed per second. These findings provide valuable insights into the performance of Ethereum smart contracts and highlight the importance of considering gas cost and block size in the design and implementation of blockchain-based systems.
区块链技术以一种去中心化的方式彻底改变了交易的进行和验证方式。以太坊智能合约的性能分析对于理解其局限性和各种应用的潜力至关重要。本研究旨在评估不同排序算法的gas成本以及区块大小对以太坊网络吞吐量的影响。结果表明,快速排序和冒泡排序两种搜索算法的gas开销差异较大,其中快速排序的gas开销较低。此外,增加区块大小对以太坊网络的吞吐量产生了积极影响,每秒处理的交易数量增加。这些发现为以太坊智能合约的性能提供了有价值的见解,并强调了在基于区块链的系统的设计和实施中考虑gas成本和块大小的重要性。
{"title":"Performance analysis of Ethereum smart contracts: A Study on Gas cost and block size impact","authors":"Tien Quyet Do, Thanh Ta Minh","doi":"10.1109/SSP53291.2023.10207974","DOIUrl":"https://doi.org/10.1109/SSP53291.2023.10207974","url":null,"abstract":"Blockchain technology has revolutionized the way transactions are conducted and verified in a decentralized manner. The performance analysis of Ethereum smart contract is crucial in understanding its limitations and potential for various applications. This study aimed to evaluate the gas cost of different sort algorithms and the impact of block size on the throughput of Ethereum network. The results showed that the gas cost of search algorithms such as quick sort and bubble sort varied significantly, with quick sort having a lower cost. Additionally, increasing the block size had a positive impact on the throughput of the Ethereum network, with a higher number of transactions processed per second. These findings provide valuable insights into the performance of Ethereum smart contracts and highlight the importance of considering gas cost and block size in the design and implementation of blockchain-based systems.","PeriodicalId":296346,"journal":{"name":"2023 IEEE Statistical Signal Processing Workshop (SSP)","volume":"14 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-07-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126303585","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Rectified Attention Gate Unit in Recurrent Neural Networks for Effective Attention Computation 修正递归神经网络中的注意门单元,实现有效的注意计算
Pub Date : 2023-07-02 DOI: 10.1109/SSP53291.2023.10207931
Manh-Hung Ha, O. Chen
Recurrent Neural Networks (RNNs) have been successful in figuring out applications on time series data. Particularly, effectively capturing local features can ameliorate the performance of RNN. Accordingly, we propose a Rectified Attention Gate Unit (RAGU) which amends Gated Recurrent Unit (GRU) with two special attention mechanisms for RNNs. These two attention mechanisms are a Convolutional Attention (ConvAtt) module performing the convolutional operations on the current input and the previous hidden state to fairly establish the spatiotemporal relationship, and an Attention Module (AM) taking outputs from ConvAtt to fulfill the integrated attention computations for discovering the contextual dependency. Experimental results reveal that RNN using the proposed RAGUs has superior accuracies than RNNs using the other cell units on the HMDB51 and MNIST datasets. Therefore, RAGU proposed herein is an effective model which can bring out outstanding performance for various time series applications.
递归神经网络(RNNs)已经成功地应用于时间序列数据。特别是,有效地捕获局部特征可以改善RNN的性能。因此,我们提出了一种纠偏注意门单元(RAGU),它用两种特殊的rnn注意机制修正了门控循环单元(GRU)。这两种注意机制分别是卷积注意模块(Convolutional attention, ConvAtt)和注意模块(attention module, AM),前者对当前输入和之前的隐藏状态进行卷积运算,以公平地建立时空关系;后者从ConvAtt中获取输出,完成综合注意计算,以发现上下文依赖性。实验结果表明,在HMDB51和MNIST数据集上,使用ragu的RNN比使用其他单元的RNN具有更高的准确率。因此,本文提出的RAGU是一种有效的模型,可以在各种时间序列应用中表现出优异的性能。
{"title":"Rectified Attention Gate Unit in Recurrent Neural Networks for Effective Attention Computation","authors":"Manh-Hung Ha, O. Chen","doi":"10.1109/SSP53291.2023.10207931","DOIUrl":"https://doi.org/10.1109/SSP53291.2023.10207931","url":null,"abstract":"Recurrent Neural Networks (RNNs) have been successful in figuring out applications on time series data. Particularly, effectively capturing local features can ameliorate the performance of RNN. Accordingly, we propose a Rectified Attention Gate Unit (RAGU) which amends Gated Recurrent Unit (GRU) with two special attention mechanisms for RNNs. These two attention mechanisms are a Convolutional Attention (ConvAtt) module performing the convolutional operations on the current input and the previous hidden state to fairly establish the spatiotemporal relationship, and an Attention Module (AM) taking outputs from ConvAtt to fulfill the integrated attention computations for discovering the contextual dependency. Experimental results reveal that RNN using the proposed RAGUs has superior accuracies than RNNs using the other cell units on the HMDB51 and MNIST datasets. Therefore, RAGU proposed herein is an effective model which can bring out outstanding performance for various time series applications.","PeriodicalId":296346,"journal":{"name":"2023 IEEE Statistical Signal Processing Workshop (SSP)","volume":"15 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-07-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126679227","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
AutoEncoder-based Feature Ranking for Predicting Mild Cognitive Impairment Conversion using FDG-PET Images 基于自编码器的特征排序预测FDG-PET图像的轻度认知障碍转换
Pub Date : 2023-07-02 DOI: 10.1109/SSP53291.2023.10208072
Pham Tuan, N. Trung, M. Adel, E. Guedj
Alzheimer’s Disease (AD) is a most common type of neurodegenerative brain disease in elderly people. Early diagnosis of AD is crucial for providing suitable care. Positron Emission Tomography (PET) images and machine learning can be used to support this purpose. In this paper, we present a method for ranking the effectiveness of brain regions of interest (ROI) to distinguish between stable mild cognitive impairment (sMCI) from progressive mild cognitive impairment (pMCI) in brain PET images based on AutoEncoder (AE). Experiments on the ADNI dataset show that our proposed method significantly improves classifier performance when compared to other popular feature ranking methods such as Fisher score, T-score, and Lasso. Our results suggest that instead of focusing on designing a complex AE structure, we can also use simple-but-multiple AEs for feature ranking. The proposed method could be easily applied to any image dataset where a feature selection is needed.
阿尔茨海默病(AD)是老年人最常见的一种神经退行性脑疾病。阿尔茨海默病的早期诊断对于提供适当的护理至关重要。正电子发射断层扫描(PET)图像和机器学习可以用来支持这一目的。本文提出了一种基于AutoEncoder (AE)的脑PET图像感兴趣脑区(ROI)有效性排序方法,用于区分稳定型轻度认知障碍(sMCI)和进行性轻度认知障碍(pMCI)。在ADNI数据集上的实验表明,与其他流行的特征排序方法(如Fisher score、T-score和Lasso)相比,我们提出的方法显著提高了分类器的性能。我们的研究结果表明,我们也可以使用简单但多个AE来进行特征排序,而不是专注于设计复杂的AE结构。该方法可以很容易地应用于任何需要特征选择的图像数据集。
{"title":"AutoEncoder-based Feature Ranking for Predicting Mild Cognitive Impairment Conversion using FDG-PET Images","authors":"Pham Tuan, N. Trung, M. Adel, E. Guedj","doi":"10.1109/SSP53291.2023.10208072","DOIUrl":"https://doi.org/10.1109/SSP53291.2023.10208072","url":null,"abstract":"Alzheimer’s Disease (AD) is a most common type of neurodegenerative brain disease in elderly people. Early diagnosis of AD is crucial for providing suitable care. Positron Emission Tomography (PET) images and machine learning can be used to support this purpose. In this paper, we present a method for ranking the effectiveness of brain regions of interest (ROI) to distinguish between stable mild cognitive impairment (sMCI) from progressive mild cognitive impairment (pMCI) in brain PET images based on AutoEncoder (AE). Experiments on the ADNI dataset show that our proposed method significantly improves classifier performance when compared to other popular feature ranking methods such as Fisher score, T-score, and Lasso. Our results suggest that instead of focusing on designing a complex AE structure, we can also use simple-but-multiple AEs for feature ranking. The proposed method could be easily applied to any image dataset where a feature selection is needed.","PeriodicalId":296346,"journal":{"name":"2023 IEEE Statistical Signal Processing Workshop (SSP)","volume":"80 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-07-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122615685","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Rankformer: Leveraging Rank Correlation for Transformer-based Time Series Forecasting Rankformer:利用等级相关性进行基于变压器的时间序列预测
Pub Date : 2023-07-02 DOI: 10.1109/SSP53291.2023.10207937
Zuokun Ouyang, M. Jabloun, P. Ravier
Long-term forecasting problem for time series has been actively studied during the last several years, and preceding Transformer-based models have exploited various self-attention mechanisms to discover the long-range dependencies. However, the hidden dependencies required by the forecasting task are not always appropriately extracted, especially the nonlinear serial dependencies in some datasets. In this paper, we propose a novel Transformer-based model, namely Rankformer, leveraging the rank correlation function and decomposition architecture for long-term time series forecasting tasks. Rankformer outperforms four state-of-the-art Transformer-based models and two RNN-based models for different forecasting horizons on different datasets on which extensive experiments were conducted.
时间序列的长期预测问题在过去的几年里得到了积极的研究,之前基于transformer的模型利用了各种自关注机制来发现长期依赖关系。然而,预测任务所需的隐藏依赖关系并不总是被适当地提取出来,特别是在一些数据集中的非线性序列依赖关系。在本文中,我们提出了一种新的基于transformer的模型,即Rankformer,利用秩相关函数和分解架构进行长期时间序列预测任务。Rankformer在不同的数据集上进行了广泛的实验,在不同的预测范围上优于四种最先进的基于变压器的模型和两种基于rnn的模型。
{"title":"Rankformer: Leveraging Rank Correlation for Transformer-based Time Series Forecasting","authors":"Zuokun Ouyang, M. Jabloun, P. Ravier","doi":"10.1109/SSP53291.2023.10207937","DOIUrl":"https://doi.org/10.1109/SSP53291.2023.10207937","url":null,"abstract":"Long-term forecasting problem for time series has been actively studied during the last several years, and preceding Transformer-based models have exploited various self-attention mechanisms to discover the long-range dependencies. However, the hidden dependencies required by the forecasting task are not always appropriately extracted, especially the nonlinear serial dependencies in some datasets. In this paper, we propose a novel Transformer-based model, namely Rankformer, leveraging the rank correlation function and decomposition architecture for long-term time series forecasting tasks. Rankformer outperforms four state-of-the-art Transformer-based models and two RNN-based models for different forecasting horizons on different datasets on which extensive experiments were conducted.","PeriodicalId":296346,"journal":{"name":"2023 IEEE Statistical Signal Processing Workshop (SSP)","volume":"49 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-07-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131387643","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Derivation of N-TH Order Cumulant Spectra N-TH阶累积谱的推导
Pub Date : 2023-07-02 DOI: 10.1109/SSP53291.2023.10207976
A. Trapp, P. Wolfsteiner
Higher-order spectra (HOS) provide the frequency-domain decomposition of higher-order moments by cross-frequency correlation. They establish the frequency-domain equivalent to correlation functions and form powerful representations for assessing nonlinear, non-Gaussian, or non-stationary systems and processes. HOS are subdivided into moment and cumulant spectra. While the latter provide a clear assessment of statistical dependence and favorable mathematical properties, cumulant spectra cannot be estimated directly. Their concept requires the identification and removal of spectra of lower order, analogously to their scalar-valued counterparts. So far, HOS applications have been based on third and fourth order and so has the derivation of cumulant spectra. Computational power, advanced methods, and new estimators put forward the interest in expanding HOS analysis to orders above four. This paper presents the combinatorial framework to define nth-order cumulant spectra in the frequency domain. On this basis, sixth-order spectral estimates are employed to differentiate two processes of same PSD and trispectrum.
高阶谱(HOS)通过交叉频率相关提供了高阶矩的频域分解。它们建立了与相关函数等效的频域,并形成了用于评估非线性、非高斯或非平稳系统和过程的强大表示。HOS可分为矩量谱和累积量谱。虽然后者提供了统计依赖性和有利的数学性质的明确评估,累积光谱不能直接估计。它们的概念需要识别和去除低阶光谱,类似于它们的标量值对应物。到目前为止,HOS的应用都是基于三阶和四阶的,累积量谱的推导也是如此。计算能力、先进的方法和新的估计方法使人们对将居屋分析扩展到四阶以上产生了兴趣。本文提出了在频域中定义n阶累积谱的组合框架。在此基础上,采用六阶谱估计来区分相同PSD和三谱的两个过程。
{"title":"Derivation of N-TH Order Cumulant Spectra","authors":"A. Trapp, P. Wolfsteiner","doi":"10.1109/SSP53291.2023.10207976","DOIUrl":"https://doi.org/10.1109/SSP53291.2023.10207976","url":null,"abstract":"Higher-order spectra (HOS) provide the frequency-domain decomposition of higher-order moments by cross-frequency correlation. They establish the frequency-domain equivalent to correlation functions and form powerful representations for assessing nonlinear, non-Gaussian, or non-stationary systems and processes. HOS are subdivided into moment and cumulant spectra. While the latter provide a clear assessment of statistical dependence and favorable mathematical properties, cumulant spectra cannot be estimated directly. Their concept requires the identification and removal of spectra of lower order, analogously to their scalar-valued counterparts. So far, HOS applications have been based on third and fourth order and so has the derivation of cumulant spectra. Computational power, advanced methods, and new estimators put forward the interest in expanding HOS analysis to orders above four. This paper presents the combinatorial framework to define nth-order cumulant spectra in the frequency domain. On this basis, sixth-order spectral estimates are employed to differentiate two processes of same PSD and trispectrum.","PeriodicalId":296346,"journal":{"name":"2023 IEEE Statistical Signal Processing Workshop (SSP)","volume":"22 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-07-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128104890","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Estimation of Differential Graphs via Log-Sum Penalized D-Trace Loss 基于对数和惩罚d轨迹损失的微分图估计
Pub Date : 2023-07-02 DOI: 10.1109/SSP53291.2023.10208014
Jitendra Tugnait
We consider the problem of estimating differences in two Gaussian graphical models (GGMs) which are known to have similar structure. The GGM structure is encoded in its precision (inverse covariance) matrix. In many applications one is interested in estimating the difference in two precision matrices to characterize underlying changes in conditional dependencies of two sets of data. Most existing methods for differential graph estimation are based on a lasso penalized loss function. In this paper, we analyze a log-sum penalized D-trace loss function approach for differential graph learning. An alternating direction method of multipliers (ADMM) algorithm is presented to optimize the objective function. Theoretical analysis establishing consistency in estimation in high-dimensional settings is provided. We illustrate our approach using a numerical example where log-sum penalized D-trace loss significantly outperforms lasso-penalized D-trace loss as well as smoothly clipped absolute deviation (SCAD) penalized D-trace loss.
我们考虑两个已知具有相似结构的高斯图模型(GGMs)的差值估计问题。GGM结构编码在其精度(逆协方差)矩阵中。在许多应用中,人们感兴趣的是估计两个精度矩阵的差异,以表征两组数据的条件依赖性的潜在变化。大多数现有的差分图估计方法都是基于lasso惩罚损失函数。在本文中,我们分析了一种对数和惩罚d -迹损失函数方法用于微分图学习。提出了一种交替方向乘法器(ADMM)算法来优化目标函数。给出了建立高维环境下估计一致性的理论分析。我们使用一个数值示例来说明我们的方法,其中对数和惩罚D-trace损耗显著优于套索惩罚D-trace损耗以及平滑剪裁绝对偏差(SCAD)惩罚D-trace损耗。
{"title":"Estimation of Differential Graphs via Log-Sum Penalized D-Trace Loss","authors":"Jitendra Tugnait","doi":"10.1109/SSP53291.2023.10208014","DOIUrl":"https://doi.org/10.1109/SSP53291.2023.10208014","url":null,"abstract":"We consider the problem of estimating differences in two Gaussian graphical models (GGMs) which are known to have similar structure. The GGM structure is encoded in its precision (inverse covariance) matrix. In many applications one is interested in estimating the difference in two precision matrices to characterize underlying changes in conditional dependencies of two sets of data. Most existing methods for differential graph estimation are based on a lasso penalized loss function. In this paper, we analyze a log-sum penalized D-trace loss function approach for differential graph learning. An alternating direction method of multipliers (ADMM) algorithm is presented to optimize the objective function. Theoretical analysis establishing consistency in estimation in high-dimensional settings is provided. We illustrate our approach using a numerical example where log-sum penalized D-trace loss significantly outperforms lasso-penalized D-trace loss as well as smoothly clipped absolute deviation (SCAD) penalized D-trace loss.","PeriodicalId":296346,"journal":{"name":"2023 IEEE Statistical Signal Processing Workshop (SSP)","volume":"19 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-07-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131798828","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
2023 IEEE Statistical Signal Processing Workshop (SSP)
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1