首页 > 最新文献

IEEE Transactions on Signal Processing最新文献

英文 中文
Personalized Coupled Tensor Decomposition for Multimodal Data Fusion: Uniqueness and Algorithms 多模态数据融合的个性化耦合张量分解:唯一性与算法
IF 4.6 2区 工程技术 Q1 ENGINEERING, ELECTRICAL & ELECTRONIC Pub Date : 2024-12-03 DOI: 10.1109/TSP.2024.3510680
Ricardo A. Borsoi;Konstantin Usevich;David Brie;Tülay Adali
Coupled tensor decompositions (CTDs) perform data fusion by linking factors from different datasets. Although many CTDs have been already proposed, current works do not address important challenges of data fusion, where: 1) the datasets are often heterogeneous, constituting different “views” of a given phenomena (multimodality); and 2) each dataset can contain personalized or dataset-specific information, constituting distinct factors that are not coupled with other datasets. In this work, we introduce a personalized CTD framework tackling these challenges. A flexible model is proposed where each dataset is represented as the sum of two components, one related to a common tensor through a multilinear measurement model, and another specific to each dataset. Both the common and distinct components are assumed to admit a polyadic decomposition. This generalizes several existing CTD models. We provide conditions for specific and generic uniqueness of the decomposition that are easy to interpret. These conditions employ uni-mode uniqueness of different individual datasets and properties of the measurement model. Two algorithms are proposed to compute the common and distinct components: a semi-algebraic one and a coordinate-descent optimization method. Experimental results illustrate the advantage of the proposed framework compared with the state of the art approaches.
耦合张量分解(CTDs)通过连接来自不同数据集的因子来实现数据融合。虽然已经提出了许多CTDs,但目前的工作并没有解决数据融合的重要挑战,其中:1)数据集通常是异构的,构成对给定现象的不同“观点”(多模态);2)每个数据集可以包含个性化或特定于数据集的信息,构成不与其他数据集耦合的不同因素。在这项工作中,我们引入了一个个性化的CTD框架来应对这些挑战。提出了一种灵活的模型,其中每个数据集表示为两个分量的和,一个通过多线性测量模型与公共张量相关,另一个特定于每个数据集。假定公共分量和不同分量都可以进行多进分解。这概括了几种现有的CTD模型。我们为分解的特定唯一性和一般唯一性提供了易于解释的条件。这些条件利用了不同个体数据集和测量模型属性的单模唯一性。提出了两种计算共同分量和不同分量的算法:半代数法和坐标下降优化法。实验结果表明,与现有的方法相比,所提出的框架具有优势。
{"title":"Personalized Coupled Tensor Decomposition for Multimodal Data Fusion: Uniqueness and Algorithms","authors":"Ricardo A. Borsoi;Konstantin Usevich;David Brie;Tülay Adali","doi":"10.1109/TSP.2024.3510680","DOIUrl":"10.1109/TSP.2024.3510680","url":null,"abstract":"Coupled tensor decompositions (CTDs) perform data fusion by linking factors from different datasets. Although many CTDs have been already proposed, current works do not address important challenges of data fusion, where: 1) the datasets are often heterogeneous, constituting different “views” of a given phenomena (multimodality); and 2) each dataset can contain \u0000<italic>personalized</i>\u0000 or dataset-specific information, constituting distinct factors that are not coupled with other datasets. In this work, we introduce a personalized CTD framework tackling these challenges. A flexible model is proposed where each dataset is represented as the sum of two components, one related to a common tensor through a multilinear measurement model, and another specific to each dataset. Both the common and distinct components are assumed to admit a polyadic decomposition. This generalizes several existing CTD models. We provide conditions for specific and generic uniqueness of the decomposition that are easy to interpret. These conditions employ \u0000<italic>uni-mode</i>\u0000 uniqueness of different individual datasets and properties of the measurement model. Two algorithms are proposed to compute the common and distinct components: a semi-algebraic one and a coordinate-descent optimization method. Experimental results illustrate the advantage of the proposed framework compared with the state of the art approaches.","PeriodicalId":13330,"journal":{"name":"IEEE Transactions on Signal Processing","volume":"73 ","pages":"113-129"},"PeriodicalIF":4.6,"publicationDate":"2024-12-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142776540","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Reliable Robust Adaptive Steganographic Coding Based on Nested Polar Codes 基于嵌套极码的可靠鲁棒自适应隐写编码
IF 4.6 2区 工程技术 Q1 ENGINEERING, ELECTRICAL & ELECTRONIC Pub Date : 2024-12-03 DOI: 10.1109/TSP.2024.3510755
Qiyi Yao;Kai Zeng;Weiming Zhang;Kejiang Chen
Steganography is the art of covert communication that pursues the secrecy of concealment. In adaptive steganography, the most commonly used framework of steganography, the sender embeds a “secret message” signal within another “cover” signal with respect to a certain adaptive distortion function that measures the distortion incurred, contributing to the composite “stego” signal that resembles the cover, and the receiver extracts the “secret message” signal from the stego. When the communication channel between the sender and the receiver is noisy, robust steganography is needed, in which robust adaptive steganographic coding plays a central role. The existing robust adaptive steganographic coding methods can only provide very limited robustness, and they fail when the communication channel is bad. To ensure the success of covert communication, we propose a reliable robust adaptive steganographic coding scheme based on nested polar codes that possesses the highest robustness among the existing algorithms while the security performance is also maintained. Theoretically, we show that for the most important binary embedding, in the special case where the communication channel is a Binary Symmetric Channel (BSC), the proposed scheme is optimal under the constant distortion profile as the cover length $N$ tends to infinity through powers of two when the design embedding rate is large enough. Experimentally, our method is capable of making sure the perfect extraction of the secret message in situations where the embedding rate is large or the communication channel is bad, while the existing algorithms are not applicable in these scenarios.
隐写术是一种追求隐蔽性的秘密通信艺术。在最常用的隐写框架——自适应隐写中,发送方将一个“秘密信息”信号嵌入到另一个“掩蔽”信号中,根据测量所产生的失真的某种自适应失真函数,形成与掩蔽相似的复合“隐写”信号,接收方从该隐写中提取“秘密信息”信号。当发送方和接收方之间的通信信道存在噪声时,需要进行鲁棒隐写,其中鲁棒自适应隐写编码起着核心作用。现有的鲁棒性自适应隐写编码方法只能提供非常有限的鲁棒性,并且在通信信道较差的情况下失效。为了保证隐蔽通信的成功,我们提出了一种可靠的基于嵌套极码的鲁棒自适应隐写编码方案,该方案在保持安全性能的同时,在现有算法中具有最高的鲁棒性。理论上,我们证明了对于最重要的二值嵌入,在通信信道为二进制对称信道(BSC)的特殊情况下,当设计嵌入率足够大时,覆盖长度$N$通过2的幂趋于无穷时,所提出的方案在恒定失真轮廓下是最优的。实验表明,我们的方法能够在嵌入率较大或通信信道较差的情况下保证秘密信息的完美提取,而现有的算法在这些情况下并不适用。
{"title":"Reliable Robust Adaptive Steganographic Coding Based on Nested Polar Codes","authors":"Qiyi Yao;Kai Zeng;Weiming Zhang;Kejiang Chen","doi":"10.1109/TSP.2024.3510755","DOIUrl":"10.1109/TSP.2024.3510755","url":null,"abstract":"Steganography is the art of covert communication that pursues the secrecy of concealment. In adaptive steganography, the most commonly used framework of steganography, the sender embeds a “secret message” signal within another “cover” signal with respect to a certain adaptive distortion function that measures the distortion incurred, contributing to the composite “stego” signal that resembles the cover, and the receiver extracts the “secret message” signal from the stego. When the communication channel between the sender and the receiver is noisy, robust steganography is needed, in which robust adaptive steganographic coding plays a central role. The existing robust adaptive steganographic coding methods can only provide very limited robustness, and they fail when the communication channel is bad. To ensure the success of covert communication, we propose a reliable robust adaptive steganographic coding scheme based on nested polar codes that possesses the highest robustness among the existing algorithms while the security performance is also maintained. Theoretically, we show that for the most important \u0000<italic>binary embedding</i>\u0000, in the special case where the communication channel is a Binary Symmetric Channel (BSC), the proposed scheme is optimal under the constant distortion profile as the cover length \u0000<inline-formula><tex-math>$N$</tex-math></inline-formula>\u0000 tends to infinity through powers of two when the \u0000<italic>design embedding rate</i>\u0000 is large enough. Experimentally, our method is capable of making sure the perfect extraction of the secret message in situations where the embedding rate is large or the communication channel is bad, while the existing algorithms are not applicable in these scenarios.","PeriodicalId":13330,"journal":{"name":"IEEE Transactions on Signal Processing","volume":"73 ","pages":"12-25"},"PeriodicalIF":4.6,"publicationDate":"2024-12-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142776569","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
WSS Processes and Wiener Filters on Digraphs 有向图上的WSS过程和Wiener滤波器
IF 4.6 2区 工程技术 Q1 ENGINEERING, ELECTRICAL & ELECTRONIC Pub Date : 2024-12-03 DOI: 10.1109/TSP.2024.3510434
Mohammad Bagher Iraji;Mohammad Eini;Arash Amini
In this paper, we generalize the concepts of kernels, weak stationarity and white noise from undirected to directed graphs (digraphs) based on the Jordan decomposition of the shift operator. We characterize two types of kernels (type-I and type-II) and their corresponding localization operators for digraphs. We analytically study the interplay of these types of kernels with the concept of stationarity, specially the filtering properties. We also generalize graph Wiener filters and the related optimization framework to digraphs. For the special case of Gaussian processes, we show that the Wiener filtering again coincides with the MAP estimator. We further investigate the linear minimum mean-squared error (LMMSE) estimator for the non-Gaussian cases; the corresponding optimization problem simplifies to a Lyapunov matrix equation. We propose an algorithm to solve the Wiener optimization using proximal splitting methods. Finally, we provide simulation results to verify the provided theory.
本文基于移位算子的Jordan分解,将核、弱平稳性和白噪声的概念从无向图推广到有向图。我们描述了两种类型的核(i型和ii型)及其对应的有向图的定位算子。我们用平稳性的概念分析研究了这些核的相互作用,特别是滤波特性。我们还将图维纳滤波器和相关的优化框架推广到有向图。对于高斯过程的特殊情况,我们证明了维纳滤波再次与MAP估计一致。我们进一步研究了非高斯情况下线性最小均方误差(LMMSE)估计量;将相应的优化问题简化为李雅普诺夫矩阵方程。我们提出了一种用近端分裂方法求解Wiener优化的算法。最后,给出了仿真结果来验证所提供的理论。
{"title":"WSS Processes and Wiener Filters on Digraphs","authors":"Mohammad Bagher Iraji;Mohammad Eini;Arash Amini","doi":"10.1109/TSP.2024.3510434","DOIUrl":"10.1109/TSP.2024.3510434","url":null,"abstract":"In this paper, we generalize the concepts of kernels, weak stationarity and white noise from undirected to directed graphs (digraphs) based on the Jordan decomposition of the shift operator. We characterize two types of kernels (type-I and type-II) and their corresponding localization operators for digraphs. We analytically study the interplay of these types of kernels with the concept of stationarity, specially the filtering properties. We also generalize graph Wiener filters and the related optimization framework to digraphs. For the special case of Gaussian processes, we show that the Wiener filtering again coincides with the MAP estimator. We further investigate the linear minimum mean-squared error (LMMSE) estimator for the non-Gaussian cases; the corresponding optimization problem simplifies to a Lyapunov matrix equation. We propose an algorithm to solve the Wiener optimization using proximal splitting methods. Finally, we provide simulation results to verify the provided theory.","PeriodicalId":13330,"journal":{"name":"IEEE Transactions on Signal Processing","volume":"73 ","pages":"1-11"},"PeriodicalIF":4.6,"publicationDate":"2024-12-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142776539","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Generalized Bilinear Factorization via Hybrid Vector Message Passing 基于混合向量消息传递的广义双线性分解
IF 4.6 2区 工程技术 Q1 ENGINEERING, ELECTRICAL & ELECTRONIC Pub Date : 2024-12-02 DOI: 10.1109/TSP.2024.3509413
Hao Jiang;Xiaojun Yuan;Qinghua Guo
Generalized bilinear factorization (GBF), in which two matrices are recovered from noisy and typically compressed measurements of their product, arises in various applications such as blind channel-and-signal estimation, image completion, and compressed video foreground and background separation. In this paper, we formulate the GBF problem by unifying several existing bilinear inverse problems, and establish a novel hybrid vector message passing (HVMP) algorithm for GBF. The GBF-HVMP algorithm integrates expectation propagation (EP) and variational message passing (VMP) via variational free energy minimization, and exchanges matrix-variable messages in closed form. GBF-HVMP is advantageous over its counterparts in several aspects. For example, a matrix-variable message can characterize the correlations between the elements of the matrix, which is not possible in scalar-variable message passing; the hybrid of EP and VMP yields closed-form Gaussian messages associated with the bilinear constraints inherent in the GBF problem. We show that damping is unnecessary for GBF-HVMP to ensure convergence. We also show that GBF-HVMP performs close to the replica bound, and significantly outperforms state-of-the-art approaches in terms of both normalized mean squared error (NMSE) performance and computational complexity.
广义双线性分解(GBF),其中两个矩阵从噪声和通常压缩的测量结果中恢复,出现在各种应用中,如盲信道和信号估计,图像补全,压缩视频前景和背景分离。本文通过统一现有的几个双线性逆问题来表述GBF问题,并建立了一种新的混合向量消息传递(HVMP)算法。GBF-HVMP算法通过变分自由能最小化将期望传播(EP)和变分消息传递(VMP)相结合,以封闭形式交换矩阵变量消息。GBF-HVMP在几个方面优于同类产品。例如,矩阵变量消息可以描述矩阵元素之间的相关性,这在标量变量消息传递中是不可能的;EP和VMP的混合产生与GBF问题中固有的双线性约束相关的封闭式高斯消息。结果表明,为了保证收敛性,GBF-HVMP算法不需要阻尼。我们还表明,GBF-HVMP的性能接近副本边界,并且在归一化均方误差(NMSE)性能和计算复杂性方面明显优于最先进的方法。
{"title":"Generalized Bilinear Factorization via Hybrid Vector Message Passing","authors":"Hao Jiang;Xiaojun Yuan;Qinghua Guo","doi":"10.1109/TSP.2024.3509413","DOIUrl":"10.1109/TSP.2024.3509413","url":null,"abstract":"Generalized bilinear factorization (GBF), in which two matrices are recovered from noisy and typically compressed measurements of their product, arises in various applications such as blind channel-and-signal estimation, image completion, and compressed video foreground and background separation. In this paper, we formulate the GBF problem by unifying several existing bilinear inverse problems, and establish a novel hybrid vector message passing (HVMP) algorithm for GBF. The GBF-HVMP algorithm integrates expectation propagation (EP) and variational message passing (VMP) via variational free energy minimization, and exchanges matrix-variable messages in closed form. GBF-HVMP is advantageous over its counterparts in several aspects. For example, a matrix-variable message can characterize the correlations between the elements of the matrix, which is not possible in scalar-variable message passing; the hybrid of EP and VMP yields closed-form Gaussian messages associated with the bilinear constraints inherent in the GBF problem. We show that damping is unnecessary for GBF-HVMP to ensure convergence. We also show that GBF-HVMP performs close to the replica bound, and significantly outperforms state-of-the-art approaches in terms of both normalized mean squared error (NMSE) performance and computational complexity.","PeriodicalId":13330,"journal":{"name":"IEEE Transactions on Signal Processing","volume":"72 ","pages":"5675-5690"},"PeriodicalIF":4.6,"publicationDate":"2024-12-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142760268","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Narrowband Interference Cancellation for OFDM Based on Deep Learning and Compressed Sensing 基于深度学习和压缩感知的OFDM窄带干扰消除
IF 5.4 2区 工程技术 Q1 ENGINEERING, ELECTRICAL & ELECTRONIC Pub Date : 2024-12-02 DOI: 10.1109/tsp.2024.3510623
Yue Hu, Songkang Huang, Lei Zhao, Ming Jiang
{"title":"Narrowband Interference Cancellation for OFDM Based on Deep Learning and Compressed Sensing","authors":"Yue Hu, Songkang Huang, Lei Zhao, Ming Jiang","doi":"10.1109/tsp.2024.3510623","DOIUrl":"https://doi.org/10.1109/tsp.2024.3510623","url":null,"abstract":"","PeriodicalId":13330,"journal":{"name":"IEEE Transactions on Signal Processing","volume":"26 1","pages":""},"PeriodicalIF":5.4,"publicationDate":"2024-12-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142760269","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Enhancing Missing Data Imputation of Non-Stationary Oscillatory Signals With Harmonic Decomposition 用谐波分解增强非平稳振荡信号缺失数据的输入
IF 4.6 2区 工程技术 Q1 ENGINEERING, ELECTRICAL & ELECTRONIC Pub Date : 2024-11-29 DOI: 10.1109/TSP.2024.3508468
Joaquin Ruiz;Hau-Tieng Wu;Marcelo A. Colominas
Dealing with time series with missing values, including those afflicted by low quality or over-saturation, presents a significant signal processing challenge. The task of recovering these missing values, known as imputation, has led to the development of several algorithms. However, we have observed that the efficacy of these algorithms tends to diminish when the time series exhibits non-stationary oscillatory behavior. In this paper, we introduce a novel algorithm, coined Harmonic Level Interpolation (HaLI), which enhances the performance of existing imputation algorithms for oscillatory time series. After running any chosen imputation algorithm, HaLI leverages the harmonic decomposition based on the adaptive non-harmonic model of the initial imputation to improve the imputation accuracy for oscillatory time series. Experimental assessments conducted on synthetic and real signals consistently highlight that HaLI enhances the performance of existing imputation algorithms. The algorithm is made publicly available as a readily employable Matlab code for other researchers to use.
处理具有缺失值的时间序列,包括那些受低质量或过饱和影响的时间序列,对信号处理提出了重大挑战。恢复这些缺失值的任务,被称为imputation,已经导致了几种算法的发展。然而,我们已经观察到,当时间序列表现出非平稳振荡行为时,这些算法的有效性趋于降低。在本文中,我们提出了一种新的算法,谐波电平插值(HaLI),它提高了现有的振荡时间序列插值算法的性能。在运行任意选择的输入算法后,HaLI利用基于初始输入的自适应非谐波模型的谐波分解来提高振荡时间序列的输入精度。对合成信号和真实信号进行的实验评估一致表明,HaLI增强了现有估算算法的性能。该算法作为易于使用的Matlab代码公开提供给其他研究人员使用。
{"title":"Enhancing Missing Data Imputation of Non-Stationary Oscillatory Signals With Harmonic Decomposition","authors":"Joaquin Ruiz;Hau-Tieng Wu;Marcelo A. Colominas","doi":"10.1109/TSP.2024.3508468","DOIUrl":"10.1109/TSP.2024.3508468","url":null,"abstract":"Dealing with time series with missing values, including those afflicted by low quality or over-saturation, presents a significant signal processing challenge. The task of recovering these missing values, known as imputation, has led to the development of several algorithms. However, we have observed that the efficacy of these algorithms tends to diminish when the time series exhibits non-stationary oscillatory behavior. In this paper, we introduce a novel algorithm, coined Harmonic Level Interpolation (\u0000<monospace>HaLI</monospace>\u0000), which enhances the performance of existing imputation algorithms for oscillatory time series. After running any chosen imputation algorithm, \u0000<monospace>HaLI</monospace>\u0000 leverages the \u0000<italic>harmonic decomposition</i>\u0000 based on the \u0000<italic>adaptive non-harmonic model</i>\u0000 of the initial imputation to improve the imputation accuracy for oscillatory time series. Experimental assessments conducted on synthetic and real signals consistently highlight that \u0000<monospace>HaLI</monospace>\u0000 enhances the performance of existing imputation algorithms. The algorithm is made publicly available as a readily employable Matlab code for other researchers to use.","PeriodicalId":13330,"journal":{"name":"IEEE Transactions on Signal Processing","volume":"72 ","pages":"5581-5592"},"PeriodicalIF":4.6,"publicationDate":"2024-11-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142753504","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Causal Influence in Federated Edge Inference 联邦边缘推理中的因果影响
IF 4.6 2区 工程技术 Q1 ENGINEERING, ELECTRICAL & ELECTRONIC Pub Date : 2024-11-28 DOI: 10.1109/TSP.2024.3507715
Mert Kayaalp;Yunus İnan;Visa Koivunen;Ali H. Sayed
In this paper, we consider a setting where heterogeneous agents with connectivity are performing inference using unlabeled streaming data. Observed data are only partially informative about the target variable of interest. In order to overcome the uncertainty, agents cooperate with each other by exchanging their local inferences with and through a fusion center. To evaluate how each agent influences the overall decision, we adopt a causal framework in order to distinguish the actual influence of agents from mere correlations within the decision-making process. Various scenarios reflecting different agent participation patterns and fusion center policies are investigated. We derive expressions to quantify the causal impact of each agent on the joint decision, which could be beneficial for anticipating and addressing atypical scenarios, such as adversarial attacks or system malfunctions. We validate our theoretical results with numerical simulations and a real-world application of multi-camera crowd counting.
在本文中,我们考虑了一种设置,其中具有连接性的异构代理使用未标记的流数据执行推理。观察到的数据只能提供有关目标变量的部分信息。为了克服不确定性,智能体之间通过融合中心交换各自的局部推理进行合作。为了评估每个主体如何影响整体决策,我们采用了一个因果框架,以区分决策过程中主体的实际影响和单纯的相关性。研究了反映不同agent参与模式和融合中心策略的各种场景。我们导出表达式来量化每个代理对联合决策的因果影响,这可能有利于预测和处理非典型场景,例如对抗性攻击或系统故障。我们通过数值模拟和多摄像头人群计数的实际应用验证了我们的理论结果。
{"title":"Causal Influence in Federated Edge Inference","authors":"Mert Kayaalp;Yunus İnan;Visa Koivunen;Ali H. Sayed","doi":"10.1109/TSP.2024.3507715","DOIUrl":"10.1109/TSP.2024.3507715","url":null,"abstract":"In this paper, we consider a setting where heterogeneous agents with connectivity are performing inference using unlabeled streaming data. Observed data are only partially informative about the target variable of interest. In order to overcome the uncertainty, agents cooperate with each other by exchanging their local inferences with and through a fusion center. To evaluate how each agent influences the overall decision, we adopt a causal framework in order to distinguish the actual influence of agents from mere correlations within the decision-making process. Various scenarios reflecting different agent participation patterns and fusion center policies are investigated. We derive expressions to quantify the causal impact of each agent on the joint decision, which could be beneficial for anticipating and addressing atypical scenarios, such as adversarial attacks or system malfunctions. We validate our theoretical results with numerical simulations and a real-world application of multi-camera crowd counting.","PeriodicalId":13330,"journal":{"name":"IEEE Transactions on Signal Processing","volume":"72 ","pages":"5604-5615"},"PeriodicalIF":4.6,"publicationDate":"2024-11-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142752853","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Penalized Likelihood Approach to Covariance Matrix Estimation From Data With Cell Outliers 基于单元格异常值数据的协方差矩阵估计的惩罚似然方法
IF 4.6 2区 工程技术 Q1 ENGINEERING, ELECTRICAL & ELECTRONIC Pub Date : 2024-11-28 DOI: 10.1109/TSP.2024.3507819
Petre Stoica;Prabhu Babu
In a recent paper we have proposed an approach for estimating the covariance matrix from a multivariate data set ${mathbf{y}(t)}$ that may contain outliers. If $mathbf{y}(t)$ is flagged as outlying by this approach, then the entire vector $mathbf{y}(t)$ is considered to contain no useful information and it is discarded. However, in some applications the data contains cell outliers, that is to say, not all elements of $mathbf{y}(t)$ are outlying but only some of them. One then wants to eliminate only the cell outliers from the data, rather than the entire vector $mathbf{y}(t)$. In this paper, we propose a penalized maximum likelihood approach to outlier detection and covariance matrix estimation from data with cell outliers. Specifically we estimate the positions of the outliers in the data set, for a given estimate of the covariance matrix, by maximizing the penalized likelihood of the data with the penalty being derived from a property of the likelihood ratio and the false discovery rate (FDR) principle. We alternate this step with a majorization-minimization (MM) technique that estimates the covariance matrix for given outlier positions. The MM is more flexible than the expectation maximization (EM) algorithm commonly used for estimating the covariance matrix from data with missing cells, as the former can be utilized in cases in which the latter is not usable. The closest competitor of our approach is the cellMCD (minimum covariance determinant) method, compared with which the proposed approach has a number of advantages described in the introduction and the numerical study section.
在最近的一篇论文中,我们提出了一种从可能包含异常值的多元数据集${mathbf{y}(t)}$估计协方差矩阵的方法。如果通过这种方法将$mathbf{y}(t)$标记为偏离,则整个向量$mathbf{y}(t)$被认为不包含有用的信息并被丢弃。但是,在某些应用程序中,数据包含单元格离群值,也就是说,不是$mathbf{y}(t)$的所有元素都是离群值,而只是其中的一些。然后只需要从数据中消除单元格异常值,而不是整个向量$mathbf{y}(t)$。在本文中,我们提出了一种惩罚最大似然方法,用于从具有细胞异常值的数据中进行异常值检测和协方差矩阵估计。具体来说,对于给定的协方差矩阵估计,我们通过最大化数据的惩罚似然来估计数据集中异常值的位置,惩罚来自似然比的性质和错误发现率(FDR)原则。我们将此步骤与估计给定离群位置的协方差矩阵的最大化最小化(MM)技术交替进行。MM比期望最大化(EM)算法更灵活,通常用于从缺少单元格的数据中估计协方差矩阵,因为前者可以在后者不可用的情况下使用。与我们的方法最接近的竞争对手是cellMCD(最小协方差行列式)方法,与之相比,我们提出的方法在引言和数值研究部分中描述了许多优点。
{"title":"Penalized Likelihood Approach to Covariance Matrix Estimation From Data With Cell Outliers","authors":"Petre Stoica;Prabhu Babu","doi":"10.1109/TSP.2024.3507819","DOIUrl":"10.1109/TSP.2024.3507819","url":null,"abstract":"In a recent paper we have proposed an approach for estimating the covariance matrix from a multivariate data set \u0000<inline-formula><tex-math>${mathbf{y}(t)}$</tex-math></inline-formula>\u0000 that may contain outliers. If \u0000<inline-formula><tex-math>$mathbf{y}(t)$</tex-math></inline-formula>\u0000 is flagged as outlying by this approach, then the entire vector \u0000<inline-formula><tex-math>$mathbf{y}(t)$</tex-math></inline-formula>\u0000 is considered to contain no useful information and it is discarded. However, in some applications the data contains cell outliers, that is to say, not all elements of \u0000<inline-formula><tex-math>$mathbf{y}(t)$</tex-math></inline-formula>\u0000 are outlying but only some of them. One then wants to eliminate only the cell outliers from the data, rather than the entire vector \u0000<inline-formula><tex-math>$mathbf{y}(t)$</tex-math></inline-formula>\u0000. In this paper, we propose a penalized maximum likelihood approach to outlier detection and covariance matrix estimation from data with cell outliers. Specifically we estimate the positions of the outliers in the data set, for a given estimate of the covariance matrix, by maximizing the penalized likelihood of the data with the penalty being derived from a property of the likelihood ratio and the false discovery rate (FDR) principle. We alternate this step with a majorization-minimization (MM) technique that estimates the covariance matrix for given outlier positions. The MM is more flexible than the expectation maximization (EM) algorithm commonly used for estimating the covariance matrix from data with missing cells, as the former can be utilized in cases in which the latter is not usable. The closest competitor of our approach is the cellMCD (minimum covariance determinant) method, compared with which the proposed approach has a number of advantages described in the introduction and the numerical study section.","PeriodicalId":13330,"journal":{"name":"IEEE Transactions on Signal Processing","volume":"72 ","pages":"5616-5627"},"PeriodicalIF":4.6,"publicationDate":"2024-11-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142752854","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Arithmetic Vs. Expected Mean of Probabilistic Asynchronous Affine Inference 概率异步仿射推理的算术与期望均值
IF 4.6 2区 工程技术 Q1 ENGINEERING, ELECTRICAL & ELECTRONIC Pub Date : 2024-11-28 DOI: 10.1109/TSP.2024.3507572
Georgios Apostolakis;Aggelos Bletsas
Distributed execution of algorithms over various terminals is a topic that regains increasing popularity; when tolerance to failures is also required, asynchronous operation is brought to the light, while probabilistic asynchronous operation can model the probability of failure for each terminal. This work focuses on the probabilistic asynchronous affine update model, applicable in a wide range of inference algorithms, possibly executed over distributed terminals. The existing literature focuses on the asymptotic properties of the expected mean. Instead, this work offers the asymptotic analysis for the arithmetic mean, utilized for discovering fixed points, as it is the only quantity that can be practically offered experimentally. It is shown that the asymptotic behavior of the arithmetic mean is different than the expected mean's and a sufficient condition is provided for convergence of the arithmetic mean to a fixed point. The lack of necessity for this condition is explained and the subcases, where the arithmetic mean converges, diverges or has an unpredictable behavior, are distinguished. Additionally, cases where the individual iterations never converge (e.g., oscillate infinitely) but their arithmetic mean does and offers fixed point, are also highlighted. This is another concrete example of the arithmetic mean utility. Applications of the affine model are also briefly discussed. Finally, simulations corroborate theoretical findings for various affine model setups.
算法在不同终端上的分布式执行是一个越来越受欢迎的话题;当还需要容错时,可以采用异步操作,而概率异步操作可以对每个终端的故障概率进行建模。这项工作的重点是概率异步仿射更新模型,适用于广泛的推理算法,可能在分布式终端上执行。现有文献主要关注期望均值的渐近性质。相反,这项工作提供了算术平均值的渐近分析,用于发现不动点,因为它是唯一可以在实验中实际提供的量。证明了算术均值的渐近性不同于期望均值的渐近性,并给出了算术均值收敛于不动点的充分条件。解释了这个条件的不必要性,并区分了算术平均值收敛、发散或具有不可预测行为的子情况。此外,个别迭代从不收敛的情况(例如,无限振荡),但它们的算术平均值确实并提供不动点,也被突出显示。这是算术平均效用的另一个具体例子。本文还简要讨论了仿射模型的应用。最后,模拟证实了各种仿射模型设置的理论发现。
{"title":"Arithmetic Vs. Expected Mean of Probabilistic Asynchronous Affine Inference","authors":"Georgios Apostolakis;Aggelos Bletsas","doi":"10.1109/TSP.2024.3507572","DOIUrl":"10.1109/TSP.2024.3507572","url":null,"abstract":"Distributed execution of algorithms over various terminals is a topic that regains increasing popularity; when tolerance to failures is also required, asynchronous operation is brought to the light, while probabilistic asynchronous operation can model the probability of failure for each terminal. This work focuses on the probabilistic asynchronous affine update model, applicable in a wide range of inference algorithms, possibly executed over distributed terminals. The existing literature focuses on the asymptotic properties of the expected mean. Instead, this work offers the asymptotic analysis for the arithmetic mean, utilized for discovering fixed points, as it is the only quantity that can be practically offered experimentally. It is shown that the asymptotic behavior of the arithmetic mean is different than the expected mean's and a sufficient condition is provided for convergence of the arithmetic mean to a fixed point. The lack of necessity for this condition is explained and the subcases, where the arithmetic mean converges, diverges or has an unpredictable behavior, are distinguished. Additionally, cases where the individual iterations never converge (e.g., oscillate infinitely) but their arithmetic mean does and offers fixed point, are also highlighted. This is another concrete example of the arithmetic mean utility. Applications of the affine model are also briefly discussed. Finally, simulations corroborate theoretical findings for various affine model setups.","PeriodicalId":13330,"journal":{"name":"IEEE Transactions on Signal Processing","volume":"72 ","pages":"5593-5603"},"PeriodicalIF":4.6,"publicationDate":"2024-11-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142752852","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Double Sparse Structure-Enhanced mmWave NLOS Imaging Under Multiangle Relay Surface 多角度中继表面下双稀疏结构增强毫米波NLOS成像
IF 4.6 2区 工程技术 Q1 ENGINEERING, ELECTRICAL & ELECTRONIC Pub Date : 2024-11-27 DOI: 10.1109/TSP.2024.3505938
You Xu;Guanghua Liu;Xiaotong Lu;Chao Xie;Lixia Xiao;Tao Jiang
Non-line-of-sight (NLOS) mmWave imaging technology reconstructs the contour features of hidden targets by analyzing the indirect reflected signals of the relay surface, which has been a hot topic in disaster reserve and autonomous driving. However, due to the differences in the reflecting characteristics of multiangle relay surfaces, traditional multipath utilization methods inevitably suffer from disturbance, and obtaining high-quality images remains a challenging task. In this paper, we propose a double sparse structure enhanced mmWave NLOS imaging framework. First, we establish an automotive-squint synthetic aperture radar (AS-SAR) model under multiangle relay surface and analyze the multiangle image characteristics. Subsequently, we introduce a double sparse structure to transform the image reconstruction problem into a hybrid convex regularization problem, and theoretically derive the minimum lower bounds of sample complexity and estimation error. Then, based on the fast iterative threshold shrinkage framework, we propose a time-domain double sparse thresholding algorithm (TD-DSTA), in which the double sparse operator is optimized by alternating direction multiplication. In addition, we propose a two-dimensional frequency domain method based on the approximate-operator to reduce the computational complexity. Finally, we evaluate the performance of the proposed method through quantitative and qualitative analysis in the NLOS multiangle relay surfaces scenario. Simulation and real experimental results verify the superiority of the proposed method in NLOS image reconstruction.
非视距毫米波成像技术通过分析中继表面的间接反射信号重构隐藏目标的轮廓特征,已成为灾备和自动驾驶领域的研究热点。然而,由于多角度中继表面反射特性的差异,传统的多径利用方法不可避免地会受到干扰,获得高质量的图像仍然是一项具有挑战性的任务。本文提出了一种双稀疏结构增强毫米波NLOS成像框架。首先,建立了多角度中继表面下的汽车斜视合成孔径雷达(AS-SAR)模型,分析了多角度图像特征。随后,我们引入双稀疏结构将图像重构问题转化为混合凸正则化问题,并从理论上推导出样本复杂度和估计误差的最小下界。然后,在快速迭代阈值收缩框架的基础上,提出了一种时域双稀疏阈值分割算法(TD-DSTA),该算法通过交替方向乘法优化双稀疏算子。此外,我们提出了一种基于近似算子的二维频域方法来降低计算复杂度。最后,我们通过定量和定性分析评估了该方法在NLOS多角度中继表面场景下的性能。仿真和实际实验结果验证了该方法在近视距图像重建中的优越性。
{"title":"Double Sparse Structure-Enhanced mmWave NLOS Imaging Under Multiangle Relay Surface","authors":"You Xu;Guanghua Liu;Xiaotong Lu;Chao Xie;Lixia Xiao;Tao Jiang","doi":"10.1109/TSP.2024.3505938","DOIUrl":"10.1109/TSP.2024.3505938","url":null,"abstract":"Non-line-of-sight (NLOS) mmWave imaging technology reconstructs the contour features of hidden targets by analyzing the indirect reflected signals of the relay surface, which has been a hot topic in disaster reserve and autonomous driving. However, due to the differences in the reflecting characteristics of multiangle relay surfaces, traditional multipath utilization methods inevitably suffer from disturbance, and obtaining high-quality images remains a challenging task. In this paper, we propose a double sparse structure enhanced mmWave NLOS imaging framework. First, we establish an automotive-squint synthetic aperture radar (AS-SAR) model under multiangle relay surface and analyze the multiangle image characteristics. Subsequently, we introduce a double sparse structure to transform the image reconstruction problem into a hybrid convex regularization problem, and theoretically derive the minimum lower bounds of sample complexity and estimation error. Then, based on the fast iterative threshold shrinkage framework, we propose a time-domain double sparse thresholding algorithm (TD-DSTA), in which the double sparse operator is optimized by alternating direction multiplication. In addition, we propose a two-dimensional frequency domain method based on the approximate-operator to reduce the computational complexity. Finally, we evaluate the performance of the proposed method through quantitative and qualitative analysis in the NLOS multiangle relay surfaces scenario. Simulation and real experimental results verify the superiority of the proposed method in NLOS image reconstruction.","PeriodicalId":13330,"journal":{"name":"IEEE Transactions on Signal Processing","volume":"72 ","pages":"5628-5643"},"PeriodicalIF":4.6,"publicationDate":"2024-11-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142753466","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
IEEE Transactions on Signal Processing
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1