首页 > 最新文献

IEEE Transactions on Signal Processing最新文献

英文 中文
Robust Wideband Beampattern Synthesis With Precise Control of Worst-Case Beampattern 通过精确控制最坏情况贝型实现稳健的宽带贝型合成
IF 4.6 2区 工程技术 Q1 ENGINEERING, ELECTRICAL & ELECTRONIC Pub Date : 2024-09-10 DOI: 10.1109/TSP.2024.3457159
Congwei Feng;Huawei Chen
Beampattern synthesis inspired by adaptive array theory (AAT) has attracted much interest in recent years, thanks to its capability to flexibly and precisely control beampattern. However, the existing AAT-inspired beampattern synthesis approaches usually assume an ideal array model, which is not realistic in practice and may lead to severe performance degradation in the presence of steering vector errors. In this paper, we propose a robust beampattern synthesis approach for wideband arrays using regularized AAT-inspired weighted least squares (WLS), which can precisely control the worst-case beampattern, including both its mainlobe ripple and sidelobe level, in the presence of steering vector errors. We develop a theory on the solutions for the regularization parameter and weighting function of the regularized AAT-inspired WLS. We propose a Newton-Raphson method to find the solution for the regularization parameter, and derive closed-form solutions for the weighting function. Moreover, we also offer some insight into the effect of steering vector errors on the control of worst-case beampattern. The effectiveness of the proposed algorithm is verified by design examples, including robust synthesis of frequency-invariant and flat-top wideband beampatterns.
近年来,受自适应阵列理论(AAT)启发的蜂鸣器合成因其能够灵活、精确地控制蜂鸣器而备受关注。然而,现有的受自适应阵列理论启发的 Beampattern 合成方法通常假设一个理想的阵列模型,这在实践中并不现实,而且在存在转向矢量误差的情况下可能会导致性能严重下降。在本文中,我们提出了一种使用正则化 AAT 启发的加权最小二乘法(WLS)进行宽带阵列的稳健贝型合成方法,该方法可以在存在转向矢量误差的情况下精确控制最坏情况下的贝型,包括其主波纹和侧叶电平。我们提出了正则化 AAT 启发的 WLS 的正则化参数和加权函数的求解理论。我们提出了一种牛顿-拉夫逊方法来寻找正则化参数的解,并推导出了加权函数的闭式解。此外,我们还对转向矢量误差对最坏情况下贝叶斯控制的影响提出了一些见解。我们通过设计实例验证了所提算法的有效性,包括稳健合成频率不变和平顶宽带蜂鸣器。
{"title":"Robust Wideband Beampattern Synthesis With Precise Control of Worst-Case Beampattern","authors":"Congwei Feng;Huawei Chen","doi":"10.1109/TSP.2024.3457159","DOIUrl":"10.1109/TSP.2024.3457159","url":null,"abstract":"Beampattern synthesis inspired by adaptive array theory (AAT) has attracted much interest in recent years, thanks to its capability to flexibly and precisely control beampattern. However, the existing AAT-inspired beampattern synthesis approaches usually assume an ideal array model, which is not realistic in practice and may lead to severe performance degradation in the presence of steering vector errors. In this paper, we propose a robust beampattern synthesis approach for wideband arrays using regularized AAT-inspired weighted least squares (WLS), which can precisely control the worst-case beampattern, including both its mainlobe ripple and sidelobe level, in the presence of steering vector errors. We develop a theory on the solutions for the regularization parameter and weighting function of the regularized AAT-inspired WLS. We propose a Newton-Raphson method to find the solution for the regularization parameter, and derive closed-form solutions for the weighting function. Moreover, we also offer some insight into the effect of steering vector errors on the control of worst-case beampattern. The effectiveness of the proposed algorithm is verified by design examples, including robust synthesis of frequency-invariant and flat-top wideband beampatterns.","PeriodicalId":13330,"journal":{"name":"IEEE Transactions on Signal Processing","volume":"72 ","pages":"4573-4588"},"PeriodicalIF":4.6,"publicationDate":"2024-09-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142166021","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Principal Component Analysis in Space Forms 空间形式的主成分分析
IF 4.6 2区 工程技术 Q1 ENGINEERING, ELECTRICAL & ELECTRONIC Pub Date : 2024-09-10 DOI: 10.1109/TSP.2024.3457529
Puoya Tabaghi;Michael Khanzadeh;Yusu Wang;Siavash Mirarab
Principal Component Analysis (PCA) is a workhorse of modern data science. While PCA assumes the data conforms to Euclidean geometry, for specific data types, such as hierarchical and cyclic data structures, other spaces are more appropriate. We study PCA in space forms; that is, those with constant curvatures. At a point on a Riemannian manifold, we can define a Riemannian affine subspace based on a set of tangent vectors. Finding the optimal low-dimensional affine subspace for given points in a space form amounts to dimensionality reduction. Our Space Form PCA (SFPCA) seeks the affine subspace that best represents a set of manifold-valued points with the minimum projection cost. We propose proper cost functions that enjoy two properties: (1) their optimal affine subspace is the solution to an eigenequation, and (2) optimal affine subspaces of different dimensions form a nested set. These properties provide advances over existing methods, which are mostly iterative algorithms with slow convergence and weaker theoretical guarantees. We evaluate the proposed SFPCA on real and simulated data in spherical and hyperbolic spaces. We show that it outperforms alternative methods in estimating true subspaces (in simulated data) with respect to convergence speed or accuracy, often both.
主成分分析(PCA)是现代数据科学的主要工具。虽然 PCA 假设数据符合欧几里得几何学,但对于特定的数据类型,如分层和循环数据结构,其他空间更为合适。我们研究的是空间形式的 PCA,即具有恒定曲率的空间形式。在黎曼流形上的某一点,我们可以根据一组切向量定义一个黎曼仿射子空间。为空间形式中的给定点找到最佳低维仿射子空间相当于降维。我们的空间形式 PCA(Space Form PCA,SFPCA)寻求的是以最小投影成本最好地代表一组流形值点的仿射子空间。我们提出的适当成本函数具有两个特性:(1)其最优仿射子空间是一个特征方程的解,(2)不同维度的最优仿射子空间形成一个嵌套集。这些特性是现有方法的进步所在,现有方法大多是迭代算法,收敛速度慢,理论保证较弱。我们在球面空间和双曲空间的真实数据和模拟数据上对所提出的 SFPCA 进行了评估。结果表明,在估计真实子空间(模拟数据)方面,SFPCA 在收敛速度或准确性(通常两者兼而有之)方面优于其他方法。
{"title":"Principal Component Analysis in Space Forms","authors":"Puoya Tabaghi;Michael Khanzadeh;Yusu Wang;Siavash Mirarab","doi":"10.1109/TSP.2024.3457529","DOIUrl":"10.1109/TSP.2024.3457529","url":null,"abstract":"Principal Component Analysis (PCA) is a workhorse of modern data science. While PCA assumes the data conforms to Euclidean geometry, for specific data types, such as hierarchical and cyclic data structures, other spaces are more appropriate. We study PCA in space forms; that is, those with constant curvatures. At a point on a Riemannian manifold, we can define a Riemannian affine subspace based on a set of tangent vectors. Finding the optimal low-dimensional affine subspace for given points in a space form amounts to dimensionality reduction. Our Space Form PCA (SFPCA) seeks the affine subspace that best represents a set of manifold-valued points with the minimum projection cost. We propose proper cost functions that enjoy two properties: (1) their optimal affine subspace is the solution to an eigenequation, and (2) optimal affine subspaces of different dimensions form a nested set. These properties provide advances over existing methods, which are mostly iterative algorithms with slow convergence and weaker theoretical guarantees. We evaluate the proposed SFPCA on real and simulated data in spherical and hyperbolic spaces. We show that it outperforms alternative methods in estimating true subspaces (in simulated data) with respect to convergence speed or accuracy, often both.","PeriodicalId":13330,"journal":{"name":"IEEE Transactions on Signal Processing","volume":"72 ","pages":"4428-4443"},"PeriodicalIF":4.6,"publicationDate":"2024-09-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10670424","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142166477","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Modeling and State Estimation of Destination-Constrained Dynamic Systems. Part II: Uncertain Arrival Time 目的地受限动态系统的建模与状态估计。第二部分:不确定到达时间
IF 5.4 2区 工程技术 Q1 ENGINEERING, ELECTRICAL & ELECTRONIC Pub Date : 2024-09-05 DOI: 10.1109/tsp.2024.3454972
Linfeng Xu, X. Rong Li, Mahendra Mallick, Zhansheng Duan
{"title":"Modeling and State Estimation of Destination-Constrained Dynamic Systems. Part II: Uncertain Arrival Time","authors":"Linfeng Xu, X. Rong Li, Mahendra Mallick, Zhansheng Duan","doi":"10.1109/tsp.2024.3454972","DOIUrl":"https://doi.org/10.1109/tsp.2024.3454972","url":null,"abstract":"","PeriodicalId":13330,"journal":{"name":"IEEE Transactions on Signal Processing","volume":"42 1","pages":""},"PeriodicalIF":5.4,"publicationDate":"2024-09-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142142665","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Ordinary Differential Equation-Based MIMO Signal Detection 基于常微分方程的多输入多输出信号检测
IF 4.6 2区 工程技术 Q1 ENGINEERING, ELECTRICAL & ELECTRONIC Pub Date : 2024-09-05 DOI: 10.1109/TSP.2024.3454703
Ayano Nakai-Kasai;Tadashi Wadayama
The required signal processing rate in future wireless communication systems exceeds the performance of the latest electronics-based processors. Introduction of analog optical computation is one promising direction for energy-efficient processing. This paper considers a continuous-time minimum mean squared error detection for multiple-input multiple-output systems to realize signal detection using analog optical devices. The proposed method is formulated by an ordinary differential equation (ODE) and its performance at any continuous time can be theoretically analyzed. Deriving and analyzing the continuous-time system is a meaningful step to verifying the feasibility of analog-domain signal processing in the future systems. In addition, considering such an ODE brings byproducts to discrete-time detection algorithms, which can be a novel methodology of algorithm construction and analysis.
未来无线通信系统所需的信号处理速度超过了最新电子处理器的性能。引入模拟光计算是节能处理的一个有前途的方向。本文考虑了多输入多输出系统的连续时间最小均方误差检测,利用模拟光学设备实现信号检测。所提出的方法由一个常微分方程(ODE)构成,可以从理论上分析其在任何连续时间的性能。推导和分析连续时间系统是验证未来系统中模拟域信号处理可行性的重要一步。此外,考虑这种 ODE 还会给离散时间检测算法带来副产品,从而成为一种新的算法构建和分析方法。
{"title":"Ordinary Differential Equation-Based MIMO Signal Detection","authors":"Ayano Nakai-Kasai;Tadashi Wadayama","doi":"10.1109/TSP.2024.3454703","DOIUrl":"10.1109/TSP.2024.3454703","url":null,"abstract":"The required signal processing rate in future wireless communication systems exceeds the performance of the latest electronics-based processors. Introduction of analog optical computation is one promising direction for energy-efficient processing. This paper considers a continuous-time minimum mean squared error detection for multiple-input multiple-output systems to realize signal detection using analog optical devices. The proposed method is formulated by an ordinary differential equation (ODE) and its performance at any continuous time can be theoretically analyzed. Deriving and analyzing the continuous-time system is a meaningful step to verifying the feasibility of analog-domain signal processing in the future systems. In addition, considering such an ODE brings byproducts to discrete-time detection algorithms, which can be a novel methodology of algorithm construction and analysis.","PeriodicalId":13330,"journal":{"name":"IEEE Transactions on Signal Processing","volume":"72 ","pages":"4147-4162"},"PeriodicalIF":4.6,"publicationDate":"2024-09-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142142762","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Revisiting High-Order Tensor Singular Value Decomposition From Basic Element Perspective 从基本元素视角重温高阶张量奇异值分解
IF 4.6 2区 工程技术 Q1 ENGINEERING, ELECTRICAL & ELECTRONIC Pub Date : 2024-09-04 DOI: 10.1109/TSP.2024.3454115
Sheng Liu;Xi-Le Zhao;Jinsong Leng;Ben-Zheng Li;Jing-Hua Yang;Xinyu Chen
Recently, tensor singular value decomposition (t-SVD), based on the tensor-tensor product (t-product), has become a powerful tool for processing third-order tensor data. However, constrained by the fact that the basic element is the fiber (i.e., vector) in the t-product, higher-order tensor data (i.e., order $d>3$) are usually unfolded into third-order tensors to satisfy the classical t-product setting, which leads to the destroying of high-dimensional structure. By revisiting the basic element in the t-product, we suggest a generalized t-product called element-based tensor-tensor product (elt-product) as an alternative of the classic t-product, where the basic element is a $(d-2)$th-order tensor instead of a vector. The benefit of the elt-product is that it can better preserve high-dimensional structures and that it can explore more complex interactions via higher-order convolution instead of first-order convolution in classic t-product. Starting from the elt-product, we develop new tensor-SVD and low-rank tensor metrics (e.g., rank and nuclear norm). Equipped with the suggested metrics, we present a tensor completion model for high-order tensor data and prove the exact recovery guarantees. To harness the resulting nonconvex optimization problem, we apply an alternating direction method of the multiplier (ADMM) algorithm with a theoretical convergence guarantee. Extensive experimental results on the simulated and real-world data (color videos, light-field images, light-field videos, and traffic data) demonstrate the superiority of the proposed model against the state-of-the-art baseline models.
最近,基于张量-张量乘积(t-product)的张量奇异值分解(t-SVD)已成为处理三阶张量数据的强大工具。然而,受限于基本元素是 t-积中的纤维(即矢量)这一事实,高阶张量数据(即阶数 $d>3$)通常被展开成三阶张量以满足经典的 t-积设置,这导致了高维结构的破坏。通过重新审视 t-积中的基本元素,我们提出了一种称为基于元素的张量-张量积(elt-product)的广义 t-积,作为经典 t-积的替代品,其中的基本元素是 $(d-2)$th-order 张量而不是向量。elt-product的优点在于它能更好地保留高维结构,并能通过高阶卷积而不是经典t-product中的一阶卷积来探索更复杂的相互作用。从elt-product 开始,我们开发了新的张量-SVD 和低阶张量度量(如秩和核规范)。利用建议的度量,我们提出了高阶张量数据的张量完成模型,并证明了精确的恢复保证。为了解决由此产生的非凸优化问题,我们应用了一种具有理论收敛保证的交替乘法(ADMM)算法。在模拟和真实世界数据(彩色视频、光场图像、光场视频和交通数据)上的大量实验结果表明,与最先进的基线模型相比,所提出的模型更具优势。
{"title":"Revisiting High-Order Tensor Singular Value Decomposition From Basic Element Perspective","authors":"Sheng Liu;Xi-Le Zhao;Jinsong Leng;Ben-Zheng Li;Jing-Hua Yang;Xinyu Chen","doi":"10.1109/TSP.2024.3454115","DOIUrl":"10.1109/TSP.2024.3454115","url":null,"abstract":"Recently, tensor singular value decomposition (t-SVD), based on the tensor-tensor product (t-product), has become a powerful tool for processing third-order tensor data. However, constrained by the fact that the basic element is the fiber (i.e., vector) in the t-product, higher-order tensor data (i.e., order \u0000<inline-formula><tex-math>$d&gt;3$</tex-math></inline-formula>\u0000) are usually unfolded into third-order tensors to satisfy the classical t-product setting, which leads to the destroying of high-dimensional structure. By revisiting the basic element in the t-product, we suggest a generalized t-product called element-based tensor-tensor product (elt-product) as an alternative of the classic t-product, where the basic element is a \u0000<inline-formula><tex-math>$(d-2)$</tex-math></inline-formula>\u0000th-order tensor instead of a vector. The benefit of the elt-product is that it can better preserve high-dimensional structures and that it can explore more complex interactions via higher-order convolution instead of first-order convolution in classic t-product. Starting from the elt-product, we develop new tensor-SVD and low-rank tensor metrics (e.g., rank and nuclear norm). Equipped with the suggested metrics, we present a tensor completion model for high-order tensor data and prove the exact recovery guarantees. To harness the resulting nonconvex optimization problem, we apply an alternating direction method of the multiplier (ADMM) algorithm with a theoretical convergence guarantee. Extensive experimental results on the simulated and real-world data (color videos, light-field images, light-field videos, and traffic data) demonstrate the superiority of the proposed model against the state-of-the-art baseline models.","PeriodicalId":13330,"journal":{"name":"IEEE Transactions on Signal Processing","volume":"72 ","pages":"4589-4603"},"PeriodicalIF":4.6,"publicationDate":"2024-09-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142137969","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Convex Parameter Estimation of Perturbed Multivariate Generalized Gaussian Distributions 受扰动多变量广义高斯分布的凸参数估计
IF 4.6 2区 工程技术 Q1 ENGINEERING, ELECTRICAL & ELECTRONIC Pub Date : 2024-09-04 DOI: 10.1109/TSP.2024.3453509
Nora Ouzir;Frédéric Pascal;Jean-Christophe Pesquet
The multivariate generalized Gaussian distribution (MGGD), also known as the multivariate exponential power (MEP) distribution, is widely used in signal and image processing. However, estimating MGGD parameters, which is required in practical applications, still faces specific theoretical challenges. In particular, establishing convergence properties for the standard fixed-point approach when both the distribution mean and the scatter (or the precision) matrix are unknown is still an open problem. In robust estimation, imposing classical constraints on the precision matrix, such as sparsity, has been limited by the non-convexity of the resulting cost function. This paper tackles these issues from an optimization viewpoint by proposing a convex formulation with well-established convergence properties. We embed our analysis in a noisy scenario where robustness is induced by modelling multiplicative perturbations. The resulting framework is flexible as it combines a variety of regularizations for the precision matrix, the mean and model perturbations. This paper presents proof of the desired theoretical properties, specifies the conditions preserving these properties for different regularization choices and designs a general proximal primal-dual optimization strategy. The experiments show a more accurate precision and covariance matrix estimation with similar performance for the mean vector parameter compared to Tyler's $M$-estimator. In a high-dimensional setting, the proposed method outperforms the classical GLASSO, one of its robust extensions, and the regularized Tyler's estimator.
多元广义高斯分布(MGGD)又称多元指数幂(MEP)分布,在信号和图像处理中得到广泛应用。然而,实际应用中所需的 MGGD 参数估计仍面临特定的理论挑战。特别是,在分布均值和散点(或精度)矩阵都未知的情况下,建立标准定点方法的收敛特性仍是一个悬而未决的问题。在稳健估算中,对精度矩阵施加经典约束(如稀疏性)一直受限于由此产生的成本函数的非凸性。本文从优化的角度出发,提出了一种具有公认收敛特性的凸公式来解决这些问题。我们将分析嵌入到噪声场景中,通过模拟乘法扰动来实现鲁棒性。由此产生的框架非常灵活,因为它结合了精度矩阵、均值和模型扰动的各种正则化。本文证明了所需的理论特性,明确了在不同正则化选择下保持这些特性的条件,并设计了一种通用的近似原始二元优化策略。实验表明,与 Tyler 的 $M$-estimator 相比,平均向量参数的精度和协方差矩阵估计更为精确,性能相似。在高维环境下,所提出的方法优于经典的 GLASSO、其稳健扩展之一以及正则化泰勒估计器。
{"title":"Convex Parameter Estimation of Perturbed Multivariate Generalized Gaussian Distributions","authors":"Nora Ouzir;Frédéric Pascal;Jean-Christophe Pesquet","doi":"10.1109/TSP.2024.3453509","DOIUrl":"10.1109/TSP.2024.3453509","url":null,"abstract":"The multivariate generalized Gaussian distribution (MGGD), also known as the multivariate exponential power (MEP) distribution, is widely used in signal and image processing. However, estimating MGGD parameters, which is required in practical applications, still faces specific theoretical challenges. In particular, establishing convergence properties for the standard fixed-point approach when both the distribution mean and the scatter (or the precision) matrix are unknown is still an open problem. In robust estimation, imposing classical constraints on the precision matrix, such as sparsity, has been limited by the non-convexity of the resulting cost function. This paper tackles these issues from an optimization viewpoint by proposing a convex formulation with well-established convergence properties. We embed our analysis in a noisy scenario where robustness is induced by modelling multiplicative perturbations. The resulting framework is flexible as it combines a variety of regularizations for the precision matrix, the mean and model perturbations. This paper presents proof of the desired theoretical properties, specifies the conditions preserving these properties for different regularization choices and designs a general proximal primal-dual optimization strategy. The experiments show a more accurate precision and covariance matrix estimation with similar performance for the mean vector parameter compared to Tyler's \u0000<inline-formula><tex-math>$M$</tex-math></inline-formula>\u0000-estimator. In a high-dimensional setting, the proposed method outperforms the classical GLASSO, one of its robust extensions, and the regularized Tyler's estimator.","PeriodicalId":13330,"journal":{"name":"IEEE Transactions on Signal Processing","volume":"72 ","pages":"4132-4146"},"PeriodicalIF":4.6,"publicationDate":"2024-09-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142137942","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Cramér-Rao Bound for Signal Parameter Estimation From Modulo ADC Generated Data 根据模数转换器生成的数据进行信号参数估计的 Cramér-Rao 边界
IF 4.6 2区 工程技术 Q1 ENGINEERING, ELECTRICAL & ELECTRONIC Pub Date : 2024-09-03 DOI: 10.1109/TSP.2024.3453346
Yuanbo Cheng;Johan Karlsson;Jian Li
To mitigate the dynamic range problems that low-bit quantization of conventional analog-to-digital converters (ADCs) suffer from, we shift our attention to the novel modulo ADCs (Mod-ADCs). We consider the Cramér-Rao bound (CRB) analysis for signal parameter estimation from Mod-ADC generated data. Four CRB formulas are derived assuming known or unknown folding-counts, for both quantized and unquantized cases. We analyze many of their characteristics, such as monotonicity, boundedness and convergence; and perform detailed comparisons of the CRBs among the conventional ADCs and the two different types of Mod-ADCs. Numerical examples are presented to demonstrate these characteristics, and that the low-bit Mod-ADCs can provide satisfactory signal parameter estimation performances even in high dynamic range situations.
为了缓解传统模数转换器(ADC)低位量化带来的动态范围问题,我们将注意力转移到了新型模数转换器(Mod-ADC)上。我们考虑从 Mod-ADC 生成的数据中进行信号参数估计的克拉梅尔-拉奥约束 (CRB) 分析。假设已知或未知的折叠次数,针对量化和非量化情况,我们推导出了四个 CRB 公式。我们分析了它们的许多特性,如单调性、有界性和收敛性;并对传统 ADC 和两种不同类型的 Mod-ADC 的 CRB 进行了详细比较。通过数字示例证明了这些特性,以及低位 Mod-ADC 即使在高动态范围情况下也能提供令人满意的信号参数估计性能。
{"title":"Cramér-Rao Bound for Signal Parameter Estimation From Modulo ADC Generated Data","authors":"Yuanbo Cheng;Johan Karlsson;Jian Li","doi":"10.1109/TSP.2024.3453346","DOIUrl":"10.1109/TSP.2024.3453346","url":null,"abstract":"To mitigate the dynamic range problems that low-bit quantization of conventional analog-to-digital converters (ADCs) suffer from, we shift our attention to the novel modulo ADCs (Mod-ADCs). We consider the Cramér-Rao bound (CRB) analysis for signal parameter estimation from Mod-ADC generated data. Four CRB formulas are derived assuming known or unknown folding-counts, for both quantized and unquantized cases. We analyze many of their characteristics, such as monotonicity, boundedness and convergence; and perform detailed comparisons of the CRBs among the conventional ADCs and the two different types of Mod-ADCs. Numerical examples are presented to demonstrate these characteristics, and that the low-bit Mod-ADCs can provide satisfactory signal parameter estimation performances even in high dynamic range situations.","PeriodicalId":13330,"journal":{"name":"IEEE Transactions on Signal Processing","volume":"72 ","pages":"4268-4285"},"PeriodicalIF":4.6,"publicationDate":"2024-09-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142130618","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Real-Time Transfer Active Learning for Functional Regression and Prediction Based on Multi-Output Gaussian Process 基于多输出高斯过程的功能回归与预测的实时转移主动学习
IF 4.6 2区 工程技术 Q1 ENGINEERING, ELECTRICAL & ELECTRONIC Pub Date : 2024-09-02 DOI: 10.1109/TSP.2024.3451412
Zengchenghao Xia;Zhiyong Hu;Qingbo He;Chao Wang
Active learning provides guidance for the design and modeling of systems with highly expensive sampling costs. However, existing active learning approaches suffer from cold-start concerns, where the performance is impaired due to the initial few experiments designed by active learning. In this paper, we propose using transfer learning to solve the cold-start problem of functional regression by leveraging knowledge from related and data-rich signals to achieve robust and superior performance, especially when only a few experiments are available in the signal of interest. More specifically, we construct a multi-output Gaussian process (MGP) to model the between-signal functional relationship. This MGP features unique innovations that distinguish the proposed transfer active learning from existing works: i) a specially designed covariance structure is proposed for characterizing within-and between-signal inter-relationships and facilitating interpretable transfer learning, and ii) an iterative Bayesian framework is proposed to update the parameters and prediction of the MGP in real-time, which significantly reduces the computational load and facilitates the iterative active learning. The inter-relationship captured by this novel MGP is then fed into active learning using the integrated mean-squared error (IMSE) as the objective. We provide theoretical justifications for this active learning mechanism, which demonstrates the objective (IMSE) is monotonically decreasing as we gather more data from the proposed transfer active learning. The real-time updating and the monotonically decreasing objective together provide both practical efficiency and theoretical guarantees for solving the cold-start concern in active learning. The proposed method is compared with benchmark methods through various numerical and real case studies, and the results demonstrate the superiority of the method, especially when limited experiments are available at the initial stage of design.
主动学习为具有高昂采样成本的系统的设计和建模提供了指导。然而,现有的主动学习方法存在冷启动问题,即由于主动学习设计的初始实验较少,导致性能受损。在本文中,我们提出利用迁移学习来解决函数回归的冷启动问题,方法是利用来自相关和数据丰富信号的知识来实现稳健而卓越的性能,尤其是在相关信号只有少量实验可用的情况下。更具体地说,我们构建了一个多输出高斯过程(MGP)来模拟信号间的函数关系。这种多输出高斯过程具有独特的创新之处,使所提出的转移主动学习有别于现有的工作:i) 提出了一种专门设计的协方差结构,用于描述信号内部和信号之间的相互关系,并促进可解释的转移学习;ii) 提出了一种迭代贝叶斯框架,用于实时更新多输出高斯过程的参数和预测,这大大减少了计算负荷,促进了迭代主动学习。然后,以综合均方误差(IMSE)为目标,将这种新型 MGP 所捕捉到的相互关系反馈到主动学习中。我们为这种主动学习机制提供了理论依据,证明随着我们从提议的转移主动学习中收集到更多数据,目标(IMSE)会单调递减。实时更新和单调递减目标共同为解决主动学习中的冷启动问题提供了实际效率和理论保证。通过各种数值研究和实际案例研究,将所提出的方法与基准方法进行了比较,结果证明了该方法的优越性,尤其是在设计初期实验有限的情况下。
{"title":"Real-Time Transfer Active Learning for Functional Regression and Prediction Based on Multi-Output Gaussian Process","authors":"Zengchenghao Xia;Zhiyong Hu;Qingbo He;Chao Wang","doi":"10.1109/TSP.2024.3451412","DOIUrl":"10.1109/TSP.2024.3451412","url":null,"abstract":"Active learning provides guidance for the design and modeling of systems with highly expensive sampling costs. However, existing active learning approaches suffer from cold-start concerns, where the performance is impaired due to the initial few experiments designed by active learning. In this paper, we propose using transfer learning to solve the cold-start problem of functional regression by leveraging knowledge from related and data-rich signals to achieve robust and superior performance, especially when only a few experiments are available in the signal of interest. More specifically, we construct a multi-output Gaussian process (MGP) to model the between-signal functional relationship. This MGP features unique innovations that distinguish the proposed transfer active learning from existing works: i) a specially designed covariance structure is proposed for characterizing within-and between-signal inter-relationships and facilitating interpretable transfer learning, and ii) an iterative Bayesian framework is proposed to update the parameters and prediction of the MGP in real-time, which significantly reduces the computational load and facilitates the iterative active learning. The inter-relationship captured by this novel MGP is then fed into active learning using the integrated mean-squared error (IMSE) as the objective. We provide theoretical justifications for this active learning mechanism, which demonstrates the objective (IMSE) is monotonically decreasing as we gather more data from the proposed transfer active learning. The real-time updating and the monotonically decreasing objective together provide both practical efficiency and theoretical guarantees for solving the cold-start concern in active learning. The proposed method is compared with benchmark methods through various numerical and real case studies, and the results demonstrate the superiority of the method, especially when limited experiments are available at the initial stage of design.","PeriodicalId":13330,"journal":{"name":"IEEE Transactions on Signal Processing","volume":"72 ","pages":"4163-4177"},"PeriodicalIF":4.6,"publicationDate":"2024-09-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142123822","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Robust and Unambiguous Four-Channel Monopulse Two-Target Resolution: A Polarimetric Closed-Form Approach 稳健、明确的四通道单脉冲双目标分辨率:极坐标闭式方法
IF 4.6 2区 工程技术 Q1 ENGINEERING, ELECTRICAL & ELECTRONIC Pub Date : 2024-09-02 DOI: 10.1109/TSP.2024.3452239
Yibin Liu;Shengbin Luo Wang;Guoqing Wu;Ping Wang;Yongzhen Li
Four-channel monopulse (FCM) technique is integral to contemporary radar systems for pinpointing and tracking multiple targets. However, the practical utility of FCM is significantly hindered by the issue of estimation failure, which arises from the specific relative phases and positions of the targets. In this paper, we introduce a polarimetric four-channel monopulse (PFCM) approach designed to deliver efficient, robust, and unambiguous resolution of two targets. Generally, PFCM adaptively modulates the null-polarization for each target. We begin by dissecting the limitations of the traditional method, utilizing the closed-form solution of FCM. Subsequently, we devise a novel closed-form solution that harnesses polarimetric adaptive nulling (PAN) technology to estimate the angles of the two targets under two distinct scenarios: the ideal condition and angular ambiguity. Under ideal conditions, estimation is conducted directly using the received signals. Incorporating polarization information mitigates the estimation results’ sensitivity to relative phase. To counteract the challenges of PAN failure in angular ambiguity situations, the proposed PFCM adeptly resolves the two targets by reconstructing the four-channel signal, indicating its applicability across various relative target positions. Furthermore, we present a comprehensive performance analysis focusing on three critical aspects. As a result, two closely spaced targets can be resolved robustly and unambiguously with minimal complexity. Numerical simulations and experimental results are substantiated to validate the effectiveness of the proposed method.
四通道单脉冲(FCM)技术是当代雷达系统精确定位和跟踪多个目标不可或缺的技术。然而,由于目标的特定相对相位和位置造成的估计失败问题,极大地阻碍了 FCM 的实际应用。在本文中,我们介绍了一种偏振四通道单脉冲(PFCM)方法,旨在高效、稳健、准确地分辨两个目标。一般来说,PFCM 可自适应地调节每个目标的空极化。我们首先利用 FCM 的闭式解剖析了传统方法的局限性。随后,我们设计了一种新型闭式解决方案,利用偏振自适应归零(PAN)技术在两种不同情况下估计两个目标的角度:理想情况和角度模糊情况。在理想条件下,估算直接使用接收到的信号。加入极化信息可减轻估计结果对相对相位的敏感性。为了应对角度模糊情况下 PAN 失效所带来的挑战,所提出的 PFCM 通过重建四通道信号巧妙地分辨出两个目标,这表明它适用于各种相对目标位置。此外,我们还针对三个关键方面进行了全面的性能分析。其结果是,两个间隔很近的目标能以最低的复杂度被稳健、明确地分辨出来。数值模拟和实验结果证实了所提方法的有效性。
{"title":"Robust and Unambiguous Four-Channel Monopulse Two-Target Resolution: A Polarimetric Closed-Form Approach","authors":"Yibin Liu;Shengbin Luo Wang;Guoqing Wu;Ping Wang;Yongzhen Li","doi":"10.1109/TSP.2024.3452239","DOIUrl":"10.1109/TSP.2024.3452239","url":null,"abstract":"Four-channel monopulse (FCM) technique is integral to contemporary radar systems for pinpointing and tracking multiple targets. However, the practical utility of FCM is significantly hindered by the issue of estimation failure, which arises from the specific relative phases and positions of the targets. In this paper, we introduce a polarimetric four-channel monopulse (PFCM) approach designed to deliver efficient, robust, and unambiguous resolution of two targets. Generally, PFCM adaptively modulates the null-polarization for each target. We begin by dissecting the limitations of the traditional method, utilizing the closed-form solution of FCM. Subsequently, we devise a novel closed-form solution that harnesses polarimetric adaptive nulling (PAN) technology to estimate the angles of the two targets under two distinct scenarios: the ideal condition and angular ambiguity. Under ideal conditions, estimation is conducted directly using the received signals. Incorporating polarization information mitigates the estimation results’ sensitivity to relative phase. To counteract the challenges of PAN failure in angular ambiguity situations, the proposed PFCM adeptly resolves the two targets by reconstructing the four-channel signal, indicating its applicability across various relative target positions. Furthermore, we present a comprehensive performance analysis focusing on three critical aspects. As a result, two closely spaced targets can be resolved robustly and unambiguously with minimal complexity. Numerical simulations and experimental results are substantiated to validate the effectiveness of the proposed method.","PeriodicalId":13330,"journal":{"name":"IEEE Transactions on Signal Processing","volume":"72 ","pages":"4222-4236"},"PeriodicalIF":4.6,"publicationDate":"2024-09-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142123823","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
STSyn: Speeding Up Local SGD With Straggler-Tolerant Synchronization STSyn:利用容错同步加速本地 SGD
IF 4.6 2区 工程技术 Q1 ENGINEERING, ELECTRICAL & ELECTRONIC Pub Date : 2024-08-30 DOI: 10.1109/TSP.2024.3452035
Feng Zhu;Jingjing Zhang;Xin Wang
Synchronous local stochastic gradient descent (local SGD) suffers from some workers being idle and random delays due to slow and straggling workers, as it waits for the workers to complete the same amount of local updates. To address this issue, a novel local SGD strategy called STSyn is proposed in this paper. The key point is to wait for the $K$ fastest workers while keeping all the workers computing continually at each synchronization round, and making full use of any effective (completed) local update of each worker regardless of stragglers. To evaluate the performance of STSyn, an analysis of the average wall-clock time, average number of local updates, and average number of uploading workers per round is provided. The convergence of STSyn is also rigorously established even when the objective function is nonconvex for both homogeneous and heterogeneous data distributions. Experimental results highlight the superiority of STSyn over state-of-the-art schemes, thanks to its straggler-tolerant technique and the inclusion of additional effective local updates at each worker. Furthermore, the impact of system parameters is investigated. By waiting for faster workers and allowing heterogeneous synchronization with different numbers of local updates across workers, STSyn provides substantial improvements both in time and communication efficiency.
同步局部随机梯度下降(local SGD)由于需要等待工作者完成相同数量的局部更新,因此会出现部分工作者闲置以及缓慢和滞后工作者造成的随机延迟。为解决这一问题,本文提出了一种名为 STSyn 的新型局部 SGD 策略。其关键在于等待速度最快的 $K$ 工作者,同时保持所有工作者在每一轮同步中持续计算,并充分利用每个工作者的任何有效(已完成)本地更新,而不考虑拖后腿的工作者。为了评估 STSyn 的性能,我们对每轮的平均挂钟时间、平均本地更新次数和平均上传工作者数量进行了分析。此外,还严格确定了 STSyn 的收敛性,即使目标函数对同质和异质数据分布都是非凸的。实验结果凸显了 STSyn 相对于最先进方案的优越性,这要归功于它的流浪者容忍技术以及在每个 Worker 中包含的额外有效局部更新。此外,还研究了系统参数的影响。通过等待速度更快的 Worker 并允许异构同步不同数量的局部更新,STSyn 在时间和通信效率方面都有了显著提高。
{"title":"STSyn: Speeding Up Local SGD With Straggler-Tolerant Synchronization","authors":"Feng Zhu;Jingjing Zhang;Xin Wang","doi":"10.1109/TSP.2024.3452035","DOIUrl":"10.1109/TSP.2024.3452035","url":null,"abstract":"Synchronous local stochastic gradient descent (local SGD) suffers from some workers being idle and random delays due to slow and straggling workers, as it waits for the workers to complete the same amount of local updates. To address this issue, a novel local SGD strategy called STSyn is proposed in this paper. The key point is to wait for the \u0000<inline-formula><tex-math>$K$</tex-math></inline-formula>\u0000 fastest workers while keeping all the workers computing continually at each synchronization round, and making full use of any effective (completed) local update of each worker regardless of stragglers. To evaluate the performance of STSyn, an analysis of the average wall-clock time, average number of local updates, and average number of uploading workers per round is provided. The convergence of STSyn is also rigorously established even when the objective function is nonconvex for both homogeneous and heterogeneous data distributions. Experimental results highlight the superiority of STSyn over state-of-the-art schemes, thanks to its straggler-tolerant technique and the inclusion of additional effective local updates at each worker. Furthermore, the impact of system parameters is investigated. By waiting for faster workers and allowing heterogeneous synchronization with different numbers of local updates across workers, STSyn provides substantial improvements both in time and communication efficiency.","PeriodicalId":13330,"journal":{"name":"IEEE Transactions on Signal Processing","volume":"72 ","pages":"4050-4064"},"PeriodicalIF":4.6,"publicationDate":"2024-08-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142101233","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
IEEE Transactions on Signal Processing
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1