首页 > 最新文献

2017 IEEE 7th International Workshop on Computational Advances in Multi-Sensor Adaptive Processing (CAMSAP)最新文献

英文 中文
Recurrent generative adversarial neural networks for compressive imaging 用于压缩成像的循环生成对抗神经网络
M. Mardani, E. Gong, Joseph Y. Cheng, J. Pauly, L. Xing
Recovering images from highly undersampled measurements has a wide range of applications across imaging sciences. State-of-the-art analytics however are not aware of the image perceptual quality, and demand iterative algorithms that incur significant computational overhead. To sidestep these hurdles, this paper brings forth a novel compressive imaging framework using deep neural networks that approximates a low-dimensional manifold of images using generative adversarial networks. To ensure the images are consistent with the measurements a recurrent GAN (RGAN) architecture is deployed that consists of multiple alternative blocks of generator networks and affine projection, which is then followed by a discriminator network to score the perceptual quality of the generated images. A deep residual network with skip connections is used for the generator, while the discriminator is a multilayer perceptron. Experiments performed with real-world contrast enhanced MRI data corroborate the diagnostic quality of the retrieved images relative to state-of-the-art CS schemes. In addition, it achieves about two-orders of magnitude faster reconstruction.
从高度欠采样测量中恢复图像在成像科学中具有广泛的应用。然而,最先进的分析并没有意识到图像的感知质量,并且需要迭代算法,这导致了大量的计算开销。为了避开这些障碍,本文提出了一种新的压缩成像框架,该框架使用深度神经网络近似使用生成对抗网络的低维图像流形。为了确保图像与测量结果一致,部署了一个循环GAN (RGAN)架构,该架构由多个可选的生成器网络和仿射投影块组成,然后由鉴别器网络对生成图像的感知质量进行评分。发生器采用带跳跃连接的深度残差网络,鉴别器采用多层感知器。用真实世界对比增强MRI数据进行的实验证实了相对于最先进的CS方案检索图像的诊断质量。此外,它实现了大约两个数量级的重建速度。
{"title":"Recurrent generative adversarial neural networks for compressive imaging","authors":"M. Mardani, E. Gong, Joseph Y. Cheng, J. Pauly, L. Xing","doi":"10.1109/CAMSAP.2017.8313209","DOIUrl":"https://doi.org/10.1109/CAMSAP.2017.8313209","url":null,"abstract":"Recovering images from highly undersampled measurements has a wide range of applications across imaging sciences. State-of-the-art analytics however are not aware of the image perceptual quality, and demand iterative algorithms that incur significant computational overhead. To sidestep these hurdles, this paper brings forth a novel compressive imaging framework using deep neural networks that approximates a low-dimensional manifold of images using generative adversarial networks. To ensure the images are consistent with the measurements a recurrent GAN (RGAN) architecture is deployed that consists of multiple alternative blocks of generator networks and affine projection, which is then followed by a discriminator network to score the perceptual quality of the generated images. A deep residual network with skip connections is used for the generator, while the discriminator is a multilayer perceptron. Experiments performed with real-world contrast enhanced MRI data corroborate the diagnostic quality of the retrieved images relative to state-of-the-art CS schemes. In addition, it achieves about two-orders of magnitude faster reconstruction.","PeriodicalId":315977,"journal":{"name":"2017 IEEE 7th International Workshop on Computational Advances in Multi-Sensor Adaptive Processing (CAMSAP)","volume":"13 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2017-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124939960","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 11
A constrained formulation for compressive spectral image reconstruction using linear mixture models 基于线性混合模型的压缩光谱图像重构约束公式
Jorge Bacca, Héctor Vargas, H. Arguello
Recent hyperspectral imaging systems are constructed on the idea of compressive sensing for efficient acquisition. However, the traditional reconstruction model in compressive hyperspectral imaging has a high computational complexity. In this work, compressive hyperspectral imaging and unmixing are combined for hyperspectral reconstruction in a low-complexity scheme. The compressed hyperspectral measurements are acquired with a single pixel spectrometer. The reconstruction model is represented in a space of lower dimension named linear mixture model. Hyperspectral reconstruction is then formulated as a nonnegative matrix factorization problem with respect to the endmembers and abundances, bypassing high-complexity tasks involving the hyperspectral data cube itself. The nonnegative matrix factorization problem is solved by combining an alternating least-squares based estimation strategy with the alternating direction method of multipliers. The estimated performance of the proposed scheme is illustrated in experiments conducted on a simulated acquisition in real data outperforming in 3dB the state-of-the-art reconstruction algorithms.
最近的高光谱成像系统是基于压缩感知的思想构建的,以实现高效的采集。然而,传统的压缩高光谱成像重建模型计算复杂度较高。在这项工作中,压缩高光谱成像和解混相结合,以低复杂度的方案进行高光谱重建。压缩高光谱测量是用单像元光谱仪获得的。重构模型在低维空间中表示为线性混合模型。然后将高光谱重建制定为关于端元和丰度的非负矩阵分解问题,绕过涉及高光谱数据立方体本身的高复杂性任务。将基于交替最小二乘的估计策略与乘子交替方向法相结合,解决了非负矩阵分解问题。在真实数据的模拟采集中进行的实验表明,该方案的估计性能优于最先进的3dB重建算法。
{"title":"A constrained formulation for compressive spectral image reconstruction using linear mixture models","authors":"Jorge Bacca, Héctor Vargas, H. Arguello","doi":"10.1109/CAMSAP.2017.8313122","DOIUrl":"https://doi.org/10.1109/CAMSAP.2017.8313122","url":null,"abstract":"Recent hyperspectral imaging systems are constructed on the idea of compressive sensing for efficient acquisition. However, the traditional reconstruction model in compressive hyperspectral imaging has a high computational complexity. In this work, compressive hyperspectral imaging and unmixing are combined for hyperspectral reconstruction in a low-complexity scheme. The compressed hyperspectral measurements are acquired with a single pixel spectrometer. The reconstruction model is represented in a space of lower dimension named linear mixture model. Hyperspectral reconstruction is then formulated as a nonnegative matrix factorization problem with respect to the endmembers and abundances, bypassing high-complexity tasks involving the hyperspectral data cube itself. The nonnegative matrix factorization problem is solved by combining an alternating least-squares based estimation strategy with the alternating direction method of multipliers. The estimated performance of the proposed scheme is illustrated in experiments conducted on a simulated acquisition in real data outperforming in 3dB the state-of-the-art reconstruction algorithms.","PeriodicalId":315977,"journal":{"name":"2017 IEEE 7th International Workshop on Computational Advances in Multi-Sensor Adaptive Processing (CAMSAP)","volume":"12 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2017-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114283716","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 6
On canonical polyadic decomposition of overcomplete tensors of arbitrary even order 任意偶阶过完备张量的正则多进分解
A. Koochakzadeh, P. Pal
Decomposition of tensors into summation of rank one components, known as Canonical Polyadic (CP) decomposition, has long been studied in the literature. Although the CP-rank of tensors can far exceed their dimensions (in which case they are called overcomplete tensors), there are only a handful of algorithms which consider CP-decomposition of such overcomplete tensors, and most of the CP-decomposition algorithms proposed in literature deal with simpler cases where the rank is of the same order as the dimensions of the tensor. In this paper, we consider symmetric tensors of arbitrary even order whose eigenvalues are assumed to be positive. We show that for a 2dth order tensor with dimension N, under some mild conditions, the problem of CP-decomposition is equivalent to solving a system of quadratic equations, even when the rank is as large as O(Nd). We will develop two different algorithms (one convex, and one nonconvex) to solve this system of quadratic equations. Our simulations show that successful recovery of eigenvectors is possible even if the rank is much larger than the dimension of the tensor.1
将张量分解为秩一分量的和,称为正则多进分解(CP),在文献中已经被研究了很长时间。尽管张量的CP-rank可以远远超过它们的维数(在这种情况下,它们被称为过完备张量),但只有少数算法考虑过完备张量的cp -分解,并且文献中提出的大多数cp -分解算法处理的是秩与张量维数相同阶的更简单的情况。本文考虑任意偶阶对称张量,其特征值假定为正。我们证明了对于一个维数为N的二阶张量,在一些温和的条件下,cp -分解问题等价于求解一个二次方程系统,即使当阶为O(Nd)时也是如此。我们将开发两种不同的算法(一种是凸的,另一种是非凸的)来解决这个二次方程系统。我们的模拟表明,即使秩比张量的维数大得多,特征向量的成功恢复也是可能的
{"title":"On canonical polyadic decomposition of overcomplete tensors of arbitrary even order","authors":"A. Koochakzadeh, P. Pal","doi":"10.1109/CAMSAP.2017.8313191","DOIUrl":"https://doi.org/10.1109/CAMSAP.2017.8313191","url":null,"abstract":"Decomposition of tensors into summation of rank one components, known as Canonical Polyadic (CP) decomposition, has long been studied in the literature. Although the CP-rank of tensors can far exceed their dimensions (in which case they are called overcomplete tensors), there are only a handful of algorithms which consider CP-decomposition of such overcomplete tensors, and most of the CP-decomposition algorithms proposed in literature deal with simpler cases where the rank is of the same order as the dimensions of the tensor. In this paper, we consider symmetric tensors of arbitrary even order whose eigenvalues are assumed to be positive. We show that for a 2dth order tensor with dimension N, under some mild conditions, the problem of CP-decomposition is equivalent to solving a system of quadratic equations, even when the rank is as large as O(Nd). We will develop two different algorithms (one convex, and one nonconvex) to solve this system of quadratic equations. Our simulations show that successful recovery of eigenvectors is possible even if the rank is much larger than the dimension of the tensor.1","PeriodicalId":315977,"journal":{"name":"2017 IEEE 7th International Workshop on Computational Advances in Multi-Sensor Adaptive Processing (CAMSAP)","volume":"19 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2017-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131496883","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 5
Block term decomposition with rank estimation using group sparsity 利用群稀疏性进行秩估计的块项分解
Xu Han, L. Albera, A. Kachenoura, H. Shu, L. Senhadji
In this paper, we propose a new rank-(L, L, 1) Block Term Decomposition (BTD) method. Contrarily to classical techniques, the proposed method estimates also the number of terms and the rank-(L, L, 1) of each term from an overestimated initialization of them. This is achieved by using Group Sparsity of the Loading (GSL) matrices. Numerical experiments with noisy tensors show the good behavior of GSL-BTD and its robustness with respect to the presence of noise in comparison with classical methods. Experiments on epileptic signals confirm its efficiency in practical contexts.
本文提出了一种新的秩-(L, L, 1)块项分解(BTD)方法。与经典技术相反,该方法还估计了项的数量和每个项的秩-(L, L, 1)。这是通过使用加载(GSL)矩阵的群稀疏性实现的。带噪声张量的数值实验表明,与经典方法相比,GSL-BTD具有良好的性能和对噪声存在的鲁棒性。对癫痫信号的实验证实了其在实际环境中的有效性。
{"title":"Block term decomposition with rank estimation using group sparsity","authors":"Xu Han, L. Albera, A. Kachenoura, H. Shu, L. Senhadji","doi":"10.1109/CAMSAP.2017.8313206","DOIUrl":"https://doi.org/10.1109/CAMSAP.2017.8313206","url":null,"abstract":"In this paper, we propose a new rank-(L, L, 1) Block Term Decomposition (BTD) method. Contrarily to classical techniques, the proposed method estimates also the number of terms and the rank-(L, L, 1) of each term from an overestimated initialization of them. This is achieved by using Group Sparsity of the Loading (GSL) matrices. Numerical experiments with noisy tensors show the good behavior of GSL-BTD and its robustness with respect to the presence of noise in comparison with classical methods. Experiments on epileptic signals confirm its efficiency in practical contexts.","PeriodicalId":315977,"journal":{"name":"2017 IEEE 7th International Workshop on Computational Advances in Multi-Sensor Adaptive Processing (CAMSAP)","volume":"24 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2017-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127805112","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 8
Simultaneous target state and sensor bias estimation: Is more better? 同时目标状态和传感器偏差估计:越多越好?
M. Kowalski, P. Willett
This paper provides an analysis of several scenarios of target tracking state estimation when additionally estimating the biases of the measuring sensors in the state. Line of Sight (LOS) sensors are used with noisy data and angle biases that are unknown to the estimator. The addition of new state components can potentially be a drawback to the estimator and this is addressed by comparing the accuracy of estimation with 2, 3, and 4 sensors. Of particular interest to us is whether “more” is worth it: More sensors? Is bias estimation even worth doing? The answers are a qualified “yes” and a definite “sometimes.”.
本文分析了在附加估计状态下测量传感器偏差的情况下目标跟踪状态估计的几种情况。视距(LOS)传感器用于估计器未知的噪声数据和角度偏差。新状态组件的添加可能是估计器的一个潜在缺点,通过比较2、3和4传感器的估计精度来解决这个问题。我们特别感兴趣的是“更多”是否值得:更多的传感器?偏差估计值得做吗?答案是一个限定的“是”和一个确定的“有时”。
{"title":"Simultaneous target state and sensor bias estimation: Is more better?","authors":"M. Kowalski, P. Willett","doi":"10.1109/CAMSAP.2017.8313183","DOIUrl":"https://doi.org/10.1109/CAMSAP.2017.8313183","url":null,"abstract":"This paper provides an analysis of several scenarios of target tracking state estimation when additionally estimating the biases of the measuring sensors in the state. Line of Sight (LOS) sensors are used with noisy data and angle biases that are unknown to the estimator. The addition of new state components can potentially be a drawback to the estimator and this is addressed by comparing the accuracy of estimation with 2, 3, and 4 sensors. Of particular interest to us is whether “more” is worth it: More sensors? Is bias estimation even worth doing? The answers are a qualified “yes” and a definite “sometimes.”.","PeriodicalId":315977,"journal":{"name":"2017 IEEE 7th International Workshop on Computational Advances in Multi-Sensor Adaptive Processing (CAMSAP)","volume":"11 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2017-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128094044","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Wideband channel tracking for mmWave MIMO system with hybrid beamforming architecture: (Invited Paper) 基于混合波束形成结构的毫米波MIMO系统宽带信道跟踪研究(特邀论文)
Han Yan, S. Chaudhari, D. Cabric
Millimeter-wave (mmWave) systems require a large number of antennas at both base station (BS) and user equipment (UE) for a desirable link budget. Due to time varying channel under UE mobility, up-to-date channel state information (CSI) is important to obtain the beamforming gain. The overhead cost of frequent channel estimation becomes a bottleneck to achieve high throughput. In this paper, we propose the first mmWave frequency selective channel tracking technique for hybrid analog and digital beamforming architecture. During tracking, this technique exploits mmWave channel sparsity and uses only one training symbol to update the CSI. Our simulation study utilizes a dynamic channel simulator that builds on top of recently proposed geometric stochastic approach from mmMAGIC project at 28 GHz. Assuming 10m/s moving speed and 200 deg/s rotation speed at UE, the proposed algorithm maintains the 80% of the spectral efficiency as compared to static environment over a time window of 100 ms. The proposed tracking algorithm reduces the overhead by 3 times as compared to existing channel estimation technique.
毫米波(mmWave)系统需要在基站(BS)和用户设备(UE)上安装大量天线,以获得理想的链路预算。由于终端可迁移性下的信道时变,最新的信道状态信息(CSI)对波束形成增益的获取至关重要。频繁信道估计的开销成本成为实现高吞吐量的瓶颈。在本文中,我们提出了第一种毫米波频率选择信道跟踪技术,用于混合模拟和数字波束形成架构。在跟踪过程中,该技术利用毫米波信道稀疏性,仅使用一个训练符号来更新CSI。我们的仿真研究利用了一个动态信道模拟器,该模拟器建立在mmMAGIC项目最近提出的28 GHz几何随机方法之上。假设移动速度为10m/s,旋转速度为200°/s,该算法在100 ms的时间窗内保持了与静态环境相比80%的频谱效率。与现有的信道估计技术相比,所提出的跟踪算法的开销减少了3倍。
{"title":"Wideband channel tracking for mmWave MIMO system with hybrid beamforming architecture: (Invited Paper)","authors":"Han Yan, S. Chaudhari, D. Cabric","doi":"10.1109/CAMSAP.2017.8313185","DOIUrl":"https://doi.org/10.1109/CAMSAP.2017.8313185","url":null,"abstract":"Millimeter-wave (mmWave) systems require a large number of antennas at both base station (BS) and user equipment (UE) for a desirable link budget. Due to time varying channel under UE mobility, up-to-date channel state information (CSI) is important to obtain the beamforming gain. The overhead cost of frequent channel estimation becomes a bottleneck to achieve high throughput. In this paper, we propose the first mmWave frequency selective channel tracking technique for hybrid analog and digital beamforming architecture. During tracking, this technique exploits mmWave channel sparsity and uses only one training symbol to update the CSI. Our simulation study utilizes a dynamic channel simulator that builds on top of recently proposed geometric stochastic approach from mmMAGIC project at 28 GHz. Assuming 10m/s moving speed and 200 deg/s rotation speed at UE, the proposed algorithm maintains the 80% of the spectral efficiency as compared to static environment over a time window of 100 ms. The proposed tracking algorithm reduces the overhead by 3 times as compared to existing channel estimation technique.","PeriodicalId":315977,"journal":{"name":"2017 IEEE 7th International Workshop on Computational Advances in Multi-Sensor Adaptive Processing (CAMSAP)","volume":"105 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2017-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"134630196","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 11
A compressive sensing-maximum likelihood approach for off-grid wideband channel estimation at mmWave 毫米波离网宽带信道估计的压缩感知-最大似然方法
Javier Rodríguez-Fernández, N. G. Prelcic, R. Heath
Obtaining accurate channel state information is crucial to configure the antenna arrays and the digital precoders and combiners in hybrid millimeter wave (mmWave) MIMO architectures. Most of prior work on channel estimation with hybrid MIMO architectures relies on the use of finite-resolution dictionaries to estimate angles of arrival (AoA) and angles of departure (AoD). When the AoAs or AoDs do not fall within the quantization grids used to generate these dictionaries, there is an unavoidable grid error in the estimation of the channel. In this paper, we propose a mixed compressed sensing-maximum likelihood algorithm that uses continuous dictionaries to estimate the channel. The quantization error due to using finite resolution dictionaries can be neglected with this approach, enhancing estimation performance without resorting to very large dictionaries. Simulation results show how the new algorithm outperforms approaches based on finite resolution dictionaries previously proposed for the estimation of mmWave channels.
在混合毫米波(mmWave) MIMO架构中,获取准确的信道状态信息对于配置天线阵列和数字预编码器和组合器至关重要。先前的混合MIMO信道估计工作大多依赖于使用有限分辨率字典来估计到达角(AoA)和出发角(AoD)。当aoa或aod不属于用于生成这些字典的量化网格时,在信道估计中不可避免地存在网格误差。本文提出了一种使用连续字典估计信道的混合压缩感知-最大似然算法。使用这种方法可以忽略由于使用有限分辨率字典而导致的量化误差,从而提高了估计性能,而无需使用非常大的字典。仿真结果表明,新算法优于先前提出的基于有限分辨率字典的毫米波信道估计方法。
{"title":"A compressive sensing-maximum likelihood approach for off-grid wideband channel estimation at mmWave","authors":"Javier Rodríguez-Fernández, N. G. Prelcic, R. Heath","doi":"10.1109/CAMSAP.2017.8313157","DOIUrl":"https://doi.org/10.1109/CAMSAP.2017.8313157","url":null,"abstract":"Obtaining accurate channel state information is crucial to configure the antenna arrays and the digital precoders and combiners in hybrid millimeter wave (mmWave) MIMO architectures. Most of prior work on channel estimation with hybrid MIMO architectures relies on the use of finite-resolution dictionaries to estimate angles of arrival (AoA) and angles of departure (AoD). When the AoAs or AoDs do not fall within the quantization grids used to generate these dictionaries, there is an unavoidable grid error in the estimation of the channel. In this paper, we propose a mixed compressed sensing-maximum likelihood algorithm that uses continuous dictionaries to estimate the channel. The quantization error due to using finite resolution dictionaries can be neglected with this approach, enhancing estimation performance without resorting to very large dictionaries. Simulation results show how the new algorithm outperforms approaches based on finite resolution dictionaries previously proposed for the estimation of mmWave channels.","PeriodicalId":315977,"journal":{"name":"2017 IEEE 7th International Workshop on Computational Advances in Multi-Sensor Adaptive Processing (CAMSAP)","volume":"447 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2017-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116230388","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 15
Nonlinear system identification: Finding structure in nonlinear black-box models 非线性系统辨识:在非线性黑箱模型中寻找结构
P. Dreesen, K. Tiels, Mariya Ishteva, J. Schoukens
The use of black-box models is wide-spread in signal processing and system identification applications. However, often such models possess a large number of parameters, and obfuscate their inner workings, as there are cross-connections between all inputs and all outputs (and possibly all internal states) of the model. Although black-box models have proven their success and wide applicability, there is a need to shed a light on what goes on inside the model. We have developed a tensor-based method that aims at pinpointing the nonlinearities of a given nonlinear model into a small number of univariate nonlinear mappings, with the advantageous side-effect of reducing the parametric complexity. In this contribution we will discuss how the method is conceived, and how it can be applied to the task of finding structure in blackbox models. We have found that the tensor-based decoupling method is able to reconstruct up to high accuracy a given blackbox nonlinear model, while reducing the parametric complexity and revealing some of the inner operation of the model. Due to their universal use, we will focus the presentation on the use of nonlinear state-space models, but the method is also suitable for other model structures. We validate the method on a case study in nonlinear system identification.
黑盒模型在信号处理和系统识别应用中得到了广泛的应用。然而,这样的模型通常拥有大量的参数,并且混淆了它们的内部工作,因为在模型的所有输入和所有输出(可能还有所有内部状态)之间存在交叉连接。尽管黑盒模型已经证明了它们的成功和广泛的适用性,但仍有必要阐明模型内部发生了什么。我们开发了一种基于张量的方法,旨在将给定非线性模型的非线性精确定位为少量的单变量非线性映射,具有降低参数复杂性的有利副作用。在本文中,我们将讨论该方法是如何构思的,以及如何将其应用于在黑箱模型中寻找结构的任务。我们发现,基于张量的解耦方法能够以较高的精度重建给定的黑盒非线性模型,同时降低了参数复杂性并揭示了模型的一些内部操作。由于它们的普遍使用,我们将重点介绍非线性状态空间模型的使用,但该方法也适用于其他模型结构。通过一个非线性系统辨识的实例验证了该方法的有效性。
{"title":"Nonlinear system identification: Finding structure in nonlinear black-box models","authors":"P. Dreesen, K. Tiels, Mariya Ishteva, J. Schoukens","doi":"10.1109/CAMSAP.2017.8313214","DOIUrl":"https://doi.org/10.1109/CAMSAP.2017.8313214","url":null,"abstract":"The use of black-box models is wide-spread in signal processing and system identification applications. However, often such models possess a large number of parameters, and obfuscate their inner workings, as there are cross-connections between all inputs and all outputs (and possibly all internal states) of the model. Although black-box models have proven their success and wide applicability, there is a need to shed a light on what goes on inside the model. We have developed a tensor-based method that aims at pinpointing the nonlinearities of a given nonlinear model into a small number of univariate nonlinear mappings, with the advantageous side-effect of reducing the parametric complexity. In this contribution we will discuss how the method is conceived, and how it can be applied to the task of finding structure in blackbox models. We have found that the tensor-based decoupling method is able to reconstruct up to high accuracy a given blackbox nonlinear model, while reducing the parametric complexity and revealing some of the inner operation of the model. Due to their universal use, we will focus the presentation on the use of nonlinear state-space models, but the method is also suitable for other model structures. We validate the method on a case study in nonlinear system identification.","PeriodicalId":315977,"journal":{"name":"2017 IEEE 7th International Workshop on Computational Advances in Multi-Sensor Adaptive Processing (CAMSAP)","volume":"24 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2017-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122602034","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Joint MEG-EEG signal decomposition using the coupled SECSI framework: Validation on a controlled experiment 基于耦合SECSI框架的脑电-脑电信号联合分解:对照实验验证
Kristina Naskovska, S. Lau, Amr Aboughazala, M. Haardt, J. Haueisen
Simultaneously recorded magnetoencephalography (MEG) and electroencephalography (EEG) signals can benefit from a joint analysis based on coupled Canonical Polyadic (CP) tensor decompositions. The coupled CP decomposition jointly decomposes tensors that have at least one factor matrix in common. The Coupled — Semi-Algebraic framework for approximate CP decomposition via SImultaneous matrix diagonalization framework (C-SECSI) efficiently estimates the factor matrices with adjustable complexity-accuracy trade-offs. Our objective is to decompose simultaneously recorded MEG and EEG signals above intact skull and above two conducting skull defects using C-SECSI in order to determine how such a tissue anomaly of the head is reflected in the tensor rank. The source of the MEG and EEG signals is a miniaturized electric dipole that is implanted into a rabbit's brain. The dipole is shifted along a line under the skull defects, and measurements are taken at regularly spaced points. The coupled SECSI analysis is conducted for MEG and EEG measurement series and ranks 1–3. This coupled decomposition produces meaningful components representing the three characteristic signal topographies for source positions under defect 1 and the positions on either side of defect 1. The rank estimation with respect to the complexity-accuracy trade-off of rank 3 reflects the three characteristic cases well and matches the dimensions spanned by the data set. The intact skull MEG signals show a higher complexity (rank 3) than the corresponding EEG signals (rank 1). The C-SECSI framework is a very promising method for blind signal separation in multidimensional data with coupled modalities, such as simultaneous MEG-EEG.
同时记录的脑磁图(MEG)和脑电图(EEG)信号可以受益于基于耦合正则多进(CP)张量分解的联合分析。耦合CP分解联合分解至少有一个共同因子矩阵的张量。基于同步矩阵对角化框架(C-SECSI)的近似CP分解的耦合半代数框架有效地估计了具有可调复杂性和精度权衡的因子矩阵。我们的目标是使用C-SECSI对完整颅骨和两个导电颅骨缺损上方同时记录的MEG和EEG信号进行分解,以确定头部的这种组织异常是如何在张量秩中反映出来的。MEG和EEG信号的来源是一个微型的电偶极子,它被植入兔子的大脑。偶极子沿着颅骨缺陷下的一条线移动,并在规则间隔的点上进行测量。对MEG和EEG测量序列进行耦合SECSI分析,排名1-3。这种耦合分解产生有意义的分量,表示缺陷1下的源位置和缺陷1两侧的位置的三个特征信号拓扑。秩估计对秩3的复杂度-精度权衡很好地反映了这三种特征情况,并且与数据集所跨越的维度相匹配。完整颅骨MEG信号的复杂度(rank 3)高于相应的EEG信号(rank 1)。C-SECSI框架是一种非常有前途的方法,用于同时进行MEG-EEG等耦合模式的多维数据的盲信号分离。
{"title":"Joint MEG-EEG signal decomposition using the coupled SECSI framework: Validation on a controlled experiment","authors":"Kristina Naskovska, S. Lau, Amr Aboughazala, M. Haardt, J. Haueisen","doi":"10.1109/CAMSAP.2017.8313193","DOIUrl":"https://doi.org/10.1109/CAMSAP.2017.8313193","url":null,"abstract":"Simultaneously recorded magnetoencephalography (MEG) and electroencephalography (EEG) signals can benefit from a joint analysis based on coupled Canonical Polyadic (CP) tensor decompositions. The coupled CP decomposition jointly decomposes tensors that have at least one factor matrix in common. The Coupled — Semi-Algebraic framework for approximate CP decomposition via SImultaneous matrix diagonalization framework (C-SECSI) efficiently estimates the factor matrices with adjustable complexity-accuracy trade-offs. Our objective is to decompose simultaneously recorded MEG and EEG signals above intact skull and above two conducting skull defects using C-SECSI in order to determine how such a tissue anomaly of the head is reflected in the tensor rank. The source of the MEG and EEG signals is a miniaturized electric dipole that is implanted into a rabbit's brain. The dipole is shifted along a line under the skull defects, and measurements are taken at regularly spaced points. The coupled SECSI analysis is conducted for MEG and EEG measurement series and ranks 1–3. This coupled decomposition produces meaningful components representing the three characteristic signal topographies for source positions under defect 1 and the positions on either side of defect 1. The rank estimation with respect to the complexity-accuracy trade-off of rank 3 reflects the three characteristic cases well and matches the dimensions spanned by the data set. The intact skull MEG signals show a higher complexity (rank 3) than the corresponding EEG signals (rank 1). The C-SECSI framework is a very promising method for blind signal separation in multidimensional data with coupled modalities, such as simultaneous MEG-EEG.","PeriodicalId":315977,"journal":{"name":"2017 IEEE 7th International Workshop on Computational Advances in Multi-Sensor Adaptive Processing (CAMSAP)","volume":"5 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2017-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123989074","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 6
Under-Determined tensor diagonalization for decomposition of difficult tensors 难张量分解的欠定张量对角化
P. Tichavský, A. Phan, A. Cichocki
Analysis of multidimensional arrays, usually called tensors, often becomes difficult in cases when the tensor rank (a minimum number of rank-one components) exceeds all the tensor dimensions. Traditional methods of canonical polyadic decomposition of such tensors, namely the alternating least squares, can be used, but a presence of a large number of false local minima can make the problem hard. Usually, multiple random initializations are advised in such cases, but the question is how many such random initializations are sufficient to get a good chance of finding the right solution. It appears that the number of the initializations can be very large. We propose a novel approach to the problem. The given tensor is augmented by some unknown parameters to the shape that admits ordinary tensor diagonalization, i.e., transforming the augmented tensor into an exact or nearly diagonal form through multiplying the tensor by non-orthogonal invertible matrices. Three possible constraints are proposed to make the optimization problem well defined. The method can be modified for an under-determined block-term decomposition.
当张量的秩(秩一分量的最小数量)超过所有张量维数时,通常称为张量的多维数组的分析变得困难。这种张量的经典多进分解的传统方法,即交替最小二乘,可以使用,但存在大量的假局部极小值会使问题变得困难。通常,在这种情况下,建议进行多个随机初始化,但问题是,有多少这样的随机初始化才足够有机会找到正确的解决方案。看起来初始化的数量可能非常大。我们提出了一种解决这个问题的新方法。给定张量通过一些未知参数增广到允许普通张量对角化的形状,即通过将张量乘以非正交可逆矩阵将增广张量转换为精确或近对角形式。提出了三种可能的约束条件,使优化问题得到很好的定义。该方法可以对不确定的块项分解进行修改。
{"title":"Under-Determined tensor diagonalization for decomposition of difficult tensors","authors":"P. Tichavský, A. Phan, A. Cichocki","doi":"10.1109/CAMSAP.2017.8313082","DOIUrl":"https://doi.org/10.1109/CAMSAP.2017.8313082","url":null,"abstract":"Analysis of multidimensional arrays, usually called tensors, often becomes difficult in cases when the tensor rank (a minimum number of rank-one components) exceeds all the tensor dimensions. Traditional methods of canonical polyadic decomposition of such tensors, namely the alternating least squares, can be used, but a presence of a large number of false local minima can make the problem hard. Usually, multiple random initializations are advised in such cases, but the question is how many such random initializations are sufficient to get a good chance of finding the right solution. It appears that the number of the initializations can be very large. We propose a novel approach to the problem. The given tensor is augmented by some unknown parameters to the shape that admits ordinary tensor diagonalization, i.e., transforming the augmented tensor into an exact or nearly diagonal form through multiplying the tensor by non-orthogonal invertible matrices. Three possible constraints are proposed to make the optimization problem well defined. The method can be modified for an under-determined block-term decomposition.","PeriodicalId":315977,"journal":{"name":"2017 IEEE 7th International Workshop on Computational Advances in Multi-Sensor Adaptive Processing (CAMSAP)","volume":"43 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2017-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126192850","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
2017 IEEE 7th International Workshop on Computational Advances in Multi-Sensor Adaptive Processing (CAMSAP)
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1