首页 > 最新文献

2017 IEEE 27th International Workshop on Machine Learning for Signal Processing (MLSP)最新文献

英文 中文
Progressive clustering of manifold-modeled data based on tangent space variations 基于切空间变化的流形模型数据的渐进聚类
G. Gokdogan, Elif Vural
An important research topic of the recent years has been to understand and analyze manifold-modeled data for clustering and classification applications. Most clustering methods developed for data of non-linear and low-dimensional structure are based on local linearity assumptions. However, clustering algorithms based on locally linear representations can tolerate difficult sampling conditions only to some extent, and may fail for scarcely sampled data manifolds or at high-curvature regions. In this paper, we consider a setting where each cluster is concentrated around a manifold and propose a manifold clustering algorithm that relies on the observation that the variation of the tangent space must be consistent along curves over the same data manifold. In order to achieve robustness against challenges due to noise, manifold intersections, and high curvature, we propose a progressive clustering approach: Observing the variation of the tangent space, we first detect the non-problematic manifold regions and form pre-clusters with the data samples belonging to such reliable regions. Next, these pre-clusters are merged together to form larger clusters with respect to constraints on both the distance and the tangent space variations. Finally, the samples identified as problematic are also assigned to the computed clusters to finalize the clustering. Experiments with synthetic and real datasets show that the proposed method outperforms the manifold clustering algorithms in comparison based on Euclidean distance and sparse representations.
近年来一个重要的研究课题是理解和分析用于聚类和分类应用的流形模型数据。大多数针对非线性和低维结构数据的聚类方法都是基于局部线性假设。然而,基于局部线性表示的聚类算法只能在一定程度上容忍困难的采样条件,并且可能在很少采样的数据流形或高曲率区域失败。在本文中,我们考虑了一种设置,其中每个簇都集中在流形周围,并提出了一种流形聚类算法,该算法依赖于在相同数据流形上切线空间的变化必须沿着曲线一致的观察。为了实现对噪声、流形相交和高曲率挑战的鲁棒性,我们提出了一种渐进式聚类方法:观察切空间的变化,我们首先检测无问题的流形区域,并与属于这些可靠区域的数据样本形成预聚类。接下来,根据距离和切空间变化的约束,将这些预聚类合并在一起,形成更大的聚类。最后,识别出有问题的样本也被分配到计算的聚类中,以完成聚类。在合成数据集和真实数据集上的实验表明,该方法在基于欧几里得距离和稀疏表示的流形聚类算法的比较中优于流形聚类算法。
{"title":"Progressive clustering of manifold-modeled data based on tangent space variations","authors":"G. Gokdogan, Elif Vural","doi":"10.1109/MLSP.2017.8168182","DOIUrl":"https://doi.org/10.1109/MLSP.2017.8168182","url":null,"abstract":"An important research topic of the recent years has been to understand and analyze manifold-modeled data for clustering and classification applications. Most clustering methods developed for data of non-linear and low-dimensional structure are based on local linearity assumptions. However, clustering algorithms based on locally linear representations can tolerate difficult sampling conditions only to some extent, and may fail for scarcely sampled data manifolds or at high-curvature regions. In this paper, we consider a setting where each cluster is concentrated around a manifold and propose a manifold clustering algorithm that relies on the observation that the variation of the tangent space must be consistent along curves over the same data manifold. In order to achieve robustness against challenges due to noise, manifold intersections, and high curvature, we propose a progressive clustering approach: Observing the variation of the tangent space, we first detect the non-problematic manifold regions and form pre-clusters with the data samples belonging to such reliable regions. Next, these pre-clusters are merged together to form larger clusters with respect to constraints on both the distance and the tangent space variations. Finally, the samples identified as problematic are also assigned to the computed clusters to finalize the clustering. Experiments with synthetic and real datasets show that the proposed method outperforms the manifold clustering algorithms in comparison based on Euclidean distance and sparse representations.","PeriodicalId":6542,"journal":{"name":"2017 IEEE 27th International Workshop on Machine Learning for Signal Processing (MLSP)","volume":"10 1","pages":"1-6"},"PeriodicalIF":0.0,"publicationDate":"2017-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"82643937","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Machine learning regression based on particle bernstein polynomials for nonlinear system identification 基于粒子bernstein多项式的非线性系统辨识机器学习回归
G. Biagetti, P. Crippa, L. Falaschetti, C. Turchetti
Polynomials have shown to be useful basis functions in the identification of nonlinear systems. However estimation of the unknown coefficients requires expensive algorithms, as for instance it occurs by applying an optimal least square approach. Bernstein polynomials have the property that the coefficients are the values of the function to be approximated at points in a fixed grid, thus avoiding a time-consuming training stage. This paper presents a novel machine learning approach to regression, based on new functions named particle-Bernstein polynomials, which is particularly suitable to solve multivariate regression problems. Several experimental results show the validity of the technique for the identification of nonlinear systems and the better performance achieved with respect to the standard techniques.
在非线性系统辨识中,多项式已被证明是有用的基函数。然而,未知系数的估计需要昂贵的算法,例如,它通过应用最优最小二乘方法来实现。Bernstein多项式的系数是待逼近函数在固定网格点上的值,从而避免了耗时的训练阶段。本文提出了一种新的机器学习回归方法,该方法基于粒子伯恩斯坦多项式的新函数,特别适合于解决多元回归问题。实验结果表明,该方法对非线性系统的辨识是有效的,并且与标准方法相比具有更好的辨识性能。
{"title":"Machine learning regression based on particle bernstein polynomials for nonlinear system identification","authors":"G. Biagetti, P. Crippa, L. Falaschetti, C. Turchetti","doi":"10.1109/MLSP.2017.8168148","DOIUrl":"https://doi.org/10.1109/MLSP.2017.8168148","url":null,"abstract":"Polynomials have shown to be useful basis functions in the identification of nonlinear systems. However estimation of the unknown coefficients requires expensive algorithms, as for instance it occurs by applying an optimal least square approach. Bernstein polynomials have the property that the coefficients are the values of the function to be approximated at points in a fixed grid, thus avoiding a time-consuming training stage. This paper presents a novel machine learning approach to regression, based on new functions named particle-Bernstein polynomials, which is particularly suitable to solve multivariate regression problems. Several experimental results show the validity of the technique for the identification of nonlinear systems and the better performance achieved with respect to the standard techniques.","PeriodicalId":6542,"journal":{"name":"2017 IEEE 27th International Workshop on Machine Learning for Signal Processing (MLSP)","volume":"30 1","pages":"1-6"},"PeriodicalIF":0.0,"publicationDate":"2017-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"84088314","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 7
Joint separation and denoising of noisy multi-talker speech using recurrent neural networks and permutation invariant training 基于循环神经网络和置换不变量训练的多话语音联合分离与去噪
Morten Kolbæk, Dong Yu, Z. Tan, J. Jensen
In this paper we propose to use utterance-level Permutation Invariant Training (uPIT) for speaker independent multi-talker speech separation and denoising, simultaneously. Specifically, we train deep bi-directional Long Short-Term Memory (LSTM) Recurrent Neural Networks (RNNs) using uPIT, for single-channel speaker independent multi-talker speech separation in multiple noisy conditions, including both synthetic and real-life noise signals. We focus our experiments on generalizability and noise robustness of models that rely on various types of a priori knowledge e.g. in terms of noise type and number of simultaneous speakers. We show that deep bi-directional LSTM RNNs trained using uPIT in noisy environments can improve the Signal-to-Distortion Ratio (SDR) as well as the Extended Short-Time Objective Intelligibility (ESTOI) measure, on the speaker independent multi-talker speech separation and denoising task, for various noise types and Signal-to-Noise Ratios (SNRs). Specifically, we first show that LSTM RNNs can achieve large SDR and ESTOI improvements, when evaluated using known noise types, and that a single model is capable of handling multiple noise types with only a slight decrease in performance. Furthermore, we show that a single LSTM RNN can handle both two-speaker and three-speaker noisy mixtures, without a priori knowledge about the exact number of speakers. Finally, we show that LSTM RNNs trained using uPIT generalize well to noise types not seen during training.
在本文中,我们提出使用话语级排列不变性训练(uPIT)同时进行独立于说话人的多说话人语音分离和去噪。具体来说,我们使用uPIT训练深度双向长短期记忆(LSTM)递归神经网络(rnn),用于在多种噪声条件下(包括合成和现实噪声信号)进行单通道独立于扬声器的多讲话者语音分离。我们将实验重点放在依赖于各种类型的先验知识的模型的泛化性和噪声鲁棒性上,例如在噪声类型和同时说话者的数量方面。研究表明,在噪声环境中使用uPIT训练的深度双向LSTM rnn可以在不同噪声类型和信噪比(SNRs)下独立于说话者的多说话者语音分离和去噪任务上提高信失真比(SDR)和扩展短时客观可解度(ESTOI)度量。具体来说,我们首先表明,当使用已知的噪声类型进行评估时,LSTM rnn可以实现很大的SDR和ESTOI改进,并且单个模型能够处理多种噪声类型,而性能仅略有下降。此外,我们证明了单个LSTM RNN可以处理双扬声器和三扬声器的噪声混合,而无需先验地知道扬声器的确切数量。最后,我们证明了使用uPIT训练的LSTM rnn可以很好地泛化到训练过程中未见的噪声类型。
{"title":"Joint separation and denoising of noisy multi-talker speech using recurrent neural networks and permutation invariant training","authors":"Morten Kolbæk, Dong Yu, Z. Tan, J. Jensen","doi":"10.1109/MLSP.2017.8168152","DOIUrl":"https://doi.org/10.1109/MLSP.2017.8168152","url":null,"abstract":"In this paper we propose to use utterance-level Permutation Invariant Training (uPIT) for speaker independent multi-talker speech separation and denoising, simultaneously. Specifically, we train deep bi-directional Long Short-Term Memory (LSTM) Recurrent Neural Networks (RNNs) using uPIT, for single-channel speaker independent multi-talker speech separation in multiple noisy conditions, including both synthetic and real-life noise signals. We focus our experiments on generalizability and noise robustness of models that rely on various types of a priori knowledge e.g. in terms of noise type and number of simultaneous speakers. We show that deep bi-directional LSTM RNNs trained using uPIT in noisy environments can improve the Signal-to-Distortion Ratio (SDR) as well as the Extended Short-Time Objective Intelligibility (ESTOI) measure, on the speaker independent multi-talker speech separation and denoising task, for various noise types and Signal-to-Noise Ratios (SNRs). Specifically, we first show that LSTM RNNs can achieve large SDR and ESTOI improvements, when evaluated using known noise types, and that a single model is capable of handling multiple noise types with only a slight decrease in performance. Furthermore, we show that a single LSTM RNN can handle both two-speaker and three-speaker noisy mixtures, without a priori knowledge about the exact number of speakers. Finally, we show that LSTM RNNs trained using uPIT generalize well to noise types not seen during training.","PeriodicalId":6542,"journal":{"name":"2017 IEEE 27th International Workshop on Machine Learning for Signal Processing (MLSP)","volume":"89 1","pages":"1-6"},"PeriodicalIF":0.0,"publicationDate":"2017-08-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"89021542","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 20
Adversarial nets with perceptual losses for text-to-image synthesis 具有感知损失的文本到图像合成对抗网络
Miriam Cha, Youngjune Gwon, H. T. Kung
Recent approaches in generative adversarial networks (GANs) can automatically synthesize realistic images from descriptive text. Despite the overall fair quality, the generated images often expose visible flaws that lack structural definition for an object of interest. In this paper, we aim to extend state of the art for GAN-based text-to-image synthesis by improving perceptual quality of generated images. Differentiated from previous work, our synthetic image generator optimizes on perceptual loss functions that measure pixel, feature activation, and texture differences against a natural image. We present visually more compelling synthetic images of birds and flowers generated from text descriptions in comparison to some of the most prominent existing work.
生成对抗网络(GANs)的最新方法可以自动从描述性文本合成逼真的图像。尽管总体质量尚可,但生成的图像经常暴露出明显的缺陷,缺乏对感兴趣对象的结构定义。在本文中,我们的目标是通过提高生成图像的感知质量来扩展基于gan的文本到图像合成的最新技术。与之前的工作不同,我们的合成图像生成器优化了感知损失函数,该函数测量自然图像的像素、特征激活和纹理差异。与一些最突出的现有工作相比,我们展示了从文本描述生成的鸟类和花卉的视觉上更引人注目的合成图像。
{"title":"Adversarial nets with perceptual losses for text-to-image synthesis","authors":"Miriam Cha, Youngjune Gwon, H. T. Kung","doi":"10.1109/MLSP.2017.8168140","DOIUrl":"https://doi.org/10.1109/MLSP.2017.8168140","url":null,"abstract":"Recent approaches in generative adversarial networks (GANs) can automatically synthesize realistic images from descriptive text. Despite the overall fair quality, the generated images often expose visible flaws that lack structural definition for an object of interest. In this paper, we aim to extend state of the art for GAN-based text-to-image synthesis by improving perceptual quality of generated images. Differentiated from previous work, our synthetic image generator optimizes on perceptual loss functions that measure pixel, feature activation, and texture differences against a natural image. We present visually more compelling synthetic images of birds and flowers generated from text descriptions in comparison to some of the most prominent existing work.","PeriodicalId":6542,"journal":{"name":"2017 IEEE 27th International Workshop on Machine Learning for Signal Processing (MLSP)","volume":"86 1","pages":"1-6"},"PeriodicalIF":0.0,"publicationDate":"2017-08-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"84008200","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 34
Scatternet hybrid deep learning (SHDL) network for object classification
Amarjot Singh, N. Kingsbury
The paper proposes the ScatterNet Hybrid Deep Learning (SHDL) network that extracts invariant and discriminative image representations for object recognition. SHDL framework is constructed with a multi-layer ScatterNet front-end, an unsupervised learning middle, and a supervised learning back-end module. Each layer of the SHDL network is automatically designed as an explicit optimization problem leading to an optimal deep learning architecture with improved computational performance as compared to the more usual deep network architectures. SHDL network produces the state-of-the-art classification performance against unsupervised and semi-supervised learning (GANs) on two image datasets. Advantages of the SHDL network over supervised methods (NIN, VGG) are also demonstrated with experiments performed on training datasets of reduced size.
提出了一种用于目标识别的离散网络混合深度学习(SHDL)网络。SHDL框架由多层ScatterNet前端、无监督学习中间和监督学习后端模块构成。SHDL网络的每一层都被自动设计为一个显式优化问题,导致与更常见的深度网络架构相比,具有更高计算性能的最佳深度学习架构。SHDL网络在两个图像数据集上针对无监督和半监督学习(gan)产生了最先进的分类性能。SHDL网络相对于监督方法(NIN, VGG)的优势也通过在缩减的训练数据集上进行的实验得到了证明。
{"title":"Scatternet hybrid deep learning (SHDL) network for object classification","authors":"Amarjot Singh, N. Kingsbury","doi":"10.1109/MLSP.2017.8168141","DOIUrl":"https://doi.org/10.1109/MLSP.2017.8168141","url":null,"abstract":"The paper proposes the ScatterNet Hybrid Deep Learning (SHDL) network that extracts invariant and discriminative image representations for object recognition. SHDL framework is constructed with a multi-layer ScatterNet front-end, an unsupervised learning middle, and a supervised learning back-end module. Each layer of the SHDL network is automatically designed as an explicit optimization problem leading to an optimal deep learning architecture with improved computational performance as compared to the more usual deep network architectures. SHDL network produces the state-of-the-art classification performance against unsupervised and semi-supervised learning (GANs) on two image datasets. Advantages of the SHDL network over supervised methods (NIN, VGG) are also demonstrated with experiments performed on training datasets of reduced size.","PeriodicalId":6542,"journal":{"name":"2017 IEEE 27th International Workshop on Machine Learning for Signal Processing (MLSP)","volume":"47 1","pages":"1-6"},"PeriodicalIF":0.0,"publicationDate":"2017-08-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"73327774","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 20
Independent low-rank matrix analysis based on complex student's t-distribution for blind audio source separation 基于复学生t分布的独立低秩矩阵分析盲音频源分离
Shinichi Mogami, Daichi Kitamura, Yoshiki Mitsui, Norihiro Takamune, H. Saruwatari, Nobutaka Ono
In this paper, we generalize a source generative model in a state-of-the-art blind source separation (BSS), independent low-rank matrix analysis (ILRMA). ILRMA is a unified method of frequency-domain independent component analysis and nonnegative matrix factorization and can provide better performance for audio BSS tasks. To further improve the performance and stability of the separation, we introduce an isotropic complex Student's t-distribution as a source generative model, which includes the isotropic complex Gaussian distribution used in conventional ILRMA. Experiments are conducted using both music and speech BSS tasks, and the results show the validity of the proposed method.
在本文中,我们推广了最先进的盲源分离(BSS),独立低秩矩阵分析(ILRMA)中的源生成模型。ILRMA是一种统一的频域独立分量分析和非负矩阵分解方法,可以为音频BSS任务提供更好的性能。为了进一步提高分离的性能和稳定性,我们引入了一个各向同性复Student's t分布作为源生成模型,其中包括传统ILRMA中使用的各向同性复高斯分布。用音乐和语音两种BSS任务进行了实验,结果表明了该方法的有效性。
{"title":"Independent low-rank matrix analysis based on complex student's t-distribution for blind audio source separation","authors":"Shinichi Mogami, Daichi Kitamura, Yoshiki Mitsui, Norihiro Takamune, H. Saruwatari, Nobutaka Ono","doi":"10.1109/MLSP.2017.8168129","DOIUrl":"https://doi.org/10.1109/MLSP.2017.8168129","url":null,"abstract":"In this paper, we generalize a source generative model in a state-of-the-art blind source separation (BSS), independent low-rank matrix analysis (ILRMA). ILRMA is a unified method of frequency-domain independent component analysis and nonnegative matrix factorization and can provide better performance for audio BSS tasks. To further improve the performance and stability of the separation, we introduce an isotropic complex Student's t-distribution as a source generative model, which includes the isotropic complex Gaussian distribution used in conventional ILRMA. Experiments are conducted using both music and speech BSS tasks, and the results show the validity of the proposed method.","PeriodicalId":6542,"journal":{"name":"2017 IEEE 27th International Workshop on Machine Learning for Signal Processing (MLSP)","volume":"132 1","pages":"1-6"},"PeriodicalIF":0.0,"publicationDate":"2017-08-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"73012085","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 22
Limiting the reconstruction capability of generative neural network using negative learning 利用负学习限制生成神经网络的重构能力
Asim Munawar, Phongtharin Vinayavekhin, Giovanni De Magistris
Generative models are widely used for unsupervised learning with various applications, including data compression and signal restoration. Training methods for such systems focus on the generality of the network given limited amount of training data. A less researched type of techniques concerns generation of only a single type of input. This is useful for applications such as constraint handling, noise reduction and anomaly detection. In this paper we present a technique to limit the generative capability of the network using negative learning. The proposed method searches the solution in the gradient direction for the desired input and in the opposite direction for the undesired input. One of the application can be anomaly detection where the undesired inputs are the anomalous data. We demonstrate the features of the algorithm using MNIST handwritten digit dataset and latter apply the technique to a real-world obstacle detection problem. The results clearly show that the proposed learning technique can significantly improve the performance for anomaly detection.
生成模型被广泛用于无监督学习的各种应用,包括数据压缩和信号恢复。这种系统的训练方法侧重于给定有限数量的训练数据的网络的通用性。一种研究较少的技术类型只涉及生成单一类型的输入。这对于约束处理、降噪和异常检测等应用非常有用。在本文中,我们提出了一种利用负学习来限制网络生成能力的技术。该方法对期望输入沿梯度方向搜索解,对不期望输入沿梯度方向搜索解。其中一个应用程序可以是异常检测,其中不需要的输入是异常数据。我们使用MNIST手写数字数据集演示了该算法的特征,然后将该技术应用于现实世界的障碍物检测问题。结果清楚地表明,所提出的学习技术可以显著提高异常检测的性能。
{"title":"Limiting the reconstruction capability of generative neural network using negative learning","authors":"Asim Munawar, Phongtharin Vinayavekhin, Giovanni De Magistris","doi":"10.1109/MLSP.2017.8168155","DOIUrl":"https://doi.org/10.1109/MLSP.2017.8168155","url":null,"abstract":"Generative models are widely used for unsupervised learning with various applications, including data compression and signal restoration. Training methods for such systems focus on the generality of the network given limited amount of training data. A less researched type of techniques concerns generation of only a single type of input. This is useful for applications such as constraint handling, noise reduction and anomaly detection. In this paper we present a technique to limit the generative capability of the network using negative learning. The proposed method searches the solution in the gradient direction for the desired input and in the opposite direction for the undesired input. One of the application can be anomaly detection where the undesired inputs are the anomalous data. We demonstrate the features of the algorithm using MNIST handwritten digit dataset and latter apply the technique to a real-world obstacle detection problem. The results clearly show that the proposed learning technique can significantly improve the performance for anomaly detection.","PeriodicalId":6542,"journal":{"name":"2017 IEEE 27th International Workshop on Machine Learning for Signal Processing (MLSP)","volume":"6 1","pages":"1-6"},"PeriodicalIF":0.0,"publicationDate":"2017-08-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"81168438","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 41
Learning approximate neural estimators for wireless channel state information 学习无线信道状态信息的近似神经估计器
Tim O'Shea, Kiran Karra, T. Clancy
Estimation is a critical component of synchronization in wireless and signal processing systems. There is a rich body of work on estimator derivation, optimization, and statistical characterization from analytic system models which are used pervasively today. We explore an alternative approach to building estimators which relies principally on approximate regression using large datasets and large computationally efficient artificial neural network models capable of learning non-linear function mappings which provide compact and accurate estimates. For single carrier PSK modulation, we explore the accuracy and computational complexity of such estimators compared with the current gold-standard analytically derived alternatives. We compare performance in various wireless operating conditions and consider the trade offs between the two different classes of systems. Our results show the learned estimators can provide improvements in areas such as short-time estimation and estimation under non-trivial real world channel conditions such as fading or other non-linear hardware or propagation effects.
在无线和信号处理系统中,估计是同步的关键组成部分。有大量的工作是关于估计量的推导、优化和分析系统模型的统计特征,这些模型在今天被广泛使用。我们探索了一种构建估计器的替代方法,该方法主要依赖于使用大型数据集和大型计算效率高的人工神经网络模型的近似回归,这些模型能够学习非线性函数映射,从而提供紧凑和准确的估计。对于单载波PSK调制,我们探讨了这种估计器的精度和计算复杂性与目前的金标准分析推导的替代方案。我们比较了各种无线操作条件下的性能,并考虑了两种不同类型系统之间的权衡。我们的研究结果表明,学习估计器可以在短时估计和非平凡现实信道条件下(如衰落或其他非线性硬件或传播效应)的估计等领域提供改进。
{"title":"Learning approximate neural estimators for wireless channel state information","authors":"Tim O'Shea, Kiran Karra, T. Clancy","doi":"10.1109/MLSP.2017.8168144","DOIUrl":"https://doi.org/10.1109/MLSP.2017.8168144","url":null,"abstract":"Estimation is a critical component of synchronization in wireless and signal processing systems. There is a rich body of work on estimator derivation, optimization, and statistical characterization from analytic system models which are used pervasively today. We explore an alternative approach to building estimators which relies principally on approximate regression using large datasets and large computationally efficient artificial neural network models capable of learning non-linear function mappings which provide compact and accurate estimates. For single carrier PSK modulation, we explore the accuracy and computational complexity of such estimators compared with the current gold-standard analytically derived alternatives. We compare performance in various wireless operating conditions and consider the trade offs between the two different classes of systems. Our results show the learned estimators can provide improvements in areas such as short-time estimation and estimation under non-trivial real world channel conditions such as fading or other non-linear hardware or propagation effects.","PeriodicalId":6542,"journal":{"name":"2017 IEEE 27th International Workshop on Machine Learning for Signal Processing (MLSP)","volume":"36 1","pages":"1-7"},"PeriodicalIF":0.0,"publicationDate":"2017-07-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"82825430","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 43
Cover tree compressed sensing for fast mr fingerprint recovery 覆盖树压缩传感快速mr指纹恢复
Mohammad Golbabaee, Zhouye Chen, Y. Wiaux, M. Davies
We adopt a data structure in the form of cover trees and iteratively apply approximate nearest neighbour (ANN) searches for fast compressed sensing reconstruction of signals living on discrete smooth manifolds. Leveraging on the recent stability results for the inexact Iterative Projected Gradient (IPG) algorithm and by using the cover tree's ANN searches, we decrease the projection cost of the IPG algorithm to be logarithmically growing with data population for low dimensional smooth manifolds. We apply our results to quantitative MRI compressed sensing and in particular within the Magnetic Resonance Fingerprinting (MRF) framework. For a similar (or sometimes better) reconstruction accuracy, we report 2–3 orders of magnitude reduction in computations compared to the standard iterative method, which uses brute-force searches.
我们采用覆盖树形式的数据结构,并迭代地应用近似近邻(ANN)搜索对离散光滑流形上的信号进行快速压缩感知重构。利用最近的不精确迭代投影梯度(IPG)算法的稳定性结果,并通过使用覆盖树的人工神经网络搜索,我们降低了IPG算法的投影成本,使其随着低维光滑流形的数据填充呈对数增长。我们将我们的结果应用于定量MRI压缩传感,特别是在磁共振指纹(MRF)框架内。对于类似的(或有时更好的)重建精度,我们报告与使用暴力搜索的标准迭代方法相比,计算减少了2-3个数量级。
{"title":"Cover tree compressed sensing for fast mr fingerprint recovery","authors":"Mohammad Golbabaee, Zhouye Chen, Y. Wiaux, M. Davies","doi":"10.1109/MLSP.2017.8168167","DOIUrl":"https://doi.org/10.1109/MLSP.2017.8168167","url":null,"abstract":"We adopt a data structure in the form of cover trees and iteratively apply approximate nearest neighbour (ANN) searches for fast compressed sensing reconstruction of signals living on discrete smooth manifolds. Leveraging on the recent stability results for the inexact Iterative Projected Gradient (IPG) algorithm and by using the cover tree's ANN searches, we decrease the projection cost of the IPG algorithm to be logarithmically growing with data population for low dimensional smooth manifolds. We apply our results to quantitative MRI compressed sensing and in particular within the Magnetic Resonance Fingerprinting (MRF) framework. For a similar (or sometimes better) reconstruction accuracy, we report 2–3 orders of magnitude reduction in computations compared to the standard iterative method, which uses brute-force searches.","PeriodicalId":6542,"journal":{"name":"2017 IEEE 27th International Workshop on Machine Learning for Signal Processing (MLSP)","volume":"22 1","pages":"1-6"},"PeriodicalIF":0.0,"publicationDate":"2017-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"72776692","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 10
Adversarial learning: A critical review and active learning study 对抗性学习:一种批判性的回顾和主动的学习研究
David J. Miller, Xinyi Hu, Zhicong Qiu, G. Kesidis
This papers consists of two parts. The first is a critical review of prior art on adversarial learning, i) identifying some significant limitations of previous works, which have focused mainly on attack exploits and ii) proposing novel defenses against adversarial attacks. The second part is an experimental study considering the adversarial active learning scenario and an investigation of the efficacy of a mixed sample selection strategy for combating an adversary who attempts to disrupt the classifier learning.
本文由两部分组成。第一部分是对对抗性学习的现有技术的批判性回顾,i)确定先前工作的一些重要局限性,这些工作主要集中在攻击利用上,ii)提出针对对抗性攻击的新防御。第二部分是一项考虑对抗性主动学习场景的实验研究,并研究了混合样本选择策略对抗试图破坏分类器学习的对手的有效性。
{"title":"Adversarial learning: A critical review and active learning study","authors":"David J. Miller, Xinyi Hu, Zhicong Qiu, G. Kesidis","doi":"10.1109/MLSP.2017.8168163","DOIUrl":"https://doi.org/10.1109/MLSP.2017.8168163","url":null,"abstract":"This papers consists of two parts. The first is a critical review of prior art on adversarial learning, i) identifying some significant limitations of previous works, which have focused mainly on attack exploits and ii) proposing novel defenses against adversarial attacks. The second part is an experimental study considering the adversarial active learning scenario and an investigation of the efficacy of a mixed sample selection strategy for combating an adversary who attempts to disrupt the classifier learning.","PeriodicalId":6542,"journal":{"name":"2017 IEEE 27th International Workshop on Machine Learning for Signal Processing (MLSP)","volume":"8 1","pages":"1-6"},"PeriodicalIF":0.0,"publicationDate":"2017-05-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"73236402","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 22
期刊
2017 IEEE 27th International Workshop on Machine Learning for Signal Processing (MLSP)
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1