首页 > 最新文献

IEEE transactions on neural networks最新文献

英文 中文
Editorial: The Blossoming of the IEEE Transactions on Neural Networks 社论:IEEE神经网络汇刊的繁荣期
Pub Date : 2011-12-01 DOI: 10.1109/TNN.2011.2176769
Derong Liu
{"title":"Editorial: The Blossoming of the IEEE Transactions on Neural Networks","authors":"Derong Liu","doi":"10.1109/TNN.2011.2176769","DOIUrl":"https://doi.org/10.1109/TNN.2011.2176769","url":null,"abstract":"","PeriodicalId":13434,"journal":{"name":"IEEE transactions on neural networks","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2011-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"73503955","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 61
Exponential synchronization of complex networks with finite distributed delays coupling. 有限分布延迟耦合复杂网络的指数同步。
Pub Date : 2011-12-01 Epub Date: 2011-10-10 DOI: 10.1109/TNN.2011.2167759
Cheng Hu, Juan Yu, Haijun Jiang, Zhidong Teng

In this paper, the exponential synchronization for a class of complex networks with finite distributed delays coupling is studied via periodically intermittent control. Some novel and useful criteria are derived by utilizing a different technique compared with some correspondingly previous results. As a special case, some sufficient conditions ensuring the exponential synchronization for a class of coupled neural networks with distributed delays are obtained. Furthermore, a feasible region of the control parameters is derived for the realization of exponential synchronization. It is worth noting that the synchronized state in this paper is not an isolated node but a non-decoupled state, in which the inner coupling matrix and the degree of the nodes play a central role. Additionally, the traditional assumptions on control width, non-control width, and discrete delays are removed in our results. Finally, some numerical simulations are given to demonstrate the effectiveness of the proposed control method.

本文研究了一类具有有限分布延迟耦合的复杂网络的周期性间歇控制的指数同步问题。利用一种不同的技术,与先前的一些结果进行了比较,得出了一些新颖而有用的判据。作为特例,得到了一类具有分布时滞的耦合神经网络的指数同步的几个充分条件。进一步推导了实现指数同步的控制参数可行域。值得注意的是,本文中的同步状态不是孤立的节点,而是非解耦的状态,其中内部耦合矩阵和节点的程度起着中心作用。此外,我们的结果中去掉了传统的控制宽度、非控制宽度和离散延迟的假设。最后,通过数值仿真验证了所提控制方法的有效性。
{"title":"Exponential synchronization of complex networks with finite distributed delays coupling.","authors":"Cheng Hu,&nbsp;Juan Yu,&nbsp;Haijun Jiang,&nbsp;Zhidong Teng","doi":"10.1109/TNN.2011.2167759","DOIUrl":"https://doi.org/10.1109/TNN.2011.2167759","url":null,"abstract":"<p><p>In this paper, the exponential synchronization for a class of complex networks with finite distributed delays coupling is studied via periodically intermittent control. Some novel and useful criteria are derived by utilizing a different technique compared with some correspondingly previous results. As a special case, some sufficient conditions ensuring the exponential synchronization for a class of coupled neural networks with distributed delays are obtained. Furthermore, a feasible region of the control parameters is derived for the realization of exponential synchronization. It is worth noting that the synchronized state in this paper is not an isolated node but a non-decoupled state, in which the inner coupling matrix and the degree of the nodes play a central role. Additionally, the traditional assumptions on control width, non-control width, and discrete delays are removed in our results. Finally, some numerical simulations are given to demonstrate the effectiveness of the proposed control method.</p>","PeriodicalId":13434,"journal":{"name":"IEEE transactions on neural networks","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2011-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1109/TNN.2011.2167759","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"30201402","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 71
Data mining based full ceramic bearing fault diagnostic system using AE sensors. 基于声发射传感器的全陶瓷轴承故障诊断系统。
Pub Date : 2011-12-01 Epub Date: 2011-10-10 DOI: 10.1109/TNN.2011.2169087
David He, Ruoyu Li, Junda Zhu, Mikhail Zade

Full ceramic bearings are considered the first step toward full ceramic, oil-free engines in the future. No research on full ceramic bearing fault diagnostics using acoustic emission (AE) sensors has been reported. Unlike their steel counterparts, signal processing methods to extract effective AE fault characteristic features and fault diagnostic systems for full ceramic bearings have not been developed. In this paper, a data mining based full ceramic bearing diagnostic system using AE based condition indicators (CIs) is presented. The system utilizes a new signal processing method based on Hilbert Huang transform to extract AE fault features for the computation of CIs. These CIs are used to build a data mining based fault classifier using a k-nearest neighbor algorithm. Seeded fault tests on full ceramic bearing outer race, inner race, balls, and cage are conducted on a bearing diagnostic test rig and AE burst data are collected. The effectiveness of the developed fault diagnostic system is validated using real full ceramic bearing seeded fault test data.

全陶瓷轴承被认为是未来全陶瓷、无油发动机的第一步。利用声发射传感器进行全陶瓷轴承故障诊断的研究尚未见报道。与钢轴承不同,全陶瓷轴承提取有效声发射故障特征特征的信号处理方法和故障诊断系统尚未开发。提出了一种基于声发射的全陶瓷轴承状态指标数据挖掘诊断系统。该系统采用一种新的基于Hilbert Huang变换的信号处理方法提取声发射故障特征,用于计算ci。这些ci用于使用k-最近邻算法构建基于数据挖掘的故障分类器。在轴承诊断试验台上对全陶瓷轴承外滚圈、内滚圈、球和保持架进行了种子故障试验,采集了声发射爆炸数据。利用全陶瓷轴承种子故障试验数据,验证了该故障诊断系统的有效性。
{"title":"Data mining based full ceramic bearing fault diagnostic system using AE sensors.","authors":"David He,&nbsp;Ruoyu Li,&nbsp;Junda Zhu,&nbsp;Mikhail Zade","doi":"10.1109/TNN.2011.2169087","DOIUrl":"https://doi.org/10.1109/TNN.2011.2169087","url":null,"abstract":"<p><p>Full ceramic bearings are considered the first step toward full ceramic, oil-free engines in the future. No research on full ceramic bearing fault diagnostics using acoustic emission (AE) sensors has been reported. Unlike their steel counterparts, signal processing methods to extract effective AE fault characteristic features and fault diagnostic systems for full ceramic bearings have not been developed. In this paper, a data mining based full ceramic bearing diagnostic system using AE based condition indicators (CIs) is presented. The system utilizes a new signal processing method based on Hilbert Huang transform to extract AE fault features for the computation of CIs. These CIs are used to build a data mining based fault classifier using a k-nearest neighbor algorithm. Seeded fault tests on full ceramic bearing outer race, inner race, balls, and cage are conducted on a bearing diagnostic test rig and AE burst data are collected. The effectiveness of the developed fault diagnostic system is validated using real full ceramic bearing seeded fault test data.</p>","PeriodicalId":13434,"journal":{"name":"IEEE transactions on neural networks","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2011-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1109/TNN.2011.2169087","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"30201405","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 81
Data-based fault-tolerant control of high-speed trains with traction/braking notch nonlinearities and actuator failures. 基于数据的高速列车牵引/制动缺口非线性和执行器故障容错控制。
Pub Date : 2011-12-01 DOI: 10.1109/TNN.2011.2175451
Qi Song, Yong-Duan Song

This paper investigates the position and velocity tracking control problem of high-speed trains with multiple vehicles connected through couplers. A dynamic model reflecting nonlinear and elastic impacts between adjacent vehicles as well as traction/braking nonlinearities and actuation faults is derived. Neuroadaptive fault-tolerant control algorithms are developed to account for various factors such as input nonlinearities, actuator failures, and uncertain impacts of in-train forces in the system simultaneously. The resultant control scheme is essentially independent of system model and is primarily data-driven because with the appropriate input-output data, the proposed control algorithms are capable of automatically generating the intermediate control parameters, neuro-weights, and the compensation signals, literally producing the traction/braking force based upon input and response data only--the whole process does not require precise information on system model or system parameter, nor human intervention. The effectiveness of the proposed approach is also confirmed through numerical simulations.

研究了多车联轴器连接高速列车的位置和速度跟踪控制问题。建立了反映相邻车辆间非线性和弹性碰撞、牵引/制动非线性和驱动故障的动力学模型。神经自适应容错控制算法的开发是为了同时考虑各种因素,如输入非线性、执行器故障和系统中列车力的不确定影响。由此产生的控制方案基本上独立于系统模型,主要是数据驱动的,因为有了适当的输入输出数据,所提出的控制算法能够自动生成中间控制参数、神经权重和补偿信号,实际上仅根据输入和响应数据产生牵引力/制动力——整个过程不需要系统模型或系统参数的精确信息。也不是人为干预。通过数值模拟验证了该方法的有效性。
{"title":"Data-based fault-tolerant control of high-speed trains with traction/braking notch nonlinearities and actuator failures.","authors":"Qi Song,&nbsp;Yong-Duan Song","doi":"10.1109/TNN.2011.2175451","DOIUrl":"https://doi.org/10.1109/TNN.2011.2175451","url":null,"abstract":"<p><p>This paper investigates the position and velocity tracking control problem of high-speed trains with multiple vehicles connected through couplers. A dynamic model reflecting nonlinear and elastic impacts between adjacent vehicles as well as traction/braking nonlinearities and actuation faults is derived. Neuroadaptive fault-tolerant control algorithms are developed to account for various factors such as input nonlinearities, actuator failures, and uncertain impacts of in-train forces in the system simultaneously. The resultant control scheme is essentially independent of system model and is primarily data-driven because with the appropriate input-output data, the proposed control algorithms are capable of automatically generating the intermediate control parameters, neuro-weights, and the compensation signals, literally producing the traction/braking force based upon input and response data only--the whole process does not require precise information on system model or system parameter, nor human intervention. The effectiveness of the proposed approach is also confirmed through numerical simulations.</p>","PeriodicalId":13434,"journal":{"name":"IEEE transactions on neural networks","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2011-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1109/TNN.2011.2175451","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"30323484","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 118
Guest editorial: special section on white box nonlinear prediction models. 客座评论:关于白盒非线性预测模型的特别部分。
Pub Date : 2011-12-01 DOI: 10.1109/TNN.2011.2177735
Bart Baesens, David Martens, Rudy Setiono, Jacek M Zurada
The five papers in this special section focus on white-box nonlinear prediction models.
{"title":"Guest editorial: special section on white box nonlinear prediction models.","authors":"Bart Baesens,&nbsp;David Martens,&nbsp;Rudy Setiono,&nbsp;Jacek M Zurada","doi":"10.1109/TNN.2011.2177735","DOIUrl":"https://doi.org/10.1109/TNN.2011.2177735","url":null,"abstract":"The five papers in this special section focus on white-box nonlinear prediction models.","PeriodicalId":13434,"journal":{"name":"IEEE transactions on neural networks","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2011-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1109/TNN.2011.2177735","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"30323485","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 6
Passivity and stability analysis of reaction-diffusion neural networks with Dirichlet boundary conditions. Dirichlet边界条件下反应-扩散神经网络的无源性和稳定性分析。
Pub Date : 2011-12-01 Epub Date: 2011-10-14 DOI: 10.1109/TNN.2011.2170096
Jin-Liang Wang, Huai-Ning Wu, Lei Guo

This paper is concerned with the passivity and stability problems of reaction-diffusion neural networks (RDNNs) in which the input and output variables are varied with the time and space variables. By utilizing the Lyapunov functional method combined with the inequality techniques, some sufficient conditions ensuring the passivity and global exponential stability are derived. Furthermore, when the parameter uncertainties appear in RDNNs, several criteria for robust passivity and robust global exponential stability are also presented. Finally, a numerical example is provided to illustrate the effectiveness of the proposed criteria.

研究了输入和输出随时间和空间变量变化的反应扩散神经网络的无源性和稳定性问题。利用Lyapunov泛函方法结合不等式技术,得到了保证系统无源性和全局指数稳定性的充分条件。此外,当rdnn中出现参数不确定性时,还给出了鲁棒无源性和鲁棒全局指数稳定性的若干准则。最后,给出了一个数值算例来说明所提准则的有效性。
{"title":"Passivity and stability analysis of reaction-diffusion neural networks with Dirichlet boundary conditions.","authors":"Jin-Liang Wang,&nbsp;Huai-Ning Wu,&nbsp;Lei Guo","doi":"10.1109/TNN.2011.2170096","DOIUrl":"https://doi.org/10.1109/TNN.2011.2170096","url":null,"abstract":"<p><p>This paper is concerned with the passivity and stability problems of reaction-diffusion neural networks (RDNNs) in which the input and output variables are varied with the time and space variables. By utilizing the Lyapunov functional method combined with the inequality techniques, some sufficient conditions ensuring the passivity and global exponential stability are derived. Furthermore, when the parameter uncertainties appear in RDNNs, several criteria for robust passivity and robust global exponential stability are also presented. Finally, a numerical example is provided to illustrate the effectiveness of the proposed criteria.</p>","PeriodicalId":13434,"journal":{"name":"IEEE transactions on neural networks","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2011-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1109/TNN.2011.2170096","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"30072531","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 92
Data-driven control for relative degree systems via iterative learning. 基于迭代学习的相对学位系统数据驱动控制。
Pub Date : 2011-12-01 Epub Date: 2011-11-18 DOI: 10.1109/TNN.2011.2174378
Deyuan Meng, Yingmin Jia, Junping Du, Fashan Yu

Iterative learning control (ILC) is a kind of effective data-driven method that is developed based on online and/or offline input/output data. The main purpose of this paper is to supply a unified 2-D analysis approach for both continuous-time and discrete-time ILC systems with relative degree. It is shown that the 2-D Roesser system framework can be established for general ILC systems regardless of relative degree, under which convergence conditions can be provided to guarantee both asymptotic stability and monotonic convergence of the ILC processes. In particular, conditions for the monotonic convergence of ILC can be given in terms of linear matrix inequalities, and formulas for the updating law can be derived simultaneously. Simulation results are presented to illustrate the effectiveness of ILC determined through the 2-D design approach in dealing with the higher order relative degree problem of ILC systems, as well as the robustness of such ILC against uncertainties.

迭代学习控制(ILC)是一种基于在线和/或离线输入/输出数据开发的有效的数据驱动方法。本文的主要目的是为具有相对度的连续时间和离散时间ILC系统提供一种统一的二维分析方法。结果表明,对于一般的ILC系统,无论相对程度如何,都可以建立二维Roesser系统框架,在该框架下,可以给出保证ILC过程渐近稳定和单调收敛的收敛条件。特别地,可以用线性矩阵不等式的形式给出ILC单调收敛的条件,并同时推导出更新律的公式。仿真结果表明,通过二维设计方法确定的ILC在处理ILC系统的高阶相对度问题时的有效性,以及这种ILC对不确定性的鲁棒性。
{"title":"Data-driven control for relative degree systems via iterative learning.","authors":"Deyuan Meng,&nbsp;Yingmin Jia,&nbsp;Junping Du,&nbsp;Fashan Yu","doi":"10.1109/TNN.2011.2174378","DOIUrl":"https://doi.org/10.1109/TNN.2011.2174378","url":null,"abstract":"<p><p>Iterative learning control (ILC) is a kind of effective data-driven method that is developed based on online and/or offline input/output data. The main purpose of this paper is to supply a unified 2-D analysis approach for both continuous-time and discrete-time ILC systems with relative degree. It is shown that the 2-D Roesser system framework can be established for general ILC systems regardless of relative degree, under which convergence conditions can be provided to guarantee both asymptotic stability and monotonic convergence of the ILC processes. In particular, conditions for the monotonic convergence of ILC can be given in terms of linear matrix inequalities, and formulas for the updating law can be derived simultaneously. Simulation results are presented to illustrate the effectiveness of ILC determined through the 2-D design approach in dealing with the higher order relative degree problem of ILC systems, as well as the robustness of such ILC against uncertainties.</p>","PeriodicalId":13434,"journal":{"name":"IEEE transactions on neural networks","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2011-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1109/TNN.2011.2174378","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"30279606","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 52
Symmetric nonnegative matrix factorization: algorithms and applications to probabilistic clustering. 对称非负矩阵分解:算法及其在概率聚类中的应用。
Pub Date : 2011-12-01 Epub Date: 2011-10-26 DOI: 10.1109/TNN.2011.2172457
Zhaoshui He, Shengli Xie, Rafal Zdunek, Guoxu Zhou, Andrzej Cichocki

Nonnegative matrix factorization (NMF) is an unsupervised learning method useful in various applications including image processing and semantic analysis of documents. This paper focuses on symmetric NMF (SNMF), which is a special case of NMF decomposition. Three parallel multiplicative update algorithms using level 3 basic linear algebra subprograms directly are developed for this problem. First, by minimizing the Euclidean distance, a multiplicative update algorithm is proposed, and its convergence under mild conditions is proved. Based on it, we further propose another two fast parallel methods: α-SNMF and β -SNMF algorithms. All of them are easy to implement. These algorithms are applied to probabilistic clustering. We demonstrate their effectiveness for facial image clustering, document categorization, and pattern clustering in gene expression.

非负矩阵分解(NMF)是一种无监督学习方法,广泛应用于图像处理和文档语义分析等领域。本文主要研究对称NMF (SNMF),它是NMF分解的一种特例。针对这一问题,提出了3种直接使用3级基本线性代数子程序的并行乘法更新算法。首先,通过最小化欧氏距离,提出了一种乘法更新算法,并证明了该算法在温和条件下的收敛性。在此基础上,我们进一步提出了另外两种快速并行算法:α-SNMF和β -SNMF算法。所有这些都很容易实现。这些算法被应用于概率聚类。我们证明了它们在面部图像聚类、文档分类和基因表达模式聚类方面的有效性。
{"title":"Symmetric nonnegative matrix factorization: algorithms and applications to probabilistic clustering.","authors":"Zhaoshui He,&nbsp;Shengli Xie,&nbsp;Rafal Zdunek,&nbsp;Guoxu Zhou,&nbsp;Andrzej Cichocki","doi":"10.1109/TNN.2011.2172457","DOIUrl":"https://doi.org/10.1109/TNN.2011.2172457","url":null,"abstract":"<p><p>Nonnegative matrix factorization (NMF) is an unsupervised learning method useful in various applications including image processing and semantic analysis of documents. This paper focuses on symmetric NMF (SNMF), which is a special case of NMF decomposition. Three parallel multiplicative update algorithms using level 3 basic linear algebra subprograms directly are developed for this problem. First, by minimizing the Euclidean distance, a multiplicative update algorithm is proposed, and its convergence under mild conditions is proved. Based on it, we further propose another two fast parallel methods: α-SNMF and β -SNMF algorithms. All of them are easy to implement. These algorithms are applied to probabilistic clustering. We demonstrate their effectiveness for facial image clustering, document categorization, and pattern clustering in gene expression.</p>","PeriodicalId":13434,"journal":{"name":"IEEE transactions on neural networks","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2011-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1109/TNN.2011.2172457","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"40117955","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 175
Incremental learning from stream data. 从流数据中增量学习。
Pub Date : 2011-12-01 Epub Date: 2011-10-31 DOI: 10.1109/TNN.2011.2171713
Haibo He, Sheng Chen, Kang Li, Xin Xu

Recent years have witnessed an incredibly increasing interest in the topic of incremental learning. Unlike conventional machine learning situations, data flow targeted by incremental learning becomes available continuously over time. Accordingly, it is desirable to be able to abandon the traditional assumption of the availability of representative training data during the training period to develop decision boundaries. Under scenarios of continuous data flow, the challenge is how to transform the vast amount of stream raw data into information and knowledge representation, and accumulate experience over time to support future decision-making process. In this paper, we propose a general adaptive incremental learning framework named ADAIN that is capable of learning from continuous raw data, accumulating experience over time, and using such knowledge to improve future learning and prediction performance. Detailed system level architecture and design strategies are presented in this paper. Simulation results over several real-world data sets are used to validate the effectiveness of this method.

近年来,人们对增量学习的兴趣日益浓厚。与传统的机器学习情况不同,增量学习针对的数据流随着时间的推移变得持续可用。因此,希望能够放弃传统的假设,即在训练期间具有代表性的训练数据的可用性,以制定决策边界。在连续数据流的场景下,如何将大量的流原始数据转化为信息和知识的表示,并随着时间的推移积累经验以支持未来的决策过程是一个挑战。在本文中,我们提出了一个通用的自适应增量学习框架ADAIN,它能够从连续的原始数据中学习,随着时间的推移积累经验,并利用这些知识来提高未来的学习和预测性能。本文给出了详细的系统级架构和设计策略。通过多个实际数据集的仿真结果验证了该方法的有效性。
{"title":"Incremental learning from stream data.","authors":"Haibo He,&nbsp;Sheng Chen,&nbsp;Kang Li,&nbsp;Xin Xu","doi":"10.1109/TNN.2011.2171713","DOIUrl":"https://doi.org/10.1109/TNN.2011.2171713","url":null,"abstract":"<p><p>Recent years have witnessed an incredibly increasing interest in the topic of incremental learning. Unlike conventional machine learning situations, data flow targeted by incremental learning becomes available continuously over time. Accordingly, it is desirable to be able to abandon the traditional assumption of the availability of representative training data during the training period to develop decision boundaries. Under scenarios of continuous data flow, the challenge is how to transform the vast amount of stream raw data into information and knowledge representation, and accumulate experience over time to support future decision-making process. In this paper, we propose a general adaptive incremental learning framework named ADAIN that is capable of learning from continuous raw data, accumulating experience over time, and using such knowledge to improve future learning and prediction performance. Detailed system level architecture and design strategies are presented in this paper. Simulation results over several real-world data sets are used to validate the effectiveness of this method.</p>","PeriodicalId":13434,"journal":{"name":"IEEE transactions on neural networks","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2011-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1109/TNN.2011.2171713","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"40131702","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 169
Bayesian multitask classification with Gaussian process priors. 高斯先验贝叶斯多任务分类。
Pub Date : 2011-12-01 Epub Date: 2011-10-10 DOI: 10.1109/TNN.2011.2168568
Grigorios Skolidis, Guido Sanguinetti

We present a novel approach to multitask learning in classification problems based on Gaussian process (GP) classification. The method extends previous work on multitask GP regression, constraining the overall covariance (across tasks and data points) to factorize as a Kronecker product. Fully Bayesian inference is possible but time consuming using sampling techniques. We propose approximations based on the popular variational Bayes and expectation propagation frameworks, showing that they both achieve excellent accuracy when compared to Gibbs sampling, in a fraction of time. We present results on a toy dataset and two real datasets, showing improved performance against the baseline results obtained by learning each task independently. We also compare with a recently proposed state-of-the-art approach based on support vector machines, obtaining comparable or better results.

提出了一种基于高斯过程(GP)分类的多任务学习方法。该方法扩展了先前在多任务GP回归上的工作,将总体协方差(跨任务和数据点)约束为Kronecker积。完全贝叶斯推理是可能的,但使用抽样技术耗时。我们提出了基于流行的变分贝叶斯和期望传播框架的近似值,表明与吉布斯采样相比,它们在很短的时间内都达到了很好的精度。我们在一个玩具数据集和两个真实数据集上展示了通过独立学习每个任务获得的基线结果的改进性能。我们还与最近提出的基于支持向量机的最先进的方法进行了比较,获得了可比或更好的结果。
{"title":"Bayesian multitask classification with Gaussian process priors.","authors":"Grigorios Skolidis,&nbsp;Guido Sanguinetti","doi":"10.1109/TNN.2011.2168568","DOIUrl":"https://doi.org/10.1109/TNN.2011.2168568","url":null,"abstract":"<p><p>We present a novel approach to multitask learning in classification problems based on Gaussian process (GP) classification. The method extends previous work on multitask GP regression, constraining the overall covariance (across tasks and data points) to factorize as a Kronecker product. Fully Bayesian inference is possible but time consuming using sampling techniques. We propose approximations based on the popular variational Bayes and expectation propagation frameworks, showing that they both achieve excellent accuracy when compared to Gibbs sampling, in a fraction of time. We present results on a toy dataset and two real datasets, showing improved performance against the baseline results obtained by learning each task independently. We also compare with a recently proposed state-of-the-art approach based on support vector machines, obtaining comparable or better results.</p>","PeriodicalId":13434,"journal":{"name":"IEEE transactions on neural networks","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2011-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1109/TNN.2011.2168568","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"30201404","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 60
期刊
IEEE transactions on neural networks
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1