首页 > 最新文献

The 2011 International Joint Conference on Neural Networks最新文献

英文 中文
Filter Bank Common Spatial Pattern (FBCSP) algorithm using online adaptive and semi-supervised learning 采用在线自适应和半监督学习的滤波器组公共空间模式(FBCSP)算法
Pub Date : 2011-10-03 DOI: 10.1109/IJCNN.2011.6033248
K. Ang, Z. Chin, Haihong Zhang, Cuntai Guan
The Filter Bank Common Spatial Pattern (FBCSP) algorithm employs multiple spatial filters to automatically select key temporal-spatial discriminative EEG characteristics and the Naïve Bayesian Parzen Window (NBPW) classifier using offline learning in EEG-based Brain-Computer Interfaces (BCI). However, it has yet to address the non-stationarity inherent in the EEG between the initial calibration session and subsequent online sessions. This paper presents the FBCSP that employs the NBPW classifier using online adaptive learning that augments the training data with available labeled data during online sessions. However, employing semi-supervised learning that simply augments the training data with available data using predicted labels can be detrimental to the classification accuracy. Hence, this paper presents the FBCSP using online semi-supervised learning that augments the training data with available data that matches the probabilistic model captured by the NBPW classifier using predicted labels. The performances of FBCSP using online adaptive and semi-supervised learning are evaluated on the BCI Competition IV datasets IIa and IIb and compared to the FBCSP using offline learning. The results showed that the FBCSP using online semi-supervised learning yielded relatively better session-to-session classification results compared against the FBCSP using offline learning. The FBCSP using online adaptive learning on true labels yielded the best results in both datasets, but the FBCSP using online semi-supervised learning on predicted labels is more practical in BCI applications where the true labels are not available.
滤波器组公共空间模式(Filter Bank Common Spatial Pattern, FBCSP)算法采用多个空间滤波器自动选择关键的时空判别性脑电特征,并在脑机接口(BCI)中采用离线学习的Naïve贝叶斯帕森窗(NBPW)分类器。然而,它还没有解决在初始校准会话和随后的在线会话之间的脑电图固有的非平稳性。本文提出了使用在线自适应学习的NBPW分类器的FBCSP,该分类器在在线会话期间使用可用的标记数据来增强训练数据。然而,使用半监督学习,即使用预测标签简单地用可用数据增强训练数据,可能会损害分类精度。因此,本文提出了使用在线半监督学习的FBCSP,该方法使用与NBPW分类器使用预测标签捕获的概率模型相匹配的可用数据来增强训练数据。在BCI Competition IV数据集IIa和IIb上评估了使用在线自适应和半监督学习的FBCSP的性能,并与使用离线学习的FBCSP进行了比较。结果表明,与使用离线学习的FBCSP相比,使用在线半监督学习的FBCSP产生了相对更好的会话到会话分类结果。在真实标签上使用在线自适应学习的FBCSP在两个数据集中都产生了最好的结果,但是在真实标签不可用的BCI应用中,在预测标签上使用在线半监督学习的FBCSP更实用。
{"title":"Filter Bank Common Spatial Pattern (FBCSP) algorithm using online adaptive and semi-supervised learning","authors":"K. Ang, Z. Chin, Haihong Zhang, Cuntai Guan","doi":"10.1109/IJCNN.2011.6033248","DOIUrl":"https://doi.org/10.1109/IJCNN.2011.6033248","url":null,"abstract":"The Filter Bank Common Spatial Pattern (FBCSP) algorithm employs multiple spatial filters to automatically select key temporal-spatial discriminative EEG characteristics and the Naïve Bayesian Parzen Window (NBPW) classifier using offline learning in EEG-based Brain-Computer Interfaces (BCI). However, it has yet to address the non-stationarity inherent in the EEG between the initial calibration session and subsequent online sessions. This paper presents the FBCSP that employs the NBPW classifier using online adaptive learning that augments the training data with available labeled data during online sessions. However, employing semi-supervised learning that simply augments the training data with available data using predicted labels can be detrimental to the classification accuracy. Hence, this paper presents the FBCSP using online semi-supervised learning that augments the training data with available data that matches the probabilistic model captured by the NBPW classifier using predicted labels. The performances of FBCSP using online adaptive and semi-supervised learning are evaluated on the BCI Competition IV datasets IIa and IIb and compared to the FBCSP using offline learning. The results showed that the FBCSP using online semi-supervised learning yielded relatively better session-to-session classification results compared against the FBCSP using offline learning. The FBCSP using online adaptive learning on true labels yielded the best results in both datasets, but the FBCSP using online semi-supervised learning on predicted labels is more practical in BCI applications where the true labels are not available.","PeriodicalId":415833,"journal":{"name":"The 2011 International Joint Conference on Neural Networks","volume":"2 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2011-10-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132311887","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 31
Online incremental clustering with distance metric learning for high dimensional data 基于距离度量学习的高维数据在线增量聚类
Pub Date : 2011-10-03 DOI: 10.1109/IJCNN.2011.6033478
S. Okada, T. Nishida
In this paper, we present a novel incremental clustering algorithm which assigns of a set of observations into clusters and learns the distance metric iteratively in an incremental manner. The proposed algorithm SOINN-AML is composed based on the Self-organizing Incremental Neural Network (Shen et al 2006), which represents the distribution of unlabeled data and reports a reasonable number of clusters. SOINN adopts a competitive Hebbian rule for each input signal, and distance between nodes is measured using the Euclidean distance. Such algorithms rely on the distance metric for the input data patterns. Distance Metric Learning (DML) learns a distance metric for the high dimensional input space of data that preserves the distance relation among the training data. DML is not performed for input space of data in SOINN based approaches. SOINN-AML learns input space of data by using the Adaptive Distance Metric Learning (AML) algorithm which is one of the DML algorithms. It improves the incremental clustering performance of the SOINN algorithm by optimizing the distance metric in the case that input data space is high dimensional. In experimental results, we evaluate the performance by using two artificial datasets, seven real datasets from the UCI dataset and three real image datasets. We have found that the proposed algorithm outperforms conventional algorithms including SOINN (Shen et al 2006) and Enhanced SOINN (Shen et al 2007). The improvement of clustering accuracy (NMI) is between 0.03 and 0.13 compared to state of the art SOINN based approaches.
本文提出了一种新的增量聚类算法,该算法将一组观测值分配到聚类中,并以增量的方式迭代学习距离度量。本文提出的SOINN-AML算法是基于自组织增量神经网络(Self-organizing Incremental Neural Network, Shen et al . 2006)组成的,它代表了未标记数据的分布,并报告了合理数量的聚类。SOINN对每个输入信号采用竞争Hebbian规则,节点间距离采用欧氏距离测量。这种算法依赖于输入数据模式的距离度量。距离度量学习(Distance Metric Learning, DML)是对数据的高维输入空间学习一种保持训练数据之间距离关系的距离度量。在基于SOINN的方法中,对数据的输入空间不执行DML。SOINN-AML使用自适应距离度量学习(AML)算法学习数据的输入空间,该算法是DML算法中的一种。在输入数据空间为高维的情况下,通过优化距离度量来提高SOINN算法的增量聚类性能。在实验结果中,我们使用2个人工数据集、7个来自UCI数据集的真实数据集和3个真实图像数据集来评估性能。我们发现所提出的算法优于传统的SOINN (Shen et al . 2006)和Enhanced SOINN (Shen et al . 2007)算法。与基于SOINN的最先进方法相比,聚类精度(NMI)的改进在0.03到0.13之间。
{"title":"Online incremental clustering with distance metric learning for high dimensional data","authors":"S. Okada, T. Nishida","doi":"10.1109/IJCNN.2011.6033478","DOIUrl":"https://doi.org/10.1109/IJCNN.2011.6033478","url":null,"abstract":"In this paper, we present a novel incremental clustering algorithm which assigns of a set of observations into clusters and learns the distance metric iteratively in an incremental manner. The proposed algorithm SOINN-AML is composed based on the Self-organizing Incremental Neural Network (Shen et al 2006), which represents the distribution of unlabeled data and reports a reasonable number of clusters. SOINN adopts a competitive Hebbian rule for each input signal, and distance between nodes is measured using the Euclidean distance. Such algorithms rely on the distance metric for the input data patterns. Distance Metric Learning (DML) learns a distance metric for the high dimensional input space of data that preserves the distance relation among the training data. DML is not performed for input space of data in SOINN based approaches. SOINN-AML learns input space of data by using the Adaptive Distance Metric Learning (AML) algorithm which is one of the DML algorithms. It improves the incremental clustering performance of the SOINN algorithm by optimizing the distance metric in the case that input data space is high dimensional. In experimental results, we evaluate the performance by using two artificial datasets, seven real datasets from the UCI dataset and three real image datasets. We have found that the proposed algorithm outperforms conventional algorithms including SOINN (Shen et al 2006) and Enhanced SOINN (Shen et al 2007). The improvement of clustering accuracy (NMI) is between 0.03 and 0.13 compared to state of the art SOINN based approaches.","PeriodicalId":415833,"journal":{"name":"The 2011 International Joint Conference on Neural Networks","volume":"10 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2011-10-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129208853","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 17
Autonomous learning of a human body model 人体模型的自主学习
Pub Date : 2011-10-03 DOI: 10.1109/IJCNN.2011.6033243
T. Walther, R. Würtz
The problem of learning a generalizable model of the visual appearance of humans from video data is of major importance for computing systems interacting naturally with their users and other humans populating their environment. We propose a step towards automatic behavior understanding by integrating principles of Organic Computing into the posture estimation cycle, thereby relegating the need for human intervention while simultaneously raising the level of system autonomy. The system extracts coherent motion from moving upper bodies and autonomously decides about limbs and their possible spatial relationships. The models from many videos are integrated into meta-models, which show good generalization to different individuals, backgrounds, and attire. These models even allow robust interpretation of single video frames, where all temporal continuity is missing.
从视频数据中学习人类视觉外观的可推广模型的问题对于计算系统与其用户和填充其环境的其他人自然交互具有重要意义。我们提出了通过将有机计算原理集成到姿态估计周期中来实现自动行为理解的一步,从而降低了对人工干预的需求,同时提高了系统自治水平。该系统从运动的上半身中提取连贯运动,并自主决定肢体及其可能的空间关系。将许多视频中的模型集成到元模型中,对不同的个体、背景和着装表现出良好的泛化。这些模型甚至允许对单个视频帧进行稳健的解释,其中所有的时间连续性都缺失了。
{"title":"Autonomous learning of a human body model","authors":"T. Walther, R. Würtz","doi":"10.1109/IJCNN.2011.6033243","DOIUrl":"https://doi.org/10.1109/IJCNN.2011.6033243","url":null,"abstract":"The problem of learning a generalizable model of the visual appearance of humans from video data is of major importance for computing systems interacting naturally with their users and other humans populating their environment. We propose a step towards automatic behavior understanding by integrating principles of Organic Computing into the posture estimation cycle, thereby relegating the need for human intervention while simultaneously raising the level of system autonomy. The system extracts coherent motion from moving upper bodies and autonomously decides about limbs and their possible spatial relationships. The models from many videos are integrated into meta-models, which show good generalization to different individuals, backgrounds, and attire. These models even allow robust interpretation of single video frames, where all temporal continuity is missing.","PeriodicalId":415833,"journal":{"name":"The 2011 International Joint Conference on Neural Networks","volume":"25 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2011-10-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125493444","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
Problems of temporal granularity in robot control: Levels of adaptation and a necessity of self-confidence 机器人控制中的时间粒度问题:适应水平和自信的必要性
Pub Date : 2011-10-03 DOI: 10.1109/IJCNN.2011.6033568
H. Wagatsuma, Yousuke Tomonaga
The granularity of “action” within a system is highly depending on the internal representation for the task, or intention of what to do if it is a biological system. In the same time, there are several levels of adaptation when the system tries to complete a mission. The problem of choosing the right level of action representation is essential for robot controls as well as in learning paradigms. Both tend to use low-granularity and transfer the processed information to upper levels constructively. However the system never guarantees the completion time of the mission if the system is composed of stiff functional blocks with a specific temporal granularity at the bottom level. However, we biological system have an ability to manage the global time for scheduling and reorganization of tasks to finish by the deadline. Brain-inspired robotics allows us to investigate a distributed parallel information system, the brain, with the ability of time management as a real time control system of the physical body through flexible planning of necessary actions by interacting with the real environment. It is an extension of subsumption approaches that fixed a set of behaviors as the basic unit of action in the viewpoint of temporal property. By focusing on the temporal granularity as a consequence of coordination among multiple levels, a self-confident robot control may arise from a coupling between top-down or purpose-oriented decomposition of the purpose to primitive functions with flexible time windows and bottom-up of sensori-motor reactions in dynamic environments.
系统内“行动”的粒度高度依赖于任务的内部表示,或者如果它是一个生物系统,则依赖于要做什么的意图。同时,当系统试图完成任务时,会有几个层次的适应。在机器人控制和学习范式中,选择正确的动作表示水平是一个非常重要的问题。两者都倾向于使用低粒度,并建设性地将处理过的信息传递给上层。然而,如果系统是由底层具有特定时间粒度的僵硬功能块组成,则系统永远无法保证任务的完成时间。然而,我们的生物系统有能力管理全局时间来安排和重组任务,以便在截止日期前完成。以大脑为灵感的机器人使我们能够研究一个分布式的并行信息系统,即具有时间管理能力的大脑,通过与真实环境的相互作用,灵活地规划必要的行动,将其作为物理身体的实时控制系统。从时间属性的观点出发,将一系列行为固定为行为的基本单位,这是包容方法的延伸。通过关注时间粒度作为多层协调的结果,自信的机器人控制可能来自于动态环境中自上而下或以目的为导向的目的分解为具有灵活时间窗口的原始函数与自下而上的感觉运动反应之间的耦合。
{"title":"Problems of temporal granularity in robot control: Levels of adaptation and a necessity of self-confidence","authors":"H. Wagatsuma, Yousuke Tomonaga","doi":"10.1109/IJCNN.2011.6033568","DOIUrl":"https://doi.org/10.1109/IJCNN.2011.6033568","url":null,"abstract":"The granularity of “action” within a system is highly depending on the internal representation for the task, or intention of what to do if it is a biological system. In the same time, there are several levels of adaptation when the system tries to complete a mission. The problem of choosing the right level of action representation is essential for robot controls as well as in learning paradigms. Both tend to use low-granularity and transfer the processed information to upper levels constructively. However the system never guarantees the completion time of the mission if the system is composed of stiff functional blocks with a specific temporal granularity at the bottom level. However, we biological system have an ability to manage the global time for scheduling and reorganization of tasks to finish by the deadline. Brain-inspired robotics allows us to investigate a distributed parallel information system, the brain, with the ability of time management as a real time control system of the physical body through flexible planning of necessary actions by interacting with the real environment. It is an extension of subsumption approaches that fixed a set of behaviors as the basic unit of action in the viewpoint of temporal property. By focusing on the temporal granularity as a consequence of coordination among multiple levels, a self-confident robot control may arise from a coupling between top-down or purpose-oriented decomposition of the purpose to primitive functions with flexible time windows and bottom-up of sensori-motor reactions in dynamic environments.","PeriodicalId":415833,"journal":{"name":"The 2011 International Joint Conference on Neural Networks","volume":"18 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2011-10-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126806438","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
New approaches for solving permutation indeterminacy and scaling ambiguity in frequency domain separation of convolved mixtures 求解卷积混合频域分离中排列不确定性和标度模糊的新方法
Pub Date : 2011-10-03 DOI: 10.1109/IJCNN.2011.6033319
Zhitang Chen, L. Chan
Permutation indeterminacy and scaling ambiguity occur in ICA and they are particularly problematic in time-frequency domain separation of convolutive mixtures. The quality of separation is severely degraded if these two problems are not well addressed. In this paper, we propose new approaches to solve the permutation indeterminacy and scaling ambiguity in the separation of convolutive mixture in frequency domain. We first apply Short Time Fourier Transform to the observed signals in order to transform the convolutive mixing in time domain to instantaneous mixing in time-frequency domain. A fixed-point algorithm with test of saddle point is adopted to derive the separated components in each frequency bin. To solve the permutation problem,we propose a new matching algorithm for this purpose. First we use discrete Haar Wavelet Transform to extract the feature vectors from the magnitude waveforms of the separated components and use Singular Value Decomposition to achieve dimension reduction. The permutation problem is solved by clustering the feature vectors using the new matching algorithm which is a combination of basic K-means and Hungarian algorithm. To solve the scaling ambiguity problem, we treat it as an overcomplete problem and realize it by maximizing the posterior of the scaling factor. Finally, experiments are conducted using benchmark data to present the effectiveness and performance of our proposed algorithms.
ICA中存在排列不确定性和尺度模糊性,在卷积混合的时频分离中尤其成问题。如果这两个问题没有得到很好的解决,分离的质量就会严重下降。本文提出了一种新的方法来解决频域卷积混合分离中的排列不确定性和标度模糊问题。首先对观测信号进行短时傅里叶变换,将时域的卷积混合变换为时频域的瞬时混合。采用鞍点检验的不动点算法,推导出各频仓内的分离分量。为了解决排列问题,我们提出了一种新的匹配算法。首先利用离散Haar小波变换从分离分量的幅值波形中提取特征向量,并利用奇异值分解实现降维。将基本K-means算法与匈牙利算法相结合,通过对特征向量进行聚类来解决排列问题。为了解决尺度模糊问题,我们将其视为一个过完备问题,并通过最大化尺度因子的后验来实现。最后,利用基准数据进行了实验,验证了所提算法的有效性和性能。
{"title":"New approaches for solving permutation indeterminacy and scaling ambiguity in frequency domain separation of convolved mixtures","authors":"Zhitang Chen, L. Chan","doi":"10.1109/IJCNN.2011.6033319","DOIUrl":"https://doi.org/10.1109/IJCNN.2011.6033319","url":null,"abstract":"Permutation indeterminacy and scaling ambiguity occur in ICA and they are particularly problematic in time-frequency domain separation of convolutive mixtures. The quality of separation is severely degraded if these two problems are not well addressed. In this paper, we propose new approaches to solve the permutation indeterminacy and scaling ambiguity in the separation of convolutive mixture in frequency domain. We first apply Short Time Fourier Transform to the observed signals in order to transform the convolutive mixing in time domain to instantaneous mixing in time-frequency domain. A fixed-point algorithm with test of saddle point is adopted to derive the separated components in each frequency bin. To solve the permutation problem,we propose a new matching algorithm for this purpose. First we use discrete Haar Wavelet Transform to extract the feature vectors from the magnitude waveforms of the separated components and use Singular Value Decomposition to achieve dimension reduction. The permutation problem is solved by clustering the feature vectors using the new matching algorithm which is a combination of basic K-means and Hungarian algorithm. To solve the scaling ambiguity problem, we treat it as an overcomplete problem and realize it by maximizing the posterior of the scaling factor. Finally, experiments are conducted using benchmark data to present the effectiveness and performance of our proposed algorithms.","PeriodicalId":415833,"journal":{"name":"The 2011 International Joint Conference on Neural Networks","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2011-10-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126237003","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 4
GA-based feature selection approach in biometric hand systems 基于遗传算法的手部生物识别系统特征选择方法
Pub Date : 2011-10-03 DOI: 10.1109/IJCNN.2011.6033228
Rafael Marcos Luque Baena, D. Elizondo, Ezequiel López-Rubio, E. Palomo
In this paper, a novel methodology for using feature selection in hand biometric systems, based on genetic algorithms and mutual information is presented. A hand segmentation algorithm based on adaptive threshold and active contours is also applied, in order to deal with complex backgrounds and non-homogeneous illumination.
本文提出了一种基于遗传算法和互信息的手部生物识别特征选择方法。针对复杂背景和非均匀光照情况,提出了一种基于自适应阈值和活动轮廓的手部分割算法。
{"title":"GA-based feature selection approach in biometric hand systems","authors":"Rafael Marcos Luque Baena, D. Elizondo, Ezequiel López-Rubio, E. Palomo","doi":"10.1109/IJCNN.2011.6033228","DOIUrl":"https://doi.org/10.1109/IJCNN.2011.6033228","url":null,"abstract":"In this paper, a novel methodology for using feature selection in hand biometric systems, based on genetic algorithms and mutual information is presented. A hand segmentation algorithm based on adaptive threshold and active contours is also applied, in order to deal with complex backgrounds and non-homogeneous illumination.","PeriodicalId":415833,"journal":{"name":"The 2011 International Joint Conference on Neural Networks","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2011-10-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122749332","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 12
Three theorems: Brain-like networks logically reason and optimally generalize 三个定理:类脑网络逻辑推理和最佳推广
Pub Date : 2011-10-03 DOI: 10.1109/IJCNN.2011.6033613
J. Weng
Finite Automata (FA) is a base net for many sophisticated probability-based systems of artificial intelligence. However, an FA processes symbols, instead of images that the brain senses and produces (e.g., sensory images and motor images). Of course, many recurrent artificial neural networks process images. However, their non-calibrated internal states prevent generalization, let alone the feasibility of immediate and error-free learning. I wish to report a general-purpose Developmental Program (DP) for a new type of, brain-anatomy inspired, networks — Developmental Networks (DNs). The new theoretical results here are summarized by three theorems. (1) From any complex FA that demonstrates human knowledge through its sequence of the symbolic inputs-outputs, the DP incrementally develops a corresponding DN through the image codes of the symbolic inputs-outputs of the FA. The DN learning from the FA is incremental, immediate and error-free. (2) After learning the FA, if the DN freezes its learning but runs, it generalizes optimally for infinitely many image inputs and actions based on the embedded inner-product distance, state equivalence, and the principle of maximum likelihood. (3) After learning the FA, if the DN continues to learn and run, it “thinks” optimally in the sense of maximum likelihood based on its past experience.
有限自动机(FA)是许多复杂的基于概率的人工智能系统的基础网络。然而,FA处理的是符号,而不是大脑感知和产生的图像(例如,感觉图像和运动图像)。当然,许多递归人工神经网络处理图像。然而,它们的非校准内部状态阻碍了泛化,更不用说即时和无错误学习的可行性了。我想报告一个通用的发展计划(DP)为一种新的,脑解剖学启发,网络-发展网络(DNs)。这里的新理论结果可以用三个定理来概括。(1)从任何通过符号输入-输出序列展示人类知识的复杂FA中,DP通过FA的符号输入-输出的图像编码逐步开发出相应的DN。DN从FA学习是增量的、即时的和无错误的。(2)学习FA后,如果DN冻结学习但运行,则基于嵌入内积距离、状态等价和最大似然原则,对无限多个图像输入和动作进行最优泛化。(3)在学习FA后,如果DN继续学习和运行,则它基于过去的经验,在最大似然意义上“认为”最优。
{"title":"Three theorems: Brain-like networks logically reason and optimally generalize","authors":"J. Weng","doi":"10.1109/IJCNN.2011.6033613","DOIUrl":"https://doi.org/10.1109/IJCNN.2011.6033613","url":null,"abstract":"Finite Automata (FA) is a base net for many sophisticated probability-based systems of artificial intelligence. However, an FA processes symbols, instead of images that the brain senses and produces (e.g., sensory images and motor images). Of course, many recurrent artificial neural networks process images. However, their non-calibrated internal states prevent generalization, let alone the feasibility of immediate and error-free learning. I wish to report a general-purpose Developmental Program (DP) for a new type of, brain-anatomy inspired, networks — Developmental Networks (DNs). The new theoretical results here are summarized by three theorems. (1) From any complex FA that demonstrates human knowledge through its sequence of the symbolic inputs-outputs, the DP incrementally develops a corresponding DN through the image codes of the symbolic inputs-outputs of the FA. The DN learning from the FA is incremental, immediate and error-free. (2) After learning the FA, if the DN freezes its learning but runs, it generalizes optimally for infinitely many image inputs and actions based on the embedded inner-product distance, state equivalence, and the principle of maximum likelihood. (3) After learning the FA, if the DN continues to learn and run, it “thinks” optimally in the sense of maximum likelihood based on its past experience.","PeriodicalId":415833,"journal":{"name":"The 2011 International Joint Conference on Neural Networks","volume":"13 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2011-10-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126374445","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 15
A comparison of sound localisation techniques using cross-correlation and spiking neural networks for mobile robotics 在移动机器人中使用相互关联和尖峰神经网络的声音定位技术的比较
Pub Date : 2011-10-03 DOI: 10.1109/IJCNN.2011.6033468
J. Wall, T. McGinnity, L. Maguire
This paper outlines the development of a cross-correlation algorithm and a spiking neural network (SNN) for sound localisation based on real sound recorded in a noisy and dynamic environment by a mobile robot. The SNN architecture aims to simulate the sound localisation ability of the mammalian auditory pathways by exploiting the binaural cue of interaural time difference (ITD). The medial superior olive was the inspiration for the SNN architecture which required the integration of an encoding layer which produced biologically realistic spike trains, a model of the bushy cells found in the cochlear nucleus and a supervised learning algorithm. The experimental results demonstrate that biologically inspired sound localisation achieved using a SNN can compare favourably to the more classical technique of cross-correlation.
本文概述了基于移动机器人在嘈杂和动态环境中记录的真实声音进行声音定位的相互关联算法和尖峰神经网络(SNN)的发展。SNN架构旨在通过利用双耳时差(ITD)线索模拟哺乳动物听觉通路的声音定位能力。内侧上橄榄是SNN结构的灵感来源,该结构需要整合编码层,产生生物学上真实的尖峰序列,耳蜗核中发现的浓密细胞模型和监督学习算法。实验结果表明,使用SNN实现的受生物启发的声音定位可以与更经典的相互关联技术相比较。
{"title":"A comparison of sound localisation techniques using cross-correlation and spiking neural networks for mobile robotics","authors":"J. Wall, T. McGinnity, L. Maguire","doi":"10.1109/IJCNN.2011.6033468","DOIUrl":"https://doi.org/10.1109/IJCNN.2011.6033468","url":null,"abstract":"This paper outlines the development of a cross-correlation algorithm and a spiking neural network (SNN) for sound localisation based on real sound recorded in a noisy and dynamic environment by a mobile robot. The SNN architecture aims to simulate the sound localisation ability of the mammalian auditory pathways by exploiting the binaural cue of interaural time difference (ITD). The medial superior olive was the inspiration for the SNN architecture which required the integration of an encoding layer which produced biologically realistic spike trains, a model of the bushy cells found in the cochlear nucleus and a supervised learning algorithm. The experimental results demonstrate that biologically inspired sound localisation achieved using a SNN can compare favourably to the more classical technique of cross-correlation.","PeriodicalId":415833,"journal":{"name":"The 2011 International Joint Conference on Neural Networks","volume":"29 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2011-10-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122240886","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
Selecting the hypothesis space for improving the generalization ability of Support Vector Machines 为提高支持向量机泛化能力选择假设空间
Pub Date : 2011-10-03 DOI: 10.1109/IJCNN.2011.6033356
D. Anguita, A. Ghio, L. Oneto, S. Ridella
The Structural Risk Minimization framework has been recently proposed as a practical method for model selection in Support Vector Machines (SVMs). The main idea is to effectively measure the complexity of the hypothesis space, as defined by the set of possible classifiers, and to use this quantity as a penalty term for guiding the model selection process. Unfortunately, the conventional SVM formulation defines a hypothesis space centered at the origin, which can cause undesired effects on the selection of the optimal classifier. We propose here a more flexible SVM formulation, which addresses this drawback, and describe a practical method for selecting more effective hypothesis spaces, leading to the improvement of the generalization ability of the final classifier.
最近,结构风险最小化框架作为一种实用的支持向量机模型选择方法被提出。主要思想是有效地测量假设空间的复杂性,由可能的分类器集合定义,并使用该数量作为指导模型选择过程的惩罚项。不幸的是,传统的支持向量机公式定义了一个以原点为中心的假设空间,这可能会对最优分类器的选择产生不利影响。我们在这里提出了一个更灵活的支持向量机公式,它解决了这一缺点,并描述了一种选择更有效的假设空间的实用方法,从而提高了最终分类器的泛化能力。
{"title":"Selecting the hypothesis space for improving the generalization ability of Support Vector Machines","authors":"D. Anguita, A. Ghio, L. Oneto, S. Ridella","doi":"10.1109/IJCNN.2011.6033356","DOIUrl":"https://doi.org/10.1109/IJCNN.2011.6033356","url":null,"abstract":"The Structural Risk Minimization framework has been recently proposed as a practical method for model selection in Support Vector Machines (SVMs). The main idea is to effectively measure the complexity of the hypothesis space, as defined by the set of possible classifiers, and to use this quantity as a penalty term for guiding the model selection process. Unfortunately, the conventional SVM formulation defines a hypothesis space centered at the origin, which can cause undesired effects on the selection of the optimal classifier. We propose here a more flexible SVM formulation, which addresses this drawback, and describe a practical method for selecting more effective hypothesis spaces, leading to the improvement of the generalization ability of the final classifier.","PeriodicalId":415833,"journal":{"name":"The 2011 International Joint Conference on Neural Networks","volume":"12 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2011-10-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126056257","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 24
A novel facial feature extraction method based on ICM network for affective recognition 一种基于ICM网络的情感识别人脸特征提取方法
Pub Date : 2011-10-03 DOI: 10.1109/IJCNN.2011.6033469
F. Mokhayeri, M. Akbarzadeh-T.
This paper presents a facial expression recognition approach to recognize the affective states. Feature extraction is a vital step in the recognition of facial expressions. In this work, a novel facial feature extraction method based on Intersecting Cortical Model (ICM) is proposed. The ICM network which is a simplified model of Pulse-Coupled Neural Network (PCNN) model has great potential to perform pixel grouping. In the proposed method the normalized face image is segmented into two regions including mouth, eyes using fuzzy c-means clustering (FCM). Segmented face images are imported into an ICM network with 300 iteration number and pulse image produced by the ICM network is chosen as the face code, then the support vector machine (SVM) is trained for discrimination of different expressions to distinguish the different affective states. In order to evaluate the performance of the proposed algorithm, the face image dataset is constructed and the proposed algorithm is used to classify seven basic expressions including happiness, sadness, fear, anger, surprise and hate The experimental results confirm that ICM network has great potential for facial feature extraction and the proposed method for human affective recognition is promising. Fast feature extraction is the most advantage of this method which can be useful for real world application.
提出了一种人脸表情识别方法来识别人脸的情感状态。特征提取是面部表情识别的重要步骤。本文提出了一种基于相交皮质模型(intersection Cortical Model, ICM)的人脸特征提取方法。ICM网络是脉冲耦合神经网络(PCNN)模型的简化模型,在像素分组方面具有很大的潜力。该方法利用模糊c均值聚类(FCM)将归一化后的人脸图像分割为嘴巴和眼睛两个区域。将分割后的人脸图像导入迭代次数为300的ICM网络,选择ICM网络产生的脉冲图像作为人脸编码,训练支持向量机(SVM)识别不同表情,区分不同的情感状态。为了评价所提算法的性能,构建了人脸图像数据集,并使用所提算法对快乐、悲伤、恐惧、愤怒、惊讶和讨厌等7种基本表情进行了分类。实验结果证实了ICM网络在人脸特征提取方面具有很大的潜力,所提方法在人类情感识别方面具有广阔的应用前景。该方法的最大优点是特征提取速度快,可用于实际应用。
{"title":"A novel facial feature extraction method based on ICM network for affective recognition","authors":"F. Mokhayeri, M. Akbarzadeh-T.","doi":"10.1109/IJCNN.2011.6033469","DOIUrl":"https://doi.org/10.1109/IJCNN.2011.6033469","url":null,"abstract":"This paper presents a facial expression recognition approach to recognize the affective states. Feature extraction is a vital step in the recognition of facial expressions. In this work, a novel facial feature extraction method based on Intersecting Cortical Model (ICM) is proposed. The ICM network which is a simplified model of Pulse-Coupled Neural Network (PCNN) model has great potential to perform pixel grouping. In the proposed method the normalized face image is segmented into two regions including mouth, eyes using fuzzy c-means clustering (FCM). Segmented face images are imported into an ICM network with 300 iteration number and pulse image produced by the ICM network is chosen as the face code, then the support vector machine (SVM) is trained for discrimination of different expressions to distinguish the different affective states. In order to evaluate the performance of the proposed algorithm, the face image dataset is constructed and the proposed algorithm is used to classify seven basic expressions including happiness, sadness, fear, anger, surprise and hate The experimental results confirm that ICM network has great potential for facial feature extraction and the proposed method for human affective recognition is promising. Fast feature extraction is the most advantage of this method which can be useful for real world application.","PeriodicalId":415833,"journal":{"name":"The 2011 International Joint Conference on Neural Networks","volume":"34 2 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2011-10-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125615036","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 5
期刊
The 2011 International Joint Conference on Neural Networks
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1