首页 > 最新文献

2019 International Joint Conference on Neural Networks (IJCNN)最新文献

英文 中文
A Riemannian Primal-dual Algorithm Based on Proximal Operator and its Application in Metric Learning 基于近邻算子的riemann原对偶算法及其在度量学习中的应用
Pub Date : 2020-05-19 DOI: 10.1109/IJCNN.2019.8852367
Shijun Wang, Baocheng Zhu, Lintao Ma, Yuan Qi
In this paper, we consider optimizing a smooth, convex, lower semicontinuous function in Riemannian space with constraints. To solve the problem, we first convert it to a dual problem and then propose a general primal-dual algorithm to optimize the primal and dual variables iteratively. In each optimization iteration, we employ a proximal operator to search optimal solution in the primal space. We prove convergence of the proposed algorithm and show its non-asymptotic convergence rate. By utilizing the proposed primal-dual optimization technique, we propose a novel metric learning algorithm which learns an optimal feature transformation matrix in the Riemannian space of positive definite matrices. Preliminary experimental results on an optimal fund selection problem in fund of funds (FOF) management for quantitative investment showed its efficacy.
本文研究了黎曼空间中具有约束的光滑、凸、下半连续函数的优化问题。为了解决该问题,我们首先将其转化为对偶问题,然后提出了一种通用的原始-对偶算法来迭代优化原始变量和对偶变量。在每次优化迭代中,我们使用一个近端算子在原始空间中搜索最优解。证明了算法的收敛性,并给出了算法的非渐近收敛率。利用所提出的原对偶优化技术,我们提出了一种新的度量学习算法,该算法在正定矩阵的黎曼空间中学习最优特征变换矩阵。对量化投资基金的基金管理中基金最优选择问题的初步实验结果表明了该方法的有效性。
{"title":"A Riemannian Primal-dual Algorithm Based on Proximal Operator and its Application in Metric Learning","authors":"Shijun Wang, Baocheng Zhu, Lintao Ma, Yuan Qi","doi":"10.1109/IJCNN.2019.8852367","DOIUrl":"https://doi.org/10.1109/IJCNN.2019.8852367","url":null,"abstract":"In this paper, we consider optimizing a smooth, convex, lower semicontinuous function in Riemannian space with constraints. To solve the problem, we first convert it to a dual problem and then propose a general primal-dual algorithm to optimize the primal and dual variables iteratively. In each optimization iteration, we employ a proximal operator to search optimal solution in the primal space. We prove convergence of the proposed algorithm and show its non-asymptotic convergence rate. By utilizing the proposed primal-dual optimization technique, we propose a novel metric learning algorithm which learns an optimal feature transformation matrix in the Riemannian space of positive definite matrices. Preliminary experimental results on an optimal fund selection problem in fund of funds (FOF) management for quantitative investment showed its efficacy.","PeriodicalId":222797,"journal":{"name":"2019 International Joint Conference on Neural Networks (IJCNN)","volume":"52 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-05-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133414374","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Towards a Smart Fault Tolerant Indoor Localization System Through Recurrent Neural Networks 基于循环神经网络的智能容错室内定位系统研究
Pub Date : 2019-09-30 DOI: 10.1109/IJCNN.2019.8852007
E. Carvalho, Bruno V. Ferreira, G. P. R. Filho, P. Gomes, G. Freitas, P. A. Vargas, J. Ueyama, G. Pessin
This paper proposes a fault-tolerant indoor localization system that employs Recurrent Neural Networks (RNNs) for the localization task. A decision module is designed to detect failures and this is responsible for the allocation of RNNs that are suitable for each situation. As well as the fault-tolerant system, several architectures and models for RNNs are exploited in the system: Gated Recurrent Unit (GRU), Long Short-Term Memory (LSTM) and Simple RNN. The system uses as inputs a collection of Wi-Fi Received Signal Strength Indication (RSSI) signals, and the RNN classifies the position of an agent on the basis of this collection. A fault-tolerant mechanism has been designed to handle two types of failures: (i) momentary failure, and (ii) permanent failure. The results show that the RNNs are suitable for tackling the problem and that the whole system is reliable when employed for a series of failures.
本文提出了一种采用递归神经网络(RNNs)进行定位的容错室内定位系统。一个决策模块被设计用来检测故障,它负责分配适合每种情况的rnn。除了容错系统外,该系统还采用了几种RNN的架构和模型:门控循环单元(GRU)、长短期记忆(LSTM)和简单RNN。系统使用一组Wi-Fi接收信号强度指示(RSSI)信号作为输入,RNN根据该信号对座席的位置进行分类。容错机制被设计用来处理两种类型的故障:(i)瞬时故障和(ii)永久故障。结果表明,rnn可以很好地解决这一问题,并且在处理一系列故障时,整个系统是可靠的。
{"title":"Towards a Smart Fault Tolerant Indoor Localization System Through Recurrent Neural Networks","authors":"E. Carvalho, Bruno V. Ferreira, G. P. R. Filho, P. Gomes, G. Freitas, P. A. Vargas, J. Ueyama, G. Pessin","doi":"10.1109/IJCNN.2019.8852007","DOIUrl":"https://doi.org/10.1109/IJCNN.2019.8852007","url":null,"abstract":"This paper proposes a fault-tolerant indoor localization system that employs Recurrent Neural Networks (RNNs) for the localization task. A decision module is designed to detect failures and this is responsible for the allocation of RNNs that are suitable for each situation. As well as the fault-tolerant system, several architectures and models for RNNs are exploited in the system: Gated Recurrent Unit (GRU), Long Short-Term Memory (LSTM) and Simple RNN. The system uses as inputs a collection of Wi-Fi Received Signal Strength Indication (RSSI) signals, and the RNN classifies the position of an agent on the basis of this collection. A fault-tolerant mechanism has been designed to handle two types of failures: (i) momentary failure, and (ii) permanent failure. The results show that the RNNs are suitable for tackling the problem and that the whole system is reliable when employed for a series of failures.","PeriodicalId":222797,"journal":{"name":"2019 International Joint Conference on Neural Networks (IJCNN)","volume":"19 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-09-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132642252","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 10
ECG-based Heartbeat Classification in Neuromorphic Hardware 神经形态硬件中基于ecg的心跳分类
Pub Date : 2019-09-30 DOI: 10.1109/IJCNN.2019.8852279
Federico Corradi, S. Pande, J. Stuijt, Ning Qiao, S. Schaafsma, G. Indiveri, F. Catthoor
Heart activity can be monitored by means of ElectroCardioGram (ECG) measure which is widely used to detect heart diseases due to its non-invasive nature. Trained cardiologists can detect anomalies by visual inspecting recordings of the ECG signals. However, arrhythmias occur intermittently especially in early stages and therefore they can be missed in routine check recordings. We propose a hardware setup that enables the always-on monitoring of ECG signals into wearables. The system exploits a fully event-driven approach for carrying arrhythmia detection and classification employing a bio-inspired spiking neural network. The two staged Spiking Neural Network (SNN) topology comprises a recurrent network of spiking neurons whose output is classified by a cluster of Leaky integrate-and-fire (LIF) neurons that have been supervisely trained to distinguish 17 types of cardiac patterns. We introduce a method for compressing ECG signals into a stream of asynchronous digital events that are used to stimulate the recurrent SNN. Using ablative analysis, we demonstrate the impact of the recurrent SNN and we show an overall classification accuracy of 95% on the PhysioNet Arrhythmia Database provided by the Massachusetts Institute of Technology and Beth Israel Hospital (MIT/BIH). The proposed system has been implemented on an event-driven mixed-signal analog/digital neuromorphic processor. This work contributes to the realization of an energy-efficient, wearable, and accurate multi-class ECG classification system.
心脏活动可以通过心电图(ECG)测量来监测,心电图因其无创性而被广泛用于检测心脏病。训练有素的心脏病专家可以通过目视检查心电图信号的记录来检测异常。然而,心律失常间歇性地发生,特别是在早期阶段,因此它们可能在常规检查记录中被遗漏。我们提出了一种硬件设置,可以将ECG信号始终监控到可穿戴设备中。该系统利用一种完全事件驱动的方法,采用生物激发的尖峰神经网络进行心律失常检测和分类。两个阶段的脉冲神经网络(SNN)拓扑结构包括一个脉冲神经元的循环网络,其输出由一组Leaky整合-点火(LIF)神经元分类,这些神经元经过监督训练,可以区分17种心脏模式。我们介绍了一种将心电信号压缩成异步数字事件流的方法,该事件流用于刺激循环SNN。通过烧蚀分析,我们证明了复发性SNN的影响,并且在麻省理工学院和贝斯以色列医院(MIT/BIH)提供的PhysioNet心律失常数据库中,我们显示了95%的总体分类准确率。该系统已在事件驱动的混合信号模拟/数字神经形态处理器上实现。该工作有助于实现节能、可穿戴、准确的多类心电分类系统。
{"title":"ECG-based Heartbeat Classification in Neuromorphic Hardware","authors":"Federico Corradi, S. Pande, J. Stuijt, Ning Qiao, S. Schaafsma, G. Indiveri, F. Catthoor","doi":"10.1109/IJCNN.2019.8852279","DOIUrl":"https://doi.org/10.1109/IJCNN.2019.8852279","url":null,"abstract":"Heart activity can be monitored by means of ElectroCardioGram (ECG) measure which is widely used to detect heart diseases due to its non-invasive nature. Trained cardiologists can detect anomalies by visual inspecting recordings of the ECG signals. However, arrhythmias occur intermittently especially in early stages and therefore they can be missed in routine check recordings. We propose a hardware setup that enables the always-on monitoring of ECG signals into wearables. The system exploits a fully event-driven approach for carrying arrhythmia detection and classification employing a bio-inspired spiking neural network. The two staged Spiking Neural Network (SNN) topology comprises a recurrent network of spiking neurons whose output is classified by a cluster of Leaky integrate-and-fire (LIF) neurons that have been supervisely trained to distinguish 17 types of cardiac patterns. We introduce a method for compressing ECG signals into a stream of asynchronous digital events that are used to stimulate the recurrent SNN. Using ablative analysis, we demonstrate the impact of the recurrent SNN and we show an overall classification accuracy of 95% on the PhysioNet Arrhythmia Database provided by the Massachusetts Institute of Technology and Beth Israel Hospital (MIT/BIH). The proposed system has been implemented on an event-driven mixed-signal analog/digital neuromorphic processor. This work contributes to the realization of an energy-efficient, wearable, and accurate multi-class ECG classification system.","PeriodicalId":222797,"journal":{"name":"2019 International Joint Conference on Neural Networks (IJCNN)","volume":"18 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-09-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124397718","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 35
DeepHist: Towards a Deep Learning-based Computational History of Trends in the NIPS 深度物理学家:迈向NIPS中基于深度学习的趋势计算历史
Pub Date : 2019-09-30 DOI: 10.1109/IJCNN.2019.8852140
Amna Dridi, M. Gaber, R. Azad, Jagdev Bhogal
Research in analysis of big scholarly data has increased in the recent past and it aims to understand research dynamics and forecast research trends. The ultimate objective in this research is to design and implement novel and scalable methods for extracting knowledge and computational history. While citations are highly used to identify emerging/rising research topics, they can take months or even years to stabilise enough to reveal research trends. Consequently, it is necessary to develop faster yet accurate methods for trend analysis and computational history that dig into content and semantics of an article. Therefore, this paper aims to conduct a fine-grained content analysis of scientific corpora from the domain of Machine Learning. This analysis uses DeepHist, a deep learning-based computational history approach; the approach relies on a dynamic word embedding that aims to represent words with low-dimensional vectors computed by deep neural networks. The scientific corpora come from 5991 publications from Neural Information Processing Systems (NIPS) conference between 1987 and 2015 which are divided into six 5-year timespans. The analysis of these corpora generates visualisations produced by applying t-distributed stochastic neighbor embedding (t-SNE) for dimensionality reduction. The qualitative and quantitative study reported here reveals the evolution of the prominent Machine Learning keywords; this evolution supports the popularity of current research topics in the field. This support is evident given how well the popularity of the detected keywords correlates with the citation counts received by their corresponding papers: Spearman’s positive correlation is 100%. With such a strong result, this work evidences the utility of deep learning techniques for determining the computational history of science.
近年来,对大学术数据分析的研究有所增加,其目的是了解研究动态和预测研究趋势。本研究的最终目标是设计和实现新的、可扩展的方法来提取知识和计算历史。虽然引文被高度用于确定新兴/新兴的研究主题,但它们可能需要数月甚至数年的时间才能稳定下来,足以揭示研究趋势。因此,有必要开发更快而准确的趋势分析和计算历史方法,以深入研究文章的内容和语义。因此,本文旨在从机器学习领域对科学语料库进行细粒度的内容分析。该分析使用了DeepHist,一种基于深度学习的计算历史方法;该方法依赖于动态词嵌入,旨在用深度神经网络计算的低维向量表示单词。科学语料库来自1987年至2015年神经信息处理系统(NIPS)会议的5991份出版物,分为六个5年时间跨度。对这些语料库的分析通过应用t分布随机邻居嵌入(t-SNE)进行降维生成可视化。这里报道的定性和定量研究揭示了突出的机器学习关键词的演变;这种演变支持了该领域当前研究课题的流行。这种支持是显而易见的,因为检测到的关键词的受欢迎程度与相应论文的引用数量之间的相关性很好:斯皮尔曼的正相关性为100%。有了这样一个强有力的结果,这项工作证明了深度学习技术在确定科学计算历史方面的实用性。
{"title":"DeepHist: Towards a Deep Learning-based Computational History of Trends in the NIPS","authors":"Amna Dridi, M. Gaber, R. Azad, Jagdev Bhogal","doi":"10.1109/IJCNN.2019.8852140","DOIUrl":"https://doi.org/10.1109/IJCNN.2019.8852140","url":null,"abstract":"Research in analysis of big scholarly data has increased in the recent past and it aims to understand research dynamics and forecast research trends. The ultimate objective in this research is to design and implement novel and scalable methods for extracting knowledge and computational history. While citations are highly used to identify emerging/rising research topics, they can take months or even years to stabilise enough to reveal research trends. Consequently, it is necessary to develop faster yet accurate methods for trend analysis and computational history that dig into content and semantics of an article. Therefore, this paper aims to conduct a fine-grained content analysis of scientific corpora from the domain of Machine Learning. This analysis uses DeepHist, a deep learning-based computational history approach; the approach relies on a dynamic word embedding that aims to represent words with low-dimensional vectors computed by deep neural networks. The scientific corpora come from 5991 publications from Neural Information Processing Systems (NIPS) conference between 1987 and 2015 which are divided into six 5-year timespans. The analysis of these corpora generates visualisations produced by applying t-distributed stochastic neighbor embedding (t-SNE) for dimensionality reduction. The qualitative and quantitative study reported here reveals the evolution of the prominent Machine Learning keywords; this evolution supports the popularity of current research topics in the field. This support is evident given how well the popularity of the detected keywords correlates with the citation counts received by their corresponding papers: Spearman’s positive correlation is 100%. With such a strong result, this work evidences the utility of deep learning techniques for determining the computational history of science.","PeriodicalId":222797,"journal":{"name":"2019 International Joint Conference on Neural Networks (IJCNN)","volume":"213 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-09-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131494718","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
Spatial Map Learning with Self-Organizing Adaptive Recurrent Incremental Network 基于自组织自适应循环增量网络的空间地图学习
Pub Date : 2019-09-30 DOI: 10.1109/IJCNN.2019.8851919
W. Chin, N. Kubota, C. Loo, Zhaojie Ju, Honghai Liu
Biological information inspires the advancement of a navigational mechanism for autonomous robots to help people explore and map real-world environments. However, the robot’s ability to constantly acquire environmental information in real-world, dynamic environments has remained a challenge for many years. In this paper, we propose a self-organizing adaptive recurrent incremental network that models human episodic memory to learn spatiotemporal representations from novel sensory data. The proposed method termed as SOARIN consists of two main learning process that is active learning and episodic memory playback. For active learning (robot exploration), SOARIN quickly learns and adapts incoming novel sensory data as episodic neurons via competitive Hebbian Learning. Episodic neurons are connecting with each other and gradually forms a spatial map that can be used for robot localization. Episodic memory playback is triggered whenever the robot is in an inactive mode (charging or hibernating). During playback, SOARIN gradually integrates knowledge and experience into more consolidate spatial map structures that can overcome the catastrophic forgetting. The proposed method is analyzed and evaluated in term of map learning and localization through a series of real robot experiments in real-world indoor environments.
生物信息激发了自主机器人导航机制的进步,以帮助人们探索和绘制现实世界的环境。然而,机器人在现实世界的动态环境中不断获取环境信息的能力多年来一直是一个挑战。在本文中,我们提出了一个自组织自适应循环增量网络,该网络模拟人类情景记忆,从新的感官数据中学习时空表征。提出的SOARIN学习方法包括两个主要的学习过程:主动学习和情景记忆回放。对于主动学习(机器人探索),SOARIN通过竞争性Hebbian学习快速学习和适应传入的新感觉数据作为情景神经元。情景神经元相互连接,逐渐形成可用于机器人定位的空间地图。每当机器人处于非活动模式(充电或休眠)时,情景记忆回放就会被触发。在回放过程中,SOARIN逐渐将知识和经验整合到更加巩固的空间地图结构中,从而克服灾难性遗忘。通过一系列真实机器人在真实室内环境中的实验,从地图学习和定位的角度对所提出的方法进行了分析和评估。
{"title":"Spatial Map Learning with Self-Organizing Adaptive Recurrent Incremental Network","authors":"W. Chin, N. Kubota, C. Loo, Zhaojie Ju, Honghai Liu","doi":"10.1109/IJCNN.2019.8851919","DOIUrl":"https://doi.org/10.1109/IJCNN.2019.8851919","url":null,"abstract":"Biological information inspires the advancement of a navigational mechanism for autonomous robots to help people explore and map real-world environments. However, the robot’s ability to constantly acquire environmental information in real-world, dynamic environments has remained a challenge for many years. In this paper, we propose a self-organizing adaptive recurrent incremental network that models human episodic memory to learn spatiotemporal representations from novel sensory data. The proposed method termed as SOARIN consists of two main learning process that is active learning and episodic memory playback. For active learning (robot exploration), SOARIN quickly learns and adapts incoming novel sensory data as episodic neurons via competitive Hebbian Learning. Episodic neurons are connecting with each other and gradually forms a spatial map that can be used for robot localization. Episodic memory playback is triggered whenever the robot is in an inactive mode (charging or hibernating). During playback, SOARIN gradually integrates knowledge and experience into more consolidate spatial map structures that can overcome the catastrophic forgetting. The proposed method is analyzed and evaluated in term of map learning and localization through a series of real robot experiments in real-world indoor environments.","PeriodicalId":222797,"journal":{"name":"2019 International Joint Conference on Neural Networks (IJCNN)","volume":"20 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-09-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114798497","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
Actively Semi-Supervised Deep Rule-based Classifier Applied to Adverse Driving Scenarios 主动半监督深度规则分类器在不良驾驶场景中的应用
Pub Date : 2019-09-30 DOI: 10.1109/IJCNN.2019.8851842
E. Soares, P. Angelov, Bruno Costa, Marcos Castro
This paper presents an actively semi-supervised multi-layer neuro-fuzzy modeling method, ASSDRB, to classify different lighting conditions for driving scenes. ASSDRB is composed of a massively parallel ensemble of AnYa type 0-order fuzzy rules. It uses a recursive learning algorithm to update its structure when new data items are provided and, therefore, is able to cope with nonstationarities. Different lighting conditions for driving situations are considered in the analysis, which is used by self-driving cars as a safety mechanism. Differently from mainstream Deep Neural Networks approaches, the ASSDRB is able to learn from unseen data. Experiments on different lighting conditions for driving scenes, demonstrated that the deep neuro-fuzzy modeling is an efficient framework for these challenging classification tasks. Classification accuracy is higher than those produced by alternative machine learning methods. The number of algebraic calculations for the present method are significantly smaller and, therefore, the method is significantly faster than common Deep Neural Networks approaches. Moreover, DRB produced transparent AnYa fuzzy rules, which are human interpretable.
本文提出了一种主动半监督多层神经模糊建模方法ASSDRB,用于对驾驶场景的不同光照条件进行分类。ASSDRB是由AnYa型0阶模糊规则的大规模并行集成而成。它使用递归学习算法在提供新数据项时更新其结构,因此能够处理非平稳性。在分析中考虑了驾驶情况的不同照明条件,这是自动驾驶汽车使用的一种安全机制。与主流的深度神经网络方法不同,ASSDRB能够从看不见的数据中学习。在不同光照条件下的驾驶场景实验表明,深度神经模糊建模是一种有效的分类框架。分类精度高于其他机器学习方法产生的分类精度。该方法的代数计算次数明显减少,因此,该方法比普通深度神经网络方法快得多。此外,DRB产生了透明和模糊的规则,这些规则是人类可解释的。
{"title":"Actively Semi-Supervised Deep Rule-based Classifier Applied to Adverse Driving Scenarios","authors":"E. Soares, P. Angelov, Bruno Costa, Marcos Castro","doi":"10.1109/IJCNN.2019.8851842","DOIUrl":"https://doi.org/10.1109/IJCNN.2019.8851842","url":null,"abstract":"This paper presents an actively semi-supervised multi-layer neuro-fuzzy modeling method, ASSDRB, to classify different lighting conditions for driving scenes. ASSDRB is composed of a massively parallel ensemble of AnYa type 0-order fuzzy rules. It uses a recursive learning algorithm to update its structure when new data items are provided and, therefore, is able to cope with nonstationarities. Different lighting conditions for driving situations are considered in the analysis, which is used by self-driving cars as a safety mechanism. Differently from mainstream Deep Neural Networks approaches, the ASSDRB is able to learn from unseen data. Experiments on different lighting conditions for driving scenes, demonstrated that the deep neuro-fuzzy modeling is an efficient framework for these challenging classification tasks. Classification accuracy is higher than those produced by alternative machine learning methods. The number of algebraic calculations for the present method are significantly smaller and, therefore, the method is significantly faster than common Deep Neural Networks approaches. Moreover, DRB produced transparent AnYa fuzzy rules, which are human interpretable.","PeriodicalId":222797,"journal":{"name":"2019 International Joint Conference on Neural Networks (IJCNN)","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-09-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128793555","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 10
Deep Capsule Network based Automatic Batch Code Identification Pipeline for a Real-life Industrial Application 基于深度胶囊网络的批量代码自动识别管道在现实工业中的应用
Pub Date : 2019-07-19 DOI: 10.1109/IJCNN.2019.8852303
C. Singh, V. Gangwar, H. Singh, Karan Narain, A. Majumder, Swagat Kumar
Automatic recognition of text, such as a batch code printed on a box placed on a moving conveyor belt, is still a challenging problem. This paper proposes an end-to-end character recognition technique while addressing the major challenges encountered in a real environment, such as motion blur in the acquired images, slanted or oriented characters, creased batch codes due to wear and tear of boxes, variations in label formats, and variations in printing styles. The major contribution of this work lies in development of three sequential modules: text localization using Connectionist Text Proposal Network(CTPN), character detection and character recognition using a modified version of the capsule network (CapsNet). In contrast to CapsNet, where only a standard single convolution is used, the proposed method uses a series of feature blocks, making it a deep CapsNet which is later proven to generate more comprehensive and better separable feature vectors over its counterpart. The feature generation module is further enhanced by setting a smaller kernel size than CapsNet. The proposed system is validated on a real-world box / packet dataset generated in a retail manufacturing industry. The proposed recognition network architecture is also validated on a standard public dataset (ICDAR 2013). The comparative results are presented with statistical analysis in the experimental results section.
文本的自动识别,例如打印在移动传送带上的盒子上的批处理代码,仍然是一个具有挑战性的问题。本文提出了一种端到端字符识别技术,同时解决了在真实环境中遇到的主要挑战,例如获取的图像中的运动模糊,倾斜或定向字符,由于盒子磨损而产生的批码折痕,标签格式的变化以及打印样式的变化。这项工作的主要贡献在于开发了三个连续的模块:使用Connectionist text Proposal Network(CTPN)的文本定位,使用改进版本的capsule Network(CapsNet)的字符检测和字符识别。与仅使用标准单个卷积的CapsNet相比,所提出的方法使用一系列特征块,使其成为一个深度CapsNet,后来被证明可以生成比其对应的更全面和更好的可分离特征向量。通过设置比CapsNet更小的内核大小,功能生成模块得到了进一步增强。提出的系统在零售制造业生成的真实盒子/包数据集上进行了验证。提出的识别网络架构也在标准公共数据集(ICDAR 2013)上进行了验证。实验结果部分给出了对比结果并进行了统计分析。
{"title":"Deep Capsule Network based Automatic Batch Code Identification Pipeline for a Real-life Industrial Application","authors":"C. Singh, V. Gangwar, H. Singh, Karan Narain, A. Majumder, Swagat Kumar","doi":"10.1109/IJCNN.2019.8852303","DOIUrl":"https://doi.org/10.1109/IJCNN.2019.8852303","url":null,"abstract":"Automatic recognition of text, such as a batch code printed on a box placed on a moving conveyor belt, is still a challenging problem. This paper proposes an end-to-end character recognition technique while addressing the major challenges encountered in a real environment, such as motion blur in the acquired images, slanted or oriented characters, creased batch codes due to wear and tear of boxes, variations in label formats, and variations in printing styles. The major contribution of this work lies in development of three sequential modules: text localization using Connectionist Text Proposal Network(CTPN), character detection and character recognition using a modified version of the capsule network (CapsNet). In contrast to CapsNet, where only a standard single convolution is used, the proposed method uses a series of feature blocks, making it a deep CapsNet which is later proven to generate more comprehensive and better separable feature vectors over its counterpart. The feature generation module is further enhanced by setting a smaller kernel size than CapsNet. The proposed system is validated on a real-world box / packet dataset generated in a retail manufacturing industry. The proposed recognition network architecture is also validated on a standard public dataset (ICDAR 2013). The comparative results are presented with statistical analysis in the experimental results section.","PeriodicalId":222797,"journal":{"name":"2019 International Joint Conference on Neural Networks (IJCNN)","volume":"34 2 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-07-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123354645","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
Prediction Using LSTM Networks 使用LSTM网络进行预测
Pub Date : 2019-07-15 DOI: 10.1109/IJCNN.2019.8852206
Sahar Arshi, Li Zhang, Rebecca Strachan
Photovoltaic (PV) systems use the sunlight and convert it to electrical power. It is predicted that by 2023, 371,000 PV installations will be embedded in power networks in the UK. This may increase the risk of voltage rise which has adverse impacts on the power network. The balance maintenance is important for high security of the physical electrical systems and the operation economy. Therefore, the prediction of the output of PV systems is of great importance. The output of a PV system highly depends on local environmental conditions. These include sun radiation, temperature, and humidity. In this research, the importance of various weather factors are studied. The weather attributes are subsequently employed for the prediction of the solar panel power generation from a time-series database. Long-Short Term Memory networks are employed for obtaining the dependencies between various elements of the weather conditions and the PV energy metrics. Evaluation results indicate the efficiency of the deep networks for energy generation prediction.
光伏(PV)系统利用阳光并将其转化为电能。据预测,到2023年,英国将有371,000个光伏装置嵌入电网。这可能会增加电压上升的风险,对电网产生不利影响。平衡维护对物理电力系统的高安全性和运行经济性具有重要意义。因此,对光伏发电系统的发电量进行预测具有重要意义。光伏发电系统的输出很大程度上取决于当地的环境条件。这些因素包括太阳辐射、温度和湿度。在本研究中,研究了各种天气因素的重要性。天气属性随后被用于从时间序列数据库预测太阳能电池板的发电量。长短期记忆网络用于获取天气条件的各种要素与光伏能源指标之间的依赖关系。评价结果表明了深度网络预测发电量的有效性。
{"title":"Prediction Using LSTM Networks","authors":"Sahar Arshi, Li Zhang, Rebecca Strachan","doi":"10.1109/IJCNN.2019.8852206","DOIUrl":"https://doi.org/10.1109/IJCNN.2019.8852206","url":null,"abstract":"Photovoltaic (PV) systems use the sunlight and convert it to electrical power. It is predicted that by 2023, 371,000 PV installations will be embedded in power networks in the UK. This may increase the risk of voltage rise which has adverse impacts on the power network. The balance maintenance is important for high security of the physical electrical systems and the operation economy. Therefore, the prediction of the output of PV systems is of great importance. The output of a PV system highly depends on local environmental conditions. These include sun radiation, temperature, and humidity. In this research, the importance of various weather factors are studied. The weather attributes are subsequently employed for the prediction of the solar panel power generation from a time-series database. Long-Short Term Memory networks are employed for obtaining the dependencies between various elements of the weather conditions and the PV energy metrics. Evaluation results indicate the efficiency of the deep networks for energy generation prediction.","PeriodicalId":222797,"journal":{"name":"2019 International Joint Conference on Neural Networks (IJCNN)","volume":"24 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-07-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116964124","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 5
Testing the Robustness of Manifold Learning on Examples of Thinned-Out Data 流形学习在稀疏数据上的鲁棒性测试
Pub Date : 2019-07-14 DOI: 10.1109/IJCNN.2019.8851939
Fayeem Aziz, S. Chalup
Manifold learning can only be successful if enough data is available. If the data is too sparse, the geometrical and topological structure of the manifold extracted from the data cannot be recognised and the manifold collapses. In this paper we used data from a simulated two-dimensional double pendulum and tested how well several manifold learning methods could extract the expected manifold, a two-dimensional torus. The experiments were repeated while the data was downsampled in several ways to test the robustness of the different manifold learning methods. We also developed a neural network-based deep autoencoder for manifold learning and demonstrated that it performed in most of our test cases similarly or better than traditional methods such as principal component analysis and isomap.
只有在有足够的数据可用的情况下,流形学习才能成功。如果数据过于稀疏,从数据中提取的流形的几何和拓扑结构将无法被识别,从而导致流形崩溃。在本文中,我们使用模拟二维双摆的数据,并测试了几种流形学习方法如何很好地提取期望的流形,即二维环面。实验重复进行,同时采用多种方式对数据进行下采样,以测试不同流形学习方法的鲁棒性。我们还开发了一种基于神经网络的深度自动编码器,用于流形学习,并证明它在大多数测试用例中的表现与传统方法(如主成分分析和等高线图)相似或更好。
{"title":"Testing the Robustness of Manifold Learning on Examples of Thinned-Out Data","authors":"Fayeem Aziz, S. Chalup","doi":"10.1109/IJCNN.2019.8851939","DOIUrl":"https://doi.org/10.1109/IJCNN.2019.8851939","url":null,"abstract":"Manifold learning can only be successful if enough data is available. If the data is too sparse, the geometrical and topological structure of the manifold extracted from the data cannot be recognised and the manifold collapses. In this paper we used data from a simulated two-dimensional double pendulum and tested how well several manifold learning methods could extract the expected manifold, a two-dimensional torus. The experiments were repeated while the data was downsampled in several ways to test the robustness of the different manifold learning methods. We also developed a neural network-based deep autoencoder for manifold learning and demonstrated that it performed in most of our test cases similarly or better than traditional methods such as principal component analysis and isomap.","PeriodicalId":222797,"journal":{"name":"2019 International Joint Conference on Neural Networks (IJCNN)","volume":"12 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-07-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121830139","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
A Multi-Application, Scalable and Adaptable Hardware SOM Architecture 一种多应用、可扩展和适应性强的硬件SOM体系结构
Pub Date : 2019-07-14 DOI: 10.1109/IJCNN.2019.8851797
Mehdi Abadi, S. Jovanovic, K. Khalifa, S. Weber, M. H. Bedoui
In this work, a scalable and adaptable hardware SOM architecture allowing to execute multiple applications in parallel is presented. The proposed architecture allows to use simultaneously multiple SOM structures with different parameters in order to satisfy multiple applications with different needs. The application switching is done within a clock cycle at the neuron’s level at run time only by analyzing the received input data. The proposed architecture was tested and validated in an image quantization experiment where 6 quantization applications with different parameters (from 6 × 6 to 15 × 15 SOMs with inputs varying from 3 to 12 elements) were performed simultaneously.
在这项工作中,提出了一个可扩展和可适应的硬件SOM架构,允许并行执行多个应用程序。所提出的体系结构允许同时使用具有不同参数的多个SOM结构,以满足具有不同需求的多个应用。应用程序切换是在一个时钟周期内完成的,在神经元的水平上,只有通过分析接收到的输入数据在运行时。在一个图像量化实验中,同时进行了6个不同参数(从6 × 6到15 × 15个som,输入从3到12个元素)的量化应用,对所提出的架构进行了测试和验证。
{"title":"A Multi-Application, Scalable and Adaptable Hardware SOM Architecture","authors":"Mehdi Abadi, S. Jovanovic, K. Khalifa, S. Weber, M. H. Bedoui","doi":"10.1109/IJCNN.2019.8851797","DOIUrl":"https://doi.org/10.1109/IJCNN.2019.8851797","url":null,"abstract":"In this work, a scalable and adaptable hardware SOM architecture allowing to execute multiple applications in parallel is presented. The proposed architecture allows to use simultaneously multiple SOM structures with different parameters in order to satisfy multiple applications with different needs. The application switching is done within a clock cycle at the neuron’s level at run time only by analyzing the received input data. The proposed architecture was tested and validated in an image quantization experiment where 6 quantization applications with different parameters (from 6 × 6 to 15 × 15 SOMs with inputs varying from 3 to 12 elements) were performed simultaneously.","PeriodicalId":222797,"journal":{"name":"2019 International Joint Conference on Neural Networks (IJCNN)","volume":"93 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-07-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127341189","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
期刊
2019 International Joint Conference on Neural Networks (IJCNN)
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1