首页 > 最新文献

2009 IEEE International Conference on Computational Intelligence for Measurement Systems and Applications最新文献

英文 中文
Monitoring natural frequency for osseointegration and bone remodeling induced by dental implants 监测种植体诱导骨整合和骨重塑的自然频率
Wei Li, D. Lin, Qing Li, M. Swain
Dental implantation to a certain extent changes the biomechanical environment, thereby leading to the surrounding supporting bone to remodel. Computational remodeling has been well established in lone bone community and a range of mathematical formulae have been available with acceptable accuracy and effectiveness. However, there has been limited information and remodeling data available for dental scenarios, despite its predominate importance and popularity in clinic. An in-vivo frequency test technique was developed to determine the extent of osseointegration and remodeling passively. It could not help predict on-going healing and consequence of implantation. This paper develops a predictive model to relate osseointegration and bone remodeling to a progressive change in natural frequencies, thereby better utilizing the data acquired from experiments. The results allow us to establish a more realistic remodeling formula, thereby making a patient-specific prediction possible.
种植牙在一定程度上改变了生物力学环境,从而导致周围支撑骨的重塑。计算重建已经很好地建立在孤独骨群落和一系列的数学公式,具有可接受的准确性和有效性。然而,有有限的信息和重塑数据可用于牙科场景,尽管其在临床上占主导地位的重要性和普及。开发了一种体内频率测试技术来确定骨整合和被动重塑的程度。它不能帮助预测持续愈合和植入的后果。本文建立了一个预测模型,将骨整合和骨重塑与自然频率的渐进变化联系起来,从而更好地利用从实验中获得的数据。结果使我们能够建立一个更现实的重塑公式,从而使患者特异性预测成为可能。
{"title":"Monitoring natural frequency for osseointegration and bone remodeling induced by dental implants","authors":"Wei Li, D. Lin, Qing Li, M. Swain","doi":"10.1109/CIMSA.2009.5069953","DOIUrl":"https://doi.org/10.1109/CIMSA.2009.5069953","url":null,"abstract":"Dental implantation to a certain extent changes the biomechanical environment, thereby leading to the surrounding supporting bone to remodel. Computational remodeling has been well established in lone bone community and a range of mathematical formulae have been available with acceptable accuracy and effectiveness. However, there has been limited information and remodeling data available for dental scenarios, despite its predominate importance and popularity in clinic. An in-vivo frequency test technique was developed to determine the extent of osseointegration and remodeling passively. It could not help predict on-going healing and consequence of implantation. This paper develops a predictive model to relate osseointegration and bone remodeling to a progressive change in natural frequencies, thereby better utilizing the data acquired from experiments. The results allow us to establish a more realistic remodeling formula, thereby making a patient-specific prediction possible.","PeriodicalId":178669,"journal":{"name":"2009 IEEE International Conference on Computational Intelligence for Measurement Systems and Applications","volume":"101 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2009-05-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133948473","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
Effect of heterogeneous time delays and link weights on the stability and convergence time of large interconnected dynamical systems: A case study 异构时滞和链路权对大型互联动力系统稳定性和收敛时间的影响:一个实例研究
D. Megherbi, M. Madera, L. Dang
In this paper, we study the stability (convergence time) of an interconnected dynamical system with respect to its connectivity in the presence of delayed feedbacks sensory inputs/outputs data. In particular, we show that under some conditions, that we introduce and present in this paper, related to the interconnected links time-delays, the less connected a given dynamical system is, the longer it will take for the overall system to stabilize. We address the conditions for obtaining an estimate of the convergence time of the system based on the system interconnections weights and time delays. In particular, we study the conditions under which such property is conserved when homogenous and/or heterogeneous time delays are introduced to the links of the interconnected system considered. Analysis of the affect of arbitrary heterogeneous time delays on the dynamical system links, system stability, and convergence time is also presented.
在本文中,我们研究了在存在延迟反馈感官输入/输出数据的情况下,一个相互连接的动力系统的稳定性(收敛时间)。特别地,我们证明了在某些条件下,我们在本文中引入并给出了与互联环节时滞相关的条件,给定的动力系统连接越少,整个系统稳定所需的时间就越长。我们讨论了基于系统互连权值和时滞的系统收敛时间估计的条件。特别地,我们研究了当同质和/或异质时滞被引入所考虑的互联系统的链路时,这种性质保持的条件。分析了任意异构时滞对动力系统链路、系统稳定性和收敛时间的影响。
{"title":"Effect of heterogeneous time delays and link weights on the stability and convergence time of large interconnected dynamical systems: A case study","authors":"D. Megherbi, M. Madera, L. Dang","doi":"10.1109/CIMSA.2009.5069961","DOIUrl":"https://doi.org/10.1109/CIMSA.2009.5069961","url":null,"abstract":"In this paper, we study the stability (convergence time) of an interconnected dynamical system with respect to its connectivity in the presence of delayed feedbacks sensory inputs/outputs data. In particular, we show that under some conditions, that we introduce and present in this paper, related to the interconnected links time-delays, the less connected a given dynamical system is, the longer it will take for the overall system to stabilize. We address the conditions for obtaining an estimate of the convergence time of the system based on the system interconnections weights and time delays. In particular, we study the conditions under which such property is conserved when homogenous and/or heterogeneous time delays are introduced to the links of the interconnected system considered. Analysis of the affect of arbitrary heterogeneous time delays on the dynamical system links, system stability, and convergence time is also presented.","PeriodicalId":178669,"journal":{"name":"2009 IEEE International Conference on Computational Intelligence for Measurement Systems and Applications","volume":"11 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2009-05-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"134445312","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 6
Three-dimensional finite element modeling of Cochlear implant induced electrical current flows 人工耳蜗感应电流的三维有限元模拟
K. Chen, Qing Li, Wei Li, H. Lau, A. Ruys, P. Carter
Cochlear implants have been one of most successful electronic devices implanted to human bodies to convert mechanical signals to electronic signals to stimulate auditory nerves to react. The current flow in the region of the cochlear is the key to determine the performance of Cochlear implants. One of the efforts could be made to reduce current leakage into the brain to increase the efficiency of the device. This paper aims to construct a three-dimensional finite element (FE) model to examine the current flow path in different surrounding tissues involved. The MRI data is processed to generate solid model and then FE model for the numerical analysis, which contains gray and white matters of the brain that was assembled and was analyzed in ABAQUS. The modeling results provide us with an effective means to improvement of Cochlear implant design in the future.
人工耳蜗是目前植入人体的最成功的电子设备之一,它将机械信号转化为电子信号,刺激听觉神经作出反应。人工耳蜗区域内的电流是决定人工耳蜗植入物性能的关键。其中一项努力是减少电流泄漏到大脑中,以提高设备的效率。本文旨在建立一个三维有限元模型来研究电流在不同周围组织中的流动路径。对MRI数据进行处理,生成实体模型,再生成有限元模型进行数值分析,其中包含了组装后的脑灰质和白质,并在ABAQUS中进行分析。模拟结果为今后改进人工耳蜗的设计提供了有效的手段。
{"title":"Three-dimensional finite element modeling of Cochlear implant induced electrical current flows","authors":"K. Chen, Qing Li, Wei Li, H. Lau, A. Ruys, P. Carter","doi":"10.1109/CIMSA.2009.5069907","DOIUrl":"https://doi.org/10.1109/CIMSA.2009.5069907","url":null,"abstract":"Cochlear implants have been one of most successful electronic devices implanted to human bodies to convert mechanical signals to electronic signals to stimulate auditory nerves to react. The current flow in the region of the cochlear is the key to determine the performance of Cochlear implants. One of the efforts could be made to reduce current leakage into the brain to increase the efficiency of the device. This paper aims to construct a three-dimensional finite element (FE) model to examine the current flow path in different surrounding tissues involved. The MRI data is processed to generate solid model and then FE model for the numerical analysis, which contains gray and white matters of the brain that was assembled and was analyzed in ABAQUS. The modeling results provide us with an effective means to improvement of Cochlear implant design in the future.","PeriodicalId":178669,"journal":{"name":"2009 IEEE International Conference on Computational Intelligence for Measurement Systems and Applications","volume":"62 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2009-05-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130333278","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Adjusting the parameters of radial basis function networks using Particle Swarm Optimization 基于粒子群算法的径向基函数网络参数调整
A. Esmaeili, N. Mozayani
Particle Swarm Optimization (PSO), a new promising evolutionary optimization technique, has a wide range of application in optimization problems including training of artificial neural networks. In this paper, an attempt is made to completely train a RBF neural network architecture including the centers, optimum spreads, and the number of hidden units. The proposed method has been evaluated on some benchmark problems: Iris, Wine, Glass, New-thyroid and its accuracy was compared with other algorithms. The results show its strong generalization ability.
粒子群算法(PSO)是一种新兴的进化优化技术,在人工神经网络训练等优化问题中有着广泛的应用。本文尝试完整地训练一个RBF神经网络体系结构,包括中心、最优扩展和隐藏单元的数量。对Iris、Wine、Glass、New-thyroid等基准问题进行了评价,并对其他算法的准确率进行了比较。结果表明,该方法具有较强的泛化能力。
{"title":"Adjusting the parameters of radial basis function networks using Particle Swarm Optimization","authors":"A. Esmaeili, N. Mozayani","doi":"10.1109/CIMSA.2009.5069942","DOIUrl":"https://doi.org/10.1109/CIMSA.2009.5069942","url":null,"abstract":"Particle Swarm Optimization (PSO), a new promising evolutionary optimization technique, has a wide range of application in optimization problems including training of artificial neural networks. In this paper, an attempt is made to completely train a RBF neural network architecture including the centers, optimum spreads, and the number of hidden units. The proposed method has been evaluated on some benchmark problems: Iris, Wine, Glass, New-thyroid and its accuracy was compared with other algorithms. The results show its strong generalization ability.","PeriodicalId":178669,"journal":{"name":"2009 IEEE International Conference on Computational Intelligence for Measurement Systems and Applications","volume":"114 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2009-05-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132928289","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 24
Data fusion for user presence identification 用于用户状态识别的数据融合
V. Di Lecce, A. Amato, V. Piuri
Aim of this work is to present a new approach to the problem of user presence monitoring in working environments. Particularly, this work is focused on the evaluation of the presence or absence of a user in front of a terminal. This question is of paramount importance in applications requiring the user's presence e.g. video surveillance systems, control centrals, etc. The authors propose a technique of data fusion using signals from various low cost sensors.
这项工作的目的是提出一种新的方法来解决工作环境中用户存在监测的问题。特别是,这项工作集中在评估用户在终端前的存在或不存在。这个问题在需要用户在场的应用中是至关重要的,例如视频监控系统,控制中心等。作者提出了一种利用各种低成本传感器信号进行数据融合的技术。
{"title":"Data fusion for user presence identification","authors":"V. Di Lecce, A. Amato, V. Piuri","doi":"10.1109/CIMSA.2009.5069958","DOIUrl":"https://doi.org/10.1109/CIMSA.2009.5069958","url":null,"abstract":"Aim of this work is to present a new approach to the problem of user presence monitoring in working environments. Particularly, this work is focused on the evaluation of the presence or absence of a user in front of a terminal. This question is of paramount importance in applications requiring the user's presence e.g. video surveillance systems, control centrals, etc. The authors propose a technique of data fusion using signals from various low cost sensors.","PeriodicalId":178669,"journal":{"name":"2009 IEEE International Conference on Computational Intelligence for Measurement Systems and Applications","volume":"2 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2009-05-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123286051","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 9
Adaptively fusing neural network predictors toward higher accuracy: A case study 面向更高精度的自适应融合神经网络预测器:一个案例研究
Yunfeng Wu, S. Ng
In order to provide function approximation solutions with high accuracy, we employ a multi-learner system that combines a group of component neural networks (CNNs) with an adaptive weighted fusion (AWF) method. In the AWF, the optimization of the normalized weights is obtained with the constrained quadratic programming. Depending on the prediction errors of the CNNs from one input sample to another, the AWF can adaptively adjust the weights which are assigned to the CNNs. The results of the function approximation experiments on six benchmark data sets demonstrate that the AWF method can effectively help the multi-learner system achieve higher accuracy (measured in terms of mean-squared error) of prediction, in comparison with the popular the Bagging algorithm.
为了提供高精度的函数逼近解,我们采用了一种多学习器系统,该系统将一组组件神经网络(cnn)与自适应加权融合(AWF)方法相结合。在AWF中,利用约束二次规划方法对归一化权值进行优化。AWF可以根据cnn从一个输入样本到另一个输入样本的预测误差,自适应调整分配给cnn的权值。在6个基准数据集上的函数逼近实验结果表明,与目前流行的Bagging算法相比,AWF方法可以有效地帮助多学习器系统实现更高的预测精度(以均方误差衡量)。
{"title":"Adaptively fusing neural network predictors toward higher accuracy: A case study","authors":"Yunfeng Wu, S. Ng","doi":"10.1109/CIMSA.2009.5069964","DOIUrl":"https://doi.org/10.1109/CIMSA.2009.5069964","url":null,"abstract":"In order to provide function approximation solutions with high accuracy, we employ a multi-learner system that combines a group of component neural networks (CNNs) with an adaptive weighted fusion (AWF) method. In the AWF, the optimization of the normalized weights is obtained with the constrained quadratic programming. Depending on the prediction errors of the CNNs from one input sample to another, the AWF can adaptively adjust the weights which are assigned to the CNNs. The results of the function approximation experiments on six benchmark data sets demonstrate that the AWF method can effectively help the multi-learner system achieve higher accuracy (measured in terms of mean-squared error) of prediction, in comparison with the popular the Bagging algorithm.","PeriodicalId":178669,"journal":{"name":"2009 IEEE International Conference on Computational Intelligence for Measurement Systems and Applications","volume":"23 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2009-05-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127073953","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Research of improved immune clonal algorithms and its applications 改进免疫克隆算法及其应用研究
Gang Shi, Yuanwei Jing
Based on the clonal selection theory, this paper is put forward an improved immune clonal selection algorithm through the introduction of cloning operator, and used to solve the CVRP problem. The algorithm through the introduction of clonal proliferation, super mutation operators and clonal selection operators, improves the global convergence speed, and can effectively avoid prematurity. Through those operators, the variety ofantibody and afinity maturation was enhanced. Experimental results showed that the algorithm has a remarkable quality of the global convergence reliability and convergence velocity, thus solving effectively the CVRP problem.
在克隆选择理论的基础上,通过引入克隆算子,提出了一种改进的免疫克隆选择算法,并用于解决CVRP问题。该算法通过引入克隆增殖算子、超突变算子和克隆选择算子,提高了全局收敛速度,并能有效避免早熟。通过这些操作,增强了抗体的多样性和亲和力成熟。实验结果表明,该算法具有显著的全局收敛可靠性和收敛速度,有效地解决了CVRP问题。
{"title":"Research of improved immune clonal algorithms and its applications","authors":"Gang Shi, Yuanwei Jing","doi":"10.1109/CIMSA.2009.5069950","DOIUrl":"https://doi.org/10.1109/CIMSA.2009.5069950","url":null,"abstract":"Based on the clonal selection theory, this paper is put forward an improved immune clonal selection algorithm through the introduction of cloning operator, and used to solve the CVRP problem. The algorithm through the introduction of clonal proliferation, super mutation operators and clonal selection operators, improves the global convergence speed, and can effectively avoid prematurity. Through those operators, the variety ofantibody and afinity maturation was enhanced. Experimental results showed that the algorithm has a remarkable quality of the global convergence reliability and convergence velocity, thus solving effectively the CVRP problem.","PeriodicalId":178669,"journal":{"name":"2009 IEEE International Conference on Computational Intelligence for Measurement Systems and Applications","volume":"4 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2009-05-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114920831","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 7
Fuzzy control for one kind of curing process 一种固化过程的模糊控制
Lu Xin-jiang, L. Han-Xiong
In this paper, fuzzy control is proposed to control one kind of nonlinear curing process. The nonlinear curing process is firstly approximately modeled by the T-S fuzzy model, upon which fuzzy control is designed to guarantee the process stability and achieve the H∞ tracking performance. Finally, the proposed method is applied to control the temperature profile of a practical curing process.
本文提出了模糊控制方法来控制一类非线性固化过程。首先采用T-S模糊模型对非线性固化过程进行近似建模,在此基础上设计模糊控制以保证过程的稳定性并实现H∞跟踪性能。最后,将该方法应用于实际固化过程的温度分布控制。
{"title":"Fuzzy control for one kind of curing process","authors":"Lu Xin-jiang, L. Han-Xiong","doi":"10.1109/CIMSA.2009.5069920","DOIUrl":"https://doi.org/10.1109/CIMSA.2009.5069920","url":null,"abstract":"In this paper, fuzzy control is proposed to control one kind of nonlinear curing process. The nonlinear curing process is firstly approximately modeled by the T-S fuzzy model, upon which fuzzy control is designed to guarantee the process stability and achieve the H∞ tracking performance. Finally, the proposed method is applied to control the temperature profile of a practical curing process.","PeriodicalId":178669,"journal":{"name":"2009 IEEE International Conference on Computational Intelligence for Measurement Systems and Applications","volume":"8 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2009-05-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115201194","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Detecting errors in the ATLAS TDAQ system: A neural networks and support vector machines approach ATLAS TDAQ系统中的错误检测:神经网络和支持向量机方法
J. Sloper, E. Hines
This paper describes how neural networks and support vector machines can be used to detect errors in a large scale distributed system, specifically the ATLAS Trigger and Data AcQuisition (TDAQ) system. By collecting, analysing and preprocessing some of the data available in the system it is possible to recognize and/or predict error situations arising in the system. This can be done without detailed knowledge of the system, nor of the data available. Hence the presented methods could be used in similar system without significant changes. The TDAQ system, and in particular the main components related to this work, is described together with the test setup used. We simulate a number of error situations in the system and simultaneously gather both performance measures and error messages from the system. The data are then preprocessed and neural networks and support vector machines are applied to try to detect the error situations, achieving classification accuracy ranging from 88% to 100% for the neural networks and 90.8% to a 100% for the support vector machines approach.
本文描述了如何使用神经网络和支持向量机来检测大规模分布式系统中的错误,特别是ATLAS触发和数据采集(TDAQ)系统。通过收集、分析和预处理系统中可用的一些数据,可以识别和/或预测系统中出现的错误情况。这可以在没有系统详细知识或可用数据的情况下完成。因此,所提出的方法可以应用于类似的系统中,而不需要做很大的改变。TDAQ系统,特别是与这项工作相关的主要组件,以及所使用的测试设置进行了描述。我们模拟了系统中的许多错误情况,并同时从系统收集性能度量和错误消息。然后对数据进行预处理,并应用神经网络和支持向量机来检测错误情况,神经网络的分类准确率为88%至100%,支持向量机方法的分类准确率为90.8%至100%。
{"title":"Detecting errors in the ATLAS TDAQ system: A neural networks and support vector machines approach","authors":"J. Sloper, E. Hines","doi":"10.1109/CIMSA.2009.5069960","DOIUrl":"https://doi.org/10.1109/CIMSA.2009.5069960","url":null,"abstract":"This paper describes how neural networks and support vector machines can be used to detect errors in a large scale distributed system, specifically the ATLAS Trigger and Data AcQuisition (TDAQ) system. By collecting, analysing and preprocessing some of the data available in the system it is possible to recognize and/or predict error situations arising in the system. This can be done without detailed knowledge of the system, nor of the data available. Hence the presented methods could be used in similar system without significant changes. The TDAQ system, and in particular the main components related to this work, is described together with the test setup used. We simulate a number of error situations in the system and simultaneously gather both performance measures and error messages from the system. The data are then preprocessed and neural networks and support vector machines are applied to try to detect the error situations, achieving classification accuracy ranging from 88% to 100% for the neural networks and 90.8% to a 100% for the support vector machines approach.","PeriodicalId":178669,"journal":{"name":"2009 IEEE International Conference on Computational Intelligence for Measurement Systems and Applications","volume":"21 1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2009-05-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129577322","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Incorporating expert knowledge in Q-learning by means of fuzzy rules 利用模糊规则将专家知识融入q学习
M. Pourhassan, N. Mozayani
Incorporating expert knowledge in reinforcement learning is an important issue, especially when a large state space is concerned. In this paper, we present a novel method for accelerating the setting of Q-values in the well-known Q-learning algorithm. Fuzzy rules indicating the state values will be used, and the knowledge will be transformed to the Q-table or Q-function in some first training experiences. There have already been methods to initialize the Q-values using fuzzy rules, but the rules were the kind of state-action rules and needed the expert to know about environment transitions on actions. In the method introduced in this paper, the expert should only apply some rules to estimate the state value while no appreciations about state transitions are required. The introduced method has been examined in a multiagent system which has the shepherding scenario. The obtaining results show that Q-learning requires much less iterations for getting good results if using the fuzzy rules estimating the state value.
在强化学习中引入专家知识是一个重要的问题,特别是当涉及到一个大的状态空间时。在本文中,我们提出了一种新的方法来加速众所周知的q -学习算法中q值的设置。将使用指示状态值的模糊规则,并将知识转换为一些首次训练经验中的q表或q函数。已经有使用模糊规则初始化q值的方法,但这些规则是一种状态-动作规则,需要专家了解动作的环境转换。在本文所介绍的方法中,专家只需要应用一些规则来估计状态值,而不需要对状态转移进行评估。所介绍的方法已经在一个具有放牧场景的多智能体系统中进行了检验。得到的结果表明,如果使用模糊规则估计状态值,q -学习所需的迭代次数要少得多,并且得到了很好的结果。
{"title":"Incorporating expert knowledge in Q-learning by means of fuzzy rules","authors":"M. Pourhassan, N. Mozayani","doi":"10.1109/CIMSA.2009.5069952","DOIUrl":"https://doi.org/10.1109/CIMSA.2009.5069952","url":null,"abstract":"Incorporating expert knowledge in reinforcement learning is an important issue, especially when a large state space is concerned. In this paper, we present a novel method for accelerating the setting of Q-values in the well-known Q-learning algorithm. Fuzzy rules indicating the state values will be used, and the knowledge will be transformed to the Q-table or Q-function in some first training experiences. There have already been methods to initialize the Q-values using fuzzy rules, but the rules were the kind of state-action rules and needed the expert to know about environment transitions on actions. In the method introduced in this paper, the expert should only apply some rules to estimate the state value while no appreciations about state transitions are required. The introduced method has been examined in a multiagent system which has the shepherding scenario. The obtaining results show that Q-learning requires much less iterations for getting good results if using the fuzzy rules estimating the state value.","PeriodicalId":178669,"journal":{"name":"2009 IEEE International Conference on Computational Intelligence for Measurement Systems and Applications","volume":"27 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2009-05-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129246653","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
期刊
2009 IEEE International Conference on Computational Intelligence for Measurement Systems and Applications
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1