首页 > 最新文献

2016 IEEE International Conference on Computational Intelligence and Virtual Environments for Measurement Systems and Applications (CIVEMSA)最新文献

英文 中文
Multi attribute decision making model using multi rough set: Case study classification of anger intensity of Javanese woman 基于多粗糙集的多属性决策模型——以爪哇妇女愤怒程度分类为例
N. Fanani, U. D. Rosiani, S. Sumpeno, M. Purnomo
Decision-making process typically involves multiple attributes. It is using a part or whole attributes to find the best decision from the alternatives. Some methods such as rough set are used to solve this problem but it has worse time complexity with respect to the numerous attributes. Hence, Multi Rough Set is proposed to improve the performance of rough set. In this study, this method used to classify the anger of Javanese woman's which require numerous attributes but has limited number of object. We divided the information table into several groups which has similarity attribute and it is computed simultaneously. The decision of each group as result of rough set and then used fuzzy rule set to obtain the final result. Using leave one out cross validation obtained 79% more accurate than using single rough set for all attribute.
决策过程通常涉及多个属性。它是使用部分或全部属性从备选项中找到最佳决策。粗糙集等方法可以解决这一问题,但由于属性多,其时间复杂度较差。因此,提出了多粗糙集来提高粗糙集的性能。在本研究中,该方法用于爪哇女性愤怒的分类,该分类需要大量属性,但对象数量有限。我们将信息表分成具有相似属性的若干组,并同时计算。将每组的决策作为粗糙集的结果,然后利用模糊规则集得到最终结果。使用“留一”交叉验证比对所有属性使用单一粗糙集的准确率高79%。
{"title":"Multi attribute decision making model using multi rough set: Case study classification of anger intensity of Javanese woman","authors":"N. Fanani, U. D. Rosiani, S. Sumpeno, M. Purnomo","doi":"10.1109/CIVEMSA.2016.7524322","DOIUrl":"https://doi.org/10.1109/CIVEMSA.2016.7524322","url":null,"abstract":"Decision-making process typically involves multiple attributes. It is using a part or whole attributes to find the best decision from the alternatives. Some methods such as rough set are used to solve this problem but it has worse time complexity with respect to the numerous attributes. Hence, Multi Rough Set is proposed to improve the performance of rough set. In this study, this method used to classify the anger of Javanese woman's which require numerous attributes but has limited number of object. We divided the information table into several groups which has similarity attribute and it is computed simultaneously. The decision of each group as result of rough set and then used fuzzy rule set to obtain the final result. Using leave one out cross validation obtained 79% more accurate than using single rough set for all attribute.","PeriodicalId":244122,"journal":{"name":"2016 IEEE International Conference on Computational Intelligence and Virtual Environments for Measurement Systems and Applications (CIVEMSA)","volume":"24 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-06-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131240231","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
Identifying the location of spinal cord injury by support vector machines using time-frequency features of somatosensory evoked potentials 基于体感诱发电位时频特征的支持向量机识别脊髓损伤部位
Yazhou Wang, Yong Hu
Somatosensory evoked potentials (SEP) have been found to contain a series of time-frequency components that conveys information about the location of neurological deficits within the spinal cord. This study aims to develop a classification system for identifying the location of neurological deficit in cervical spinal cord based on the time-frequency patterns of SEPs. Waveforms of SEPs after compressive injuries at various locations (C4, C5, and C6) of rats' spinal cord were decomposed into a series of time-frequency components (TFCs) by a high resolution time-frequency analysis method, matching pursuit (MP). A classification system was build according to the distributional distinction of these TFCs among different levels using support vector machine (SVM). This distinction manifests itself in different categories of SEP TFCs. High-energy TFCs of normal state SEP have significantly higher power and frequency compared with those of injury state SEP. The level of C5 is characterized by a unique distribution pattern of middle-energy TFCs. And the difference between C4 and C6 level is evidenced by the distribution pattern of low-energy TFCs. The proposed classification system was proved to be able to distinguish the four functional status (normal, injury at C4, C5, and C6) with an accuracy of 80.17%.
体感诱发电位(SEP)已被发现包含一系列的时间-频率成分,传递有关脊髓内神经缺陷位置的信息。本研究旨在建立一个基于sep时频模式的分类系统,用于识别颈脊髓神经功能缺损的位置。采用高分辨率时频分析方法匹配追踪(MP),将大鼠脊髓不同部位(C4、C5、C6)压缩损伤后的sep波形分解为一系列时频分量(tfc)。根据这些tfc在不同层次上的分布差异,利用支持向量机(SVM)建立了分类系统。这种区别表现在SEP tfc的不同类别上。正常状态SEP的高能tfc功率和频率明显高于损伤状态SEP, C5水平中能量tfc具有独特的分布模式。C4和C6水平的差异体现在低能tfc的分布格局上。结果表明,该分类系统能够区分正常、C4、C5、C6损伤四种功能状态,准确率为80.17%。
{"title":"Identifying the location of spinal cord injury by support vector machines using time-frequency features of somatosensory evoked potentials","authors":"Yazhou Wang, Yong Hu","doi":"10.1109/CIVEMSA.2016.7524315","DOIUrl":"https://doi.org/10.1109/CIVEMSA.2016.7524315","url":null,"abstract":"Somatosensory evoked potentials (SEP) have been found to contain a series of time-frequency components that conveys information about the location of neurological deficits within the spinal cord. This study aims to develop a classification system for identifying the location of neurological deficit in cervical spinal cord based on the time-frequency patterns of SEPs. Waveforms of SEPs after compressive injuries at various locations (C4, C5, and C6) of rats' spinal cord were decomposed into a series of time-frequency components (TFCs) by a high resolution time-frequency analysis method, matching pursuit (MP). A classification system was build according to the distributional distinction of these TFCs among different levels using support vector machine (SVM). This distinction manifests itself in different categories of SEP TFCs. High-energy TFCs of normal state SEP have significantly higher power and frequency compared with those of injury state SEP. The level of C5 is characterized by a unique distribution pattern of middle-energy TFCs. And the difference between C4 and C6 level is evidenced by the distribution pattern of low-energy TFCs. The proposed classification system was proved to be able to distinguish the four functional status (normal, injury at C4, C5, and C6) with an accuracy of 80.17%.","PeriodicalId":244122,"journal":{"name":"2016 IEEE International Conference on Computational Intelligence and Virtual Environments for Measurement Systems and Applications (CIVEMSA)","volume":"52 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-06-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128712703","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Using 6 DOF vision-inertial tracking to evaluate and improve low cost depth sensor based SLAM 利用6自由度视觉惯性跟踪对低成本深度传感器SLAM进行评价和改进
Thomas Calloway, D. Megherbi
Systems that use low cost depth sensors, to perform 3D reconstructions of environments while simultaneously tracking sensor pose, have received significant attention in recent years. While the majority of publications in the literature on the subject focus on the successes of various 3D scene reconstruction algorithms used, few attempt to quantify the practical limitations of the RGB-D sensors themselves. Furthermore, many publications report successful results while ignoring the many situations in which the systems will be entirely non-functional. In our prior work, using an optical-inertial motion tracker, we evaluated 3 Degree-Of-Freedom (3 DOF) sensor orientation estimation errors existing in a Simultaneous Localization and Mapping (SLAM) implementation based on the popular Microsoft Kinect. In this paper we present and extend our analysis of 3 DOF sensor orientation estimation error, using an optical-inertial motion tracker, to include the full 6 DOF sensor pose (positioning and orientation). We then fully integrate the motion tracker into the original depth sensor-based algorithm, demonstrating improved reliability and accuracy of scene reconstruction.
近年来,使用低成本深度传感器的系统在跟踪传感器姿态的同时执行环境的3D重建,受到了极大的关注。虽然关于该主题的大多数出版物都集中在使用的各种3D场景重建算法的成功上,但很少有人试图量化RGB-D传感器本身的实际限制。此外,许多出版物报告了成功的结果,而忽略了系统将完全不起作用的许多情况。在我们之前的工作中,我们使用光学惯性运动跟踪器,评估了基于流行的微软Kinect的同步定位和地图(SLAM)实现中存在的3个自由度(3 DOF)传感器方向估计误差。在本文中,我们提出并扩展了使用光学惯性运动跟踪器对3自由度传感器方向估计误差的分析,以包括完整的6自由度传感器姿态(定位和方向)。然后,我们将运动跟踪器完全集成到原始的基于深度传感器的算法中,证明了场景重建的可靠性和准确性。
{"title":"Using 6 DOF vision-inertial tracking to evaluate and improve low cost depth sensor based SLAM","authors":"Thomas Calloway, D. Megherbi","doi":"10.1109/CIVEMSA.2016.7524314","DOIUrl":"https://doi.org/10.1109/CIVEMSA.2016.7524314","url":null,"abstract":"Systems that use low cost depth sensors, to perform 3D reconstructions of environments while simultaneously tracking sensor pose, have received significant attention in recent years. While the majority of publications in the literature on the subject focus on the successes of various 3D scene reconstruction algorithms used, few attempt to quantify the practical limitations of the RGB-D sensors themselves. Furthermore, many publications report successful results while ignoring the many situations in which the systems will be entirely non-functional. In our prior work, using an optical-inertial motion tracker, we evaluated 3 Degree-Of-Freedom (3 DOF) sensor orientation estimation errors existing in a Simultaneous Localization and Mapping (SLAM) implementation based on the popular Microsoft Kinect. In this paper we present and extend our analysis of 3 DOF sensor orientation estimation error, using an optical-inertial motion tracker, to include the full 6 DOF sensor pose (positioning and orientation). We then fully integrate the motion tracker into the original depth sensor-based algorithm, demonstrating improved reliability and accuracy of scene reconstruction.","PeriodicalId":244122,"journal":{"name":"2016 IEEE International Conference on Computational Intelligence and Virtual Environments for Measurement Systems and Applications (CIVEMSA)","volume":"445 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-06-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126054327","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
Secured and energy efficient architecture for sensor networks 传感器网络的安全节能架构
Jetendra Joshi, Amrit Bagga, Abhinandan Bhargava, Abhinav Goel, Divya Kurian, Urijit Kurulkar
Wireless Sensor Network has been one of the most diversified and widely used area and has a vast range of has applications in almost every field. Wireless Sensor Network is a domain with a large number of motes that collects data from the surrounding and after processing, it transfers the data to the sink node through intermediate sensor node after which it is finally transmitted to the base station. With wide range of applications, Wireless Sensor Network comes up with one of the major issues i.e. Energy Consumption. Due to the dense network topology of WSN, the communication range is short which incurs a redundancy in the sensed data. To reduce this redundancy, Data Aggregation and Data Fusion are most effective as it helps in saving both data and energy. This paper proposes a Secure and energy efficient architecture that takes account of the constraints of sensor networks. A hierarchical network topology is formed that enables end-to-end communication between sensor nodes and the architecture also supports the detection and isolation of malicious nodes. Moreover, security issues of a wireless sensor network are also a major concern and so, we aim to design a secured architecture for reliable and safe data communication. To make the system energy efficient, Low-Energy Adaptive Clustering Hierarchy (LEACH) algorithm has been used. Algorithm also helps in the secure transmission of data and also conserves energy. By doing simulations in NS2 we found that it saves energy and hence enhances the lifetime of a mote.
无线传感器网络已经成为最多样化和应用最广泛的领域之一,在几乎每个领域都有广泛的应用。无线传感器网络是一个有大量节点的领域,它从周围采集数据,经过处理后,通过中间传感器节点将数据传输到汇聚节点,最后传输到基站。随着无线传感器网络的广泛应用,其主要问题之一就是能耗问题。由于无线传感器网络的密集网络拓扑结构,使得其通信范围较短,从而导致了感知数据的冗余。为了减少这种冗余,数据聚合和数据融合是最有效的,因为它有助于节省数据和能源。本文提出了一种考虑传感器网络约束的安全节能架构。形成了分层的网络拓扑结构,实现了传感器节点之间的端到端通信,并支持恶意节点的检测和隔离。此外,无线传感器网络的安全问题也是一个主要关注的问题,因此,我们的目标是设计一个安全的架构,以实现可靠和安全的数据通信。为了提高系统的能量利用率,采用了低能量自适应聚类层次算法。算法还有助于数据的安全传输,并节约能源。通过在NS2中进行模拟,我们发现它节省了能量,从而提高了mote的寿命。
{"title":"Secured and energy efficient architecture for sensor networks","authors":"Jetendra Joshi, Amrit Bagga, Abhinandan Bhargava, Abhinav Goel, Divya Kurian, Urijit Kurulkar","doi":"10.1109/CIVEMSA.2016.7524319","DOIUrl":"https://doi.org/10.1109/CIVEMSA.2016.7524319","url":null,"abstract":"Wireless Sensor Network has been one of the most diversified and widely used area and has a vast range of has applications in almost every field. Wireless Sensor Network is a domain with a large number of motes that collects data from the surrounding and after processing, it transfers the data to the sink node through intermediate sensor node after which it is finally transmitted to the base station. With wide range of applications, Wireless Sensor Network comes up with one of the major issues i.e. Energy Consumption. Due to the dense network topology of WSN, the communication range is short which incurs a redundancy in the sensed data. To reduce this redundancy, Data Aggregation and Data Fusion are most effective as it helps in saving both data and energy. This paper proposes a Secure and energy efficient architecture that takes account of the constraints of sensor networks. A hierarchical network topology is formed that enables end-to-end communication between sensor nodes and the architecture also supports the detection and isolation of malicious nodes. Moreover, security issues of a wireless sensor network are also a major concern and so, we aim to design a secured architecture for reliable and safe data communication. To make the system energy efficient, Low-Energy Adaptive Clustering Hierarchy (LEACH) algorithm has been used. Algorithm also helps in the secure transmission of data and also conserves energy. By doing simulations in NS2 we found that it saves energy and hence enhances the lifetime of a mote.","PeriodicalId":244122,"journal":{"name":"2016 IEEE International Conference on Computational Intelligence and Virtual Environments for Measurement Systems and Applications (CIVEMSA)","volume":"50 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-06-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127334956","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 5
Analyzing images in frequency domain to estimate the quality of wood particles in OSB production 利用频域图像分析方法对木屑颗粒质量进行评估
R. D. Labati, A. Genovese, E. M. Ballester, V. Piuri, F. Scotti, Gianluca Sforza
The analysis of the quality of particulate materials is of great importance for a variety of research and industrial applications. Most image-based methods rely on the segmentation of the image to measure the particles and aggregate their characteristics. However, the segmentation of particulate materials can be severely affected when the setup is not controlled. For instance, when there are device errors, changes in the light conditions, or when the camera gets dirty because of the dust or a similar substance. All of these circumstances are common in industrial setups, like the one studied in this paper. This work presents a framework for quality estimation based on image processing algorithms that avoids segmentation. The considered application scenario is the online quality control of the production of Oriented Strand Boards (OSB), a type of wood panel frequently used in construction and manufacturing industries. The proposed method quantizes frequency domain into a histogram using a non-parametric method, which is later exploited using computational intelligence to classify the quality of superimposed wood particles deposed on a conveyor belt. The method has been tested using synthetic and real images with different noise conditions. The results illustrate the robustness of the approach and its capability to detect significant quality changes in the wood particles.
颗粒材料的质量分析对各种研究和工业应用具有重要意义。大多数基于图像的方法依赖于图像的分割来测量粒子并聚合它们的特征。然而,当设置不受控制时,颗粒材料的分割会受到严重影响。例如,当设备出现错误,光线条件发生变化,或者当相机被灰尘或类似物质弄脏时。所有这些情况在工业装置中都很常见,就像本文所研究的那样。这项工作提出了一个基于图像处理算法的质量估计框架,避免了分割。考虑的应用场景是定向刨花板(OSB)生产的在线质量控制,OSB是一种经常用于建筑和制造业的木板。该方法使用非参数方法将频域量化为直方图,然后利用计算智能对沉积在传送带上的叠加木颗粒的质量进行分类。用不同噪声条件下的合成图像和真实图像对该方法进行了测试。结果说明了该方法的鲁棒性及其检测木材颗粒显著质量变化的能力。
{"title":"Analyzing images in frequency domain to estimate the quality of wood particles in OSB production","authors":"R. D. Labati, A. Genovese, E. M. Ballester, V. Piuri, F. Scotti, Gianluca Sforza","doi":"10.1109/CIVEMSA.2016.7524251","DOIUrl":"https://doi.org/10.1109/CIVEMSA.2016.7524251","url":null,"abstract":"The analysis of the quality of particulate materials is of great importance for a variety of research and industrial applications. Most image-based methods rely on the segmentation of the image to measure the particles and aggregate their characteristics. However, the segmentation of particulate materials can be severely affected when the setup is not controlled. For instance, when there are device errors, changes in the light conditions, or when the camera gets dirty because of the dust or a similar substance. All of these circumstances are common in industrial setups, like the one studied in this paper. This work presents a framework for quality estimation based on image processing algorithms that avoids segmentation. The considered application scenario is the online quality control of the production of Oriented Strand Boards (OSB), a type of wood panel frequently used in construction and manufacturing industries. The proposed method quantizes frequency domain into a histogram using a non-parametric method, which is later exploited using computational intelligence to classify the quality of superimposed wood particles deposed on a conveyor belt. The method has been tested using synthetic and real images with different noise conditions. The results illustrate the robustness of the approach and its capability to detect significant quality changes in the wood particles.","PeriodicalId":244122,"journal":{"name":"2016 IEEE International Conference on Computational Intelligence and Virtual Environments for Measurement Systems and Applications (CIVEMSA)","volume":"18 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-06-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123815023","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 5
Measurement classification using hybrid weighted Naive Bayes 基于混合加权朴素贝叶斯的测量分类
David Hamblin, Dali Wang, Gao Chen
This paper presents an algorithm for classifying measurement variables within airborne measurement data files collected by NASA. The proposed solution utilizes a combination of decision tree and Naive Bayes classifiers. In order to mitigate the independence assumption of Naive Bayes, we apply a weight vector to the feature set based on each feature's role in the classification process. The Analytic Hierarchy Process is selected to calculate the weight vector, after an investigation of various weight calculation techniques. The assessment of the algorithm with recent NASA data shows that the algorithm delivers robust results, and exceeds the performance expectation in the presence of inconsistencies and inaccuracies among measurement data.
提出了一种NASA机载测量数据文件中测量变量的分类算法。提出的解决方案利用决策树和朴素贝叶斯分类器的组合。为了减轻朴素贝叶斯的独立性假设,我们根据每个特征在分类过程中的作用对特征集应用权重向量。在研究了各种权重计算方法后,选择层次分析法来计算权重向量。用NASA最近的数据对该算法进行的评估表明,该算法提供了稳健的结果,并且在测量数据不一致和不准确的情况下超出了预期的性能。
{"title":"Measurement classification using hybrid weighted Naive Bayes","authors":"David Hamblin, Dali Wang, Gao Chen","doi":"10.1109/CIVEMSA.2016.7524248","DOIUrl":"https://doi.org/10.1109/CIVEMSA.2016.7524248","url":null,"abstract":"This paper presents an algorithm for classifying measurement variables within airborne measurement data files collected by NASA. The proposed solution utilizes a combination of decision tree and Naive Bayes classifiers. In order to mitigate the independence assumption of Naive Bayes, we apply a weight vector to the feature set based on each feature's role in the classification process. The Analytic Hierarchy Process is selected to calculate the weight vector, after an investigation of various weight calculation techniques. The assessment of the algorithm with recent NASA data shows that the algorithm delivers robust results, and exceeds the performance expectation in the presence of inconsistencies and inaccuracies among measurement data.","PeriodicalId":244122,"journal":{"name":"2016 IEEE International Conference on Computational Intelligence and Virtual Environments for Measurement Systems and Applications (CIVEMSA)","volume":"7 3 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-06-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116816540","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
A hybrid P2P and master-slave cooperative distributed multi-agent reinforcement learning technique with asynchronously triggered exploratory trials and clutter-index-based selected sub-goals 一种异步触发探索性试验和基于杂波索引选择子目标的混合型P2P和主从合作分布式多智能体强化学习技术
D. Megherbi, Minsuk Kim
In many large infrastructures, such as military battlefields, transportation and maritime systems spanning hundreds of miles at a time, collaborative multi-agent based monitoring is important. Agent Reinforcement Learning (RL), in general, becomes more challenging in a dynamic complex cluttered environment for autonomous path planning, where agents could be moving randomly to reach their respective goals. In our previous work we presented a hybrid master-slave and peer-to-peer system architecture, where each distributed agent knows only of a given master node, is only concerned with its assigned work load, has a limited knowledge of the environment and can, collaboratively with other agents, share learned information of the environment over a communication network. In this paper we extend our previous work and focus on (a) the study of the performance of said system and the effect of the agents' random walks on the overall system agent learning speed, when each of the distributed agents, after the random walk phase, starts its exploratory trials independently of the other agents, asynchronously, and immediately after it finishes its first exploratory trial towards a sub-goal or after its random walk phase, without waiting for the slowest agent to finish its first random walk or its first exploratory phase toward a sub-goal. (b) the effect on the agent learning speed, of using an environment-clutter-index to select agent sub-goals with the aim of reducing the agent initial random walk steps and (c) the effect of agent sharing/or not sharing environment information on the agent learning speed in such scenarios.
在许多大型基础设施中,例如军事战场、运输和海上系统,一次跨越数百英里,基于多代理的协作监控非常重要。一般来说,智能体强化学习(RL)在动态复杂混乱的环境中变得更具挑战性,因为智能体可以随机移动以达到各自的目标。在我们之前的工作中,我们提出了一个主从和点对点的混合系统架构,其中每个分布式代理只知道一个给定的主节点,只关心其分配的工作负载,对环境的了解有限,并且可以与其他代理协作,通过通信网络共享环境的学习信息。在本文中,我们扩展了之前的工作,并专注于(a)研究所述系统的性能以及智能体随机行走对整个系统智能体学习速度的影响,当每个分布式智能体在随机行走阶段之后,独立于其他智能体异步地开始其探索性试验,并且在完成其针对子目标的第一次探索性试验之后或在其随机行走阶段之后,无需等待最慢的智能体完成第一次随机漫步或第一次探索阶段。(b)使用环境-杂乱指数来选择代理子目标以减少代理初始随机行走步数对代理学习速度的影响;(c)在这种情况下,代理共享/不共享环境信息对代理学习速度的影响。
{"title":"A hybrid P2P and master-slave cooperative distributed multi-agent reinforcement learning technique with asynchronously triggered exploratory trials and clutter-index-based selected sub-goals","authors":"D. Megherbi, Minsuk Kim","doi":"10.1109/CIVEMSA.2016.7524249","DOIUrl":"https://doi.org/10.1109/CIVEMSA.2016.7524249","url":null,"abstract":"In many large infrastructures, such as military battlefields, transportation and maritime systems spanning hundreds of miles at a time, collaborative multi-agent based monitoring is important. Agent Reinforcement Learning (RL), in general, becomes more challenging in a dynamic complex cluttered environment for autonomous path planning, where agents could be moving randomly to reach their respective goals. In our previous work we presented a hybrid master-slave and peer-to-peer system architecture, where each distributed agent knows only of a given master node, is only concerned with its assigned work load, has a limited knowledge of the environment and can, collaboratively with other agents, share learned information of the environment over a communication network. In this paper we extend our previous work and focus on (a) the study of the performance of said system and the effect of the agents' random walks on the overall system agent learning speed, when each of the distributed agents, after the random walk phase, starts its exploratory trials independently of the other agents, asynchronously, and immediately after it finishes its first exploratory trial towards a sub-goal or after its random walk phase, without waiting for the slowest agent to finish its first random walk or its first exploratory phase toward a sub-goal. (b) the effect on the agent learning speed, of using an environment-clutter-index to select agent sub-goals with the aim of reducing the agent initial random walk steps and (c) the effect of agent sharing/or not sharing environment information on the agent learning speed in such scenarios.","PeriodicalId":244122,"journal":{"name":"2016 IEEE International Conference on Computational Intelligence and Virtual Environments for Measurement Systems and Applications (CIVEMSA)","volume":"66 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-06-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123261971","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
期刊
2016 IEEE International Conference on Computational Intelligence and Virtual Environments for Measurement Systems and Applications (CIVEMSA)
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1