首页 > 最新文献

2019 International Conference on Artificial Intelligence in Information and Communication (ICAIIC)最新文献

英文 中文
ICAIIC 2019 TOC
{"title":"ICAIIC 2019 TOC","authors":"","doi":"10.1109/icaiic.2019.8669001","DOIUrl":"https://doi.org/10.1109/icaiic.2019.8669001","url":null,"abstract":"","PeriodicalId":273383,"journal":{"name":"2019 International Conference on Artificial Intelligence in Information and Communication (ICAIIC)","volume":"27 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129694143","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Vehicle/Pedestrian Localization System Using Multiple Radio Beacons and Machine Learning for Smart Parking 基于多无线电信标和机器学习的智能停车车辆/行人定位系统
Takuro Ebuchi, Hiroshi Yamamoto
In recent years, the number of casualties and injuries at intersections and roads has been decreasing due to wide spread of safe driving support systems, but the number of casualties and injuries due to low-speed traffic accidents in parking lots has not decreased. In the parking lot, it is necessary to drive while looking for an empty slot, which may result in contact accidents with pedestrians. Therefore, in this research, we propose a new smart parking system that prevents low-speed contact accidents by estimating availability of slots in the parking lot and the position of pedestrians. The proposed system attempts to estimate positions of user’s smartphones by deploying a small number of beacon devices on the parking lot, and by analyzing the radio wave intensity measured by the smartphones. In addition, estimation accuracy of the position of the pedestrian / driver is evaluated by experimental evaluation in a parking lot. Through the performance evaluation, estimation accuracy of the vehicle’s position to higher than 98%, and estimation accuracy of the pedestrian’s position is about 70%.
近年来,由于安全驾驶辅助系统的广泛应用,十字路口和道路上的伤亡人数不断减少,但停车场低速交通事故的伤亡人数并没有减少。在停车场,需要一边开车一边寻找空槽,这可能会导致与行人的接触事故。因此,在本研究中,我们提出了一种新的智能停车系统,该系统通过估计停车场槽位的可用性和行人的位置来防止低速接触事故。该系统试图通过在停车场部署少量信标设备,并通过分析智能手机测量的无线电波强度来估计用户智能手机的位置。此外,以停车场为例,通过实验评价对行人/驾驶员位置的估计精度进行了评价。通过性能评估,对车辆位置的估计精度达到98%以上,对行人位置的估计精度达到70%左右。
{"title":"Vehicle/Pedestrian Localization System Using Multiple Radio Beacons and Machine Learning for Smart Parking","authors":"Takuro Ebuchi, Hiroshi Yamamoto","doi":"10.1109/ICAIIC.2019.8668993","DOIUrl":"https://doi.org/10.1109/ICAIIC.2019.8668993","url":null,"abstract":"In recent years, the number of casualties and injuries at intersections and roads has been decreasing due to wide spread of safe driving support systems, but the number of casualties and injuries due to low-speed traffic accidents in parking lots has not decreased. In the parking lot, it is necessary to drive while looking for an empty slot, which may result in contact accidents with pedestrians. Therefore, in this research, we propose a new smart parking system that prevents low-speed contact accidents by estimating availability of slots in the parking lot and the position of pedestrians. The proposed system attempts to estimate positions of user’s smartphones by deploying a small number of beacon devices on the parking lot, and by analyzing the radio wave intensity measured by the smartphones. In addition, estimation accuracy of the position of the pedestrian / driver is evaluated by experimental evaluation in a parking lot. Through the performance evaluation, estimation accuracy of the vehicle’s position to higher than 98%, and estimation accuracy of the pedestrian’s position is about 70%.","PeriodicalId":273383,"journal":{"name":"2019 International Conference on Artificial Intelligence in Information and Communication (ICAIIC)","volume":"34 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129316506","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 10
ICAIIC 2019 Venue
{"title":"ICAIIC 2019 Venue","authors":"","doi":"10.1109/icaiic.2019.8668994","DOIUrl":"https://doi.org/10.1109/icaiic.2019.8668994","url":null,"abstract":"","PeriodicalId":273383,"journal":{"name":"2019 International Conference on Artificial Intelligence in Information and Communication (ICAIIC)","volume":"76 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127334812","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Pedestrian Detection and Distance Estimation Using Thermal Camera in Night Time 基于热像仪的夜间行人检测与距离估计
Jongbae Kim
In this paper, we propose a method to detect a pedestrian in real time in a low illumination environment and estimate the distance from the camera using a smart phone based thermal camera. Thermal cameras use equipment that can be attached to low-cost smartphones and which use cameras for image processing in real-time. A pedestrian detector is created using a multi-stage cascade learning device to detect pedestrians in a low-illuminated environment, and the pedestrian area is detected using this detector. Then, the distance is estimated by calculating the position of the pedestrian detected in the real-world 3D environment in the 2D thermal image by calculating the parameters detected by the thermal imaging camera in advance. Experimental results show that the detection accuracy of pedestrians is about 91% and the accuracy of distance estimation is 95%. In this way, the proposed method can be applied to the image sensing system in real time in a low-illuminance environment such as nighttime.
在本文中,我们提出了一种在低照度环境下实时检测行人的方法,并使用基于智能手机的热像仪估计行人与相机的距离。热像仪使用的设备可以连接到低成本的智能手机上,并且使用相机进行实时图像处理。使用多级级联学习装置创建行人检测器,用于检测低照度环境下的行人,并使用该检测器检测行人区域。然后,通过预先计算热像仪检测到的参数,计算出在真实三维环境中检测到的行人在二维热图像中的位置,从而估计出距离。实验结果表明,该方法对行人的检测准确率约为91%,距离估计准确率为95%。这样,所提出的方法可以应用于夜间等低照度环境下的实时图像传感系统。
{"title":"Pedestrian Detection and Distance Estimation Using Thermal Camera in Night Time","authors":"Jongbae Kim","doi":"10.1109/ICAIIC.2019.8669070","DOIUrl":"https://doi.org/10.1109/ICAIIC.2019.8669070","url":null,"abstract":"In this paper, we propose a method to detect a pedestrian in real time in a low illumination environment and estimate the distance from the camera using a smart phone based thermal camera. Thermal cameras use equipment that can be attached to low-cost smartphones and which use cameras for image processing in real-time. A pedestrian detector is created using a multi-stage cascade learning device to detect pedestrians in a low-illuminated environment, and the pedestrian area is detected using this detector. Then, the distance is estimated by calculating the position of the pedestrian detected in the real-world 3D environment in the 2D thermal image by calculating the parameters detected by the thermal imaging camera in advance. Experimental results show that the detection accuracy of pedestrians is about 91% and the accuracy of distance estimation is 95%. In this way, the proposed method can be applied to the image sensing system in real time in a low-illuminance environment such as nighttime.","PeriodicalId":273383,"journal":{"name":"2019 International Conference on Artificial Intelligence in Information and Communication (ICAIIC)","volume":"241 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132951183","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 6
Adaptive Natural Gradient Method for Learning Neural Networks with Large Data set in Mini-Batch Mode 小批模式下神经网络学习的自适应自然梯度方法
Hyeyoung Park, Kwanyong Lee
Natural gradient learning, which is one of gradient descent learning methods, is known to have ideal convergence properties in the learning of hierarchical machines such as layered neural networks. However, there are a few limitations that degrades its practical usability: necessity of true probability density function of input variables and heavy computational cost due to matrix inversion. Though its adaptive approximation have been developed, it is basically derived for online learning mode, in which a single update is done for a single data sample. Noting that the on-line learning mode is not appropriate for the tasks with huge number of training data, this paper proposes a practical implementation of natural gradient for mini-batch learning mode, which is the most common setting in the real application with large data set. Computational experiments on benchmark datasets shows the efficiency of the proposed methods.
自然梯度学习是梯度下降学习方法的一种,在分层神经网络等层次机器的学习中具有理想的收敛性。然而,由于输入变量的真实概率密度函数的必要性和矩阵反演的计算成本大,降低了其实际可用性。虽然它的自适应近似已经被开发出来,但它基本上是为在线学习模式导出的,在在线学习模式中,对单个数据样本进行一次更新。注意到在线学习模式不适合训练数据量巨大的任务,本文提出了一种基于自然梯度的小批量学习模式的实际实现,这是大数据集实际应用中最常见的设置。在基准数据集上的计算实验表明了所提方法的有效性。
{"title":"Adaptive Natural Gradient Method for Learning Neural Networks with Large Data set in Mini-Batch Mode","authors":"Hyeyoung Park, Kwanyong Lee","doi":"10.1109/ICAIIC.2019.8669082","DOIUrl":"https://doi.org/10.1109/ICAIIC.2019.8669082","url":null,"abstract":"Natural gradient learning, which is one of gradient descent learning methods, is known to have ideal convergence properties in the learning of hierarchical machines such as layered neural networks. However, there are a few limitations that degrades its practical usability: necessity of true probability density function of input variables and heavy computational cost due to matrix inversion. Though its adaptive approximation have been developed, it is basically derived for online learning mode, in which a single update is done for a single data sample. Noting that the on-line learning mode is not appropriate for the tasks with huge number of training data, this paper proposes a practical implementation of natural gradient for mini-batch learning mode, which is the most common setting in the real application with large data set. Computational experiments on benchmark datasets shows the efficiency of the proposed methods.","PeriodicalId":273383,"journal":{"name":"2019 International Conference on Artificial Intelligence in Information and Communication (ICAIIC)","volume":"55 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121320131","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
People Crowd Density Estimation System using Deep Learning for Radio Wave Sensing of Cellular Communication 基于深度学习的蜂窝通信无线电波感知人群密度估计系统
Kyosuke Shibata, Hiroshi Yamamoto
In recent years, research and development of a people flow observation system is attracting attention in various fields (e.g., city area, shopping district) because the directional information of people flow is very useful for various objective (e.g., navigation, evacuation). However, existing studies of the observation system have mainly been utilizing cameras and image analysis techniques for specifying people flow, but the use of cameras is not preferable in actual fields because of the privacy issues.Therefore, in this study, we propose a new people crowd density observation system for people flow observation. In order to avoid privacy issues, the proposed system dmeasures only signal strength of radio waves of the cellular communication. Furthermore, the measurement results are analyzed by utilizing several machine learning techniques so as to estimate crowd density of many people who have a mobile phone or a smartphone.
近年来,人流观测系统的研究和开发受到了各个领域(如城市区域、购物区)的关注,因为人流的方向信息对各种目标(如导航、疏散)都有很大的帮助。然而,现有的观测系统研究主要是利用摄像机和图像分析技术来指定人流,但由于隐私问题,在实际领域中使用摄像机并不可取。因此,在本研究中,我们提出了一种新的人群密度观测系统,用于人流观测。为了避免隐私问题,该系统仅测量蜂窝通信无线电波的信号强度。此外,通过使用几种机器学习技术对测量结果进行分析,以估计拥有手机或智能手机的许多人的人群密度。
{"title":"People Crowd Density Estimation System using Deep Learning for Radio Wave Sensing of Cellular Communication","authors":"Kyosuke Shibata, Hiroshi Yamamoto","doi":"10.1109/ICAIIC.2019.8669071","DOIUrl":"https://doi.org/10.1109/ICAIIC.2019.8669071","url":null,"abstract":"In recent years, research and development of a people flow observation system is attracting attention in various fields (e.g., city area, shopping district) because the directional information of people flow is very useful for various objective (e.g., navigation, evacuation). However, existing studies of the observation system have mainly been utilizing cameras and image analysis techniques for specifying people flow, but the use of cameras is not preferable in actual fields because of the privacy issues.Therefore, in this study, we propose a new people crowd density observation system for people flow observation. In order to avoid privacy issues, the proposed system dmeasures only signal strength of radio waves of the cellular communication. Furthermore, the measurement results are analyzed by utilizing several machine learning techniques so as to estimate crowd density of many people who have a mobile phone or a smartphone.","PeriodicalId":273383,"journal":{"name":"2019 International Conference on Artificial Intelligence in Information and Communication (ICAIIC)","volume":"91 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116670582","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 9
Image Recommendation for Automatic Report Generation using Semantic Similarity 使用语义相似度自动生成报表的图像推荐
Changhun Hyun, Hyeyoung Park
Automatic report generation is a technology that automatically generates documents in the form of report by summarizing various materials according to a specific topic in time sequence or subject. Although the main content of the report is text, insertion of appropriate images can improve the completeness of the report. In this paper, we propose an image recommendation method for automatically selecting and inserting appropriate images corresponding to a specific part of a report. In our proposed method, reevaluation of the candidate images is performed based on the semantic similarity between query and the contents of the images. In order to transform semantic information of text query and image into one vector space, we extracted semantic information from image as a set of tags form using deep learning based object detection module. Also, we extracted tags from the given title of the image so that the proposed system can evaluate the candidate images even in the case that the given query includes specific keywords or proper nouns which were not learned by object detection and recognition module in advance. In this paper, we conducted experiments on eight queries related to recent events to verify the applicability of our proposed image recommendation system and evaluate the image selection accuracy.
自动报表生成是一种根据特定的主题或时间顺序,对各种资料进行汇总,自动生成报表形式文档的技术。虽然报告的主要内容是文字,但适当插入图片可以提高报告的完整性。在本文中,我们提出了一种图像推荐方法,用于自动选择和插入与报告的特定部分相对应的合适图像。在我们提出的方法中,基于查询和图像内容之间的语义相似性对候选图像进行重新评估。为了将文本查询和图像的语义信息转换为一个向量空间,我们使用基于深度学习的目标检测模块从图像中提取语义信息作为一组标签形式。此外,我们从给定的图像标题中提取标签,使得系统可以在给定查询包含特定关键词或专有名词的情况下评估候选图像,这些关键词或专有名词是物体检测和识别模块事先没有学习到的。在本文中,我们对8个与近期事件相关的查询进行了实验,以验证我们提出的图像推荐系统的适用性,并评估图像选择的准确性。
{"title":"Image Recommendation for Automatic Report Generation using Semantic Similarity","authors":"Changhun Hyun, Hyeyoung Park","doi":"10.1109/ICAIIC.2019.8669018","DOIUrl":"https://doi.org/10.1109/ICAIIC.2019.8669018","url":null,"abstract":"Automatic report generation is a technology that automatically generates documents in the form of report by summarizing various materials according to a specific topic in time sequence or subject. Although the main content of the report is text, insertion of appropriate images can improve the completeness of the report. In this paper, we propose an image recommendation method for automatically selecting and inserting appropriate images corresponding to a specific part of a report. In our proposed method, reevaluation of the candidate images is performed based on the semantic similarity between query and the contents of the images. In order to transform semantic information of text query and image into one vector space, we extracted semantic information from image as a set of tags form using deep learning based object detection module. Also, we extracted tags from the given title of the image so that the proposed system can evaluate the candidate images even in the case that the given query includes specific keywords or proper nouns which were not learned by object detection and recognition module in advance. In this paper, we conducted experiments on eight queries related to recent events to verify the applicability of our proposed image recommendation system and evaluate the image selection accuracy.","PeriodicalId":273383,"journal":{"name":"2019 International Conference on Artificial Intelligence in Information and Communication (ICAIIC)","volume":"2 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132677326","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
Swarm Reinforcement Learning for Operational Planning of Energy Plants for Small and Mid-Sized Building Energy Management Systems 基于群强化学习的中小型建筑能源管理系统能源工厂运行规划
M. Sato, Y. Fukuyama
This paper proposes operation planning of energy plants by swarm reinforcement learning in order to realize successful BEMS for small and mid-sized buildings. It usually takes many man-hours to develop an evolutionary computation based program and develop a model considering facility characteristics and so on for an energy management system, while engineering man-hours can be reduced and appropriate operational planning can be expected to be realized by a versatile program of swarm reinforcement learning without consideration of facility characteristics and so on. Moreover, the results of the proposed methods are compared with those of a basic Q learning based method and a basic particle swarm optimization (PSO) based method. It is verified that energy cost can be more reduced by one of the proposed methods (PSO-Q based method) than those by the original Q-learning based method. Since the rates to the whole cost are large in case of small and mid-sized buildings, the proposed swarm reinforcement learning based methods can contribute to successful BEMS for small and mid-sized buildings.
本文提出了利用群强化学习的方法对能源工厂进行运行规划,以实现成功的中小型建筑BEMS。对于能源管理系统,通常需要花费大量的工时来开发基于进化计算的程序并建立考虑设施特征等的模型,而通过群体强化学习的通用程序可以在不考虑设施特征等的情况下减少工程工时并期望实现适当的运行规划。并与基于基本Q学习的方法和基于基本粒子群优化(PSO)的方法的结果进行了比较。实验结果表明,与原基于q学习的方法相比,所提出的基于PSO-Q的方法能更有效地降低能量成本。由于中小型建筑的总成本占比较大,本文提出的基于群体强化学习的方法可以为中小型建筑的BEMS提供成功的帮助。
{"title":"Swarm Reinforcement Learning for Operational Planning of Energy Plants for Small and Mid-Sized Building Energy Management Systems","authors":"M. Sato, Y. Fukuyama","doi":"10.1109/ICAIIC.2019.8668985","DOIUrl":"https://doi.org/10.1109/ICAIIC.2019.8668985","url":null,"abstract":"This paper proposes operation planning of energy plants by swarm reinforcement learning in order to realize successful BEMS for small and mid-sized buildings. It usually takes many man-hours to develop an evolutionary computation based program and develop a model considering facility characteristics and so on for an energy management system, while engineering man-hours can be reduced and appropriate operational planning can be expected to be realized by a versatile program of swarm reinforcement learning without consideration of facility characteristics and so on. Moreover, the results of the proposed methods are compared with those of a basic Q learning based method and a basic particle swarm optimization (PSO) based method. It is verified that energy cost can be more reduced by one of the proposed methods (PSO-Q based method) than those by the original Q-learning based method. Since the rates to the whole cost are large in case of small and mid-sized buildings, the proposed swarm reinforcement learning based methods can contribute to successful BEMS for small and mid-sized buildings.","PeriodicalId":273383,"journal":{"name":"2019 International Conference on Artificial Intelligence in Information and Communication (ICAIIC)","volume":"42 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132280001","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
Future Optical Camera Communication Based Applications and Opportunities for 5G and Beyond 未来基于光学相机通信的应用和5G及以后的机遇
M. Shahjalal, Moh. Khalid Hasan, M. Z. Chowdhury, Y. Jang
Optical camera communication (OCC) refers to the wireless communications between optical sources and cameras (image sensor). Camera image sensors are used to receive data from light emitting diodes. This technology can be implemented in all cameras as well in smartphone as it has the capability of image processing. In this paper we provided some future OCC based indoor and outdoor applications and described their opportunities for 5G and beyond communication systems. Also, we addressed some future works in real-time OCC features.
光学摄像机通信(OCC)是指光源与摄像机(图像传感器)之间的无线通信。相机图像传感器用于接收来自发光二极管的数据。该技术具有图像处理能力,可以应用于所有相机和智能手机。在本文中,我们提供了一些未来基于OCC的室内和室外应用,并描述了它们在5G及以后通信系统中的机会。此外,我们还讨论了实时OCC功能的一些未来工作。
{"title":"Future Optical Camera Communication Based Applications and Opportunities for 5G and Beyond","authors":"M. Shahjalal, Moh. Khalid Hasan, M. Z. Chowdhury, Y. Jang","doi":"10.1109/ICAIIC.2019.8669075","DOIUrl":"https://doi.org/10.1109/ICAIIC.2019.8669075","url":null,"abstract":"Optical camera communication (OCC) refers to the wireless communications between optical sources and cameras (image sensor). Camera image sensors are used to receive data from light emitting diodes. This technology can be implemented in all cameras as well in smartphone as it has the capability of image processing. In this paper we provided some future OCC based indoor and outdoor applications and described their opportunities for 5G and beyond communication systems. Also, we addressed some future works in real-time OCC features.","PeriodicalId":273383,"journal":{"name":"2019 International Conference on Artificial Intelligence in Information and Communication (ICAIIC)","volume":"12 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"134557911","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 7
Deep Q-Network Based Rotary Inverted Pendulum System and Its Monitoring on the EdgeX Platform 基于深度q -网络的旋转倒立摆系统及其在EdgeX平台上的监测
Ju-Bong Kim, Do-Hyung Kwon, Yong-Geun Hong, Hyun-kyo Lim, Min Suk Kim, Youn-Hee Han
A rotary inverted pendulum is an unstable and highly nonlinear device and is used as a common model for engineering applications in linear and nonlinear control. In this study, we created a cyber physical system (CPS) to demonstrate that a deep reinforcement learning agent using a rotary inverted pendulum can successfully control a remotely located physical device. The device we created is composed of a cyber environment and physical environment using the Message Queuing Telemetry Transport (MQTT) protocol with an Ethernet connection to connect the cyber environment and the physical environment. The reinforcement learning agent controls the physical device, which is located remotely from the controller and a classical proportional integral derivative (PID) controller is utilized to implement imitation and reinforcement learning and facilitate the learning process. In addition, the control and monitoring system is built on the open source EdgeX platform, so that learning tasks performed near the source of data generation and real-time data emitted from the physical device can be observed while reinforcement learning is performed. From our CPS experimental system, we verify that a deep reinforcement learning agent can control a remotely located real-world device successfully.
旋转式倒立摆是一种不稳定的、高度非线性的装置,是工程应用中线性和非线性控制的常用模型。在本研究中,我们创建了一个网络物理系统(CPS)来证明使用旋转倒立摆的深度强化学习代理可以成功地控制远程物理设备。我们创建的设备由网络环境和物理环境组成,使用消息队列遥测传输(MQTT)协议,并使用以太网连接连接网络环境和物理环境。强化学习代理控制远离控制器的物理设备,利用经典的比例积分导数(PID)控制器实现模仿和强化学习,方便学习过程。此外,控制和监控系统建立在开源的EdgeX平台上,在进行强化学习的同时,可以观察到在数据生成源附近执行的学习任务和从物理设备发出的实时数据。从我们的CPS实验系统中,我们验证了深度强化学习代理可以成功地控制远程位于现实世界的设备。
{"title":"Deep Q-Network Based Rotary Inverted Pendulum System and Its Monitoring on the EdgeX Platform","authors":"Ju-Bong Kim, Do-Hyung Kwon, Yong-Geun Hong, Hyun-kyo Lim, Min Suk Kim, Youn-Hee Han","doi":"10.1109/ICAIIC.2019.8668979","DOIUrl":"https://doi.org/10.1109/ICAIIC.2019.8668979","url":null,"abstract":"A rotary inverted pendulum is an unstable and highly nonlinear device and is used as a common model for engineering applications in linear and nonlinear control. In this study, we created a cyber physical system (CPS) to demonstrate that a deep reinforcement learning agent using a rotary inverted pendulum can successfully control a remotely located physical device. The device we created is composed of a cyber environment and physical environment using the Message Queuing Telemetry Transport (MQTT) protocol with an Ethernet connection to connect the cyber environment and the physical environment. The reinforcement learning agent controls the physical device, which is located remotely from the controller and a classical proportional integral derivative (PID) controller is utilized to implement imitation and reinforcement learning and facilitate the learning process. In addition, the control and monitoring system is built on the open source EdgeX platform, so that learning tasks performed near the source of data generation and real-time data emitted from the physical device can be observed while reinforcement learning is performed. From our CPS experimental system, we verify that a deep reinforcement learning agent can control a remotely located real-world device successfully.","PeriodicalId":273383,"journal":{"name":"2019 International Conference on Artificial Intelligence in Information and Communication (ICAIIC)","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129133025","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
期刊
2019 International Conference on Artificial Intelligence in Information and Communication (ICAIIC)
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1