A distributed approach to Reinforcement Learning in tasks of ramp metering and dynamic route guidance is presented. The problem domain, a freeway integration control application, is formulated as a distributed reinforcement learning problem. The DRL approach was implemented via a multi-agent control architecture where the decision agent was assigned to each of the on-ramp or VMS. The return of each agent is simultaneously updating a single shared policy. The control strategy’s efficiency is demonstrated through its application to the simple freeway network. Analyses of simulation results using this approach show significant improvement over traditional local control, especially for the case of large traffic demand. Using the DRL approach, the TTS of the Network has been reduced by 20% under the heavy demands.
{"title":"A Machine Learning Method for Dynamic Traffic Control and Guidance on Freeway Networks","authors":"Kaige Wen, Shiru Qu, Yumei Zhang","doi":"10.1109/CAR.2009.96","DOIUrl":"https://doi.org/10.1109/CAR.2009.96","url":null,"abstract":"A distributed approach to Reinforcement Learning in tasks of ramp metering and dynamic route guidance is presented. The problem domain, a freeway integration control application, is formulated as a distributed reinforcement learning problem. The DRL approach was implemented via a multi-agent control architecture where the decision agent was assigned to each of the on-ramp or VMS. The return of each agent is simultaneously updating a single shared policy. The control strategy’s efficiency is demonstrated through its application to the simple freeway network. Analyses of simulation results using this approach show significant improvement over traditional local control, especially for the case of large traffic demand. Using the DRL approach, the TTS of the Network has been reduced by 20% under the heavy demands.","PeriodicalId":320307,"journal":{"name":"2009 International Asia Conference on Informatics in Control, Automation and Robotics","volume":"22 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2009-02-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125423615","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
For solving on-line extract torsional vibrating parameter detecting and metrical problem of spanless point of complex and precise heavy machinery large scale rotary driving shaft, a new torsional vibration continuous shaft segment mass detecting and analytic model was proposed by using kinetics theory and measuring theory. The new method established the vibrational transmission relationship between the measurable point and the spanless point. New model was verified correctness, feasibility and effectiveness by means of gathering torque signal in the production field and comparing the consistency between measured value and theoretical calculation value of spanless point torque signal. Based on the experiment’s result, new model can supply a engineered means for acquiring the vibration detailed information of the point on precise heavy machinery large scale driving shaft which was inconvenience fitted sensor. It also can program composition for implement on-line monitor and fault forecast on rotary shaft and then guarantee the precise heavy complex rotary machine even running.
{"title":"Investigations on Detection Model of Large Scale Rotation Shaft Torsional Vibration in Precision Heavy Machinery","authors":"Zhaoyu Wu","doi":"10.1109/CAR.2009.91","DOIUrl":"https://doi.org/10.1109/CAR.2009.91","url":null,"abstract":"For solving on-line extract torsional vibrating parameter detecting and metrical problem of spanless point of complex and precise heavy machinery large scale rotary driving shaft, a new torsional vibration continuous shaft segment mass detecting and analytic model was proposed by using kinetics theory and measuring theory. The new method established the vibrational transmission relationship between the measurable point and the spanless point. New model was verified correctness, feasibility and effectiveness by means of gathering torque signal in the production field and comparing the consistency between measured value and theoretical calculation value of spanless point torque signal. Based on the experiment’s result, new model can supply a engineered means for acquiring the vibration detailed information of the point on precise heavy machinery large scale driving shaft which was inconvenience fitted sensor. It also can program composition for implement on-line monitor and fault forecast on rotary shaft and then guarantee the precise heavy complex rotary machine even running.","PeriodicalId":320307,"journal":{"name":"2009 International Asia Conference on Informatics in Control, Automation and Robotics","volume":"298 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2009-02-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133710237","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
This paper presents the design of lateral/directional control with RCS on reentry of Reusable Launch Vehicle. Thecontrol law are designed, with great computational advantage,for a linear system and then applied in a nonlinear way with on-off type RCS. The lateral/directional control concept essentially reverses the traditional role of the lateral force effectors. The feedback of roll rate to aileron is used to damping the Dutch roll while the yaw jets is used to damping roll mode and maintaining the roll attitude. And a revised PWM is developed based on principle of equivalent accumulated impulse. The final simulation result shows the validity of this method.
{"title":"Lateral-Direction Control via Reaction Control System","authors":"Liaoni Wu, Yimin Huang, ChengLong He","doi":"10.1109/CAR.2009.62","DOIUrl":"https://doi.org/10.1109/CAR.2009.62","url":null,"abstract":"This paper presents the design of lateral/directional control with RCS on reentry of Reusable Launch Vehicle. Thecontrol law are designed, with great computational advantage,for a linear system and then applied in a nonlinear way with on-off type RCS. The lateral/directional control concept essentially reverses the traditional role of the lateral force effectors. The feedback of roll rate to aileron is used to damping the Dutch roll while the yaw jets is used to damping roll mode and maintaining the roll attitude. And a revised PWM is developed based on principle of equivalent accumulated impulse. The final simulation result shows the validity of this method.","PeriodicalId":320307,"journal":{"name":"2009 International Asia Conference on Informatics in Control, Automation and Robotics","volume":"34 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2009-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116665402","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
This article proposes a new characteristic-based image mosaic algorithm that used the granular computing theory. Firstly, establish a granular computing model of the image waiting to be spliced to obtain the image's edge segmentation; Secondly, extract the characteristic points in the edge graph, then carry on the related operation to these characteristic points to find matching characteristic points, and eliminate the mismatches to find the most superior matching characteristics; Thirdly, work out the spot transformation relations of two images according to the matching characteristic points, and mapped the two images on the same geometric plane surface by transformation matrix; Finally, smooth transition processing will be carried on the overlapped region to achieve the purpose of seamless image mosaic. The experimental result indicates that the algorithm in this article is a stable and steady method that superior than the traditional algorithm, and it gets well effectiveness.
{"title":"The Research of Granular Computing Applied in Image Mosaic","authors":"Gang Xu, J. Cai","doi":"10.1109/CAR.2009.79","DOIUrl":"https://doi.org/10.1109/CAR.2009.79","url":null,"abstract":"This article proposes a new characteristic-based image mosaic algorithm that used the granular computing theory. Firstly, establish a granular computing model of the image waiting to be spliced to obtain the image's edge segmentation; Secondly, extract the characteristic points in the edge graph, then carry on the related operation to these characteristic points to find matching characteristic points, and eliminate the mismatches to find the most superior matching characteristics; Thirdly, work out the spot transformation relations of two images according to the matching characteristic points, and mapped the two images on the same geometric plane surface by transformation matrix; Finally, smooth transition processing will be carried on the overlapped region to achieve the purpose of seamless image mosaic. The experimental result indicates that the algorithm in this article is a stable and steady method that superior than the traditional algorithm, and it gets well effectiveness.","PeriodicalId":320307,"journal":{"name":"2009 International Asia Conference on Informatics in Control, Automation and Robotics","volume":"402 1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2009-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123257911","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
The train control center which plays a central role of message communication is a pivotal sub-system of the china train control system. On the basis of developing and debugging the engineering prototype of the train control center, an index system for evaluating the safety of the train control center was set up. Based on the analytic hierarchy process, a safety evaluation method for the train control center was proposed. Using the technology of verification, validation and accreditation, comprehensive analysis to the safety evaluation index of the train control center was carried on. At last, the safety evaluation index of the whole train control center was obtained, which is useful to the nationalized train control center.
{"title":"One Method to Evaluate the Safety of Train Control Center","authors":"Peng Zhou, Hongze Xu, J. Hou","doi":"10.1109/CAR.2009.75","DOIUrl":"https://doi.org/10.1109/CAR.2009.75","url":null,"abstract":"The train control center which plays a central role of message communication is a pivotal sub-system of the china train control system. On the basis of developing and debugging the engineering prototype of the train control center, an index system for evaluating the safety of the train control center was set up. Based on the analytic hierarchy process, a safety evaluation method for the train control center was proposed. Using the technology of verification, validation and accreditation, comprehensive analysis to the safety evaluation index of the train control center was carried on. At last, the safety evaluation index of the whole train control center was obtained, which is useful to the nationalized train control center.","PeriodicalId":320307,"journal":{"name":"2009 International Asia Conference on Informatics in Control, Automation and Robotics","volume":"43 4 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2009-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114369754","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
In order to sample two channels mixing frequency signals in high speed and process them synchronously in the system, a dual-channel, high-speed digital lock-in amplifier (LIA) that uses orthogonal digital demodulation is proposed. The instrument, based on a digital signal processor (DSP) and its associated hardware, is implemented. The system adopts a method of high speed bi-directional parallel communication between DSP and parallel interface of PC by EPP (Enhanced Parallel Port) protocol. The EPP achieves an easy installation for industrial applications. The experimental tests showed that the system is feasible.
{"title":"A Novel Digital Lock-in Amplifier with Dual Channels","authors":"Dongyue Wu, Chao Wang, Hongjun Sun, Huaxiang Wang","doi":"10.1109/CAR.2009.24","DOIUrl":"https://doi.org/10.1109/CAR.2009.24","url":null,"abstract":"In order to sample two channels mixing frequency signals in high speed and process them synchronously in the system, a dual-channel, high-speed digital lock-in amplifier (LIA) that uses orthogonal digital demodulation is proposed. The instrument, based on a digital signal processor (DSP) and its associated hardware, is implemented. The system adopts a method of high speed bi-directional parallel communication between DSP and parallel interface of PC by EPP (Enhanced Parallel Port) protocol. The EPP achieves an easy installation for industrial applications. The experimental tests showed that the system is feasible.","PeriodicalId":320307,"journal":{"name":"2009 International Asia Conference on Informatics in Control, Automation and Robotics","volume":"204 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2009-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116179761","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Simulation of communication system in control network plays important role in modern industrial production and can be used in various application. Based on development of WorldFIP field intelligent control network, a kind of communication simulation system was designed and implemented. Simulation principle and implementation methods for data communication in the network were presented. Design and implementation for simulation of network scheduler, intelligent nodes and WorldFIP network communication based on OOP and multi-thread methods were presented in detail. Visual and multi-layered HMI for the simulation system was designed. Techniques in OOP were fully used in design with VC.NET as principle programming language. Complete simulation of WorldFIP communication network and field intelligent nodes was implemented. Operational practice showed the simulation system was stable in operation, good in flexibility and portability, which showed good practicability.
{"title":"A Kind of Communication Simulation System for WorldFIP Field Intelligent Control Network","authors":"Geng Liang, Guotian Yang","doi":"10.1109/CAR.2009.87","DOIUrl":"https://doi.org/10.1109/CAR.2009.87","url":null,"abstract":"Simulation of communication system in control network plays important role in modern industrial production and can be used in various application. Based on development of WorldFIP field intelligent control network, a kind of communication simulation system was designed and implemented. Simulation principle and implementation methods for data communication in the network were presented. Design and implementation for simulation of network scheduler, intelligent nodes and WorldFIP network communication based on OOP and multi-thread methods were presented in detail. Visual and multi-layered HMI for the simulation system was designed. Techniques in OOP were fully used in design with VC.NET as principle programming language. Complete simulation of WorldFIP communication network and field intelligent nodes was implemented. Operational practice showed the simulation system was stable in operation, good in flexibility and portability, which showed good practicability.","PeriodicalId":320307,"journal":{"name":"2009 International Asia Conference on Informatics in Control, Automation and Robotics","volume":"22 2-3","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2009-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114031981","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
The changing tendency of robot performance varying with assembly error was analyzed. Based on performance tendency curve, performance loss function is given to reflect performance change led by assembly error. Robot performance loss is divided by three phases, and all terms meeting practical application of performance loss function were put forward. Calculating process of index of performance loss was given, establishing a performance loss model of robot. An approximate design and development process based on performance loss model was built. Finally, an example was given to demonstrate calculating procedure of loss model. Through index of performance loss, changing information of assembly quality impacted by assembly error is known clearly. The effect of uncertainty of robot assembly process on assembly quality and performance is known through assembly error.
{"title":"Performance Loss Model Based Forecasting Method of Robot Assembly Quality","authors":"Pengzhong Li, Weimin Zhang","doi":"10.1109/CAR.2009.19","DOIUrl":"https://doi.org/10.1109/CAR.2009.19","url":null,"abstract":"The changing tendency of robot performance varying with assembly error was analyzed. Based on performance tendency curve, performance loss function is given to reflect performance change led by assembly error. Robot performance loss is divided by three phases, and all terms meeting practical application of performance loss function were put forward. Calculating process of index of performance loss was given, establishing a performance loss model of robot. An approximate design and development process based on performance loss model was built. Finally, an example was given to demonstrate calculating procedure of loss model. Through index of performance loss, changing information of assembly quality impacted by assembly error is known clearly. The effect of uncertainty of robot assembly process on assembly quality and performance is known through assembly error.","PeriodicalId":320307,"journal":{"name":"2009 International Asia Conference on Informatics in Control, Automation and Robotics","volume":"110 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2009-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115923631","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
The polygon image fragment is a special fragment type, whose sides is composed of straight line segment, and it has seldom been researched. In this paper, a new image fragment reassembly methodology based on corner detection and gray correlation is proposed for polygon fragments. The experimentation indicates the reassembly methodology based on corner detection and gray correlation can get good result, although there are rotation, translation and noise between image fragments.
{"title":"Implementation of a Fast Reassembly Methodology for Polygon Fragment","authors":"Gang Xu, Yi Xian","doi":"10.1109/CAR.2009.61","DOIUrl":"https://doi.org/10.1109/CAR.2009.61","url":null,"abstract":"The polygon image fragment is a special fragment type, whose sides is composed of straight line segment, and it has seldom been researched. In this paper, a new image fragment reassembly methodology based on corner detection and gray correlation is proposed for polygon fragments. The experimentation indicates the reassembly methodology based on corner detection and gray correlation can get good result, although there are rotation, translation and noise between image fragments.","PeriodicalId":320307,"journal":{"name":"2009 International Asia Conference on Informatics in Control, Automation and Robotics","volume":"80 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2009-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132550458","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
The traditional automatic smart image surveillance system can usually be used in the environment with still background. That is, the background image must not contain the moving objects. If there is waving ocean, waving tree, floating cloud, or raining in the background image, the traditional methods do not work well. In order to improve this problem, a new motion detection method based on the theory of entropy and combined a multi-periods Sigma-Delta background estimation algorithm is developed in this paper. Based on the theory of moving average, a moving thresholding method is designed in this paper to obtain a sequence of alarm announcements. Experiments are carried out for some samples with dynamic backgrounds to demonstrate the computational advantage of the proposed method.
{"title":"Motion Detection with Entropy in Dynamic Background","authors":"Yu-Kumg Chen, T. Cheng, Shuo-Tsung Chiu","doi":"10.1109/CAR.2009.88","DOIUrl":"https://doi.org/10.1109/CAR.2009.88","url":null,"abstract":"The traditional automatic smart image surveillance system can usually be used in the environment with still background. That is, the background image must not contain the moving objects. If there is waving ocean, waving tree, floating cloud, or raining in the background image, the traditional methods do not work well. In order to improve this problem, a new motion detection method based on the theory of entropy and combined a multi-periods Sigma-Delta background estimation algorithm is developed in this paper. Based on the theory of moving average, a moving thresholding method is designed in this paper to obtain a sequence of alarm announcements. Experiments are carried out for some samples with dynamic backgrounds to demonstrate the computational advantage of the proposed method.","PeriodicalId":320307,"journal":{"name":"2009 International Asia Conference on Informatics in Control, Automation and Robotics","volume":"40 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2009-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133619412","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
京公网安备 11010802042870号
京ICP备2023020795号-1
扫码关注我们
求助内容：
应助结果提醒方式：