Various studies related to machine learning have been performed. In this study, we focus on reinforcement learning, which is one of the methods used in machine learning. In conventional reinforcement leaning, the reward function is difficult to design, because it is complex and laborious and it requires expert knowledge. In previous studies, the robot learned from outside itself, not autonomously. To solve this problem, we propose a method of robot learning through interactions with humans using sensor input, and the reward is also generated through interactions with humans but does not require additional tasks to be performed by the human. Therefore, in this method, expert knowledge is not required, and anyone can teach the robot. Our experiment confirmed that robot learning is possible through the proposed method.
{"title":"Self-Generation of Reward by Sensor Input in Reinforcement Learning","authors":"Kaoru Nikaido, K. Kurashige","doi":"10.1109/RVSP.2013.67","DOIUrl":"https://doi.org/10.1109/RVSP.2013.67","url":null,"abstract":"Various studies related to machine learning have been performed. In this study, we focus on reinforcement learning, which is one of the methods used in machine learning. In conventional reinforcement leaning, the reward function is difficult to design, because it is complex and laborious and it requires expert knowledge. In previous studies, the robot learned from outside itself, not autonomously. To solve this problem, we propose a method of robot learning through interactions with humans using sensor input, and the reward is also generated through interactions with humans but does not require additional tasks to be performed by the human. Therefore, in this method, expert knowledge is not required, and anyone can teach the robot. Our experiment confirmed that robot learning is possible through the proposed method.","PeriodicalId":6585,"journal":{"name":"2013 Second International Conference on Robot, Vision and Signal Processing","volume":"23 1","pages":"270-273"},"PeriodicalIF":0.0,"publicationDate":"2013-12-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"81694830","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
This paper presents a neural network for online topological map construction inspired by the beta oscillations and hippocampal place cell learning. In our proposed method, nodes in the topological map represent place cells (robot location) while edges connect nodes and store robot action (i.e. orientation, direction). Our proposed method (TGARAM) comprises 2 layers: the input layer and the memory layer. The input layer collects sensory information and cluster the obtained information into a set of topological nodes incrementally. In the memory layer, the clustered information is used as a topological map where nodes are associated with actions. Then, topological nodes are clustered together into space regions to represent the environment in the memory layer. The advantages of the proposed method are that 1) it does not require high-level cognitive processes and prior knowledge which is able to work in natural environment, 2) it can process multiple sensory sources simultaneously in continuous space, and 3) it is an incremental and unsupervised learning method. Thus, topological map generated by TGARAM is utilised for path planning to constitutes a basis for robot navigation. Finally, we validate the proposed method through several experiments.
{"title":"Biologically Inspired Topological Gaussian ARAM for Robot Navigation","authors":"W. Chin, C. Loo","doi":"10.1109/RVSP.2013.66","DOIUrl":"https://doi.org/10.1109/RVSP.2013.66","url":null,"abstract":"This paper presents a neural network for online topological map construction inspired by the beta oscillations and hippocampal place cell learning. In our proposed method, nodes in the topological map represent place cells (robot location) while edges connect nodes and store robot action (i.e. orientation, direction). Our proposed method (TGARAM) comprises 2 layers: the input layer and the memory layer. The input layer collects sensory information and cluster the obtained information into a set of topological nodes incrementally. In the memory layer, the clustered information is used as a topological map where nodes are associated with actions. Then, topological nodes are clustered together into space regions to represent the environment in the memory layer. The advantages of the proposed method are that 1) it does not require high-level cognitive processes and prior knowledge which is able to work in natural environment, 2) it can process multiple sensory sources simultaneously in continuous space, and 3) it is an incremental and unsupervised learning method. Thus, topological map generated by TGARAM is utilised for path planning to constitutes a basis for robot navigation. Finally, we validate the proposed method through several experiments.","PeriodicalId":6585,"journal":{"name":"2013 Second International Conference on Robot, Vision and Signal Processing","volume":"53 1","pages":"265-269"},"PeriodicalIF":0.0,"publicationDate":"2013-12-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"90362001","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Kernel learning is an important research topic in the machine learning area. Research on self-optimization learning of kernel function and its parameter has an important theoretical value for solving the kernel selection problem widely endured by kernel learning machine, and has the same important practical meaning for the improving of kernel learning systems. In this paper, we focus on two schemes: kernel optimization algorithm and procedure, the framework of kernel self-optimization learning. Finally, the proposed kernel optimization is applied into popular kernel learning methods including KPCA, KDA and KLPP. Simulation results demonstrate that the kernel self-optimization is feasible to improve various kernel-based learning methods.
{"title":"Kernel-Optimized Based Machine for Image Recognition","authors":"Yun-Heng Wang, P. Fu","doi":"10.1109/RVSP.2013.29","DOIUrl":"https://doi.org/10.1109/RVSP.2013.29","url":null,"abstract":"Kernel learning is an important research topic in the machine learning area. Research on self-optimization learning of kernel function and its parameter has an important theoretical value for solving the kernel selection problem widely endured by kernel learning machine, and has the same important practical meaning for the improving of kernel learning systems. In this paper, we focus on two schemes: kernel optimization algorithm and procedure, the framework of kernel self-optimization learning. Finally, the proposed kernel optimization is applied into popular kernel learning methods including KPCA, KDA and KLPP. Simulation results demonstrate that the kernel self-optimization is feasible to improve various kernel-based learning methods.","PeriodicalId":6585,"journal":{"name":"2013 Second International Conference on Robot, Vision and Signal Processing","volume":"129 1","pages":"98-101"},"PeriodicalIF":0.0,"publicationDate":"2013-12-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"88642086","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
This paper proposes the road detection method corresponded to multi road types with Flood Fill. Flood Fill is one of the image processing methods to partition the region of input image based on RGB color model. Road detection is useful for automatic robots because the robots work on various road surface in outdoor environment. The proposed method has two features. Firstly, the method can cancel the influence of shadow on road by using HSV color model. Secondly, the method can recognize multi road types by k-nearest neighbor algorithm. By using the proposed method, the robot can select the suitable controller for road surface or the safety route. We implement the proposed method in vehicle navigation and the availability is verified by the experimental results.
{"title":"Road Detection Method Corresponded to Multi Road Types with Flood Fill and Vehicle Control","authors":"Tomoya Fukukawa, Yu Maeda, K. Sekiyama, T. Fukuda","doi":"10.1109/RVSP.2013.68","DOIUrl":"https://doi.org/10.1109/RVSP.2013.68","url":null,"abstract":"This paper proposes the road detection method corresponded to multi road types with Flood Fill. Flood Fill is one of the image processing methods to partition the region of input image based on RGB color model. Road detection is useful for automatic robots because the robots work on various road surface in outdoor environment. The proposed method has two features. Firstly, the method can cancel the influence of shadow on road by using HSV color model. Secondly, the method can recognize multi road types by k-nearest neighbor algorithm. By using the proposed method, the robot can select the suitable controller for road surface or the safety route. We implement the proposed method in vehicle navigation and the availability is verified by the experimental results.","PeriodicalId":6585,"journal":{"name":"2013 Second International Conference on Robot, Vision and Signal Processing","volume":"23 1","pages":"274-277"},"PeriodicalIF":0.0,"publicationDate":"2013-12-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"83577278","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
ADS-B is a cooperating surveillance technology which can broadcast not only the position messages, but also the velocity, status and TCP (Trajectory Change Point) which could be used for target surveillance. This paper tries to utilize the multi-model method to enhance the filtering function. Through the simulation, we find it is reasonable to use the multi-model method and we also propose the unified modes structure which will benefit the computing efficiency and the parameter auto-adaptive modulation.
{"title":"Trajectory Tracking Using Auto-adaptive Multi-model Filtering Method in ADS-B System","authors":"Kai-Ge Zhang, Yu-Long Qiao, Chaozhu Zhang","doi":"10.1109/RVSP.2013.28","DOIUrl":"https://doi.org/10.1109/RVSP.2013.28","url":null,"abstract":"ADS-B is a cooperating surveillance technology which can broadcast not only the position messages, but also the velocity, status and TCP (Trajectory Change Point) which could be used for target surveillance. This paper tries to utilize the multi-model method to enhance the filtering function. Through the simulation, we find it is reasonable to use the multi-model method and we also propose the unified modes structure which will benefit the computing efficiency and the parameter auto-adaptive modulation.","PeriodicalId":6585,"journal":{"name":"2013 Second International Conference on Robot, Vision and Signal Processing","volume":"21 1","pages":"93-97"},"PeriodicalIF":0.0,"publicationDate":"2013-12-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"78298869","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Exchange rate forecasting has become a popular research topic in recent years because the problems of the forecasting model selection and the improvement on forecasting accuracy are not easy to be solved. In this study, we employ a swarm intelligence method called Interactive Artificial Bee Colony (IABC) and use nine macroeconomic factors as the input for the exchange rate forecasting. The sliding window is used in the experiment for both the training and the testing. In our experiments, we use continuous previous three days data as the training set, and use the training result to forecast the fourth day's exchange rage. Moreover, we evaluate the forecasting accuracy with three criteria, namely, Mean Square Error (MSE), Mean Absolute Error (MAE), and Root Mean Square Error (RMSE). The experimental results indicate that using IABC with the macroeconomic factors is a positive and doable way for the exchange rate forecasting.
{"title":"Using Interactive Artificial Bee Colony to Forecast Exchange Rate","authors":"Jui-Fang Chang, Chun-Tsung Hsiao, Pei-wei Tsai","doi":"10.1109/RVSP.2013.37","DOIUrl":"https://doi.org/10.1109/RVSP.2013.37","url":null,"abstract":"Exchange rate forecasting has become a popular research topic in recent years because the problems of the forecasting model selection and the improvement on forecasting accuracy are not easy to be solved. In this study, we employ a swarm intelligence method called Interactive Artificial Bee Colony (IABC) and use nine macroeconomic factors as the input for the exchange rate forecasting. The sliding window is used in the experiment for both the training and the testing. In our experiments, we use continuous previous three days data as the training set, and use the training result to forecast the fourth day's exchange rage. Moreover, we evaluate the forecasting accuracy with three criteria, namely, Mean Square Error (MSE), Mean Absolute Error (MAE), and Root Mean Square Error (RMSE). The experimental results indicate that using IABC with the macroeconomic factors is a positive and doable way for the exchange rate forecasting.","PeriodicalId":6585,"journal":{"name":"2013 Second International Conference on Robot, Vision and Signal Processing","volume":"31 1","pages":"133-136"},"PeriodicalIF":0.0,"publicationDate":"2013-12-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"81732657","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Yi-Ting Chen, Bin-Yih Liao, Chin-Feng Lee, Wu-Der Tsay, M. Lai
An Adjustable Frequency Bat Algorithm (AFBA) is proposed to improve solution accuracy for optimization problem in this study. The conception is to employ the adjustable frequency determined by flight direction of bats to adapt the velocity toward the correct direction. The bats emit an ultrasound with various frequencies decided by flight direction to the current best bat. The adjustable frequency can provide the bats correct direction, proper velocity to move their position. And the bats can more systematical explore new possible better position in movement. Subsequently, there are many scenarios designed by different dimensions from low to high and benchmark functions with diverse modal to verify the performance of the proposed AFBA. The experimental numeric result shows that AFBA has better ability of search to improve the quality of the global optimal solution than BA. The fitness errors almost are less than 1.00E-6 for the unimodal function and multimodal function in tested dimensions.
{"title":"An Adjustable Frequency Bat Algorithm Based on Flight Direction to Improve Solution Accuracy for Optimization Problems","authors":"Yi-Ting Chen, Bin-Yih Liao, Chin-Feng Lee, Wu-Der Tsay, M. Lai","doi":"10.1109/RVSP.2013.47","DOIUrl":"https://doi.org/10.1109/RVSP.2013.47","url":null,"abstract":"An Adjustable Frequency Bat Algorithm (AFBA) is proposed to improve solution accuracy for optimization problem in this study. The conception is to employ the adjustable frequency determined by flight direction of bats to adapt the velocity toward the correct direction. The bats emit an ultrasound with various frequencies decided by flight direction to the current best bat. The adjustable frequency can provide the bats correct direction, proper velocity to move their position. And the bats can more systematical explore new possible better position in movement. Subsequently, there are many scenarios designed by different dimensions from low to high and benchmark functions with diverse modal to verify the performance of the proposed AFBA. The experimental numeric result shows that AFBA has better ability of search to improve the quality of the global optimal solution than BA. The fitness errors almost are less than 1.00E-6 for the unimodal function and multimodal function in tested dimensions.","PeriodicalId":6585,"journal":{"name":"2013 Second International Conference on Robot, Vision and Signal Processing","volume":"60 1","pages":"172-177"},"PeriodicalIF":0.0,"publicationDate":"2013-12-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"80557060","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
In this paper, we propose a new method for cartoon image retrieval based on the local invariant shape feature, named Scalable Shape Context. The proposed feature uses the Harris-Laplace corner to localize the key points and corresponding scale in the cartoon image. Then, we use Shape Context to describe the local shape. The feature point matching is achieved by a weighted bipartite graph matching algorithm and the similarity between the query and the indexing image is presented by the match cost. The experimental results show that our method is more efficient than Shape Context and SIFT for the cartoon image retrieval.
{"title":"Local Invariant Shape Feature for Cartoon Image Retrieval","authors":"Tiejun Zhang, Q. Han, Handan Hou, X. Niu","doi":"10.1109/RVSP.2013.31","DOIUrl":"https://doi.org/10.1109/RVSP.2013.31","url":null,"abstract":"In this paper, we propose a new method for cartoon image retrieval based on the local invariant shape feature, named Scalable Shape Context. The proposed feature uses the Harris-Laplace corner to localize the key points and corresponding scale in the cartoon image. Then, we use Shape Context to describe the local shape. The feature point matching is achieved by a weighted bipartite graph matching algorithm and the similarity between the query and the indexing image is presented by the match cost. The experimental results show that our method is more efficient than Shape Context and SIFT for the cartoon image retrieval.","PeriodicalId":6585,"journal":{"name":"2013 Second International Conference on Robot, Vision and Signal Processing","volume":"48 4 1","pages":"107-110"},"PeriodicalIF":0.0,"publicationDate":"2013-12-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"83201989","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Evaporative cooling with watery pad and exhaust fan has been broadly studied in past years. Although such cooling system has been demonstrated for higher energy saving than traditional air conditioning machines, it also innately inherits drawback of temperature gradient along airflow direction. In this paper, we will practically survey the performance of our evaporative cooling system. According to experimental results, the problem of uneven temperature distribution might not be insolvable, the second half area without the effectiveness of humid air could be cooled by forced ventilation. Our survey indicates that exhaust fan can nearly cools the rest of half airflow path. This makes evaporative cooling system becoming more feasible for greenhouse designs in the future.
{"title":"A Practical Survey of Evaporative Cooling System for Orchids Greenhouse","authors":"Ying-Hao Yu, Chun-Hsien Yeh, Yuh-Kuang Chen, Ping-Hsuan Lai, Pei-Yin Chen, Chih-Yuan Lien","doi":"10.1109/RVSP.2013.75","DOIUrl":"https://doi.org/10.1109/RVSP.2013.75","url":null,"abstract":"Evaporative cooling with watery pad and exhaust fan has been broadly studied in past years. Although such cooling system has been demonstrated for higher energy saving than traditional air conditioning machines, it also innately inherits drawback of temperature gradient along airflow direction. In this paper, we will practically survey the performance of our evaporative cooling system. According to experimental results, the problem of uneven temperature distribution might not be insolvable, the second half area without the effectiveness of humid air could be cooled by forced ventilation. Our survey indicates that exhaust fan can nearly cools the rest of half airflow path. This makes evaporative cooling system becoming more feasible for greenhouse designs in the future.","PeriodicalId":6585,"journal":{"name":"2013 Second International Conference on Robot, Vision and Signal Processing","volume":"4 1","pages":"303-306"},"PeriodicalIF":0.0,"publicationDate":"2013-12-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"88813235","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Ke-Yu Lee, C. Hsiung, Keng-Chih Hsu, Chih-Feng Huang
The study aims to report the results of experimental system and curriculum design by utilizing PC, Kinect sensing device, interface circuit, embedded controller, and actuating device. Through this system and curriculum, students learned the skills of PC control programming, signal transmission, interface circuit design, and embedded controller programming, their proficiency in system integration was also developed. In order to achieve the results of Kinect sensing motion experimental system and curriculum design, literature review was conducted to understand the experimental materials. Besides, interviews with the experts of industial circles and academic community were carried out to plan the learning background and curriculum contents. In accordance with the information collected, experimental design and syllabus were outlined and further developed.
{"title":"Establishment of a Kinect Motion-Sensing System and Its Curriculum Development","authors":"Ke-Yu Lee, C. Hsiung, Keng-Chih Hsu, Chih-Feng Huang","doi":"10.1109/RVSP.2013.39","DOIUrl":"https://doi.org/10.1109/RVSP.2013.39","url":null,"abstract":"The study aims to report the results of experimental system and curriculum design by utilizing PC, Kinect sensing device, interface circuit, embedded controller, and actuating device. Through this system and curriculum, students learned the skills of PC control programming, signal transmission, interface circuit design, and embedded controller programming, their proficiency in system integration was also developed. In order to achieve the results of Kinect sensing motion experimental system and curriculum design, literature review was conducted to understand the experimental materials. Besides, interviews with the experts of industial circles and academic community were carried out to plan the learning background and curriculum contents. In accordance with the information collected, experimental design and syllabus were outlined and further developed.","PeriodicalId":6585,"journal":{"name":"2013 Second International Conference on Robot, Vision and Signal Processing","volume":"60 1","pages":"141-143"},"PeriodicalIF":0.0,"publicationDate":"2013-12-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"83731525","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
京公网安备 11010802042870号
京ICP备2023020795号-1
扫码关注我们
求助内容：
应助结果提醒方式：