Rafael Arias-Michel, M. García-Torres, C. Schaerer, F. Divina
{"title":"基于CFS方法的近似马尔可夫毛毯特征选择","authors":"Rafael Arias-Michel, M. García-Torres, C. Schaerer, F. Divina","doi":"10.1109/DMIA.2015.17","DOIUrl":null,"url":null,"abstract":"Feature selection has become an important research area in machine learning due to rapid advances in technology. In high-dimensional spaces, the difficulty of classification is intrinsically caused by the existence of irrelevant and redundant features that, in general, degrade the performance of a classifier. Moreover, finding the optimal subset of features becomes intractable even for low-dimensional datasets. In this context, Markov blanket discovery can be used to identify such subset. The approximated Markov blanket (AMb) is an efficient and effective approach to induce Markov blankets from data. However, this approach only considers pairwise comparisons of features. In this paper, we redefine the AMb to consider the interaction among features of a given subset of features. We use the Correlation based Feature Selection (CFS) function to measure such interactions and, as search strategy, the Fast Correlation based Filter (FCBF). The proposal, denoted as FCBFCFS, is compared with the FCBF and tested on synthetic and real-world datasets from the microarray domain. Results show that the inclusion of interactions among features in a subset may led to smaller subsets of features without degrading the classification task.","PeriodicalId":387758,"journal":{"name":"2015 International Workshop on Data Mining with Industrial Applications (DMIA)","volume":null,"pages":null},"PeriodicalIF":0.0000,"publicationDate":"2015-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"9","resultStr":"{\"title\":\"Feature Selection via Approximated Markov Blankets Using the CFS Method\",\"authors\":\"Rafael Arias-Michel, M. García-Torres, C. Schaerer, F. Divina\",\"doi\":\"10.1109/DMIA.2015.17\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Feature selection has become an important research area in machine learning due to rapid advances in technology. In high-dimensional spaces, the difficulty of classification is intrinsically caused by the existence of irrelevant and redundant features that, in general, degrade the performance of a classifier. Moreover, finding the optimal subset of features becomes intractable even for low-dimensional datasets. In this context, Markov blanket discovery can be used to identify such subset. The approximated Markov blanket (AMb) is an efficient and effective approach to induce Markov blankets from data. However, this approach only considers pairwise comparisons of features. In this paper, we redefine the AMb to consider the interaction among features of a given subset of features. We use the Correlation based Feature Selection (CFS) function to measure such interactions and, as search strategy, the Fast Correlation based Filter (FCBF). The proposal, denoted as FCBFCFS, is compared with the FCBF and tested on synthetic and real-world datasets from the microarray domain. Results show that the inclusion of interactions among features in a subset may led to smaller subsets of features without degrading the classification task.\",\"PeriodicalId\":387758,\"journal\":{\"name\":\"2015 International Workshop on Data Mining with Industrial Applications (DMIA)\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2015-09-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"9\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2015 International Workshop on Data Mining with Industrial Applications (DMIA)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/DMIA.2015.17\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2015 International Workshop on Data Mining with Industrial Applications (DMIA)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/DMIA.2015.17","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Feature Selection via Approximated Markov Blankets Using the CFS Method
Feature selection has become an important research area in machine learning due to rapid advances in technology. In high-dimensional spaces, the difficulty of classification is intrinsically caused by the existence of irrelevant and redundant features that, in general, degrade the performance of a classifier. Moreover, finding the optimal subset of features becomes intractable even for low-dimensional datasets. In this context, Markov blanket discovery can be used to identify such subset. The approximated Markov blanket (AMb) is an efficient and effective approach to induce Markov blankets from data. However, this approach only considers pairwise comparisons of features. In this paper, we redefine the AMb to consider the interaction among features of a given subset of features. We use the Correlation based Feature Selection (CFS) function to measure such interactions and, as search strategy, the Fast Correlation based Filter (FCBF). The proposal, denoted as FCBFCFS, is compared with the FCBF and tested on synthetic and real-world datasets from the microarray domain. Results show that the inclusion of interactions among features in a subset may led to smaller subsets of features without degrading the classification task.