Anton Poletaev , Buhong Liu , Lingbo Li , Vitali Avagyan , Vardan Voskanyan
{"title":"在数字时代改进预测:最小冗余的因果特征选择","authors":"Anton Poletaev , Buhong Liu , Lingbo Li , Vitali Avagyan , Vardan Voskanyan","doi":"10.1016/j.jdec.2024.05.001","DOIUrl":null,"url":null,"abstract":"<div><p>Effective decision-making in complex environments requires discerning the relevant from the irrelevant, a challenge that becomes pronounced with large multivariate time-series data. However, existing feature selection algorithms often suffer from complexity and a lack of interpretability, making it difficult for decision-makers to extract value, manage risks, and adhere to compliance regulations in a thoroughly explainable way. To address these challenges, we propose a novel causality-based feature selection technique that embeds an explainable unsupervised feature selection algorithm. We refer to our proposed method as Causal Feature Selection with Minimum Redundancy (CFSMR). Our method yields a minimum viable feature set without compromising model performance while ensuring interpretability. We conduct an experimental study to compare the proposed technique with conventional feature selection techniques. Our results demonstrate that our proposed method outperforms or performs on par with existing techniques, making it a promising approach for decision-makers seeking an effective and interpretable feature selection method.</p></div>","PeriodicalId":100773,"journal":{"name":"Journal of Digital Economy","volume":"3 ","pages":"Pages 14-36"},"PeriodicalIF":0.0000,"publicationDate":"2024-05-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2773067024000086/pdfft?md5=0c92ad6bb37824309edf9b3296dce80d&pid=1-s2.0-S2773067024000086-main.pdf","citationCount":"0","resultStr":"{\"title\":\"Improve the prediction in the digital Era: Causal feature selection with minimum redundancy\",\"authors\":\"Anton Poletaev , Buhong Liu , Lingbo Li , Vitali Avagyan , Vardan Voskanyan\",\"doi\":\"10.1016/j.jdec.2024.05.001\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><p>Effective decision-making in complex environments requires discerning the relevant from the irrelevant, a challenge that becomes pronounced with large multivariate time-series data. However, existing feature selection algorithms often suffer from complexity and a lack of interpretability, making it difficult for decision-makers to extract value, manage risks, and adhere to compliance regulations in a thoroughly explainable way. To address these challenges, we propose a novel causality-based feature selection technique that embeds an explainable unsupervised feature selection algorithm. We refer to our proposed method as Causal Feature Selection with Minimum Redundancy (CFSMR). Our method yields a minimum viable feature set without compromising model performance while ensuring interpretability. We conduct an experimental study to compare the proposed technique with conventional feature selection techniques. Our results demonstrate that our proposed method outperforms or performs on par with existing techniques, making it a promising approach for decision-makers seeking an effective and interpretable feature selection method.</p></div>\",\"PeriodicalId\":100773,\"journal\":{\"name\":\"Journal of Digital Economy\",\"volume\":\"3 \",\"pages\":\"Pages 14-36\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-05-15\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.sciencedirect.com/science/article/pii/S2773067024000086/pdfft?md5=0c92ad6bb37824309edf9b3296dce80d&pid=1-s2.0-S2773067024000086-main.pdf\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of Digital Economy\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S2773067024000086\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Digital Economy","FirstCategoryId":"1085","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2773067024000086","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Improve the prediction in the digital Era: Causal feature selection with minimum redundancy
Effective decision-making in complex environments requires discerning the relevant from the irrelevant, a challenge that becomes pronounced with large multivariate time-series data. However, existing feature selection algorithms often suffer from complexity and a lack of interpretability, making it difficult for decision-makers to extract value, manage risks, and adhere to compliance regulations in a thoroughly explainable way. To address these challenges, we propose a novel causality-based feature selection technique that embeds an explainable unsupervised feature selection algorithm. We refer to our proposed method as Causal Feature Selection with Minimum Redundancy (CFSMR). Our method yields a minimum viable feature set without compromising model performance while ensuring interpretability. We conduct an experimental study to compare the proposed technique with conventional feature selection techniques. Our results demonstrate that our proposed method outperforms or performs on par with existing techniques, making it a promising approach for decision-makers seeking an effective and interpretable feature selection method.