Zhenwu Wang, Shiqi Zhang, Yang Chen, Mengjie Han, Yang Zhou, Benting Wan
{"title":"用于多标签分类的基于贝叶斯网络的新型集合分类器链","authors":"Zhenwu Wang, Shiqi Zhang, Yang Chen, Mengjie Han, Yang Zhou, Benting Wan","doi":"10.1007/s40747-024-01528-7","DOIUrl":null,"url":null,"abstract":"<p>In this paper, we address the challenges of random label ordering and limited interpretability associated with Ensemble Classifier Chains (ECC) by introducing a novel ECC method, ECC-MOO&BN, which integrates Bayesian Networks (BN) and Multi-Objective Optimization (MOO). This approach is designed to concurrently overcome these ECC limitations. The ECC-MOO&BN method focuses on extracting diverse and interpretable label orderings for the ECC classifier. We initiated this process by employing mutual information to investigate label relationships and establish the initial structures of the BN. Subsequently, an enhanced NSGA-II algorithm was applied to develop a series of Directed Acyclic Graphs (DAGs) that effectively balance the likelihood and complexity of the BN structure. The rationale behind using the MOO method lies in its ability to optimize both complexity and likelihood simultaneously, which not only diversifies DAG generation but also helps avoid overfitting during the production of label orderings. The DAGs, once sorted topologically, yielded a series of label orderings, which were then seamlessly integrated into the ECC framework for addressing multi-label classification (MLC) problems. Experimental results show that when benchmarked against eleven leading-edge MLC algorithms, our proposed method achieves the highest average ranking across seven evaluation criteria on nine out of thirteen MLC datasets. The results of the Friedman test and Nemenyi test also indicate that the performance of the proposed method has a significant advantage compared to other algorithms.</p>","PeriodicalId":10524,"journal":{"name":"Complex & Intelligent Systems","volume":null,"pages":null},"PeriodicalIF":5.0000,"publicationDate":"2024-07-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"A novel bayesian network-based ensemble classifier chains for multi-label classification\",\"authors\":\"Zhenwu Wang, Shiqi Zhang, Yang Chen, Mengjie Han, Yang Zhou, Benting Wan\",\"doi\":\"10.1007/s40747-024-01528-7\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p>In this paper, we address the challenges of random label ordering and limited interpretability associated with Ensemble Classifier Chains (ECC) by introducing a novel ECC method, ECC-MOO&BN, which integrates Bayesian Networks (BN) and Multi-Objective Optimization (MOO). This approach is designed to concurrently overcome these ECC limitations. The ECC-MOO&BN method focuses on extracting diverse and interpretable label orderings for the ECC classifier. We initiated this process by employing mutual information to investigate label relationships and establish the initial structures of the BN. Subsequently, an enhanced NSGA-II algorithm was applied to develop a series of Directed Acyclic Graphs (DAGs) that effectively balance the likelihood and complexity of the BN structure. The rationale behind using the MOO method lies in its ability to optimize both complexity and likelihood simultaneously, which not only diversifies DAG generation but also helps avoid overfitting during the production of label orderings. The DAGs, once sorted topologically, yielded a series of label orderings, which were then seamlessly integrated into the ECC framework for addressing multi-label classification (MLC) problems. Experimental results show that when benchmarked against eleven leading-edge MLC algorithms, our proposed method achieves the highest average ranking across seven evaluation criteria on nine out of thirteen MLC datasets. The results of the Friedman test and Nemenyi test also indicate that the performance of the proposed method has a significant advantage compared to other algorithms.</p>\",\"PeriodicalId\":10524,\"journal\":{\"name\":\"Complex & Intelligent Systems\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":5.0000,\"publicationDate\":\"2024-07-15\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Complex & Intelligent Systems\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://doi.org/10.1007/s40747-024-01528-7\",\"RegionNum\":2,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Complex & Intelligent Systems","FirstCategoryId":"94","ListUrlMain":"https://doi.org/10.1007/s40747-024-01528-7","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
A novel bayesian network-based ensemble classifier chains for multi-label classification
In this paper, we address the challenges of random label ordering and limited interpretability associated with Ensemble Classifier Chains (ECC) by introducing a novel ECC method, ECC-MOO&BN, which integrates Bayesian Networks (BN) and Multi-Objective Optimization (MOO). This approach is designed to concurrently overcome these ECC limitations. The ECC-MOO&BN method focuses on extracting diverse and interpretable label orderings for the ECC classifier. We initiated this process by employing mutual information to investigate label relationships and establish the initial structures of the BN. Subsequently, an enhanced NSGA-II algorithm was applied to develop a series of Directed Acyclic Graphs (DAGs) that effectively balance the likelihood and complexity of the BN structure. The rationale behind using the MOO method lies in its ability to optimize both complexity and likelihood simultaneously, which not only diversifies DAG generation but also helps avoid overfitting during the production of label orderings. The DAGs, once sorted topologically, yielded a series of label orderings, which were then seamlessly integrated into the ECC framework for addressing multi-label classification (MLC) problems. Experimental results show that when benchmarked against eleven leading-edge MLC algorithms, our proposed method achieves the highest average ranking across seven evaluation criteria on nine out of thirteen MLC datasets. The results of the Friedman test and Nemenyi test also indicate that the performance of the proposed method has a significant advantage compared to other algorithms.
期刊介绍:
Complex & Intelligent Systems aims to provide a forum for presenting and discussing novel approaches, tools and techniques meant for attaining a cross-fertilization between the broad fields of complex systems, computational simulation, and intelligent analytics and visualization. The transdisciplinary research that the journal focuses on will expand the boundaries of our understanding by investigating the principles and processes that underlie many of the most profound problems facing society today.