{"title":"无先验知识分层多标签分类中的错误检测和约束恢复","authors":"Joshua Shay Kricheli, Khoa Vo, Aniruddha Datta, Spencer Ozgur, Paulo Shakarian","doi":"arxiv-2407.15192","DOIUrl":null,"url":null,"abstract":"Recent advances in Hierarchical Multi-label Classification (HMC),\nparticularly neurosymbolic-based approaches, have demonstrated improved\nconsistency and accuracy by enforcing constraints on a neural model during\ntraining. However, such work assumes the existence of such constraints\na-priori. In this paper, we relax this strong assumption and present an\napproach based on Error Detection Rules (EDR) that allow for learning\nexplainable rules about the failure modes of machine learning models. We show\nthat these rules are not only effective in detecting when a machine learning\nclassifier has made an error but also can be leveraged as constraints for HMC,\nthereby allowing the recovery of explainable constraints even if they are not\nprovided. We show that our approach is effective in detecting machine learning\nerrors and recovering constraints, is noise tolerant, and can function as a\nsource of knowledge for neurosymbolic models on multiple datasets, including a\nnewly introduced military vehicle recognition dataset.","PeriodicalId":501033,"journal":{"name":"arXiv - CS - Symbolic Computation","volume":"6 1","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2024-07-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Error Detection and Constraint Recovery in Hierarchical Multi-Label Classification without Prior Knowledge\",\"authors\":\"Joshua Shay Kricheli, Khoa Vo, Aniruddha Datta, Spencer Ozgur, Paulo Shakarian\",\"doi\":\"arxiv-2407.15192\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Recent advances in Hierarchical Multi-label Classification (HMC),\\nparticularly neurosymbolic-based approaches, have demonstrated improved\\nconsistency and accuracy by enforcing constraints on a neural model during\\ntraining. However, such work assumes the existence of such constraints\\na-priori. In this paper, we relax this strong assumption and present an\\napproach based on Error Detection Rules (EDR) that allow for learning\\nexplainable rules about the failure modes of machine learning models. We show\\nthat these rules are not only effective in detecting when a machine learning\\nclassifier has made an error but also can be leveraged as constraints for HMC,\\nthereby allowing the recovery of explainable constraints even if they are not\\nprovided. We show that our approach is effective in detecting machine learning\\nerrors and recovering constraints, is noise tolerant, and can function as a\\nsource of knowledge for neurosymbolic models on multiple datasets, including a\\nnewly introduced military vehicle recognition dataset.\",\"PeriodicalId\":501033,\"journal\":{\"name\":\"arXiv - CS - Symbolic Computation\",\"volume\":\"6 1\",\"pages\":\"\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-07-21\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"arXiv - CS - Symbolic Computation\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/arxiv-2407.15192\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"arXiv - CS - Symbolic Computation","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/arxiv-2407.15192","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Error Detection and Constraint Recovery in Hierarchical Multi-Label Classification without Prior Knowledge
Recent advances in Hierarchical Multi-label Classification (HMC),
particularly neurosymbolic-based approaches, have demonstrated improved
consistency and accuracy by enforcing constraints on a neural model during
training. However, such work assumes the existence of such constraints
a-priori. In this paper, we relax this strong assumption and present an
approach based on Error Detection Rules (EDR) that allow for learning
explainable rules about the failure modes of machine learning models. We show
that these rules are not only effective in detecting when a machine learning
classifier has made an error but also can be leveraged as constraints for HMC,
thereby allowing the recovery of explainable constraints even if they are not
provided. We show that our approach is effective in detecting machine learning
errors and recovering constraints, is noise tolerant, and can function as a
source of knowledge for neurosymbolic models on multiple datasets, including a
newly introduced military vehicle recognition dataset.