用于联邦学习的可解释的客户决策树聚合过程

IF 8.1 1区 计算机科学 0 COMPUTER SCIENCE, INFORMATION SYSTEMS Information Sciences Pub Date : 2024-11-28 DOI:10.1016/j.ins.2024.121711
A. Argente-Garrido , C. Zuheros , M.V. Luzón , F. Herrera
{"title":"用于联邦学习的可解释的客户决策树聚合过程","authors":"A. Argente-Garrido ,&nbsp;C. Zuheros ,&nbsp;M.V. Luzón ,&nbsp;F. Herrera","doi":"10.1016/j.ins.2024.121711","DOIUrl":null,"url":null,"abstract":"<div><div>Trustworthy Artificial Intelligence solutions are essential in today's data-driven applications, prioritizing principles such as robustness, safety, transparency, explainability, and privacy among others. This has led to the emergence of Federated Learning as a solution for privacy and distributed machine learning. While decision trees, as self-explanatory models, are ideal for collaborative model training across multiple devices in resource-constrained environments such as federated learning environments for injecting interpretability in these models. Decision tree structure makes the aggregation in a federated learning environment not trivial. They require techniques that can merge their decision paths without introducing bias or overfitting while keeping the aggregated decision trees robust and generalizable. In this paper, we propose an Interpretable Client Decision Tree Aggregation process for Federated Learning scenarios that keeps the interpretability and the precision of the base decision trees used for the aggregation. This model is based on aggregating multiple decision paths of the decision trees and can be used on different decision tree types, such as ID3, CART and C4.5. We carry out the experiments within four datasets, and the analysis shows that the tree built with the model improves the local models without federated learning, and outperforms the state-of-the-art.</div></div>","PeriodicalId":51063,"journal":{"name":"Information Sciences","volume":"694 ","pages":"Article 121711"},"PeriodicalIF":8.1000,"publicationDate":"2024-11-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"An interpretable client decision tree aggregation process for federated learning\",\"authors\":\"A. Argente-Garrido ,&nbsp;C. Zuheros ,&nbsp;M.V. Luzón ,&nbsp;F. Herrera\",\"doi\":\"10.1016/j.ins.2024.121711\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Trustworthy Artificial Intelligence solutions are essential in today's data-driven applications, prioritizing principles such as robustness, safety, transparency, explainability, and privacy among others. This has led to the emergence of Federated Learning as a solution for privacy and distributed machine learning. While decision trees, as self-explanatory models, are ideal for collaborative model training across multiple devices in resource-constrained environments such as federated learning environments for injecting interpretability in these models. Decision tree structure makes the aggregation in a federated learning environment not trivial. They require techniques that can merge their decision paths without introducing bias or overfitting while keeping the aggregated decision trees robust and generalizable. In this paper, we propose an Interpretable Client Decision Tree Aggregation process for Federated Learning scenarios that keeps the interpretability and the precision of the base decision trees used for the aggregation. This model is based on aggregating multiple decision paths of the decision trees and can be used on different decision tree types, such as ID3, CART and C4.5. We carry out the experiments within four datasets, and the analysis shows that the tree built with the model improves the local models without federated learning, and outperforms the state-of-the-art.</div></div>\",\"PeriodicalId\":51063,\"journal\":{\"name\":\"Information Sciences\",\"volume\":\"694 \",\"pages\":\"Article 121711\"},\"PeriodicalIF\":8.1000,\"publicationDate\":\"2024-11-28\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Information Sciences\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0020025524016256\",\"RegionNum\":1,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"0\",\"JCRName\":\"COMPUTER SCIENCE, INFORMATION SYSTEMS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Information Sciences","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0020025524016256","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"0","JCRName":"COMPUTER SCIENCE, INFORMATION SYSTEMS","Score":null,"Total":0}
引用次数: 0

摘要

值得信赖的人工智能解决方案在当今数据驱动的应用中至关重要,优先考虑鲁棒性、安全性、透明度、可解释性和隐私等原则。这导致了联邦学习作为隐私和分布式机器学习解决方案的出现。而决策树作为自解释模型,非常适合在资源受限的环境中跨多个设备进行协作模型训练,例如在联邦学习环境中为这些模型注入可解释性。决策树结构使得在联邦学习环境中的聚合不是微不足道的。它们需要能够在不引入偏差或过拟合的情况下合并决策路径的技术,同时保持聚合决策树的鲁棒性和可泛化性。在本文中,我们为联邦学习场景提出了一个可解释的客户端决策树聚合过程,该过程保持了用于聚合的基本决策树的可解释性和精度。该模型基于对决策树的多个决策路径的聚合,可用于不同的决策树类型,如ID3、CART和C4.5。我们在四个数据集上进行了实验,分析表明,用该模型构建的树改进了没有联邦学习的局部模型,并且优于目前的最先进的模型。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
An interpretable client decision tree aggregation process for federated learning
Trustworthy Artificial Intelligence solutions are essential in today's data-driven applications, prioritizing principles such as robustness, safety, transparency, explainability, and privacy among others. This has led to the emergence of Federated Learning as a solution for privacy and distributed machine learning. While decision trees, as self-explanatory models, are ideal for collaborative model training across multiple devices in resource-constrained environments such as federated learning environments for injecting interpretability in these models. Decision tree structure makes the aggregation in a federated learning environment not trivial. They require techniques that can merge their decision paths without introducing bias or overfitting while keeping the aggregated decision trees robust and generalizable. In this paper, we propose an Interpretable Client Decision Tree Aggregation process for Federated Learning scenarios that keeps the interpretability and the precision of the base decision trees used for the aggregation. This model is based on aggregating multiple decision paths of the decision trees and can be used on different decision tree types, such as ID3, CART and C4.5. We carry out the experiments within four datasets, and the analysis shows that the tree built with the model improves the local models without federated learning, and outperforms the state-of-the-art.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Information Sciences
Information Sciences 工程技术-计算机:信息系统
CiteScore
14.00
自引率
17.30%
发文量
1322
审稿时长
10.4 months
期刊介绍: Informatics and Computer Science Intelligent Systems Applications is an esteemed international journal that focuses on publishing original and creative research findings in the field of information sciences. We also feature a limited number of timely tutorial and surveying contributions. Our journal aims to cater to a diverse audience, including researchers, developers, managers, strategic planners, graduate students, and anyone interested in staying up-to-date with cutting-edge research in information science, knowledge engineering, and intelligent systems. While readers are expected to share a common interest in information science, they come from varying backgrounds such as engineering, mathematics, statistics, physics, computer science, cell biology, molecular biology, management science, cognitive science, neurobiology, behavioral sciences, and biochemistry.
期刊最新文献
An interpretable client decision tree aggregation process for federated learning Representation of quasi-overlap functions for normal convex fuzzy truth values based on generalized extended overlap functions A neural network transformation based global optimization algorithm Multi-criteria decision making with Hamacher aggregation operators based on multi-polar fuzzy Z-numbers MAHACO: Multi-algorithm hybrid ant colony optimizer for 3D path planning of a group of UAVs
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1