MonoKAN:经过认证的单调科尔莫戈罗夫-阿诺德网络

Alejandro Polo-Molina, David Alfaya, Jose Portela
{"title":"MonoKAN:经过认证的单调科尔莫戈罗夫-阿诺德网络","authors":"Alejandro Polo-Molina, David Alfaya, Jose Portela","doi":"arxiv-2409.11078","DOIUrl":null,"url":null,"abstract":"Artificial Neural Networks (ANNs) have significantly advanced various fields\nby effectively recognizing patterns and solving complex problems. Despite these\nadvancements, their interpretability remains a critical challenge, especially\nin applications where transparency and accountability are essential. To address\nthis, explainable AI (XAI) has made progress in demystifying ANNs, yet\ninterpretability alone is often insufficient. In certain applications, model\npredictions must align with expert-imposed requirements, sometimes exemplified\nby partial monotonicity constraints. While monotonic approaches are found in\nthe literature for traditional Multi-layer Perceptrons (MLPs), they still face\ndifficulties in achieving both interpretability and certified partial\nmonotonicity. Recently, the Kolmogorov-Arnold Network (KAN) architecture, based\non learnable activation functions parametrized as splines, has been proposed as\na more interpretable alternative to MLPs. Building on this, we introduce a\nnovel ANN architecture called MonoKAN, which is based on the KAN architecture\nand achieves certified partial monotonicity while enhancing interpretability.\nTo achieve this, we employ cubic Hermite splines, which guarantee monotonicity\nthrough a set of straightforward conditions. Additionally, by using positive\nweights in the linear combinations of these splines, we ensure that the network\npreserves the monotonic relationships between input and output. Our experiments\ndemonstrate that MonoKAN not only enhances interpretability but also improves\npredictive performance across the majority of benchmarks, outperforming\nstate-of-the-art monotonic MLP approaches.","PeriodicalId":501347,"journal":{"name":"arXiv - CS - Neural and Evolutionary Computing","volume":"46 1","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2024-09-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"MonoKAN: Certified Monotonic Kolmogorov-Arnold Network\",\"authors\":\"Alejandro Polo-Molina, David Alfaya, Jose Portela\",\"doi\":\"arxiv-2409.11078\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Artificial Neural Networks (ANNs) have significantly advanced various fields\\nby effectively recognizing patterns and solving complex problems. Despite these\\nadvancements, their interpretability remains a critical challenge, especially\\nin applications where transparency and accountability are essential. To address\\nthis, explainable AI (XAI) has made progress in demystifying ANNs, yet\\ninterpretability alone is often insufficient. In certain applications, model\\npredictions must align with expert-imposed requirements, sometimes exemplified\\nby partial monotonicity constraints. While monotonic approaches are found in\\nthe literature for traditional Multi-layer Perceptrons (MLPs), they still face\\ndifficulties in achieving both interpretability and certified partial\\nmonotonicity. Recently, the Kolmogorov-Arnold Network (KAN) architecture, based\\non learnable activation functions parametrized as splines, has been proposed as\\na more interpretable alternative to MLPs. Building on this, we introduce a\\nnovel ANN architecture called MonoKAN, which is based on the KAN architecture\\nand achieves certified partial monotonicity while enhancing interpretability.\\nTo achieve this, we employ cubic Hermite splines, which guarantee monotonicity\\nthrough a set of straightforward conditions. Additionally, by using positive\\nweights in the linear combinations of these splines, we ensure that the network\\npreserves the monotonic relationships between input and output. Our experiments\\ndemonstrate that MonoKAN not only enhances interpretability but also improves\\npredictive performance across the majority of benchmarks, outperforming\\nstate-of-the-art monotonic MLP approaches.\",\"PeriodicalId\":501347,\"journal\":{\"name\":\"arXiv - CS - Neural and Evolutionary Computing\",\"volume\":\"46 1\",\"pages\":\"\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-09-17\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"arXiv - CS - Neural and Evolutionary Computing\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/arxiv-2409.11078\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"arXiv - CS - Neural and Evolutionary Computing","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/arxiv-2409.11078","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

人工神经网络(ANN)通过有效识别模式和解决复杂问题,极大地推动了各个领域的发展。尽管取得了这些进步,但其可解释性仍然是一个严峻的挑战,尤其是在对透明度和问责制至关重要的应用领域。为了解决这个问题,可解释人工智能(XAI)在揭开人工智能的神秘面纱方面取得了进展,但仅有可解释性往往是不够的。在某些应用中,模型预测必须符合专家提出的要求,有时部分单调性约束就是一个例子。虽然传统多层感知器(MLP)的单调性方法已见诸文献,但它们在实现可解释性和经认证的部分单调性方面仍然面临困难。最近,有人提出了基于参数化为劈线的可学习激活函数的 Kolmogorov-Arnold 网络(KAN)架构,作为 MLP 的一种更可解释的替代方案。在此基础上,我们推出了一种名为 MonoKAN 的新型 ANN 架构,它以 KAN 架构为基础,在增强可解释性的同时实现了经认证的部分单调性。此外,通过在这些样条的线性组合中使用正权重,我们确保了网络保留了输入和输出之间的单调关系。我们的实验证明,MonoKAN 不仅增强了可解释性,而且在大多数基准测试中提高了预测性能,表现优于最先进的单调 MLP 方法。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
MonoKAN: Certified Monotonic Kolmogorov-Arnold Network
Artificial Neural Networks (ANNs) have significantly advanced various fields by effectively recognizing patterns and solving complex problems. Despite these advancements, their interpretability remains a critical challenge, especially in applications where transparency and accountability are essential. To address this, explainable AI (XAI) has made progress in demystifying ANNs, yet interpretability alone is often insufficient. In certain applications, model predictions must align with expert-imposed requirements, sometimes exemplified by partial monotonicity constraints. While monotonic approaches are found in the literature for traditional Multi-layer Perceptrons (MLPs), they still face difficulties in achieving both interpretability and certified partial monotonicity. Recently, the Kolmogorov-Arnold Network (KAN) architecture, based on learnable activation functions parametrized as splines, has been proposed as a more interpretable alternative to MLPs. Building on this, we introduce a novel ANN architecture called MonoKAN, which is based on the KAN architecture and achieves certified partial monotonicity while enhancing interpretability. To achieve this, we employ cubic Hermite splines, which guarantee monotonicity through a set of straightforward conditions. Additionally, by using positive weights in the linear combinations of these splines, we ensure that the network preserves the monotonic relationships between input and output. Our experiments demonstrate that MonoKAN not only enhances interpretability but also improves predictive performance across the majority of benchmarks, outperforming state-of-the-art monotonic MLP approaches.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
期刊最新文献
Hardware-Friendly Implementation of Physical Reservoir Computing with CMOS-based Time-domain Analog Spiking Neurons Self-Contrastive Forward-Forward Algorithm Bio-Inspired Mamba: Temporal Locality and Bioplausible Learning in Selective State Space Models PReLU: Yet Another Single-Layer Solution to the XOR Problem Inferno: An Extensible Framework for Spiking Neural Networks
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1