首页 > 最新文献

arXiv - CS - Symbolic Computation最新文献

英文 中文
Automated Loss function Search for Class-imbalanced Node Classification 用于类别不平衡节点分类的自动损失函数搜索
Pub Date : 2024-05-23 DOI: arxiv-2405.14133
Xinyu Guo, Kai Wu, Xiaoyu Zhang, Jing Liu
Class-imbalanced node classification tasks are prevalent in real-worldscenarios. Due to the uneven distribution of nodes across different classes,learning high-quality node representations remains a challenging endeavor. Theengineering of loss functions has shown promising potential in addressing thisissue. It involves the meticulous design of loss functions, utilizinginformation about the quantities of nodes in different categories and thenetwork's topology to learn unbiased node representations. However, the designof these loss functions heavily relies on human expert knowledge and exhibitslimited adaptability to specific target tasks. In this paper, we introduce ahigh-performance, flexible, and generalizable automated loss function searchframework to tackle this challenge. Across 15 combinations of graph neuralnetworks and datasets, our framework achieves a significant improvement inperformance compared to state-of-the-art methods. Additionally, we observe thathomophily in graph-structured data significantly contributes to thetransferability of the proposed framework.
类不平衡节点分类任务在现实世界场景中非常普遍。由于节点在不同类别中的分布不均衡,学习高质量的节点表示仍然是一项具有挑战性的工作。损失函数工程在解决这一问题方面显示出了巨大的潜力。它涉及损失函数的精心设计,利用不同类别节点的数量信息和网络拓扑结构来学习无偏的节点表示。然而,这些损失函数的设计严重依赖于人类专家的知识,对特定目标任务的适应性有限。在本文中,我们引入了一个高性能、灵活且可通用的自动损失函数搜索框架来应对这一挑战。在图神经网络和数据集的 15 种组合中,与最先进的方法相比,我们的框架取得了显著的性能提升。此外,我们还观察到,图结构数据的同源性大大提高了所提框架的可移植性。
{"title":"Automated Loss function Search for Class-imbalanced Node Classification","authors":"Xinyu Guo, Kai Wu, Xiaoyu Zhang, Jing Liu","doi":"arxiv-2405.14133","DOIUrl":"https://doi.org/arxiv-2405.14133","url":null,"abstract":"Class-imbalanced node classification tasks are prevalent in real-world\u0000scenarios. Due to the uneven distribution of nodes across different classes,\u0000learning high-quality node representations remains a challenging endeavor. The\u0000engineering of loss functions has shown promising potential in addressing this\u0000issue. It involves the meticulous design of loss functions, utilizing\u0000information about the quantities of nodes in different categories and the\u0000network's topology to learn unbiased node representations. However, the design\u0000of these loss functions heavily relies on human expert knowledge and exhibits\u0000limited adaptability to specific target tasks. In this paper, we introduce a\u0000high-performance, flexible, and generalizable automated loss function search\u0000framework to tackle this challenge. Across 15 combinations of graph neural\u0000networks and datasets, our framework achieves a significant improvement in\u0000performance compared to state-of-the-art methods. Additionally, we observe that\u0000homophily in graph-structured data significantly contributes to the\u0000transferability of the proposed framework.","PeriodicalId":501033,"journal":{"name":"arXiv - CS - Symbolic Computation","volume":"48 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-05-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141153880","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
The Recovery of $λ$ from a Hilbert Polynomial 从希尔伯特多项式中找回 $λ$
Pub Date : 2024-05-21 DOI: arxiv-2405.12886
Joseph Donato, Monica Lewis
In the study of Hilbert schemes, the integer partition $lambda$ helpsresearchers identify some geometric and combinatorial properties of the schemein question. To aid researchers in extracting such information from a Hilbertpolynomial, we describe an efficient algorithm which can identify if$p(x)inmathbb{Q}[x]$ is a Hilbert polynomial and if so, recover the integerpartition $lambda$ associated with it.
在对希尔伯特方案的研究中,整数分割 $lambda$ 可以帮助研究人员识别相关方案的一些几何和组合性质。为了帮助研究人员从希尔伯特多项式中提取这些信息,我们描述了一种高效的算法,它可以识别$p(x)inmathbb{Q}[x]$是否是希尔伯特多项式,如果是,则恢复与之相关的整数分区$lambda$。
{"title":"The Recovery of $λ$ from a Hilbert Polynomial","authors":"Joseph Donato, Monica Lewis","doi":"arxiv-2405.12886","DOIUrl":"https://doi.org/arxiv-2405.12886","url":null,"abstract":"In the study of Hilbert schemes, the integer partition $lambda$ helps\u0000researchers identify some geometric and combinatorial properties of the scheme\u0000in question. To aid researchers in extracting such information from a Hilbert\u0000polynomial, we describe an efficient algorithm which can identify if\u0000$p(x)inmathbb{Q}[x]$ is a Hilbert polynomial and if so, recover the integer\u0000partition $lambda$ associated with it.","PeriodicalId":501033,"journal":{"name":"arXiv - CS - Symbolic Computation","volume":"114 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-05-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141147604","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Strided Difference Bound Matrices 跨距差分约束矩阵
Pub Date : 2024-05-18 DOI: arxiv-2405.11244
Arjun Pitchanathan, Albert Cohen, Oleksandr Zinenko, Tobias Grosser
A wide range of symbolic analysis and optimization problems can be formalizedusing polyhedra. Sub-classes of polyhedra, also known as sub-polyhedraldomains, are sought for their lower space and time complexity. We introduce theStrided Difference Bound Matrix (SDBM) domain, which represents a sweet spot inthe context of optimizing compilers. Its expressiveness and efficientalgorithms are particularly well suited to the construction of machine learningcompilers. We present decision algorithms, abstract domain operators andcomputational complexity proofs for SDBM. We also conduct an empirical studywith the MLIR compiler framework to validate the domain's practicalapplicability. We characterize a sub-class of SDBMs that frequently occurs inpractice, and demonstrate even faster algorithms on this sub-class.
利用多面体可以形式化各种符号分析和优化问题。多面体的子类(也称为子多面体域)因其较低的空间和时间复杂性而受到追捧。我们引入了有边差分约束矩阵(SDBM)域,它代表了优化编译器的一个甜蜜点。它的表现力和高效算法特别适合构建机器学习编译器。我们介绍了 SDBM 的决策算法、抽象域算子和计算复杂度证明。我们还利用 MLIR 编译器框架进行了实证研究,以验证该领域的实际适用性。我们描述了在实践中经常出现的 SDBM 的一个子类,并在这个子类上演示了更快的算法。
{"title":"Strided Difference Bound Matrices","authors":"Arjun Pitchanathan, Albert Cohen, Oleksandr Zinenko, Tobias Grosser","doi":"arxiv-2405.11244","DOIUrl":"https://doi.org/arxiv-2405.11244","url":null,"abstract":"A wide range of symbolic analysis and optimization problems can be formalized\u0000using polyhedra. Sub-classes of polyhedra, also known as sub-polyhedral\u0000domains, are sought for their lower space and time complexity. We introduce the\u0000Strided Difference Bound Matrix (SDBM) domain, which represents a sweet spot in\u0000the context of optimizing compilers. Its expressiveness and efficient\u0000algorithms are particularly well suited to the construction of machine learning\u0000compilers. We present decision algorithms, abstract domain operators and\u0000computational complexity proofs for SDBM. We also conduct an empirical study\u0000with the MLIR compiler framework to validate the domain's practical\u0000applicability. We characterize a sub-class of SDBMs that frequently occurs in\u0000practice, and demonstrate even faster algorithms on this sub-class.","PeriodicalId":501033,"journal":{"name":"arXiv - CS - Symbolic Computation","volume":"67 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-05-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141147581","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Simulating Petri nets with Boolean Matrix Logic Programming 用布尔矩阵逻辑编程模拟 Petri 网
Pub Date : 2024-05-18 DOI: arxiv-2405.11412
Lun Ai, Stephen H. Muggleton, Shi-Shun Liang, Geoff S. Baldwin
Recent attention to relational knowledge bases has sparked a demand forunderstanding how relations change between entities. Petri nets can representknowledge structure and dynamically simulate interactions between entities, andthus they are well suited for achieving this goal. However, logic programsstruggle to deal with extensive Petri nets due to the limitations of high-levelsymbol manipulations. To address this challenge, we introduce a novel approachcalled Boolean Matrix Logic Programming (BMLP), utilising boolean matrices asan alternative computation mechanism for Prolog to evaluate logic programs.Within this framework, we propose two novel BMLP algorithms for simulating aclass of Petri nets known as elementary nets. This is done by transformingelementary nets into logically equivalent datalog programs. We demonstrateempirically that BMLP algorithms can evaluate these programs 40 times fasterthan tabled B-Prolog, SWI-Prolog, XSB-Prolog and Clingo. Our work enables theefficient simulation of elementary nets using Prolog, expanding the scope ofanalysis, learning and verification of complex systems with logic programmingtechniques.
最近对关系知识库的关注引发了对了解实体间关系如何变化的需求。Petri 网可以表示知识结构并动态模拟实体之间的交互,因此非常适合实现这一目标。然而,由于高级符号操作的限制,逻辑程序在处理庞大的 Petri 网时举步维艰。为了应对这一挑战,我们引入了一种称为布尔矩阵逻辑编程(Boolean Matrix Logic Programming,BMLP)的新方法,利用布尔矩阵作为 Prolog 的替代计算机制来评估逻辑程序。在这个框架内,我们提出了两种新颖的 BMLP 算法,用于模拟一类被称为基本网的 Petri 网,具体做法是将基本网转化为逻辑上等价的 datalog 程序。我们通过经验证明,BMLP 算法评估这些程序的速度比表中的 B-Prolog、SWI-Prolog、XSB-Prolog 和 Clingo 快 40 倍。我们的工作实现了使用 Prolog 对基本网进行高效模拟,扩大了使用逻辑编程技术分析、学习和验证复杂系统的范围。
{"title":"Simulating Petri nets with Boolean Matrix Logic Programming","authors":"Lun Ai, Stephen H. Muggleton, Shi-Shun Liang, Geoff S. Baldwin","doi":"arxiv-2405.11412","DOIUrl":"https://doi.org/arxiv-2405.11412","url":null,"abstract":"Recent attention to relational knowledge bases has sparked a demand for\u0000understanding how relations change between entities. Petri nets can represent\u0000knowledge structure and dynamically simulate interactions between entities, and\u0000thus they are well suited for achieving this goal. However, logic programs\u0000struggle to deal with extensive Petri nets due to the limitations of high-level\u0000symbol manipulations. To address this challenge, we introduce a novel approach\u0000called Boolean Matrix Logic Programming (BMLP), utilising boolean matrices as\u0000an alternative computation mechanism for Prolog to evaluate logic programs.\u0000Within this framework, we propose two novel BMLP algorithms for simulating a\u0000class of Petri nets known as elementary nets. This is done by transforming\u0000elementary nets into logically equivalent datalog programs. We demonstrate\u0000empirically that BMLP algorithms can evaluate these programs 40 times faster\u0000than tabled B-Prolog, SWI-Prolog, XSB-Prolog and Clingo. Our work enables the\u0000efficient simulation of elementary nets using Prolog, expanding the scope of\u0000analysis, learning and verification of complex systems with logic programming\u0000techniques.","PeriodicalId":501033,"journal":{"name":"arXiv - CS - Symbolic Computation","volume":"42 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-05-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141147582","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Jacobi Stability Analysis for Systems of ODEs Using Symbolic Computation 利用符号计算对 ODE 系统进行雅可比稳定性分析
Pub Date : 2024-05-17 DOI: arxiv-2405.10578
Bo Huang, Dongming Wang, Jing Yang
The classical theory of Kosambi-Cartan-Chern (KCC) developed in differentialgeometry provides a powerful method for analyzing the behaviors of dynamicalsystems. In the KCC theory, the properties of a dynamical system are describedin terms of five geometrical invariants, of which the second corresponds to theso-called Jacobi stability of the system. Different from that of the Lyapunovstability that has been studied extensively in the literature, the analysis ofthe Jacobi stability has been investigated more recently using geometricalconcepts and tools. It turns out that the existing work on the Jacobi stabilityanalysis remains theoretical and the problem of algorithmic and symbolictreatment of Jacobi stability analysis has yet to be addressed. In this paper,we initiate our study on the problem for a class of ODE systems of arbitrarydimension and propose two algorithmic schemes using symbolic computation tocheck whether a nonlinear dynamical system may exhibit Jacobi stability. Thefirst scheme, based on the construction of the complex root structure of acharacteristic polynomial and on the method of quantifier elimination, iscapable of detecting the existence of the Jacobi stability of the givendynamical system. The second algorithmic scheme exploits the method ofsemi-algebraic system solving and allows one to determine conditions on theparameters for a given dynamical system to have a prescribed number of Jacobistable fixed points. Several examples are presented to demonstrate theeffectiveness of the proposed algorithmic schemes.
在微分几何中发展起来的经典科桑比-卡坦-切恩(KCC)理论为分析动力学系统的行为提供了一种强有力的方法。在 KCC 理论中,动力学系统的特性用五个几何不变式来描述,其中第二个不变式对应于系统的所谓雅可比稳定性。与文献中广泛研究的李亚普诺夫稳定性不同,雅可比稳定性的分析最近使用几何概念和工具进行了研究。事实证明,现有的雅可比稳定性分析工作仍停留在理论层面,雅可比稳定性分析的算法和符号处理问题仍有待解决。在本文中,我们首先研究了一类任意维度的 ODE 系统的雅可比稳定性问题,并提出了两种利用符号计算来检验非线性动力系统是否可能表现出雅可比稳定性的算法方案。第一种方案基于特征多项式复根结构的构造和量子消元方法,能够检测给定动态系统是否存在雅可比稳定性。第二种算法方案利用了半代数系统求解方法,可以确定给定动力系统的参数条件,使其具有规定数量的雅可比定点。本文列举了几个例子来证明所提算法方案的有效性。
{"title":"Jacobi Stability Analysis for Systems of ODEs Using Symbolic Computation","authors":"Bo Huang, Dongming Wang, Jing Yang","doi":"arxiv-2405.10578","DOIUrl":"https://doi.org/arxiv-2405.10578","url":null,"abstract":"The classical theory of Kosambi-Cartan-Chern (KCC) developed in differential\u0000geometry provides a powerful method for analyzing the behaviors of dynamical\u0000systems. In the KCC theory, the properties of a dynamical system are described\u0000in terms of five geometrical invariants, of which the second corresponds to the\u0000so-called Jacobi stability of the system. Different from that of the Lyapunov\u0000stability that has been studied extensively in the literature, the analysis of\u0000the Jacobi stability has been investigated more recently using geometrical\u0000concepts and tools. It turns out that the existing work on the Jacobi stability\u0000analysis remains theoretical and the problem of algorithmic and symbolic\u0000treatment of Jacobi stability analysis has yet to be addressed. In this paper,\u0000we initiate our study on the problem for a class of ODE systems of arbitrary\u0000dimension and propose two algorithmic schemes using symbolic computation to\u0000check whether a nonlinear dynamical system may exhibit Jacobi stability. The\u0000first scheme, based on the construction of the complex root structure of a\u0000characteristic polynomial and on the method of quantifier elimination, is\u0000capable of detecting the existence of the Jacobi stability of the given\u0000dynamical system. The second algorithmic scheme exploits the method of\u0000semi-algebraic system solving and allows one to determine conditions on the\u0000parameters for a given dynamical system to have a prescribed number of Jacobi\u0000stable fixed points. Several examples are presented to demonstrate the\u0000effectiveness of the proposed algorithmic schemes.","PeriodicalId":501033,"journal":{"name":"arXiv - CS - Symbolic Computation","volume":"46 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-05-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141147605","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Bridging Syntax and Semantics of Lean Expressions in E-Graphs 架起电子图表中精益表达语法与语义的桥梁
Pub Date : 2024-05-16 DOI: arxiv-2405.10188
Marcus Rossel, Andrés Goens
Interactive theorem provers, like Isabelle/HOL, Coq and Lean, have expressivelanguages that allow the formalization of general mathematical objects andproofs. In this context, an important goal is to reduce the time and effortneeded to prove theorems. A significant means of achieving this is by improvingproof automation. We have implemented an early prototype of proof automationfor equational reasoning in Lean by using equality saturation. To achieve this,we need to bridge the gap between Lean's expression semantics and thesyntactically driven e-graphs in equality saturation. This involves handlingbound variables, implicit typing, as well as Lean's definitional equality,which is more general than syntactic equality and involves notions like$alpha$-equivalence, $beta$-reduction, and $eta$-reduction. In this extendedabstract, we highlight how we attempt to bridge this gap, and which challengesremain to be solved. Notably, while our techniques are partially unsound, theresulting proof automation remains sound by virtue of Lean's proof checking.
交互式定理证明器,如 Isabelle/HOL、Coq 和 Lean,都有很强的表达能力,可以将一般数学对象和定理形式化。在这种情况下,一个重要的目标就是减少定理证明所需的时间和精力。实现这一目标的一个重要手段就是提高证明的自动化程度。我们已经利用相等饱和实现了 Lean 中等式推理证明自动化的早期原型。为了实现这一目标,我们需要弥合精益表达式语义与等价饱和中的句法驱动电子图之间的差距。这涉及到处理绑定变量、隐式类型以及精益的定义相等,定义相等比语法相等更一般,涉及到诸如$alpha$-等价、$beta$-还原和$eta$-还原等概念。在这篇扩展摘要中,我们将重点介绍我们是如何试图弥合这一差距的,以及哪些难题仍有待解决。值得注意的是,虽然我们的技术有部分是不健全的,但凭借精益证明检查,由此产生的证明自动化仍然是健全的。
{"title":"Bridging Syntax and Semantics of Lean Expressions in E-Graphs","authors":"Marcus Rossel, Andrés Goens","doi":"arxiv-2405.10188","DOIUrl":"https://doi.org/arxiv-2405.10188","url":null,"abstract":"Interactive theorem provers, like Isabelle/HOL, Coq and Lean, have expressive\u0000languages that allow the formalization of general mathematical objects and\u0000proofs. In this context, an important goal is to reduce the time and effort\u0000needed to prove theorems. A significant means of achieving this is by improving\u0000proof automation. We have implemented an early prototype of proof automation\u0000for equational reasoning in Lean by using equality saturation. To achieve this,\u0000we need to bridge the gap between Lean's expression semantics and the\u0000syntactically driven e-graphs in equality saturation. This involves handling\u0000bound variables, implicit typing, as well as Lean's definitional equality,\u0000which is more general than syntactic equality and involves notions like\u0000$alpha$-equivalence, $beta$-reduction, and $eta$-reduction. In this extended\u0000abstract, we highlight how we attempt to bridge this gap, and which challenges\u0000remain to be solved. Notably, while our techniques are partially unsound, the\u0000resulting proof automation remains sound by virtue of Lean's proof checking.","PeriodicalId":501033,"journal":{"name":"arXiv - CS - Symbolic Computation","volume":"18 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-05-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141059658","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Generalized Holographic Reduced Representations 广义全息还原表征
Pub Date : 2024-05-15 DOI: arxiv-2405.09689
Calvin Yeung, Zhuowen Zou, Mohsen Imani
Deep learning has achieved remarkable success in recent years. Central to itssuccess is its ability to learn representations that preserve task-relevantstructure. However, massive energy, compute, and data costs are required tolearn general representations. This paper explores Hyperdimensional Computing(HDC), a computationally and data-efficient brain-inspired alternative. HDCacts as a bridge between connectionist and symbolic approaches to artificialintelligence (AI), allowing explicit specification of representationalstructure as in symbolic approaches while retaining the flexibility ofconnectionist approaches. However, HDC's simplicity poses challenges forencoding complex compositional structures, especially in its binding operation.To address this, we propose Generalized Holographic Reduced Representations(GHRR), an extension of Fourier Holographic Reduced Representations (FHRR), aspecific HDC implementation. GHRR introduces a flexible, non-commutativebinding operation, enabling improved encoding of complex data structures whilepreserving HDC's desirable properties of robustness and transparency. In thiswork, we introduce the GHRR framework, prove its theoretical properties and itsadherence to HDC properties, explore its kernel and binding characteristics,and perform empirical experiments showcasing its flexible non-commutativity,enhanced decoding accuracy for compositional structures, and improvedmemorization capacity compared to FHRR.
深度学习近年来取得了令人瞩目的成就。其成功的核心在于它能够学习保留任务相关结构的表征。然而,学习一般表征需要大量的能源、计算和数据成本。本文探讨了超维计算(HDC),这是一种计算和数据高效的大脑启发式替代方案。HDC 是连接主义和符号方法之间的一座桥梁,它允许像符号方法那样明确指定表征结构,同时保留连接主义方法的灵活性。为了解决这个问题,我们提出了广义全息还原表征(GHRR),它是傅立叶全息还原表征(FHRR)的扩展,是 HDC 的具体实现。GHRR 引入了灵活的非交换绑定操作,在保留 HDC 理想的鲁棒性和透明性的同时,改进了复杂数据结构的编码。在这项工作中,我们介绍了 GHRR 框架,证明了它的理论特性及其与 HDC 特性的一致性,探索了它的内核和绑定特性,并进行了实证实验,展示了它灵活的非交换性,与 FHRR 相比,它提高了组成结构的解码精度,并改善了记忆能力。
{"title":"Generalized Holographic Reduced Representations","authors":"Calvin Yeung, Zhuowen Zou, Mohsen Imani","doi":"arxiv-2405.09689","DOIUrl":"https://doi.org/arxiv-2405.09689","url":null,"abstract":"Deep learning has achieved remarkable success in recent years. Central to its\u0000success is its ability to learn representations that preserve task-relevant\u0000structure. However, massive energy, compute, and data costs are required to\u0000learn general representations. This paper explores Hyperdimensional Computing\u0000(HDC), a computationally and data-efficient brain-inspired alternative. HDC\u0000acts as a bridge between connectionist and symbolic approaches to artificial\u0000intelligence (AI), allowing explicit specification of representational\u0000structure as in symbolic approaches while retaining the flexibility of\u0000connectionist approaches. However, HDC's simplicity poses challenges for\u0000encoding complex compositional structures, especially in its binding operation.\u0000To address this, we propose Generalized Holographic Reduced Representations\u0000(GHRR), an extension of Fourier Holographic Reduced Representations (FHRR), a\u0000specific HDC implementation. GHRR introduces a flexible, non-commutative\u0000binding operation, enabling improved encoding of complex data structures while\u0000preserving HDC's desirable properties of robustness and transparency. In this\u0000work, we introduce the GHRR framework, prove its theoretical properties and its\u0000adherence to HDC properties, explore its kernel and binding characteristics,\u0000and perform empirical experiments showcasing its flexible non-commutativity,\u0000enhanced decoding accuracy for compositional structures, and improved\u0000memorization capacity compared to FHRR.","PeriodicalId":501033,"journal":{"name":"arXiv - CS - Symbolic Computation","volume":"12 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-05-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141059787","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Vector-Symbolic Architecture for Event-Based Optical Flow 基于事件的光流矢量符号架构
Pub Date : 2024-05-14 DOI: arxiv-2405.08300
Hongzhi You, Yijun Cao, Wei Yuan, Fanjun Wang, Ning Qiao, Yongjie Li
From a perspective of feature matching, optical flow estimation for eventcameras involves identifying event correspondences by comparing featuresimilarity across accompanying event frames. In this work, we introduces aneffective and robust high-dimensional (HD) feature descriptor for event frames,utilizing Vector Symbolic Architectures (VSA). The topological similarity amongneighboring variables within VSA contributes to the enhanced representationsimilarity of feature descriptors for flow-matching points, while itsstructured symbolic representation capacity facilitates feature fusion fromboth event polarities and multiple spatial scales. Based on this HD featuredescriptor, we propose a novel feature matching framework for event-basedoptical flow, encompassing both model-based (VSA-Flow) and self-supervisedlearning (VSA-SM) methods. In VSA-Flow, accurate optical flow estimationvalidates the effectiveness of HD feature descriptors. In VSA-SM, a novelsimilarity maximization method based on the HD feature descriptor is proposedto learn optical flow in a self-supervised way from events alone, eliminatingthe need for auxiliary grayscale images. Evaluation results demonstrate thatour VSA-based method achieves superior accuracy in comparison to bothmodel-based and self-supervised learning methods on the DSEC benchmark, whileremains competitive among both methods on the MVSEC benchmark. Thiscontribution marks a significant advancement in event-based optical flow withinthe feature matching methodology.
从特征匹配的角度来看,事件摄像机的光流估计包括通过比较伴随事件帧之间的特征相似性来识别事件对应关系。在这项工作中,我们利用矢量符号架构(VSA)为事件帧引入了一种有效且稳健的高维(HD)特征描述符。VSA 中相邻变量之间的拓扑相似性有助于增强流匹配点特征描述符的表征相似性,而其结构化符号表征能力则有利于从两个事件极性和多个空间尺度进行特征融合。基于这种高清特征描述符,我们提出了一种新颖的基于事件的光流特征匹配框架,包括基于模型的方法(VSA-Flow)和自我监督学习方法(VSA-SM)。在 VSA-Flow 中,精确的光流估计验证了高清特征描述符的有效性。在 VSA-SM 中,提出了一种基于高清特征描述符的新颖相似性最大化方法,以自我监督的方式仅从事件中学习光流,从而消除了对辅助灰度图像的需求。评估结果表明,在 DSEC 基准测试中,与基于模型的学习方法和自我监督学习方法相比,我们基于 VSA 的方法获得了更高的准确率,而在 MVSEC 基准测试中,我们的方法在两种方法中仍然具有竞争力。这一贡献标志着基于事件的光流特征匹配方法取得了重大进展。
{"title":"Vector-Symbolic Architecture for Event-Based Optical Flow","authors":"Hongzhi You, Yijun Cao, Wei Yuan, Fanjun Wang, Ning Qiao, Yongjie Li","doi":"arxiv-2405.08300","DOIUrl":"https://doi.org/arxiv-2405.08300","url":null,"abstract":"From a perspective of feature matching, optical flow estimation for event\u0000cameras involves identifying event correspondences by comparing feature\u0000similarity across accompanying event frames. In this work, we introduces an\u0000effective and robust high-dimensional (HD) feature descriptor for event frames,\u0000utilizing Vector Symbolic Architectures (VSA). The topological similarity among\u0000neighboring variables within VSA contributes to the enhanced representation\u0000similarity of feature descriptors for flow-matching points, while its\u0000structured symbolic representation capacity facilitates feature fusion from\u0000both event polarities and multiple spatial scales. Based on this HD feature\u0000descriptor, we propose a novel feature matching framework for event-based\u0000optical flow, encompassing both model-based (VSA-Flow) and self-supervised\u0000learning (VSA-SM) methods. In VSA-Flow, accurate optical flow estimation\u0000validates the effectiveness of HD feature descriptors. In VSA-SM, a novel\u0000similarity maximization method based on the HD feature descriptor is proposed\u0000to learn optical flow in a self-supervised way from events alone, eliminating\u0000the need for auxiliary grayscale images. Evaluation results demonstrate that\u0000our VSA-based method achieves superior accuracy in comparison to both\u0000model-based and self-supervised learning methods on the DSEC benchmark, while\u0000remains competitive among both methods on the MVSEC benchmark. This\u0000contribution marks a significant advancement in event-based optical flow within\u0000the feature matching methodology.","PeriodicalId":501033,"journal":{"name":"arXiv - CS - Symbolic Computation","volume":"49 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-05-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141059651","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Predictive Modeling of Flexible EHD Pumps using Kolmogorov-Arnold Networks 利用 Kolmogorov-Arnold 网络建立柔性 EHD 泵的预测模型
Pub Date : 2024-05-13 DOI: arxiv-2405.07488
Yanhong Peng, Miao He, Fangchao Hu, Zebing Mao, Xia Huang, Jun Ding
We present a novel approach to predicting the pressure and flow rate offlexible electrohydrodynamic pumps using the Kolmogorov-Arnold Network.Inspired by the Kolmogorov-Arnold representation theorem, KAN replaces fixedactivation functions with learnable spline-based activation functions, enablingit to approximate complex nonlinear functions more effectively than traditionalmodels like Multi-Layer Perceptron and Random Forest. We evaluated KAN on adataset of flexible EHD pump parameters and compared its performance againstRF, and MLP models. KAN achieved superior predictive accuracy, with MeanSquared Errors of 12.186 and 0.001 for pressure and flow rate predictions,respectively. The symbolic formulas extracted from KAN provided insights intothe nonlinear relationships between input parameters and pump performance.These findings demonstrate that KAN offers exceptional accuracy andinterpretability, making it a promising alternative for predictive modeling inelectrohydrodynamic pumping.
受 Kolmogorov-Arnold 表示定理的启发,KAN 用可学习的基于样条的激活函数取代了固定的激活函数,使其能够比多层感知器和随机森林等传统模型更有效地逼近复杂的非线性函数。我们在一组灵活的 EHD 泵参数上对 KAN 进行了评估,并将其性能与 RF 和 MLP 模型进行了比较。KAN 的预测准确性更胜一筹,压力和流量预测的均方误差分别为 12.186 和 0.001。从 KAN 中提取的符号公式深入揭示了输入参数与泵性能之间的非线性关系。这些研究结果表明,KAN 具有极高的准确性和可解释性,是电流体动力泵预测建模的理想选择。
{"title":"Predictive Modeling of Flexible EHD Pumps using Kolmogorov-Arnold Networks","authors":"Yanhong Peng, Miao He, Fangchao Hu, Zebing Mao, Xia Huang, Jun Ding","doi":"arxiv-2405.07488","DOIUrl":"https://doi.org/arxiv-2405.07488","url":null,"abstract":"We present a novel approach to predicting the pressure and flow rate of\u0000flexible electrohydrodynamic pumps using the Kolmogorov-Arnold Network.\u0000Inspired by the Kolmogorov-Arnold representation theorem, KAN replaces fixed\u0000activation functions with learnable spline-based activation functions, enabling\u0000it to approximate complex nonlinear functions more effectively than traditional\u0000models like Multi-Layer Perceptron and Random Forest. We evaluated KAN on a\u0000dataset of flexible EHD pump parameters and compared its performance against\u0000RF, and MLP models. KAN achieved superior predictive accuracy, with Mean\u0000Squared Errors of 12.186 and 0.001 for pressure and flow rate predictions,\u0000respectively. The symbolic formulas extracted from KAN provided insights into\u0000the nonlinear relationships between input parameters and pump performance.\u0000These findings demonstrate that KAN offers exceptional accuracy and\u0000interpretability, making it a promising alternative for predictive modeling in\u0000electrohydrodynamic pumping.","PeriodicalId":501033,"journal":{"name":"arXiv - CS - Symbolic Computation","volume":"87 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-05-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140926730","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Scalable Computation of Inter-Core Bounds Through Exact Abstractions 通过精确抽象实现内核间界限的可扩展计算
Pub Date : 2024-05-10 DOI: arxiv-2405.06387
Mohammed Aristide Foughali, Marius Mikučionis, Maryline Zhang
Real-time systems (RTSs) are at the heart of numerous safety-criticalapplications. An RTS typically consists of a set of real-time tasks (thesoftware) that execute on a multicore shared-memory platform (the hardware)following a scheduling policy. In an RTS, computing inter-core bounds, i.e.,bounds separating events produced by tasks on different cores, is crucial.While efficient techniques to over-approximate such bounds exist, little hasbeen proposed to compute their exact values. Given an RTS with a set of cores Cand a set of tasks T , under partitioned fixed- priority scheduling withlimited preemption, a recent work by Foughali, Hladik and Zuepke (FHZ) modelstasks with affinity c (i.e., allocated to core c in C) as a Uppaal timedautomata (TA) network Nc. For each core c in C, Nc integrates blocking (due todata sharing) using tight analytical formulae. Through compositional modelchecking, FHZ achieved a substantial gain in scalability for bounds local to acore. However, computing inter-core bounds for some events of interest E,produced by a subset of tasks TE with different affinities CE, requires modelchecking the parallel composition of all TA networks Nc for each c in CE, whichproduces a large, often intractable, state space. In this paper, we present anew scalable approach based on exact abstractions to compute exact inter-corebounds in a schedulable RTS, under the assumption that tasks in TE havedistinct affinities. We develop a novel algorithm, leveraging a new query thatwe implement in Uppaal, that computes for each TA network Nc in NE anabstraction A(Nc) preserving the exact intervals within which events occur onc, therefore drastically reducing the state space. The scalability of ourapproach is demonstrated on the WATERS 2017 industrial challenge, for which weefficiently compute various types of inter-core bounds where FHZ fails toscale.
实时系统(RTS)是众多安全关键型应用的核心。实时系统通常由一组实时任务(软件)组成,这些任务按照调度策略在多核共享内存平台(硬件)上执行。在 RTS 中,计算内核间界限(即区分不同内核上的任务所产生的事件的界限)至关重要。虽然存在过度估算此类界限的高效技术,但很少有人提出计算其精确值的方法。Foughali, Hladik and Zuepke (FHZ) 最近的一项研究将具有亲和性 c 的任务(即分配给 C 中的核心 c)建模为 Uppaal timedautomata (TA) 网络 Nc。对于 C 中的每个核心 c,Nc 使用严密的分析公式整合阻塞(由于数据共享)。通过组合模型检查,FHZ 在 ac 核局部边界的可扩展性方面取得了重大进展。然而,要计算由具有不同亲缘关系 CE 的任务子集 TE 产生的某些相关事件 E 的核间界限,需要对 CE 中每个 c 的所有 TA 网络 Nc 的并行组成进行建模检查,这会产生一个庞大的、通常难以处理的状态空间。在本文中,我们提出了一种基于精确抽象的全新可扩展方法,在可调度 RTS 中计算精确的内核间边界,前提是 TE 中的任务具有不同的亲和力。我们开发了一种新算法,利用我们在 Uppaal 中实现的新查询,为 NE 中的每个 TA 网络 Nc 计算出保留事件发生精确时间间隔的抽象 A(Nc),从而大大减少了状态空间。我们在 WATERS 2017 工业挑战赛上展示了我们方法的可扩展性,在该挑战赛中,我们有效地计算了 FHZ 无法扩展的各种类型的内核间边界。
{"title":"Scalable Computation of Inter-Core Bounds Through Exact Abstractions","authors":"Mohammed Aristide Foughali, Marius Mikučionis, Maryline Zhang","doi":"arxiv-2405.06387","DOIUrl":"https://doi.org/arxiv-2405.06387","url":null,"abstract":"Real-time systems (RTSs) are at the heart of numerous safety-critical\u0000applications. An RTS typically consists of a set of real-time tasks (the\u0000software) that execute on a multicore shared-memory platform (the hardware)\u0000following a scheduling policy. In an RTS, computing inter-core bounds, i.e.,\u0000bounds separating events produced by tasks on different cores, is crucial.\u0000While efficient techniques to over-approximate such bounds exist, little has\u0000been proposed to compute their exact values. Given an RTS with a set of cores C\u0000and a set of tasks T , under partitioned fixed- priority scheduling with\u0000limited preemption, a recent work by Foughali, Hladik and Zuepke (FHZ) models\u0000tasks with affinity c (i.e., allocated to core c in C) as a Uppaal timed\u0000automata (TA) network Nc. For each core c in C, Nc integrates blocking (due to\u0000data sharing) using tight analytical formulae. Through compositional model\u0000checking, FHZ achieved a substantial gain in scalability for bounds local to a\u0000core. However, computing inter-core bounds for some events of interest E,\u0000produced by a subset of tasks TE with different affinities CE, requires model\u0000checking the parallel composition of all TA networks Nc for each c in CE, which\u0000produces a large, often intractable, state space. In this paper, we present a\u0000new scalable approach based on exact abstractions to compute exact inter-core\u0000bounds in a schedulable RTS, under the assumption that tasks in TE have\u0000distinct affinities. We develop a novel algorithm, leveraging a new query that\u0000we implement in Uppaal, that computes for each TA network Nc in NE an\u0000abstraction A(Nc) preserving the exact intervals within which events occur on\u0000c, therefore drastically reducing the state space. The scalability of our\u0000approach is demonstrated on the WATERS 2017 industrial challenge, for which we\u0000efficiently compute various types of inter-core bounds where FHZ fails to\u0000scale.","PeriodicalId":501033,"journal":{"name":"arXiv - CS - Symbolic Computation","volume":"21 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-05-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140927120","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
arXiv - CS - Symbolic Computation
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1