首页 > 最新文献

arXiv - CS - Formal Languages and Automata Theory最新文献

英文 中文
Query Learning of Advice and Nominal Automata 建议和名义自动机的查询学习
Pub Date : 2024-09-17 DOI: arxiv-2409.10822
Kevin Zhou
Learning automata by queries is a long-studied area initiated by Angluin in1987 with the introduction of the $L^*$ algorithm to learn regular languages,with a large body of work afterwards on many different variations andgeneralizations of DFAs. Recently, Chase and Freitag introduced a novelapproach to proving query learning bounds by computing combinatorial complexitymeasures for the classes in question, which they applied to the setting of DFAsto obtain qualitatively different results compared to the $L^*$ algorithm.Using this approach, we prove new query learning bounds for two generalizationsof DFAs. The first setting is that of advice DFAs, which are DFAs augmentedwith an advice string that informs the DFA's transition behavior at each step.For advice DFAs, we give the first known upper bounds for query complexity. Thesecond setting is that of nominal DFAs, which generalize DFAs to infinitealphabets which admit some structure via symmetries. For nominal DFAs, we makequalitative improvements over prior results.
通过查询学习自动机是一个研究已久的领域,1987 年,Angluin 提出了学习正则表达式语言的 $L^*$ 算法,随后又有大量工作涉及 DFA 的许多不同变体和泛化。最近,Chase 和 Freitag 引入了一种新方法,通过计算相关类的组合复杂性度量来证明查询学习边界,他们将这种方法应用到 DFA 的设置中,得到了与 $L^*$ 算法截然不同的结果。第一种情况是建议 DFA,这种 DFA 在每一步都有一个建议字符串,为 DFA 的转换行为提供信息。对于建议 DFA,我们首次给出了已知的查询复杂度上限。第二种情况是名义 DFA,它将 DFA 概括为无限字母表,并通过对称性容许某种结构。对于名义 DFA,我们对之前的结果进行了定性改进。
{"title":"Query Learning of Advice and Nominal Automata","authors":"Kevin Zhou","doi":"arxiv-2409.10822","DOIUrl":"https://doi.org/arxiv-2409.10822","url":null,"abstract":"Learning automata by queries is a long-studied area initiated by Angluin in\u00001987 with the introduction of the $L^*$ algorithm to learn regular languages,\u0000with a large body of work afterwards on many different variations and\u0000generalizations of DFAs. Recently, Chase and Freitag introduced a novel\u0000approach to proving query learning bounds by computing combinatorial complexity\u0000measures for the classes in question, which they applied to the setting of DFAs\u0000to obtain qualitatively different results compared to the $L^*$ algorithm.\u0000Using this approach, we prove new query learning bounds for two generalizations\u0000of DFAs. The first setting is that of advice DFAs, which are DFAs augmented\u0000with an advice string that informs the DFA's transition behavior at each step.\u0000For advice DFAs, we give the first known upper bounds for query complexity. The\u0000second setting is that of nominal DFAs, which generalize DFAs to infinite\u0000alphabets which admit some structure via symmetries. For nominal DFAs, we make\u0000qualitative improvements over prior results.","PeriodicalId":501124,"journal":{"name":"arXiv - CS - Formal Languages and Automata Theory","volume":"39 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-09-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142249545","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Well-Behaved (Co)algebraic Semantics of Regular Expressions in Dafny Dafny 中正则表达式的完备(共)代数语义学
Pub Date : 2024-09-15 DOI: arxiv-2409.09889
Stefan Zetzsche, Wojciech Rozowski
Regular expressions are commonly understood in terms of their denotationalsemantics, that is, through formal languages -- the regular languages. Thisview is inductive in nature: two primitives are equivalent if they areconstructed in the same way. Alternatively, regular expressions can beunderstood in terms of their operational semantics, that is, throughdeterministic finite automata. This view is coinductive in nature: twoprimitives are equivalent if they are deconstructed in the same way. It isimplied by Kleene's famous theorem that both views are equivalent: regularlanguages are precisely the formal languages accepted by deterministic finiteautomata. In this paper, we use Dafny, a verification-aware programminglanguage, to formally verify, for the first time, what has been previouslyestablished only through proofs-by-hand: the two semantics of regularexpressions are well-behaved, in the sense that they are in fact one and thesame, up to pointwise bisimilarity. At each step of our formalisation, wepropose an interpretation in the language of Coalgebra. We found that Dafny isparticularly well suited for the task due to its inductive and coinductivefeatures and hope our approach serves as a blueprint for future generalisationsto other theories.
正则表达式通常从其指称语义学的角度来理解,也就是通过形式语言--正则表达式语言--来理解。这种观点在本质上是归纳性的:如果两个基元以相同的方式构造,它们就是等价的。另外,正则表达式也可以从其运算语义的角度来理解,即通过确定性有限自动机来理解。这种观点在本质上是共导的:如果两个正则表达式以相同的方式解构,它们就是等价的。克莱因的著名定理暗示这两种观点是等价的:正则表达式语言正是确定性有限自动机所接受的形式语言。在本文中,我们使用 Dafny 这种具有验证意识的编程语言,首次正式验证了以前只能通过手写证明来确立的观点:正则表达式的两种语义都是良好的,从这个意义上说,它们实际上是相同的,直到点上的二相似性。在我们形式化的每一步,我们都提出了用 Coalgebra 语言进行解释的方法。我们发现,由于 Dafny 的归纳和共推特性,它特别适合这项任务,并希望我们的方法可以作为未来推广到其他理论的蓝图。
{"title":"Well-Behaved (Co)algebraic Semantics of Regular Expressions in Dafny","authors":"Stefan Zetzsche, Wojciech Rozowski","doi":"arxiv-2409.09889","DOIUrl":"https://doi.org/arxiv-2409.09889","url":null,"abstract":"Regular expressions are commonly understood in terms of their denotational\u0000semantics, that is, through formal languages -- the regular languages. This\u0000view is inductive in nature: two primitives are equivalent if they are\u0000constructed in the same way. Alternatively, regular expressions can be\u0000understood in terms of their operational semantics, that is, through\u0000deterministic finite automata. This view is coinductive in nature: two\u0000primitives are equivalent if they are deconstructed in the same way. It is\u0000implied by Kleene's famous theorem that both views are equivalent: regular\u0000languages are precisely the formal languages accepted by deterministic finite\u0000automata. In this paper, we use Dafny, a verification-aware programming\u0000language, to formally verify, for the first time, what has been previously\u0000established only through proofs-by-hand: the two semantics of regular\u0000expressions are well-behaved, in the sense that they are in fact one and the\u0000same, up to pointwise bisimilarity. At each step of our formalisation, we\u0000propose an interpretation in the language of Coalgebra. We found that Dafny is\u0000particularly well suited for the task due to its inductive and coinductive\u0000features and hope our approach serves as a blueprint for future generalisations\u0000to other theories.","PeriodicalId":501124,"journal":{"name":"arXiv - CS - Formal Languages and Automata Theory","volume":"195 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-09-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142249546","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Run supports and initial algebra supports of weighted automata 加权自动机的运行支持和初始代数支持
Pub Date : 2024-09-13 DOI: arxiv-2409.08727
Manfred Droste, Heiko Vogler
We consider weighted automata over words and over trees where the weightalgebras are strong bimonoids, i.e., semirings which may lack distributivity.It is well known that, for each such weighted automaton, its run semantics andits initial algebra semantics can be different, due to the presence ofnondeterminism and the absence of distributivity. Here we investigate thequestion under which conditions on the strong bimonoid the support of the runsemantics equals the support of the initial algebra semantics. We prove acharacterization of this equality in terms of strongly zero-sum-free strongbimonoids (for weighted automata over words) and in terms of bi-stronglyzero-sum-free strong bimonoids (for weighted automata over trees). We alsoconsider shortly the images of the two semantics functions.
众所周知,对于每一个这样的加权自动机,由于非确定性的存在和分配性的缺失,其运行语义和初始代数语义可能是不同的。在这里,我们研究了在强双元上,运行语义的支持等于初始代数语义的支持的条件。我们用强无零和强双元体(对于词上的加权自动机)和双强无零和强双元体(对于树上的加权自动机)证明了这种相等的特征。我们还将很快考虑这两个语义函数的图像。
{"title":"Run supports and initial algebra supports of weighted automata","authors":"Manfred Droste, Heiko Vogler","doi":"arxiv-2409.08727","DOIUrl":"https://doi.org/arxiv-2409.08727","url":null,"abstract":"We consider weighted automata over words and over trees where the weight\u0000algebras are strong bimonoids, i.e., semirings which may lack distributivity.\u0000It is well known that, for each such weighted automaton, its run semantics and\u0000its initial algebra semantics can be different, due to the presence of\u0000nondeterminism and the absence of distributivity. Here we investigate the\u0000question under which conditions on the strong bimonoid the support of the run\u0000semantics equals the support of the initial algebra semantics. We prove a\u0000characterization of this equality in terms of strongly zero-sum-free strong\u0000bimonoids (for weighted automata over words) and in terms of bi-strongly\u0000zero-sum-free strong bimonoids (for weighted automata over trees). We also\u0000consider shortly the images of the two semantics functions.","PeriodicalId":501124,"journal":{"name":"arXiv - CS - Formal Languages and Automata Theory","volume":"25 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-09-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142249547","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
$mathbb{N}$-polyregular functions arise from well-quasi-orderings $mathbb{N}$多不规则函数产生于良好准有序性
Pub Date : 2024-09-12 DOI: arxiv-2409.07882
Aliaume Lopez
A fundamental construction in formal language theory is the Myhill-Nerodecongruence on words, whose finitedness characterizes regular language. Thisconstruction was generalized to functions from $Sigma^*$ to $mathbb{Z}$ byColcombet, Dou'eneau-Tabot, and Lopez to characterize the class of so-called$mathbb{Z}$-polyregular functions. In this paper, we relax the notion ofequivalence relation to quasi-ordering in order to study the class of$mathbb{N}$-polyregular functions, that plays the role of$mathbb{Z}$-polyregular functions among functions from $Sigma^*$ to$mathbb{N}$. The analogue of having a finite index is then being awell-quasi-ordering. This provides a canonical object to describe$mathbb{N}$-polyregular functions, together with a powerful newcharacterization of this class.
形式语言理论中的一个基本构造是词的 Myhill-Nerodecongruence ,它的有限性是规则语言的特征。科尔康贝特(Colcombet)、杜埃诺-塔博特(Dou'eneau-Tabot)和洛佩兹(Lopez)将这一构造推广到从 $Sigma^*$ 到 $mathbb{Z}$ 的函数上,以表征所谓的 $mathbb{Z}$ 多正则函数类。在本文中,我们把等价关系的概念放宽到准排序,以研究$mathbb{N}$ 多正则函数类,它在从$Sigma^*$到$mathbb{N}$的函数中扮演着$mathbb{Z}$ 多正则函数的角色。具有有限索引的类似物就是awell-quasi-ordering。这就为描述$mathbb{N}$ 多正则函数提供了一个典型对象,同时也为这一类函数提供了一个强大的新特征。
{"title":"$mathbb{N}$-polyregular functions arise from well-quasi-orderings","authors":"Aliaume Lopez","doi":"arxiv-2409.07882","DOIUrl":"https://doi.org/arxiv-2409.07882","url":null,"abstract":"A fundamental construction in formal language theory is the Myhill-Nerode\u0000congruence on words, whose finitedness characterizes regular language. This\u0000construction was generalized to functions from $Sigma^*$ to $mathbb{Z}$ by\u0000Colcombet, Dou'eneau-Tabot, and Lopez to characterize the class of so-called\u0000$mathbb{Z}$-polyregular functions. In this paper, we relax the notion of\u0000equivalence relation to quasi-ordering in order to study the class of\u0000$mathbb{N}$-polyregular functions, that plays the role of\u0000$mathbb{Z}$-polyregular functions among functions from $Sigma^*$ to\u0000$mathbb{N}$. The analogue of having a finite index is then being a\u0000well-quasi-ordering. This provides a canonical object to describe\u0000$mathbb{N}$-polyregular functions, together with a powerful new\u0000characterization of this class.","PeriodicalId":501124,"journal":{"name":"arXiv - CS - Formal Languages and Automata Theory","volume":"41 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-09-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142197180","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Alternating hierarchy of sushifts defined by nondeterministic plane-walking automata 由非确定性平面行走自动机定义的交替分层苏轼
Pub Date : 2024-09-12 DOI: arxiv-2409.08024
Benjamin Hellouin de Menibus, Pacôme Perrotin
Plane-walking automata were introduced by Salo & T"orma to recogniselanguages of two-dimensional infinite words (subshifts), the counterpart of$4$-way finite automata for two-dimensional finite words. We extend the modelto allow for nondeterminism and alternation of quantifiers. We prove that therecognised subshifts form a strict subclass of sofic subshifts, and that theclasses corresponding to existential and universal nondeterminism areincomparable and both larger that the deterministic class. We define ahierarchy of subshifts recognised by plane-walking automata with alternatingquantifiers, which we conjecture to be strict.
平面行走自动机由萨洛和特尔马提出,用于识别二维无限词(子移位)语言,与二维有限词的$4$路有限自动机相对应。我们扩展了这一模型,以允许非确定性和量词交替。我们证明,这些被认可的子转移构成了索非克子转移的严格子类,而且与存在非确定性和普遍非确定性相对应的类是可比的,并且都大于确定性类。我们定义了具有交替量词的平面行走自动机所识别的子转移的等级体系,我们猜想它是严格的。
{"title":"Alternating hierarchy of sushifts defined by nondeterministic plane-walking automata","authors":"Benjamin Hellouin de Menibus, Pacôme Perrotin","doi":"arxiv-2409.08024","DOIUrl":"https://doi.org/arxiv-2409.08024","url":null,"abstract":"Plane-walking automata were introduced by Salo & T\"orma to recognise\u0000languages of two-dimensional infinite words (subshifts), the counterpart of\u0000$4$-way finite automata for two-dimensional finite words. We extend the model\u0000to allow for nondeterminism and alternation of quantifiers. We prove that the\u0000recognised subshifts form a strict subclass of sofic subshifts, and that the\u0000classes corresponding to existential and universal nondeterminism are\u0000incomparable and both larger that the deterministic class. We define a\u0000hierarchy of subshifts recognised by plane-walking automata with alternating\u0000quantifiers, which we conjecture to be strict.","PeriodicalId":501124,"journal":{"name":"arXiv - CS - Formal Languages and Automata Theory","volume":"93 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-09-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142197179","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Winning Strategies for the Synchronization Game on Subclasses of Finite Automata 有限自动机子类上同步博弈的制胜策略
Pub Date : 2024-09-11 DOI: arxiv-2409.06971
Henning FernauUniversität Trier, Fachbereich IV, Informatikwissenschaften, Trier, Germany, Carolina HaaseUniversität Trier, Fachbereich IV, Informatikwissenschaften, Trier, Germany, Stefan HoffmannInstitute of Natural Sciences and Mathematics, Ural Federal University, Ekaterinburg, Russia, Mikhail VolkovInstitute of Natural Sciences and Mathematics, Ural Federal University, Ekaterinburg, Russia
We exhibit a winning strategy for Synchronizer in the synchronization game onevery synchronizing automaton in whose transition monoid the regular D-classesform subsemigroups
我们展示了同步器在同步博弈中的制胜策略,即在每一个同步自动机中,其过渡单元中的正则 D 类都构成子组
{"title":"Winning Strategies for the Synchronization Game on Subclasses of Finite Automata","authors":"Henning FernauUniversität Trier, Fachbereich IV, Informatikwissenschaften, Trier, Germany, Carolina HaaseUniversität Trier, Fachbereich IV, Informatikwissenschaften, Trier, Germany, Stefan HoffmannInstitute of Natural Sciences and Mathematics, Ural Federal University, Ekaterinburg, Russia, Mikhail VolkovInstitute of Natural Sciences and Mathematics, Ural Federal University, Ekaterinburg, Russia","doi":"arxiv-2409.06971","DOIUrl":"https://doi.org/arxiv-2409.06971","url":null,"abstract":"We exhibit a winning strategy for Synchronizer in the synchronization game on\u0000every synchronizing automaton in whose transition monoid the regular D-classes\u0000form subsemigroups","PeriodicalId":501124,"journal":{"name":"arXiv - CS - Formal Languages and Automata Theory","volume":"1 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-09-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142197187","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Determinism in Multi-Soliton Automata 多孑子自动机中的决定论
Pub Date : 2024-09-11 DOI: arxiv-2409.06969
Henning BordihnUniversity of Potsdam, Institute of Computer Science, Helena Schulz
Soliton automata are mathematical models of soliton switching in chemicalmolecules. Several concepts of determinism for soliton automata have beendefined. The concept of strong determinism has been investigated for the casein which only a single soliton can be present in a molecule. In the presentpaper, several different concepts of determinism are explored for themulti-soliton case. It is shown that the degree of non-determinism is aconnected measure of descriptional complexity for multi-soliton automata. Acharacterization of the class of strongly deterministic multi-soliton automatais presented. Finally, the concept of perfect determinism, forming a naturalextension of strong determinism, is introduced and considered for multi-solitonautomata.
孤子自动机是化学分子中孤子开关的数学模型。人们已经定义了孤子自动机的几种确定性概念。在分子中只能存在一个孤子的情况下,研究了强确定性概念。本文针对多孤子情况探讨了几种不同的确定性概念。结果表明,非确定性程度是多孤子自动机描述复杂性的一个相关度量。此外,还介绍了强确定性多孑子自动机的特征。最后,引入了完全确定性的概念,它是强确定性的自然延伸,并对多孑子自动机进行了研究。
{"title":"Determinism in Multi-Soliton Automata","authors":"Henning BordihnUniversity of Potsdam, Institute of Computer Science, Helena Schulz","doi":"arxiv-2409.06969","DOIUrl":"https://doi.org/arxiv-2409.06969","url":null,"abstract":"Soliton automata are mathematical models of soliton switching in chemical\u0000molecules. Several concepts of determinism for soliton automata have been\u0000defined. The concept of strong determinism has been investigated for the case\u0000in which only a single soliton can be present in a molecule. In the present\u0000paper, several different concepts of determinism are explored for the\u0000multi-soliton case. It is shown that the degree of non-determinism is a\u0000connected measure of descriptional complexity for multi-soliton automata. A\u0000characterization of the class of strongly deterministic multi-soliton automata\u0000is presented. Finally, the concept of perfect determinism, forming a natural\u0000extension of strong determinism, is introduced and considered for multi-soliton\u0000automata.","PeriodicalId":501124,"journal":{"name":"arXiv - CS - Formal Languages and Automata Theory","volume":"14 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-09-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142197189","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Large Language Models and the Extended Church-Turing Thesis 大型语言模型和扩展的丘奇-图灵理论
Pub Date : 2024-09-11 DOI: arxiv-2409.06978
Jiří Wiedermann, Jan van Leeuwen
The Extended Church-Turing Thesis (ECTT) posits that all effectiveinformation processing, including unbounded and non-uniform interactivecomputations, can be described in terms of interactive Turing machines withadvice. Does this assertion also apply to the abilities of contemporary largelanguage models (LLMs)? From a broader perspective, this question calls for aninvestigation of the computational power of LLMs by the classical means ofcomputability and computational complexity theory, especially the theory ofautomata. Along these lines, we establish a number of fundamental results.Firstly, we argue that any fixed (non-adaptive) LLM is computationallyequivalent to a, possibly very large, deterministic finite-state transducer.This characterizes the base level of LLMs. We extend this to a key resultconcerning the simulation of space-bounded Turing machines by LLMs. Secondly,we show that lineages of evolving LLMs are computationally equivalent tointeractive Turing machines with advice. The latter finding confirms thevalidity of the ECTT for lineages of LLMs. From a computability viewpoint, italso suggests that lineages of LLMs possess super-Turing computational power.Consequently, in our computational model knowledge generation is in general anon-algorithmic process realized by lineages of LLMs. Finally, we discuss themerits of our findings in the broader context of several related disciplinesand philosophies.
扩展丘奇-图灵论(ECTT)认为,所有有效的信息处理,包括无边界和非统一的交互式计算,都可以用带建议的交互式图灵机来描述。这一论断是否也适用于当代大型语言模型(LLM)的能力?从更广阔的视角来看,这个问题要求我们用可计算性和计算复杂性理论的经典方法,特别是同构理论,来研究 LLMs 的计算能力。首先,我们认为任何固定的(非自适应的)LLM在计算上等同于一个可能非常大的确定性有限状态变换器。我们将其扩展到一个关键结果,即用 LLM 模拟空间边界图灵机。其次,我们证明了不断演化的 LLM 在计算上等同于带建议的交互式图灵机。后一个发现证实了ECTT对LLMs行列的有效性。因此,在我们的计算模型中,知识生成一般是由LLMs的线粒体实现的非算法过程。最后,我们将在几个相关学科和哲学的更广阔背景下讨论我们研究发现的优点。
{"title":"Large Language Models and the Extended Church-Turing Thesis","authors":"Jiří Wiedermann, Jan van Leeuwen","doi":"arxiv-2409.06978","DOIUrl":"https://doi.org/arxiv-2409.06978","url":null,"abstract":"The Extended Church-Turing Thesis (ECTT) posits that all effective\u0000information processing, including unbounded and non-uniform interactive\u0000computations, can be described in terms of interactive Turing machines with\u0000advice. Does this assertion also apply to the abilities of contemporary large\u0000language models (LLMs)? From a broader perspective, this question calls for an\u0000investigation of the computational power of LLMs by the classical means of\u0000computability and computational complexity theory, especially the theory of\u0000automata. Along these lines, we establish a number of fundamental results.\u0000Firstly, we argue that any fixed (non-adaptive) LLM is computationally\u0000equivalent to a, possibly very large, deterministic finite-state transducer.\u0000This characterizes the base level of LLMs. We extend this to a key result\u0000concerning the simulation of space-bounded Turing machines by LLMs. Secondly,\u0000we show that lineages of evolving LLMs are computationally equivalent to\u0000interactive Turing machines with advice. The latter finding confirms the\u0000validity of the ECTT for lineages of LLMs. From a computability viewpoint, it\u0000also suggests that lineages of LLMs possess super-Turing computational power.\u0000Consequently, in our computational model knowledge generation is in general a\u0000non-algorithmic process realized by lineages of LLMs. Finally, we discuss the\u0000merits of our findings in the broader context of several related disciplines\u0000and philosophies.","PeriodicalId":501124,"journal":{"name":"arXiv - CS - Formal Languages and Automata Theory","volume":"14 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-09-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142197181","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
How to Demonstrate Metalinearness and Regularity by Tree-Restricted General Grammars 如何通过树状限制的通用语法证明金属线性和规则性
Pub Date : 2024-09-11 DOI: arxiv-2409.06972
Martin HavelBrno University of Technology, Faculty of Information Technology, Zbyněk KřivkaBrno University of Technology, Faculty of Information Technology, Alexander MedunaBrno University of Technology, Faculty of Information Technology
This paper introduces derivation trees for general grammars. Within thesetrees, it defines context-dependent pairs of nodes, corresponding to rewritingtwo neighboring symbols using a non context-free rule. It proves that thelanguage generated by a linear core general grammar with a slow-branchingderivation tree is k-linear if there is a constant u such that every sentence win the generated language is the frontier of a derivation tree in which anypair of neighboring paths contains u or fewer context-dependent pairs of nodes.Next, it proves that the language generated by a general grammar with a regularcore is regular if there is a constant u such that every sentence w in thegenerated language is the frontier of a derivation tree in which any pair ofneighboring paths contains u or fewer context-dependent pairs of nodes. Thepaper explains that this result is a powerful tool for showing that certainlanguages are k-linear or regular.
本文介绍了一般语法的推导树。在推导树中,它定义了与上下文相关的节点对,对应于使用非无上下文规则重写两个相邻符号。如果存在一个常数 u,使得生成语言中的每个句子都是派生树的前沿,在派生树中,任何一对相邻路径都包含 u 或更少的上下文相关节点对,那么它就证明了具有慢分支派生树的线性核心通用语法生成的语言是 k 线性的。接下来,论文证明,如果存在一个常数 u,使得生成语言中的每个句子 w 都是一棵派生树的前沿,在这棵派生树中,任何一对相邻路径都包含 u 或更少的上下文相关节点对,那么由具有正则核的一般语法生成的语言就是正则语言。论文解释说,这一结果是证明某些语言是 k 线性或正则性语言的有力工具。
{"title":"How to Demonstrate Metalinearness and Regularity by Tree-Restricted General Grammars","authors":"Martin HavelBrno University of Technology, Faculty of Information Technology, Zbyněk KřivkaBrno University of Technology, Faculty of Information Technology, Alexander MedunaBrno University of Technology, Faculty of Information Technology","doi":"arxiv-2409.06972","DOIUrl":"https://doi.org/arxiv-2409.06972","url":null,"abstract":"This paper introduces derivation trees for general grammars. Within these\u0000trees, it defines context-dependent pairs of nodes, corresponding to rewriting\u0000two neighboring symbols using a non context-free rule. It proves that the\u0000language generated by a linear core general grammar with a slow-branching\u0000derivation tree is k-linear if there is a constant u such that every sentence w\u0000in the generated language is the frontier of a derivation tree in which any\u0000pair of neighboring paths contains u or fewer context-dependent pairs of nodes.\u0000Next, it proves that the language generated by a general grammar with a regular\u0000core is regular if there is a constant u such that every sentence w in the\u0000generated language is the frontier of a derivation tree in which any pair of\u0000neighboring paths contains u or fewer context-dependent pairs of nodes. The\u0000paper explains that this result is a powerful tool for showing that certain\u0000languages are k-linear or regular.","PeriodicalId":501124,"journal":{"name":"arXiv - CS - Formal Languages and Automata Theory","volume":"s1-8 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-09-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142197186","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Various Types of Comet Languages and their Application in External Contextual Grammars 各种类型的彗星语言及其在外部语境语法中的应用
Pub Date : 2024-09-11 DOI: arxiv-2409.06974
Marvin Ködding, Bianca Truthe
In this paper, we continue the research on the power of contextual grammarswith selection languages from subfamilies of the family of regular languages.We investigate various comet-like types of languages and compare such languagefamilies to some other subregular families of languages (finite, monoidal,nilpotent, combinational, (symmetric) definite, ordered, non-counting,power-separating, suffix-closed, commutative, circular, or union-freelanguages). Further, we compare the language families defined by these typesfor the selection with each other and with the families of the hierarchyobtained for external contextual grammars. In this way, we extend the existinghierarchy by new language families.
我们研究了各种彗星类型的语言,并将这些语系与其他一些亚规则语系(有限语系、一元语系、无幂语系、组合语系、(对称)定语系、有序语系、非计数语系、幂分语系、后缀封闭语系、交换语系、循环语系或无联合语系)进行了比较。此外,我们还将这些类型定义的语言族与外部上下文语法的层级族进行了比较。通过这种方式,我们用新的语系扩展了现有的层次结构。
{"title":"Various Types of Comet Languages and their Application in External Contextual Grammars","authors":"Marvin Ködding, Bianca Truthe","doi":"arxiv-2409.06974","DOIUrl":"https://doi.org/arxiv-2409.06974","url":null,"abstract":"In this paper, we continue the research on the power of contextual grammars\u0000with selection languages from subfamilies of the family of regular languages.\u0000We investigate various comet-like types of languages and compare such language\u0000families to some other subregular families of languages (finite, monoidal,\u0000nilpotent, combinational, (symmetric) definite, ordered, non-counting,\u0000power-separating, suffix-closed, commutative, circular, or union-free\u0000languages). Further, we compare the language families defined by these types\u0000for the selection with each other and with the families of the hierarchy\u0000obtained for external contextual grammars. In this way, we extend the existing\u0000hierarchy by new language families.","PeriodicalId":501124,"journal":{"name":"arXiv - CS - Formal Languages and Automata Theory","volume":"93 3 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-09-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142197184","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
arXiv - CS - Formal Languages and Automata Theory
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1