首页 > 最新文献

arXiv - PHYS - Disordered Systems and Neural Networks最新文献

英文 中文
Quantum Hopfield Model with Dilute Memories 具有稀释记忆的量子霍普菲尔德模型
Pub Date : 2024-05-21 DOI: arxiv-2405.13240
Rongfeng Xie, Alex Kamenev
We discuss adiabatic spectra and dynamics of the quantum, i.e. transversefield, Hopfield model with dilute memories (the number of stored patterns $p <log_2 N$, where $N$ is the number of qubits). At some critical transverse fieldthe model undergoes the quantum phase transition from the ordered to theparamagnetic state. The corresponding critical exponents are calculated andused to determine efficiency of quantum annealing protocols. We also discussimplications of these results for the quantum annealing of generic spin glassmodels.
我们讨论了具有稀释记忆(存储模式的数量 $p
{"title":"Quantum Hopfield Model with Dilute Memories","authors":"Rongfeng Xie, Alex Kamenev","doi":"arxiv-2405.13240","DOIUrl":"https://doi.org/arxiv-2405.13240","url":null,"abstract":"We discuss adiabatic spectra and dynamics of the quantum, i.e. transverse\u0000field, Hopfield model with dilute memories (the number of stored patterns $p <\u0000log_2 N$, where $N$ is the number of qubits). At some critical transverse field\u0000the model undergoes the quantum phase transition from the ordered to the\u0000paramagnetic state. The corresponding critical exponents are calculated and\u0000used to determine efficiency of quantum annealing protocols. We also discuss\u0000implications of these results for the quantum annealing of generic spin glass\u0000models.","PeriodicalId":501066,"journal":{"name":"arXiv - PHYS - Disordered Systems and Neural Networks","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2024-05-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141150746","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Critical feature learning in deep neural networks 深度神经网络中的关键特征学习
Pub Date : 2024-05-17 DOI: arxiv-2405.10761
Kirsten Fischer, Javed Lindner, David Dahmen, Zohar Ringel, Michael Krämer, Moritz Helias
A key property of neural networks driving their success is their ability tolearn features from data. Understanding feature learning from a theoreticalviewpoint is an emerging field with many open questions. In this work wecapture finite-width effects with a systematic theory of network kernels indeep non-linear neural networks. We show that the Bayesian prior of the networkcan be written in closed form as a superposition of Gaussian processes, whosekernels are distributed with a variance that depends inversely on the networkwidth N . A large deviation approach, which is exact in the proportional limitfor the number of data points $P = alpha N rightarrow infty$, yields a pairof forward-backward equations for the maximum a posteriori kernels in alllayers at once. We study their solutions perturbatively to demonstrate how thebackward propagation across layers aligns kernels with the target. Analternative field-theoretic formulation shows that kernel adaptation of theBayesian posterior at finite-width results from fluctuations in the prior:larger fluctuations correspond to a more flexible network prior and thus enablestronger adaptation to data. We thus find a bridge between the classicaledge-of-chaos NNGP theory and feature learning, exposing an intricate interplaybetween criticality, response functions, and feature scale.
神经网络取得成功的一个关键特性是其从数据中学习特征的能力。从理论角度理解特征学习是一个新兴领域,存在许多未决问题。在这项工作中,我们利用深入非线性神经网络的网络核的系统理论来捕捉有限宽度效应。我们证明,网络的贝叶斯先验可以以封闭形式写成高斯过程的叠加,其内核分布的方差与网络宽度 N 成反比。大偏差方法在数据点数量 $P = alpha N rightarrow infty$ 的比例极限下是精确的,它可以一次性得到所有层中最大后验核的前向后向方程。我们对它们的解进行了扰动研究,以证明跨层的后向传播如何使核与目标保持一致。替代的场论表述表明,贝叶斯后验在有限宽度下的内核适应性来自于先验的波动:较大的波动对应于更灵活的网络先验,从而能够更强地适应数据。因此,我们在经典的边缘混沌 NNGP 理论和特征学习之间找到了一座桥梁,揭示了临界性、响应函数和特征尺度之间错综复杂的相互作用。
{"title":"Critical feature learning in deep neural networks","authors":"Kirsten Fischer, Javed Lindner, David Dahmen, Zohar Ringel, Michael Krämer, Moritz Helias","doi":"arxiv-2405.10761","DOIUrl":"https://doi.org/arxiv-2405.10761","url":null,"abstract":"A key property of neural networks driving their success is their ability to\u0000learn features from data. Understanding feature learning from a theoretical\u0000viewpoint is an emerging field with many open questions. In this work we\u0000capture finite-width effects with a systematic theory of network kernels in\u0000deep non-linear neural networks. We show that the Bayesian prior of the network\u0000can be written in closed form as a superposition of Gaussian processes, whose\u0000kernels are distributed with a variance that depends inversely on the network\u0000width N . A large deviation approach, which is exact in the proportional limit\u0000for the number of data points $P = alpha N rightarrow infty$, yields a pair\u0000of forward-backward equations for the maximum a posteriori kernels in all\u0000layers at once. We study their solutions perturbatively to demonstrate how the\u0000backward propagation across layers aligns kernels with the target. An\u0000alternative field-theoretic formulation shows that kernel adaptation of the\u0000Bayesian posterior at finite-width results from fluctuations in the prior:\u0000larger fluctuations correspond to a more flexible network prior and thus enable\u0000stronger adaptation to data. We thus find a bridge between the classical\u0000edge-of-chaos NNGP theory and feature learning, exposing an intricate interplay\u0000between criticality, response functions, and feature scale.","PeriodicalId":501066,"journal":{"name":"arXiv - PHYS - Disordered Systems and Neural Networks","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2024-05-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141150703","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Generative modeling through internal high-dimensional chaotic activity 通过内部高维混沌活动生成模型
Pub Date : 2024-05-17 DOI: arxiv-2405.10822
Samantha J. Fournier, Pierfrancesco Urbani
Generative modeling aims at producing new datapoints whose statisticalproperties resemble the ones in a training dataset. In recent years, there hasbeen a burst of machine learning techniques and settings that can achieve thisgoal with remarkable performances. In most of these settings, one uses thetraining dataset in conjunction with noise, which is added as a source ofstatistical variability and is essential for the generative task. Here, weexplore the idea of using internal chaotic dynamics in high-dimensional chaoticsystems as a way to generate new datapoints from a training dataset. We showthat simple learning rules can achieve this goal within a set of vanillaarchitectures and characterize the quality of the generated datapoints throughstandard accuracy measures.
生成模型旨在生成统计属性与训练数据集相似的新数据点。近年来,机器学习技术和设置层出不穷,这些技术和设置都能以出色的性能实现这一目标。在大多数情况下,人们会将训练数据集与噪声结合起来使用,而噪声是作为统计变异性的来源添加的,对于生成任务至关重要。在这里,我们探讨了在高维混沌系统中使用内部混沌动力学作为从训练数据集生成新数据点的方法。我们展示了简单的学习规则就能在一套虚构架构中实现这一目标,并通过标准的准确度测量来表征生成数据点的质量。
{"title":"Generative modeling through internal high-dimensional chaotic activity","authors":"Samantha J. Fournier, Pierfrancesco Urbani","doi":"arxiv-2405.10822","DOIUrl":"https://doi.org/arxiv-2405.10822","url":null,"abstract":"Generative modeling aims at producing new datapoints whose statistical\u0000properties resemble the ones in a training dataset. In recent years, there has\u0000been a burst of machine learning techniques and settings that can achieve this\u0000goal with remarkable performances. In most of these settings, one uses the\u0000training dataset in conjunction with noise, which is added as a source of\u0000statistical variability and is essential for the generative task. Here, we\u0000explore the idea of using internal chaotic dynamics in high-dimensional chaotic\u0000systems as a way to generate new datapoints from a training dataset. We show\u0000that simple learning rules can achieve this goal within a set of vanilla\u0000architectures and characterize the quality of the generated datapoints through\u0000standard accuracy measures.","PeriodicalId":501066,"journal":{"name":"arXiv - PHYS - Disordered Systems and Neural Networks","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2024-05-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141150750","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Restoring balance: principled under/oversampling of data for optimal classification 恢复平衡:原则性数据取样不足/取样过多,实现最佳分类
Pub Date : 2024-05-15 DOI: arxiv-2405.09535
Emanuele Loffredo, Mauro Pastore, Simona Cocco, Rémi Monasson
Class imbalance in real-world data poses a common bottleneck for machinelearning tasks, since achieving good generalization on under-representedexamples is often challenging. Mitigation strategies, such as under oroversampling the data depending on their abundances, are routinely proposed andtested empirically, but how they should adapt to the data statistics remainspoorly understood. In this work, we determine exact analytical expressions ofthe generalization curves in the high-dimensional regime for linear classifiers(Support Vector Machines). We also provide a sharp prediction of the effects ofunder/oversampling strategies depending on class imbalance, first and secondmoments of the data, and the metrics of performance considered. We show thatmixed strategies involving under and oversampling of data lead to performanceimprovement. Through numerical experiments, we show the relevance of ourtheoretical predictions on real datasets, on deeper architectures and withsampling strategies based on unsupervised probabilistic models.
现实世界数据中的类不平衡是机器学习任务的一个常见瓶颈,因为在代表性不足的样本上实现良好的泛化往往具有挑战性。缓解策略,如根据数据的丰度对数据进行低采样或高采样,已被例行提出并进行了实证测试,但人们对这些策略应如何适应数据统计仍知之甚少。在这项工作中,我们确定了线性分类器(支持向量机)的高维泛化曲线的精确分析表达式。我们还根据类的不平衡性、数据的第一和第二矩以及所考虑的性能指标,对欠采样/过采样策略的效果进行了精确预测。我们表明,涉及数据低采样和高采样的混合策略会提高性能。通过数值实验,我们证明了我们的理论预测在真实数据集、更深入的架构和基于无监督概率模型的采样策略上的相关性。
{"title":"Restoring balance: principled under/oversampling of data for optimal classification","authors":"Emanuele Loffredo, Mauro Pastore, Simona Cocco, Rémi Monasson","doi":"arxiv-2405.09535","DOIUrl":"https://doi.org/arxiv-2405.09535","url":null,"abstract":"Class imbalance in real-world data poses a common bottleneck for machine\u0000learning tasks, since achieving good generalization on under-represented\u0000examples is often challenging. Mitigation strategies, such as under or\u0000oversampling the data depending on their abundances, are routinely proposed and\u0000tested empirically, but how they should adapt to the data statistics remains\u0000poorly understood. In this work, we determine exact analytical expressions of\u0000the generalization curves in the high-dimensional regime for linear classifiers\u0000(Support Vector Machines). We also provide a sharp prediction of the effects of\u0000under/oversampling strategies depending on class imbalance, first and second\u0000moments of the data, and the metrics of performance considered. We show that\u0000mixed strategies involving under and oversampling of data lead to performance\u0000improvement. Through numerical experiments, we show the relevance of our\u0000theoretical predictions on real datasets, on deeper architectures and with\u0000sampling strategies based on unsupervised probabilistic models.","PeriodicalId":501066,"journal":{"name":"arXiv - PHYS - Disordered Systems and Neural Networks","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2024-05-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141063578","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Daydreaming Hopfield Networks and their surprising effectiveness on correlated data 白日梦 Hopfield 网络及其对相关数据的惊人功效
Pub Date : 2024-05-14 DOI: arxiv-2405.08777
Ludovica Serricchio, Dario Bocchi, Claudio Chilin, Raffaele Marino, Matteo Negri, Chiara Cammarota, Federico Ricci-Tersenghi
To improve the storage capacity of the Hopfield model, we develop a versionof the dreaming algorithm that perpetually reinforces the patterns to be stored(as in the Hebb rule), and erases the spurious memories (as in dreamingalgorithms). For this reason, we called it Daydreaming. Daydreaming is notdestructive and it converges asymptotically to stationary retrieval maps. Whentrained on random uncorrelated examples, the model shows optimal performance interms of the size of the basins of attraction of stored examples and thequality of reconstruction. We also train the Daydreaming algorithm oncorrelated data obtained via the random-features model and argue that itspontaneously exploits the correlations thus increasing even further thestorage capacity and the size of the basins of attraction. Moreover, theDaydreaming algorithm is also able to stabilize the features hidden in thedata. Finally, we test Daydreaming on the MNIST dataset and show that it stillworks surprisingly well, producing attractors that are close to unseen examplesand class prototypes.
为了提高霍普菲尔德模型的存储容量,我们开发了一个版本的做梦算法,它可以永久强化要存储的模式(如赫伯规则),并清除虚假记忆(如做梦算法)。因此,我们称之为 "白日梦"。白日梦算法不具有破坏性,而且它可以渐近收敛到静态检索图。在对随机无相关示例进行训练时,该模型在存储示例的吸引力盆地大小和重构质量方面都表现出最佳性能。我们还在通过随机特征模型获得的相关数据上对白日梦算法进行了训练,结果表明它能自发地利用相关性,从而进一步提高了存储容量和吸引盆地的大小。此外,白日梦算法还能稳定隐藏在数据中的特征。最后,我们在 MNIST 数据集上测试了 "白日梦 "算法,结果表明它的效果仍然出人意料地好,产生的吸引子接近于未见过的示例和类原型。
{"title":"Daydreaming Hopfield Networks and their surprising effectiveness on correlated data","authors":"Ludovica Serricchio, Dario Bocchi, Claudio Chilin, Raffaele Marino, Matteo Negri, Chiara Cammarota, Federico Ricci-Tersenghi","doi":"arxiv-2405.08777","DOIUrl":"https://doi.org/arxiv-2405.08777","url":null,"abstract":"To improve the storage capacity of the Hopfield model, we develop a version\u0000of the dreaming algorithm that perpetually reinforces the patterns to be stored\u0000(as in the Hebb rule), and erases the spurious memories (as in dreaming\u0000algorithms). For this reason, we called it Daydreaming. Daydreaming is not\u0000destructive and it converges asymptotically to stationary retrieval maps. When\u0000trained on random uncorrelated examples, the model shows optimal performance in\u0000terms of the size of the basins of attraction of stored examples and the\u0000quality of reconstruction. We also train the Daydreaming algorithm on\u0000correlated data obtained via the random-features model and argue that it\u0000spontaneously exploits the correlations thus increasing even further the\u0000storage capacity and the size of the basins of attraction. Moreover, the\u0000Daydreaming algorithm is also able to stabilize the features hidden in the\u0000data. Finally, we test Daydreaming on the MNIST dataset and show that it still\u0000works surprisingly well, producing attractors that are close to unseen examples\u0000and class prototypes.","PeriodicalId":501066,"journal":{"name":"arXiv - PHYS - Disordered Systems and Neural Networks","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2024-05-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140941023","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Describing the critical behavior of the Anderson transition in infinite dimension by random-matrix ensembles: logarithmic multifractality and critical localization 用随机矩阵集合描述无限维安德森转变的临界行为:对数多分形和临界定位
Pub Date : 2024-05-12 DOI: arxiv-2405.10975
Weitao Chen, Olivier Giraud, Jiangbin Gong, Gabriel Lemarié
Due to their analytical tractability, random matrix ensembles serve as robustplatforms for exploring exotic phenomena in systems that are computationallydemanding. Building on a companion letter [arXiv:2312.17481], this paperinvestigates two random matrix ensembles tailored to capture the criticalbehavior of the Anderson transition in infinite dimension, employing bothanalytical techniques and extensive numerical simulations. Our study unveilstwo types of critical behaviors: logarithmic multifractality and criticallocalization. In contrast to conventional multifractality, the novellogarithmic multifractality features eigenstate moments scaling algebraicallywith the logarithm of the system size. Critical localization, characterized byeigenstate moments of order $q>1/2$ converging to a finite value indicatinglocalization, exhibits characteristic logarithmic finite-size or time effects,consistent with the critical behavior observed in random regular andErd"os-R'enyi graphs of effective infinite dimensionality. Using perturbativemethods, we establish the existence of logarithmic multifractality and criticallocalization in our models. Furthermore, we explore the emergence of novelscaling behaviors in the time dynamics and spatial correlation functions. Ourmodels provide a valuable framework for studying infinite-dimensional quantumdisordered systems, and the universality of our findings enables broadapplicability to systems with pronounced finite-size effects and slow dynamics,including the contentious many-body localization transition, akin to theAnderson transition in infinite dimension.
随机矩阵集合因其分析上的可操作性,成为探索计算要求高的系统中奇异现象的强大平台。本论文在一封附信[arXiv:2312.17481]的基础上,采用分析技术和大量数值模拟,研究了两种为捕捉无限维安德森转换临界行为而定制的随机矩阵集合。我们的研究揭示了两类临界行为:对数多重分形和批判局部化。与传统的多分形不同,新对数多分形的特征是特征态矩与系统大小的对数呈代数缩放关系。临界局部化的特征是特征状态矩的阶数$q>1/2$收敛到一个有限值,表明局部化,表现出特征对数有限大小或时间效应,这与在有效无限维度的随机正则图和Erd"os-R'enyi 图中观察到的临界行为一致。利用微扰方法,我们在模型中建立了对数多分形和批判局部化的存在。此外,我们还探索了时间动力学和空间相关函数中出现的新颖尺度行为。我们的模型为研究无限维量子无序系统提供了一个有价值的框架,我们发现的普遍性使其广泛适用于具有明显有限尺寸效应和缓慢动力学的系统,包括有争议的多体局域化转变,类似于无限维的安德森转变。
{"title":"Describing the critical behavior of the Anderson transition in infinite dimension by random-matrix ensembles: logarithmic multifractality and critical localization","authors":"Weitao Chen, Olivier Giraud, Jiangbin Gong, Gabriel Lemarié","doi":"arxiv-2405.10975","DOIUrl":"https://doi.org/arxiv-2405.10975","url":null,"abstract":"Due to their analytical tractability, random matrix ensembles serve as robust\u0000platforms for exploring exotic phenomena in systems that are computationally\u0000demanding. Building on a companion letter [arXiv:2312.17481], this paper\u0000investigates two random matrix ensembles tailored to capture the critical\u0000behavior of the Anderson transition in infinite dimension, employing both\u0000analytical techniques and extensive numerical simulations. Our study unveils\u0000two types of critical behaviors: logarithmic multifractality and critical\u0000localization. In contrast to conventional multifractality, the novel\u0000logarithmic multifractality features eigenstate moments scaling algebraically\u0000with the logarithm of the system size. Critical localization, characterized by\u0000eigenstate moments of order $q>1/2$ converging to a finite value indicating\u0000localization, exhibits characteristic logarithmic finite-size or time effects,\u0000consistent with the critical behavior observed in random regular and\u0000Erd\"os-R'enyi graphs of effective infinite dimensionality. Using perturbative\u0000methods, we establish the existence of logarithmic multifractality and critical\u0000localization in our models. Furthermore, we explore the emergence of novel\u0000scaling behaviors in the time dynamics and spatial correlation functions. Our\u0000models provide a valuable framework for studying infinite-dimensional quantum\u0000disordered systems, and the universality of our findings enables broad\u0000applicability to systems with pronounced finite-size effects and slow dynamics,\u0000including the contentious many-body localization transition, akin to the\u0000Anderson transition in infinite dimension.","PeriodicalId":501066,"journal":{"name":"arXiv - PHYS - Disordered Systems and Neural Networks","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2024-05-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141150704","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Statistical physics of complex systems: glasses, spin glasses, continuous constraint satisfaction problems, high-dimensional inference and neural networks 复杂系统的统计物理学:玻璃、自旋玻璃、连续约束满足问题、高维推理和神经网络
Pub Date : 2024-05-10 DOI: arxiv-2405.06384
Pierfrancesco Urbani
The purpose of this manuscript is to review my recent activity on three mainresearch topics. The first concerns the nature of low temperature amorphoussolids and their relation with the spin glass transition in a magnetic field.This is the subject of the first chapter where I discuss a new model, the KHGPSmodel, which allows to make some progress. In the second chapter I review asecond research line that concerns the study of the rigidity/jammingtransitions in particle system models and their relation to constraintsatisfaction and optimization problems in high dimension. Finally in the lastchapter I review my activity on the problem of the dynamics of learningalgorithms in high-dimensional inference and supervised learning problems.
本手稿旨在回顾我最近在三个主要研究课题上的活动。首先是低温无定形固体的性质及其与磁场中自旋玻璃化转变的关系。这是第一章的主题,我讨论了一个新模型,即 KHGPS 模型,该模型取得了一些进展。在第二章中,我回顾了第二条研究路线,即研究粒子系统模型中的刚性/干扰转变及其与约束满足和高维度优化问题的关系。最后一章,我回顾了自己在高维推理和监督学习问题中学习算法动力学问题上的研究活动。
{"title":"Statistical physics of complex systems: glasses, spin glasses, continuous constraint satisfaction problems, high-dimensional inference and neural networks","authors":"Pierfrancesco Urbani","doi":"arxiv-2405.06384","DOIUrl":"https://doi.org/arxiv-2405.06384","url":null,"abstract":"The purpose of this manuscript is to review my recent activity on three main\u0000research topics. The first concerns the nature of low temperature amorphous\u0000solids and their relation with the spin glass transition in a magnetic field.\u0000This is the subject of the first chapter where I discuss a new model, the KHGPS\u0000model, which allows to make some progress. In the second chapter I review a\u0000second research line that concerns the study of the rigidity/jamming\u0000transitions in particle system models and their relation to constraint\u0000satisfaction and optimization problems in high dimension. Finally in the last\u0000chapter I review my activity on the problem of the dynamics of learning\u0000algorithms in high-dimensional inference and supervised learning problems.","PeriodicalId":501066,"journal":{"name":"arXiv - PHYS - Disordered Systems and Neural Networks","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2024-05-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140941028","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Practical and Scalable Quantum Reservoir Computing 实用且可扩展的量子储层计算
Pub Date : 2024-05-08 DOI: arxiv-2405.04799
Chuanzhou Zhu, Peter J. Ehlers, Hendra I. Nurdin, Daniel Soh
Quantum Reservoir Computing leverages quantum systems to solve complexcomputational tasks with unprecedented efficiency and reduced energyconsumption. This paper presents a novel QRC framework utilizing a quantumoptical reservoir composed of two-level atoms within a single-mode opticalcavity. Employing the Jaynes-Cummings and Tavis-Cummings models, we introduce ascalable and practically measurable reservoir that outperforms traditionalclassical reservoir computing in both memory retention and nonlinear dataprocessing. We evaluate the reservoir's performance through two primary tasks:the prediction of time-series data via the Mackey-Glass task and theclassification of sine-square waveforms. Our results demonstrate significantenhancements in performance with increased numbers of atoms, supported bynon-destructive, continuous quantum measurements and polynomial regressiontechniques. This study confirms the potential of QRC to offer a scalable andefficient solution for advanced computational challenges, marking a significantstep forward in the integration of quantum physics with machine learningtechnology.
量子存储计算(Quantum Reservoir Computing)利用量子系统以前所未有的效率和更低的能耗解决复杂的计算任务。本文提出了一种新颖的 QRC 框架,利用单模光腔内由两级原子组成的量子光库。利用杰恩斯-康明斯和塔维斯-康明斯模型,我们介绍了可升级和实际可测量的贮存器,它在内存保留和非线性数据处理方面都优于传统的经典贮存器计算。我们通过两个主要任务来评估蓄水池的性能:通过 Mackey-Glass 任务预测时间序列数据和正弦波形分类。我们的结果表明,在非破坏性、连续量子测量和多项式回归技术的支持下,随着原子数量的增加,性能得到了显著提高。这项研究证实了 QRC 在为高级计算挑战提供可扩展的高效解决方案方面的潜力,标志着量子物理与机器学习技术的整合向前迈出了重要一步。
{"title":"Practical and Scalable Quantum Reservoir Computing","authors":"Chuanzhou Zhu, Peter J. Ehlers, Hendra I. Nurdin, Daniel Soh","doi":"arxiv-2405.04799","DOIUrl":"https://doi.org/arxiv-2405.04799","url":null,"abstract":"Quantum Reservoir Computing leverages quantum systems to solve complex\u0000computational tasks with unprecedented efficiency and reduced energy\u0000consumption. This paper presents a novel QRC framework utilizing a quantum\u0000optical reservoir composed of two-level atoms within a single-mode optical\u0000cavity. Employing the Jaynes-Cummings and Tavis-Cummings models, we introduce a\u0000scalable and practically measurable reservoir that outperforms traditional\u0000classical reservoir computing in both memory retention and nonlinear data\u0000processing. We evaluate the reservoir's performance through two primary tasks:\u0000the prediction of time-series data via the Mackey-Glass task and the\u0000classification of sine-square waveforms. Our results demonstrate significant\u0000enhancements in performance with increased numbers of atoms, supported by\u0000non-destructive, continuous quantum measurements and polynomial regression\u0000techniques. This study confirms the potential of QRC to offer a scalable and\u0000efficient solution for advanced computational challenges, marking a significant\u0000step forward in the integration of quantum physics with machine learning\u0000technology.","PeriodicalId":501066,"journal":{"name":"arXiv - PHYS - Disordered Systems and Neural Networks","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2024-05-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140940958","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Exact solution of Dynamical Mean-Field Theory for a linear system with annealed disorder 退火无序线性系统的动态平均场理论精确解
Pub Date : 2024-05-08 DOI: arxiv-2405.05183
Francesco Ferraro, Christian Grilletta, Amos Maritan, Samir Suweis, Sandro Azaele
We investigate a disordered multi-dimensional linear system in which theinteraction parameters vary stochastically in time with defined temporalcorrelations. We refer to this type of disorder as "annealed", in contrast toquenched disorder in which couplings are fixed in time. We extend DynamicalMean-Field Theory to accommodate annealed disorder and employ it to find theexact solution of the linear model in the limit of a large number of degrees offreedom. Our analysis yields analytical results for the non-stationaryauto-correlation, the stationary variance, the power spectral density, and thephase diagram of the model. Interestingly, some unexpected features emerge uponchanging the correlation time of the interactions. The stationary variance ofthe system and the critical variance of the disorder are generally found to bea non-monotonic function of the correlation time of the interactions. We alsofind that in some cases a re-entrant phase transition takes place when thiscorrelation time is varied.
我们研究了一个无序的多维线性系统,其中的相互作用参数随时间随机变化,并具有确定的时间相关性。我们将这种无序称为 "退火",与耦合在时间上固定不变的淬火无序形成对比。我们扩展了动态平均场理论,以适应退火无序状态,并利用该理论找到线性模型在大量自由度极限下的精确解。我们的分析得出了模型的非静态自相关、静态方差、功率谱密度和相图的分析结果。有趣的是,在改变相互作用的相关时间后,出现了一些意想不到的特征。我们发现系统的静态方差和无序的临界方差通常是相互作用相关时间的非单调函数。我们还发现,在某些情况下,当相关时间改变时,会发生重入相变。
{"title":"Exact solution of Dynamical Mean-Field Theory for a linear system with annealed disorder","authors":"Francesco Ferraro, Christian Grilletta, Amos Maritan, Samir Suweis, Sandro Azaele","doi":"arxiv-2405.05183","DOIUrl":"https://doi.org/arxiv-2405.05183","url":null,"abstract":"We investigate a disordered multi-dimensional linear system in which the\u0000interaction parameters vary stochastically in time with defined temporal\u0000correlations. We refer to this type of disorder as \"annealed\", in contrast to\u0000quenched disorder in which couplings are fixed in time. We extend Dynamical\u0000Mean-Field Theory to accommodate annealed disorder and employ it to find the\u0000exact solution of the linear model in the limit of a large number of degrees of\u0000freedom. Our analysis yields analytical results for the non-stationary\u0000auto-correlation, the stationary variance, the power spectral density, and the\u0000phase diagram of the model. Interestingly, some unexpected features emerge upon\u0000changing the correlation time of the interactions. The stationary variance of\u0000the system and the critical variance of the disorder are generally found to be\u0000a non-monotonic function of the correlation time of the interactions. We also\u0000find that in some cases a re-entrant phase transition takes place when this\u0000correlation time is varied.","PeriodicalId":501066,"journal":{"name":"arXiv - PHYS - Disordered Systems and Neural Networks","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2024-05-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140940962","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Subsystem Information Capacity in Random Circuits and Hamiltonian Dynamics 随机电路和哈密顿动力学中的子系统信息容量
Pub Date : 2024-05-08 DOI: arxiv-2405.05076
Yu-Qin Chen, Shuo Liu, Shi-Xin Zhang
In this study, we explore the information capacity of open quantum systems,focusing on the effective channels formed by the subsystem of random quantumcircuits and quantum Hamiltonian evolution. By analyzing the subsysteminformation capacity, which is closely linked to quantum coherent informationof these effective quantum channels, we uncover a diverse range of dynamicaland steady behaviors depending on the types of evolution. Therefore, thesubsystem information capacity serves as a valuable tool for studying theintrinsic nature of various dynamical phases, such as integrable, localized,thermalized, and topological systems. We also reveal the impact of differentinitial information encoding schemes on information dynamics includingone-to-one, one-to-many, and many-to-many. To support our findings, we providerepresentative examples for numerical simulations, including random quantumcircuits with or without mid-circuit measurements, random Clifford Floquetcircuits, free and interacting Aubry-Andr'e models, and Su-Schrieffer-Heegermodels. Those numerical results are further quantitatively explained using theeffective statistical model mapping and the quasiparticle picture in the casesof random circuits and non-interacting Hamiltonian dynamics, respectively.
在这项研究中,我们探讨了开放量子系统的信息容量,重点是随机量子电路子系统和量子哈密顿演化形成的有效通道。子系统信息容量与这些有效量子通道的量子相干信息密切相关,通过分析子系统信息容量,我们发现了不同演化类型下的多种动态和稳定行为。因此,子系统信息容量是研究可积分、局部化、热化和拓扑系统等各种动力学阶段内在性质的重要工具。我们还揭示了不同初始信息编码方案对信息动态的影响,包括一对一、一对多和多对多。为了支持我们的发现,我们提供了具有代表性的数值模拟实例,包括有或没有中途测量的随机量子电路、随机克利福德-弗洛奎特电路、自由和相互作用的奥布里-安德罗(Aubry-Andr'e)模型以及苏-施里弗-赫格(Su-Schrieffer-Heegermels)模型。在随机电路和非相互作用哈密顿动力学的情况下,分别使用有效统计模型映射和准粒子图进一步定量解释了这些数值结果。
{"title":"Subsystem Information Capacity in Random Circuits and Hamiltonian Dynamics","authors":"Yu-Qin Chen, Shuo Liu, Shi-Xin Zhang","doi":"arxiv-2405.05076","DOIUrl":"https://doi.org/arxiv-2405.05076","url":null,"abstract":"In this study, we explore the information capacity of open quantum systems,\u0000focusing on the effective channels formed by the subsystem of random quantum\u0000circuits and quantum Hamiltonian evolution. By analyzing the subsystem\u0000information capacity, which is closely linked to quantum coherent information\u0000of these effective quantum channels, we uncover a diverse range of dynamical\u0000and steady behaviors depending on the types of evolution. Therefore, the\u0000subsystem information capacity serves as a valuable tool for studying the\u0000intrinsic nature of various dynamical phases, such as integrable, localized,\u0000thermalized, and topological systems. We also reveal the impact of different\u0000initial information encoding schemes on information dynamics including\u0000one-to-one, one-to-many, and many-to-many. To support our findings, we provide\u0000representative examples for numerical simulations, including random quantum\u0000circuits with or without mid-circuit measurements, random Clifford Floquet\u0000circuits, free and interacting Aubry-Andr'e models, and Su-Schrieffer-Heeger\u0000models. Those numerical results are further quantitatively explained using the\u0000effective statistical model mapping and the quasiparticle picture in the cases\u0000of random circuits and non-interacting Hamiltonian dynamics, respectively.","PeriodicalId":501066,"journal":{"name":"arXiv - PHYS - Disordered Systems and Neural Networks","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2024-05-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140941031","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
arXiv - PHYS - Disordered Systems and Neural Networks
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1