首页 > 最新文献

npj Unconventional Computing最新文献

英文 中文
Hybrid quantum-classical photonic neural networks. 混合量子-经典光子神经网络。
Pub Date : 2025-01-01 Epub Date: 2025-12-01 DOI: 10.1038/s44335-025-00045-1
Tristan Austin, Simon Bilodeau, Andrew Hayman, Nir Rotenberg, Bhavin J Shastri

Neuromorphic (brain-inspired) photonics accelerates AI1 with high-speed, energy-efficient solutions for RF communication2, image processing3,4, and fast matrix multiplication5,6. However, integrated neuromorphic photonic hardware faces size constraints that limit network complexity. Recent advances in photonic quantum hardware7 and performant trainable quantum circuits8 offer a path to more scalable photonic neural networks. Here, we show that a combination of classical network layers with trainable continuous variable quantum circuits yields hybrid networks with improved trainability and accuracy. On a classification task, these hybrid networks match the performance of classical networks nearly twice their size. These performance benefits remain even when evaluated at state-of-the-art bit precisions for classical and quantum hardware. Finally, we outline available hardware and a roadmap to hybrid architectures. These hybrid quantum-classical networks demonstrate a unique route to enhance the computational capacity of integrated photonic neural networks without increasing the network size.

神经形态(大脑启发)光子学通过高速、节能的射频通信解决方案2、图像处理3,4和快速矩阵乘法5,6来加速AI1。然而,集成的神经形态光子硬件面临着限制网络复杂性的尺寸限制。光子量子硬件和高性能可训练量子电路的最新进展为更可扩展的光子神经网络提供了一条途径。在这里,我们证明了经典网络层与可训练的连续可变量子电路的结合产生了具有改进的可训练性和准确性的混合网络。在分类任务中,这些混合网络的性能可以达到经典网络的两倍。即使在经典和量子硬件的最先进的位精度下进行评估,这些性能优势仍然存在。最后,我们概述了可用的硬件和混合架构的路线图。这些混合量子-经典网络展示了一种在不增加网络规模的情况下提高集成光子神经网络计算能力的独特途径。
{"title":"Hybrid quantum-classical photonic neural networks.","authors":"Tristan Austin, Simon Bilodeau, Andrew Hayman, Nir Rotenberg, Bhavin J Shastri","doi":"10.1038/s44335-025-00045-1","DOIUrl":"10.1038/s44335-025-00045-1","url":null,"abstract":"<p><p>Neuromorphic (brain-inspired) photonics accelerates AI<sup>1</sup> with high-speed, energy-efficient solutions for RF communication<sup>2</sup>, image processing<sup>3,4</sup>, and fast matrix multiplication<sup>5,6</sup>. However, integrated neuromorphic photonic hardware faces size constraints that limit network complexity. Recent advances in photonic quantum hardware<sup>7</sup> and performant trainable quantum circuits<sup>8</sup> offer a path to more scalable photonic neural networks. Here, we show that a combination of classical network layers with trainable continuous variable quantum circuits yields hybrid networks with improved trainability and accuracy. On a classification task, these hybrid networks match the performance of classical networks nearly twice their size. These performance benefits remain even when evaluated at state-of-the-art bit precisions for classical and quantum hardware. Finally, we outline available hardware and a roadmap to hybrid architectures. These hybrid quantum-classical networks demonstrate a unique route to enhance the computational capacity of integrated photonic neural networks without increasing the network size.</p>","PeriodicalId":501715,"journal":{"name":"npj Unconventional Computing","volume":"2 1","pages":"29"},"PeriodicalIF":0.0,"publicationDate":"2025-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12669026/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145672906","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A self-training spiking superconducting neuromorphic architecture. 一个自我训练的尖峰超导神经形态结构。
Pub Date : 2025-01-01 Epub Date: 2025-03-04 DOI: 10.1038/s44335-025-00021-9
M L Schneider, E M Jué, M R Pufall, K Segall, C W Anderson

Neuromorphic computing takes biological inspiration to the device level aiming to improve computational efficiency and capabilities. One of the major issues that arises is the training of neuromorphic hardware systems. Typically training algorithms require global information and are thus inefficient to implement directly in hardware. In this paper we describe a set of reinforcement learning based, local weight update rules and their implementation in superconducting hardware. Using SPICE circuit simulations, we implement a small-scale neural network with a learning time of order one nanosecond per update. This network can be trained to learn new functions simply by changing the target output for a given set of inputs, without the need for any external adjustments to the network. Further, this architecture does not require programing explicit weight values in the network, alleviating a critical challenge with analog hardware implementations of neural networks.

神经形态计算将生物学灵感带到设备层面,旨在提高计算效率和能力。出现的主要问题之一是神经形态硬件系统的训练。通常,训练算法需要全局信息,因此直接在硬件中实现效率低下。本文描述了一套基于强化学习的局部权重更新规则及其在超导硬件中的实现。利用SPICE电路模拟,我们实现了一个小规模的神经网络,每次更新的学习时间为1纳秒。这个网络可以简单地通过改变给定输入集的目标输出来训练学习新函数,而不需要对网络进行任何外部调整。此外,该架构不需要在网络中编程显式权重值,从而减轻了神经网络模拟硬件实现的关键挑战。
{"title":"A self-training spiking superconducting neuromorphic architecture.","authors":"M L Schneider, E M Jué, M R Pufall, K Segall, C W Anderson","doi":"10.1038/s44335-025-00021-9","DOIUrl":"10.1038/s44335-025-00021-9","url":null,"abstract":"<p><p>Neuromorphic computing takes biological inspiration to the device level aiming to improve computational efficiency and capabilities. One of the major issues that arises is the training of neuromorphic hardware systems. Typically training algorithms require global information and are thus inefficient to implement directly in hardware. In this paper we describe a set of reinforcement learning based, local weight update rules and their implementation in superconducting hardware. Using SPICE circuit simulations, we implement a small-scale neural network with a learning time of order one nanosecond per update. This network can be trained to learn new functions simply by changing the target output for a given set of inputs, without the need for any external adjustments to the network. Further, this architecture does not require programing explicit weight values in the network, alleviating a critical challenge with analog hardware implementations of neural networks.</p>","PeriodicalId":501715,"journal":{"name":"npj Unconventional Computing","volume":"2 1","pages":"5"},"PeriodicalIF":0.0,"publicationDate":"2025-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11879878/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143575047","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A neuromorphic multi-scale approach for real-time heart rate and state detection. 实时心率和状态检测的神经形态多尺度方法。
Pub Date : 2025-01-01 Epub Date: 2025-04-02 DOI: 10.1038/s44335-025-00024-6
Chiara De Luca, Mirco Tincani, Giacomo Indiveri, Elisa Donati

With the advent of novel sensor and machine learning technologies, it is becoming possible to develop wearable systems that perform continuous recording and processing of biosignals for health or body state assessment. For example, modern smartwatches can already track physiological functions, including heart rate and its anomalies, with high precision. However, stringent constraints on size and energy consumption pose significant challenges for always-on operation to detect trends across multiple time scales for extended periods of time. To address these challenges, we propose an alternative solution that exploits the ultra-low power consumption features of mixed-signal neuromorphic technologies. We present a biosignal processing architecture that integrates multimodal sensory inputs and processes them using the principles of neural computation to reliably detect trends in heart rate and physiological states. We validate this architecture on a mixed-signal neuromorphic processor and demonstrate its robust operation despite the inherent variability of the analog circuits present in the system. In addition, we demonstrate how the system can process multi scale signals, namely instantaneous heart rate and its long-term states discretized into distinct zones, effectively detecting monotonic changes over extended periods that indicate pathological conditions such as agitation. This approach paves the way for a new generation of energy-efficient stand-alone wearable devices that are particularly suited for scenarios that require continuous health monitoring with minimal device maintenance.

随着新型传感器和机器学习技术的出现,开发可穿戴系统成为可能,这些系统可以连续记录和处理生物信号,以评估健康或身体状态。例如,现代智能手表已经可以高精度地跟踪包括心率及其异常在内的生理功能。然而,在尺寸和能耗方面的严格限制,给持续运行带来了重大挑战,无法在长时间内检测多个时间尺度的趋势。为了应对这些挑战,我们提出了一种替代解决方案,利用混合信号神经形态技术的超低功耗特性。我们提出了一种生物信号处理架构,它集成了多模态感官输入,并使用神经计算原理处理它们,以可靠地检测心率和生理状态的趋势。我们在一个混合信号神经形态处理器上验证了这种架构,并证明了它的鲁棒性,尽管系统中存在模拟电路的固有可变性。此外,我们还演示了该系统如何处理多尺度信号,即瞬时心率及其离散到不同区域的长期状态,有效地检测长时间内指示躁动等病理状态的单调变化。这种方法为新一代节能的独立可穿戴设备铺平了道路,特别适合需要以最少的设备维护进行持续健康监测的场景。
{"title":"A neuromorphic multi-scale approach for real-time heart rate and state detection.","authors":"Chiara De Luca, Mirco Tincani, Giacomo Indiveri, Elisa Donati","doi":"10.1038/s44335-025-00024-6","DOIUrl":"10.1038/s44335-025-00024-6","url":null,"abstract":"<p><p>With the advent of novel sensor and machine learning technologies, it is becoming possible to develop wearable systems that perform continuous recording and processing of biosignals for health or body state assessment. For example, modern smartwatches can already track physiological functions, including heart rate and its anomalies, with high precision. However, stringent constraints on size and energy consumption pose significant challenges for always-on operation to detect trends across multiple time scales for extended periods of time. To address these challenges, we propose an alternative solution that exploits the ultra-low power consumption features of mixed-signal neuromorphic technologies. We present a biosignal processing architecture that integrates multimodal sensory inputs and processes them using the principles of neural computation to reliably detect trends in heart rate and physiological states. We validate this architecture on a mixed-signal neuromorphic processor and demonstrate its robust operation despite the inherent variability of the analog circuits present in the system. In addition, we demonstrate how the system can process multi scale signals, namely instantaneous heart rate and its long-term states discretized into distinct zones, effectively detecting monotonic changes over extended periods that indicate pathological conditions such as agitation. This approach paves the way for a new generation of energy-efficient stand-alone wearable devices that are particularly suited for scenarios that require continuous health monitoring with minimal device maintenance.</p>","PeriodicalId":501715,"journal":{"name":"npj Unconventional Computing","volume":"2 1","pages":"6"},"PeriodicalIF":0.0,"publicationDate":"2025-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11964916/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143797550","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Computing with oscillators from theoretical underpinnings to applications and demonstrators 计算与振荡器从理论基础到应用和示范
Pub Date : 2024-12-04 DOI: 10.1038/s44335-024-00015-z
Aida Todri-Sanial, Corentin Delacour, Madeleine Abernot, Filip Sabo
Networks of coupled oscillators have far-reaching implications across various fields, providing insights into a plethora of dynamics. This review offers an in-depth overview of computing with oscillators covering computational capability, synchronization occurrence and mathematical formalism. We discuss numerous circuit design implementations, technology choices and applications from pattern retrieval, combinatorial optimization problems to machine learning algorithms. We also outline perspectives to broaden the applications and mathematical understanding of coupled oscillator dynamics.
耦合振荡器网络在各个领域具有深远的影响,提供了对过多动力学的见解。这篇综述提供了一个深入的概述与振荡器计算涵盖计算能力,同步发生和数学形式。我们讨论了许多电路设计实现,技术选择和应用,从模式检索,组合优化问题到机器学习算法。我们还概述了拓宽耦合振荡器动力学的应用和数学理解的观点。
{"title":"Computing with oscillators from theoretical underpinnings to applications and demonstrators","authors":"Aida Todri-Sanial,&nbsp;Corentin Delacour,&nbsp;Madeleine Abernot,&nbsp;Filip Sabo","doi":"10.1038/s44335-024-00015-z","DOIUrl":"10.1038/s44335-024-00015-z","url":null,"abstract":"Networks of coupled oscillators have far-reaching implications across various fields, providing insights into a plethora of dynamics. This review offers an in-depth overview of computing with oscillators covering computational capability, synchronization occurrence and mathematical formalism. We discuss numerous circuit design implementations, technology choices and applications from pattern retrieval, combinatorial optimization problems to machine learning algorithms. We also outline perspectives to broaden the applications and mathematical understanding of coupled oscillator dynamics.","PeriodicalId":501715,"journal":{"name":"npj Unconventional Computing","volume":" ","pages":"1-16"},"PeriodicalIF":0.0,"publicationDate":"2024-12-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.nature.com/articles/s44335-024-00015-z.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142762891","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Adiabatic leaky integrate and fire neurons with refractory period for ultra low energy neuromorphic computing 超低能神经形态计算的绝热泄漏积分和不应期放电神经元
Pub Date : 2024-12-04 DOI: 10.1038/s44335-024-00013-1
Marco Massarotto, Stefano Saggini, Mirko Loghi, David Esseni
In recent years, the in-memory-computing in charge domain has gained significant interest as a promising solution to further enhance the energy efficiency of neuromorphic hardware. In this work, we explore the synergy between the brain-inspired computation and the adiabatic paradigm by presenting an adiabatic Leaky Integrate-and-Fire neuron in 180 nm CMOS technology, that is able to emulate the most important primitives for a valuable neuromorphic computation, such as the accumulation of the incoming input spikes, an exponential leakage of the membrane potential and a tunable refractory period. Differently from previous contributions in the literature, our design can exploit both the charging and recovery phases of the adiabatic operation to ensure a seamless and continuous computation, all the while exchanging energy with the power supply with an efficiency higher than 90% over a wide range of resonance frequencies, and even surpassing 99% for the lowest frequencies. Our simulations unveil a minimum energy per synaptic operation of 470 fJ at a 500 kHz resonance frequency, which yields a 9x energy saving with respect to a non-adiabatic operation.
近年来,内存计算控制领域作为进一步提高神经形态硬件能量效率的一种有前途的解决方案而引起了人们的极大兴趣。在这项工作中,我们探索了脑启发计算和绝热范式之间的协同作用,通过在180纳米CMOS技术中提出一个绝热的Leaky集成和发射神经元,该神经元能够模拟有价值的神经形态计算的最重要的原语,如输入尖峰的积累,膜电位的指数泄漏和可调不应期。与以往文献不同的是,我们的设计可以同时利用绝热运行的充电和恢复阶段,以确保计算的无缝和连续,同时在较宽的谐振频率范围内以高于90%的效率与电源交换能量,最低频率甚至超过99%。我们的模拟揭示了在500 kHz共振频率下每个突触操作的最小能量为470 fJ,这与非绝热操作相比节省了9倍的能量。
{"title":"Adiabatic leaky integrate and fire neurons with refractory period for ultra low energy neuromorphic computing","authors":"Marco Massarotto,&nbsp;Stefano Saggini,&nbsp;Mirko Loghi,&nbsp;David Esseni","doi":"10.1038/s44335-024-00013-1","DOIUrl":"10.1038/s44335-024-00013-1","url":null,"abstract":"In recent years, the in-memory-computing in charge domain has gained significant interest as a promising solution to further enhance the energy efficiency of neuromorphic hardware. In this work, we explore the synergy between the brain-inspired computation and the adiabatic paradigm by presenting an adiabatic Leaky Integrate-and-Fire neuron in 180 nm CMOS technology, that is able to emulate the most important primitives for a valuable neuromorphic computation, such as the accumulation of the incoming input spikes, an exponential leakage of the membrane potential and a tunable refractory period. Differently from previous contributions in the literature, our design can exploit both the charging and recovery phases of the adiabatic operation to ensure a seamless and continuous computation, all the while exchanging energy with the power supply with an efficiency higher than 90% over a wide range of resonance frequencies, and even surpassing 99% for the lowest frequencies. Our simulations unveil a minimum energy per synaptic operation of 470 fJ at a 500 kHz resonance frequency, which yields a 9x energy saving with respect to a non-adiabatic operation.","PeriodicalId":501715,"journal":{"name":"npj Unconventional Computing","volume":" ","pages":"1-11"},"PeriodicalIF":0.0,"publicationDate":"2024-12-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.nature.com/articles/s44335-024-00013-1.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142762941","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Thermodynamic linear algebra 热力学线性代数
Pub Date : 2024-11-05 DOI: 10.1038/s44335-024-00014-0
Maxwell Aifer, Kaelan Donatella, Max Hunter Gordon, Samuel Duffield, Thomas Ahle, Daniel Simpson, Gavin Crooks, Patrick J. Coles
Linear algebra is central to many algorithms in engineering, science, and machine learning; hence, accelerating it would have tremendous economic impact. Quantum computing has been proposed for this purpose, although the resource requirements are far beyond current technological capabilities. We consider an alternative physics-based computing paradigm based on classical thermodynamics, to provide a near-term approach to accelerating linear algebra. At first sight, thermodynamics and linear algebra seem to be unrelated fields. Here, we connect solving linear algebra problems to sampling from the thermodynamic equilibrium distribution of a system of coupled harmonic oscillators. We present simple thermodynamic algorithms for solving linear systems of equations, computing matrix inverses, and computing matrix determinants. Under reasonable assumptions, we rigorously establish asymptotic speedups for our algorithms, relative to digital methods, that scale linearly in matrix dimension. Our algorithms exploit thermodynamic principles like ergodicity, entropy, and equilibration, highlighting the deep connection between these two seemingly distinct fields, and opening up algebraic applications for thermodynamic computers.
线性代数是工程、科学和机器学习中许多算法的核心;因此,加速线性代数将产生巨大的经济影响。为此,有人提出了量子计算,但其资源需求远远超出了目前的技术能力。我们考虑基于经典热力学的另一种物理计算范式,为加速线性代数提供一种近期方法。乍一看,热力学和线性代数似乎是互不相关的领域。在这里,我们将解决线性代数问题与从耦合谐振子系统的热力学平衡分布中采样联系起来。我们介绍了求解线性方程组、计算矩阵倒数和计算矩阵行列式的简单热力学算法。在合理的假设条件下,我们严格地确定了我们算法相对于数字方法的渐进提速,这种提速在矩阵维度上呈线性扩展。我们的算法利用了热力学原理,如遍历性、熵和平衡,突出了这两个看似不同的领域之间的深刻联系,并为热力学计算机开辟了代数应用领域。
{"title":"Thermodynamic linear algebra","authors":"Maxwell Aifer,&nbsp;Kaelan Donatella,&nbsp;Max Hunter Gordon,&nbsp;Samuel Duffield,&nbsp;Thomas Ahle,&nbsp;Daniel Simpson,&nbsp;Gavin Crooks,&nbsp;Patrick J. Coles","doi":"10.1038/s44335-024-00014-0","DOIUrl":"10.1038/s44335-024-00014-0","url":null,"abstract":"Linear algebra is central to many algorithms in engineering, science, and machine learning; hence, accelerating it would have tremendous economic impact. Quantum computing has been proposed for this purpose, although the resource requirements are far beyond current technological capabilities. We consider an alternative physics-based computing paradigm based on classical thermodynamics, to provide a near-term approach to accelerating linear algebra. At first sight, thermodynamics and linear algebra seem to be unrelated fields. Here, we connect solving linear algebra problems to sampling from the thermodynamic equilibrium distribution of a system of coupled harmonic oscillators. We present simple thermodynamic algorithms for solving linear systems of equations, computing matrix inverses, and computing matrix determinants. Under reasonable assumptions, we rigorously establish asymptotic speedups for our algorithms, relative to digital methods, that scale linearly in matrix dimension. Our algorithms exploit thermodynamic principles like ergodicity, entropy, and equilibration, highlighting the deep connection between these two seemingly distinct fields, and opening up algebraic applications for thermodynamic computers.","PeriodicalId":501715,"journal":{"name":"npj Unconventional Computing","volume":" ","pages":"1-11"},"PeriodicalIF":0.0,"publicationDate":"2024-11-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.nature.com/articles/s44335-024-00014-0.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142579797","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Efficient generation of grids and traversal graphs in compositional spaces towards exploration and path planning 在组合空间中高效生成网格和遍历图,实现探索和路径规划
Pub Date : 2024-11-05 DOI: 10.1038/s44335-024-00012-2
Adam M. Krajewski, Allison M. Beese, Wesley F. Reinhart, Zi-Kui Liu
Diverse disciplines across science and engineering deal with problems related to compositions, which exist in non-Euclidean simplex spaces, rendering many standard tools inaccurate or inefficient. This work explores such spaces conceptually in the context of materials discovery, quantifies their computational feasibility, and implements several essential methods specific to simplex spaces through a new high-performance open-source library nimplex. Most significantly, we derive and implement an algorithm for constructing a novel n-dimensional simplex graph data structure, containing all discretized compositions and possible neighbor-to-neighbor transitions. Critically, no distance or neighborhood calculations are performed, instead leveraging pure combinatorics and order in procedurally generated simplex grids, keeping the algorithm $${mathcal{O}}(N)$$ , with minimal memory, enabling rapid construction of graphs with billions of transitions in seconds. Additionally, we demonstrate how such graph representations can be combined to homogeneously express complex path-planning problems, while facilitating efficient deployment of existing high-performance gradient descent, graph traversal, and other optimization algorithms.
科学和工程领域的多个学科都在处理与组合相关的问题,这些问题存在于非欧几里得单纯形空间中,导致许多标准工具不准确或效率低下。这项研究从概念上探索了材料发现背景下的这类空间,量化了其计算可行性,并通过一个新的高性能开源库 nimplex 实现了几种针对单纯形空间的基本方法。最重要的是,我们推导并实现了一种构建新颖的 n 维单纯形图数据结构的算法,其中包含所有离散化组合和可能的邻域到邻域转换。重要的是,该算法不进行距离或邻域计算,而是利用纯粹的组合学和程序化生成的单纯形网格中的秩序,保持算法 $${mathcal{O}}(N)$$ 的最小内存,从而能够在数秒内快速构建具有数十亿次转换的图形。此外,我们还展示了如何将这种图表示法结合起来,同质地表达复杂的路径规划问题,同时促进现有高性能梯度下降、图遍历和其他优化算法的高效部署。
{"title":"Efficient generation of grids and traversal graphs in compositional spaces towards exploration and path planning","authors":"Adam M. Krajewski,&nbsp;Allison M. Beese,&nbsp;Wesley F. Reinhart,&nbsp;Zi-Kui Liu","doi":"10.1038/s44335-024-00012-2","DOIUrl":"10.1038/s44335-024-00012-2","url":null,"abstract":"Diverse disciplines across science and engineering deal with problems related to compositions, which exist in non-Euclidean simplex spaces, rendering many standard tools inaccurate or inefficient. This work explores such spaces conceptually in the context of materials discovery, quantifies their computational feasibility, and implements several essential methods specific to simplex spaces through a new high-performance open-source library nimplex. Most significantly, we derive and implement an algorithm for constructing a novel n-dimensional simplex graph data structure, containing all discretized compositions and possible neighbor-to-neighbor transitions. Critically, no distance or neighborhood calculations are performed, instead leveraging pure combinatorics and order in procedurally generated simplex grids, keeping the algorithm $${mathcal{O}}(N)$$ , with minimal memory, enabling rapid construction of graphs with billions of transitions in seconds. Additionally, we demonstrate how such graph representations can be combined to homogeneously express complex path-planning problems, while facilitating efficient deployment of existing high-performance gradient descent, graph traversal, and other optimization algorithms.","PeriodicalId":501715,"journal":{"name":"npj Unconventional Computing","volume":" ","pages":"1-12"},"PeriodicalIF":0.0,"publicationDate":"2024-11-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.nature.com/articles/s44335-024-00012-2.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142579804","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Demonstration of 4-quadrant analog in-memory matrix multiplication in a single modulation 单调制 4 象限模拟内存矩阵乘法演示
Pub Date : 2024-10-03 DOI: 10.1038/s44335-024-00010-4
Manuel Le Gallo, Oscar Hrynkevych, Benedikt Kersting, Geethan Karunaratne, Athanasios Vasilopoulos, Riduan Khaddam-Aljameh, Ghazi Sarwat Syed, Abu Sebastian
Analog in-memory computing (AIMC) leverages the inherent physical characteristics of resistive memory devices to execute computational operations, notably matrix-vector multiplications (MVMs). However, executing MVMs using a single-phase reading scheme to reduce latency necessitates the simultaneous application of both positive and negative voltages across resistive memory devices. This degrades the accuracy of the computation due to the dependence of the device conductance on the voltage polarity. Here, we demonstrate the realization of a 4-quadrant MVM in a single modulation by developing analog and digital calibration procedures to mitigate the conductance polarity dependence, fully implemented on a multi-core AIMC chip based on phase-change memory. With this approach, we experimentally demonstrate accurate neural network inference and similarity search tasks using one or multiple cores of the chip, at 4 times higher MVM throughput and energy efficiency than the conventional four-phase reading scheme.
模拟内存计算(AIMC)利用电阻式内存设备的固有物理特性执行计算操作,特别是矩阵向量乘法(MVM)。然而,要使用单相读取方案执行 MVM 以减少延迟,就必须在电阻式存储器件上同时施加正负电压。由于器件电导与电压极性有关,这就降低了计算的准确性。在这里,我们通过开发模拟和数字校准程序来减轻电导极性依赖性,并在基于相变存储器的多核 AIMC 芯片上全面实施,从而展示了在单调制中实现 4 象限 MVM 的方法。利用这种方法,我们在实验中演示了使用芯片的一个或多个内核进行精确的神经网络推理和相似性搜索任务,其 MVM 吞吐量和能效比传统的四相读取方案高出 4 倍。
{"title":"Demonstration of 4-quadrant analog in-memory matrix multiplication in a single modulation","authors":"Manuel Le Gallo,&nbsp;Oscar Hrynkevych,&nbsp;Benedikt Kersting,&nbsp;Geethan Karunaratne,&nbsp;Athanasios Vasilopoulos,&nbsp;Riduan Khaddam-Aljameh,&nbsp;Ghazi Sarwat Syed,&nbsp;Abu Sebastian","doi":"10.1038/s44335-024-00010-4","DOIUrl":"10.1038/s44335-024-00010-4","url":null,"abstract":"Analog in-memory computing (AIMC) leverages the inherent physical characteristics of resistive memory devices to execute computational operations, notably matrix-vector multiplications (MVMs). However, executing MVMs using a single-phase reading scheme to reduce latency necessitates the simultaneous application of both positive and negative voltages across resistive memory devices. This degrades the accuracy of the computation due to the dependence of the device conductance on the voltage polarity. Here, we demonstrate the realization of a 4-quadrant MVM in a single modulation by developing analog and digital calibration procedures to mitigate the conductance polarity dependence, fully implemented on a multi-core AIMC chip based on phase-change memory. With this approach, we experimentally demonstrate accurate neural network inference and similarity search tasks using one or multiple cores of the chip, at 4 times higher MVM throughput and energy efficiency than the conventional four-phase reading scheme.","PeriodicalId":501715,"journal":{"name":"npj Unconventional Computing","volume":" ","pages":"1-8"},"PeriodicalIF":0.0,"publicationDate":"2024-10-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.nature.com/articles/s44335-024-00010-4.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142368745","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
In-memory search with learning to hash based on resistive memory for recommendation acceleration 基于电阻式内存的学习散列内存搜索,为推荐加速
Pub Date : 2024-10-01 DOI: 10.1038/s44335-024-00009-x
Fei Wang, Woyu Zhang, Zhi Li, Ning Lin, Rui Bao, Xiaoxin Xu, Chunmeng Dou, Zhongrui Wang, Dashan Shang
Similarity search is essential in current artificial intelligence applications and widely utilized in various fields, such as recommender systems. However, the exponential growth of data poses significant challenges in search time and energy consumption on traditional digital hardware. Here, we propose a software-hardware co-optimization to address these challenges. On the software side, we employ a learning-to-hash method for vector encoding and achieve an approximate nearest neighbor search by calculating Hamming distance, thereby reducing computational complexity. On the hardware side, we leverage the resistance random-access memory crossbar array to implement the hash encoding process and the content-addressable memory with an in-memory computing paradigm to lower the energy consumption during searches. Simulations on the MovieLens dataset demonstrate that the implementation achieves comparable accuracy to software and reduces energy consumption by 30-fold compared to traditional digital systems. These results provide insight into the development of energy-efficient in-memory search systems for edge computing.
相似性搜索在当前的人工智能应用中至关重要,并广泛应用于推荐系统等多个领域。然而,数据的指数级增长给传统数字硬件的搜索时间和能耗带来了巨大挑战。在此,我们提出了一种软硬件协同优化的方法来应对这些挑战。在软件方面,我们采用学习到哈希(learning-to-hash)方法进行向量编码,并通过计算汉明距离(Hamming distance)实现近似近邻搜索,从而降低计算复杂度。在硬件方面,我们利用电阻式随机存取存储器横条阵列来实现哈希编码过程,并利用内容可寻址存储器的内存计算模式来降低搜索过程中的能耗。在 MovieLens 数据集上进行的仿真表明,与传统数字系统相比,该实现方法达到了与软件相当的精度,并将能耗降低了 30 倍。这些结果为开发用于边缘计算的高能效内存搜索系统提供了启示。
{"title":"In-memory search with learning to hash based on resistive memory for recommendation acceleration","authors":"Fei Wang,&nbsp;Woyu Zhang,&nbsp;Zhi Li,&nbsp;Ning Lin,&nbsp;Rui Bao,&nbsp;Xiaoxin Xu,&nbsp;Chunmeng Dou,&nbsp;Zhongrui Wang,&nbsp;Dashan Shang","doi":"10.1038/s44335-024-00009-x","DOIUrl":"10.1038/s44335-024-00009-x","url":null,"abstract":"Similarity search is essential in current artificial intelligence applications and widely utilized in various fields, such as recommender systems. However, the exponential growth of data poses significant challenges in search time and energy consumption on traditional digital hardware. Here, we propose a software-hardware co-optimization to address these challenges. On the software side, we employ a learning-to-hash method for vector encoding and achieve an approximate nearest neighbor search by calculating Hamming distance, thereby reducing computational complexity. On the hardware side, we leverage the resistance random-access memory crossbar array to implement the hash encoding process and the content-addressable memory with an in-memory computing paradigm to lower the energy consumption during searches. Simulations on the MovieLens dataset demonstrate that the implementation achieves comparable accuracy to software and reduces energy consumption by 30-fold compared to traditional digital systems. These results provide insight into the development of energy-efficient in-memory search systems for edge computing.","PeriodicalId":501715,"journal":{"name":"npj Unconventional Computing","volume":" ","pages":"1-9"},"PeriodicalIF":0.0,"publicationDate":"2024-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.nature.com/articles/s44335-024-00009-x.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142360088","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A perfect storm and a new dawn for unconventional computing technologies 非传统计算技术的完美风暴和新曙光
Pub Date : 2024-09-12 DOI: 10.1038/s44335-024-00011-3
Wei D. Lu, Christof Teuscher, Stephen A. Sarles, Yuchao Yang, Aida Todri-Sanial, Xiao-Bo Zhu
{"title":"A perfect storm and a new dawn for unconventional computing technologies","authors":"Wei D. Lu,&nbsp;Christof Teuscher,&nbsp;Stephen A. Sarles,&nbsp;Yuchao Yang,&nbsp;Aida Todri-Sanial,&nbsp;Xiao-Bo Zhu","doi":"10.1038/s44335-024-00011-3","DOIUrl":"10.1038/s44335-024-00011-3","url":null,"abstract":"","PeriodicalId":501715,"journal":{"name":"npj Unconventional Computing","volume":" ","pages":"1-2"},"PeriodicalIF":0.0,"publicationDate":"2024-09-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.nature.com/articles/s44335-024-00011-3.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142170398","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
npj Unconventional Computing
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1