首页 > 最新文献

International Journal of Intelligent Computing and Cybernetics最新文献

英文 中文
Single-Pixel Photoacoustic Microscopy with Speckle Illumination 带有散斑照明的单像素光声显微镜
IF 4.3 Q1 Computer Science Pub Date : 2023-01-01 DOI: 10.34133/icomputing.0011
A. Caravaca-Aguirre, F. Poisson, D. Bouchet, N. Stasio, P. Moreau, I. Wang, E. Zhang, P. Beard, C. Prada, C. Moser, D. Psaltis, O. Katz, E. Bossy
Wide-field optical-resolution microscopy with structured illumination and single-pixel detection has been the topic of a number of research investigations. Its advantages over point scanning approaches are many and include a faster acquisition rate for sparse samples, sectioning, and super-resolution features. Initially introduced for fluorescence imaging, structured illumination approaches have been adapted and developed for many other imaging modalities. In this paper, we illustrate how speckle illumination, as a particular type of structured illumination, can be exploited to perform optical-resolution photoacoustic microscopy with a single-pixel imaging approach. We first introduce the principle of single-pixel detection applied to photoacoustic imaging and then illustrate in 2 different situations how photoacoustic images may be computationally reconstructed from speckle illumination: In the first situation where the speckle patterns are known through a prior calibration, various reconstruction approaches may be implemented, which are demonstrated experimentally through both scattering layers and multimode optical fibers; in the second situation where the speckle patterns are unknown (blind structured illumination), the so-called memory effect can be harnessed to produce calibration-free photoacoustic images, following the approach initially proposed for fluorescence imaging through thin scattering layers.
具有结构照明和单像素检测的宽视场光学分辨率显微镜已经成为许多研究调查的主题。它比点扫描方法有很多优点,包括对稀疏样本、切片和超分辨率特征的更快采集速率。最初引入荧光成像,结构照明方法已经适应和发展了许多其他成像模式。在本文中,我们说明了如何散斑照明,作为一种特殊类型的结构化照明,可以利用单像素成像方法来执行光学分辨率光声显微镜。我们首先介绍了应用于光声成像的单像素检测原理,然后在两种不同的情况下说明了如何从散斑照明中计算重建光声图像:在第一种情况下,通过事先校准知道散斑图案,可以实现各种重建方法,这些方法通过散射层和多模光纤进行实验证明;在第二种情况下,散斑模式是未知的(盲结构照明),所谓的记忆效应可以利用产生不需要校准的光声图像,遵循最初提出的通过薄散射层进行荧光成像的方法。
{"title":"Single-Pixel Photoacoustic Microscopy with Speckle Illumination","authors":"A. Caravaca-Aguirre, F. Poisson, D. Bouchet, N. Stasio, P. Moreau, I. Wang, E. Zhang, P. Beard, C. Prada, C. Moser, D. Psaltis, O. Katz, E. Bossy","doi":"10.34133/icomputing.0011","DOIUrl":"https://doi.org/10.34133/icomputing.0011","url":null,"abstract":"Wide-field optical-resolution microscopy with structured illumination and single-pixel detection has been the topic of a number of research investigations. Its advantages over point scanning approaches are many and include a faster acquisition rate for sparse samples, sectioning, and super-resolution features. Initially introduced for fluorescence imaging, structured illumination approaches have been adapted and developed for many other imaging modalities. In this paper, we illustrate how speckle illumination, as a particular type of structured illumination, can be exploited to perform optical-resolution photoacoustic microscopy with a single-pixel imaging approach. We first introduce the principle of single-pixel detection applied to photoacoustic imaging and then illustrate in 2 different situations how photoacoustic images may be computationally reconstructed from speckle illumination: In the first situation where the speckle patterns are known through a prior calibration, various reconstruction approaches may be implemented, which are demonstrated experimentally through both scattering layers and multimode optical fibers; in the second situation where the speckle patterns are unknown (blind structured illumination), the so-called memory effect can be harnessed to produce calibration-free photoacoustic images, following the approach initially proposed for fluorescence imaging through thin scattering layers.","PeriodicalId":45291,"journal":{"name":"International Journal of Intelligent Computing and Cybernetics","volume":null,"pages":null},"PeriodicalIF":4.3,"publicationDate":"2023-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"76252482","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
What Should Replace the Turing Test? 什么应该取代图灵测试?
Q1 Computer Science Pub Date : 2023-01-01 DOI: 10.34133/icomputing.0064
Philip N Johnson-Laird, Marco Ragni
Today, chatbots and other artificial intelligence tools pass the Turing test, which was Turing’s alternative to trying to answer the question: can a machine think? Despite their success in passing the Turing test, these machines do not think. We therefore propose a test of a more focused question: does a program reason in the way that humans reason? This test treats an “intelligent” program as though it were a participant in a psychological study and has 3 steps: (a) test the program in a set of experiments examining its inferences, (b) test its understanding of its own way of reasoning, and (c) examine, if possible, the cognitive adequacy of the source code for the program.
今天,聊天机器人和其他人工智能工具通过了图灵测试,这是图灵试图回答这个问题的另一种选择:机器能思考吗?尽管这些机器成功地通过了图灵测试,但它们不会思考。因此,我们提出了一个更集中的问题的测试:程序是否以人类推理的方式进行推理?这个测试把一个“智能”程序当作一个心理学研究的参与者,有三个步骤:(a)在一组实验中测试程序,检查它的推论,(b)测试它对自己推理方式的理解,(c)检查,如果可能的话,程序源代码的认知充分性。
{"title":"What Should Replace the Turing Test?","authors":"Philip N Johnson-Laird, Marco Ragni","doi":"10.34133/icomputing.0064","DOIUrl":"https://doi.org/10.34133/icomputing.0064","url":null,"abstract":"Today, chatbots and other artificial intelligence tools pass the Turing test, which was Turing’s alternative to trying to answer the question: can a machine think? Despite their success in passing the Turing test, these machines do not think. We therefore propose a test of a more focused question: does a program reason in the way that humans reason? This test treats an “intelligent” program as though it were a participant in a psychological study and has 3 steps: (a) test the program in a set of experiments examining its inferences, (b) test its understanding of its own way of reasoning, and (c) examine, if possible, the cognitive adequacy of the source code for the program.","PeriodicalId":45291,"journal":{"name":"International Journal of Intelligent Computing and Cybernetics","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2023-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135051490","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Unconventional Integrated Photonic Accelerators for High-Throughput Convolutional Neural Networks 用于高通量卷积神经网络的非常规集成光子加速器
IF 4.3 Q1 Computer Science Pub Date : 2023-01-01 DOI: 10.34133/icomputing.0032
Aris Tsirigotis, G. Sarantoglou, M. Skontranis, S. Deligiannidis, Kostas Sozos, Giannis Tsilikas, Dimitris Dermanis, A. Bogris, C. Mesaritakis
We provide an overview of the rapidly evolving landscape of integrated photonic neuromorphic architectures, specifically targeting the implementation of convolutional neural networks. The exploding research momentum stems from the well-known advantages of photonic circuits compared to digital electronics, and at the same time, it is driven by the massive need for cognitive image/video processing. In this context, we provide a detailed literature review on photonic cores operating as convolutional neural networks, covering either the functionality of a conventional neural network or its spiking counterpart. Moreover, we propose 2 alternative photonic approaches that refrain from simply transferring neural network concepts directly into the optical domain; instead, they focus on fusing photonic, digital electronic, and event-based bioinspired processing to optimally exploit the virtues of each scheme. These approaches can offer beyond state-of-the-art performance while relying on realistic, scalable technology. The first approach is based on a photonic integrated platform and a bioinspired spectrum-slicing technique. The photonic chip allows feature extraction through optical filtering with low power consumption and an equivalent computational efficiency of 72 femtojoules per multiply-and-accumulate operation for 5-bit precision. When combined with typical digital neural networks, an almost 5-fold reduction in the number of parameters was achieved with a minor loss of accuracy compared to established convolutional neural networks. The second approach follows a bioisomorphic route in which miniaturized spiking laser neurons and unsupervised bioinspired training are unified in a deep architecture, revealing a noise-resilient and power-efficient proposition.
我们概述了集成光子神经形态架构的快速发展前景,特别是针对卷积神经网络的实现。与数字电子相比,光子电路具有众所周知的优势,同时,对认知图像/视频处理的巨大需求也推动了这一研究势头的爆炸式增长。在这种情况下,我们提供了一个详细的文献综述的光子核作为卷积神经网络,包括传统的神经网络的功能或其尖峰对应。此外,我们提出了两种替代的光子方法,避免简单地将神经网络概念直接转移到光学领域;相反,他们专注于融合光子、数字电子和基于事件的生物启发处理,以最佳地利用每种方案的优点。这些方法可以提供超越最先进的性能,同时依赖于现实的、可扩展的技术。第一种方法是基于光子集成平台和生物启发的光谱切片技术。该光子芯片允许通过光学滤波提取特征,功耗低,每次乘加运算的等效计算效率为72飞焦耳,精度为5位。当与典型的数字神经网络相结合时,与已建立的卷积神经网络相比,参数数量减少了近5倍,精度损失很小。第二种方法遵循生物同构路线,其中小型化的脉冲激光神经元和无监督的生物启发训练统一在一个深度架构中,揭示了一个抗噪声和节能的主张。
{"title":"Unconventional Integrated Photonic Accelerators for High-Throughput Convolutional Neural Networks","authors":"Aris Tsirigotis, G. Sarantoglou, M. Skontranis, S. Deligiannidis, Kostas Sozos, Giannis Tsilikas, Dimitris Dermanis, A. Bogris, C. Mesaritakis","doi":"10.34133/icomputing.0032","DOIUrl":"https://doi.org/10.34133/icomputing.0032","url":null,"abstract":"We provide an overview of the rapidly evolving landscape of integrated photonic neuromorphic architectures, specifically targeting the implementation of convolutional neural networks. The exploding research momentum stems from the well-known advantages of photonic circuits compared to digital electronics, and at the same time, it is driven by the massive need for cognitive image/video processing. In this context, we provide a detailed literature review on photonic cores operating as convolutional neural networks, covering either the functionality of a conventional neural network or its spiking counterpart. Moreover, we propose 2 alternative photonic approaches that refrain from simply transferring neural network concepts directly into the optical domain; instead, they focus on fusing photonic, digital electronic, and event-based bioinspired processing to optimally exploit the virtues of each scheme. These approaches can offer beyond state-of-the-art performance while relying on realistic, scalable technology. The first approach is based on a photonic integrated platform and a bioinspired spectrum-slicing technique. The photonic chip allows feature extraction through optical filtering with low power consumption and an equivalent computational efficiency of 72 femtojoules per multiply-and-accumulate operation for 5-bit precision. When combined with typical digital neural networks, an almost 5-fold reduction in the number of parameters was achieved with a minor loss of accuracy compared to established convolutional neural networks. The second approach follows a bioisomorphic route in which miniaturized spiking laser neurons and unsupervised bioinspired training are unified in a deep architecture, revealing a noise-resilient and power-efficient proposition.","PeriodicalId":45291,"journal":{"name":"International Journal of Intelligent Computing and Cybernetics","volume":null,"pages":null},"PeriodicalIF":4.3,"publicationDate":"2023-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"83221305","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Intelligent Computing: Proceedings of the 2023 Computing Conference, Volume 1 智能计算:2023计算会议论文集,第1卷
IF 4.3 Q1 Computer Science Pub Date : 2023-01-01 DOI: 10.1007/978-3-031-37717-4
{"title":"Intelligent Computing: Proceedings of the 2023 Computing Conference, Volume 1","authors":"","doi":"10.1007/978-3-031-37717-4","DOIUrl":"https://doi.org/10.1007/978-3-031-37717-4","url":null,"abstract":"","PeriodicalId":45291,"journal":{"name":"International Journal of Intelligent Computing and Cybernetics","volume":null,"pages":null},"PeriodicalIF":4.3,"publicationDate":"2023-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"85965514","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Intelligent Computing: Proceedings of the 2023 Computing Conference, Volume 2 智能计算:2023年计算会议论文集,第2卷
IF 4.3 Q1 Computer Science Pub Date : 2023-01-01 DOI: 10.1007/978-3-031-37963-5
{"title":"Intelligent Computing: Proceedings of the 2023 Computing Conference, Volume 2","authors":"","doi":"10.1007/978-3-031-37963-5","DOIUrl":"https://doi.org/10.1007/978-3-031-37963-5","url":null,"abstract":"","PeriodicalId":45291,"journal":{"name":"International Journal of Intelligent Computing and Cybernetics","volume":null,"pages":null},"PeriodicalIF":4.3,"publicationDate":"2023-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"90504699","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Computational Ghost Imaging with the Human Brain 计算鬼影成像与人脑
Q1 Computer Science Pub Date : 2023-01-01 DOI: 10.34133/icomputing.0014
Gao Wang, Daniele Faccio
Brain–computer interfaces are enabling a range of new possibilities and routes for augmenting human capability. Here, we propose brain–computer interfaces as a route towards forms of computation, i.e., computational imaging, that blend the brain with external silicon processing. We demonstrate ghost imaging of a hidden scene using the human visual system that is combined with an adaptive computational imaging scheme. This is achieved through a projection pattern “carving” technique that relies on real-time feedback from the brain to modify patterns at the light projector, thus enabling more efficient and higher-resolution imaging. This brain–computer connectivity demonstrates a form of augmented human computation that could, in the future, extend the sensing range of human vision and provide new approaches to the study of the neurophysics of human perception. As an example, we illustrate a simple experiment whereby image reconstruction quality is affected by simultaneous conscious processing and readout of the perceived light intensities.
脑机接口为增强人类能力提供了一系列新的可能性和途径。在这里,我们提出脑机接口作为计算形式的途径,即计算成像,将大脑与外部硅处理相结合。我们演示了使用人类视觉系统与自适应计算成像方案相结合的隐藏场景的鬼成像。这是通过投影模式“雕刻”技术实现的,该技术依赖于大脑的实时反馈来修改光投影仪上的模式,从而实现更高效、更高分辨率的成像。这种脑机连接展示了一种增强人类计算的形式,在未来,它可以扩展人类视觉的感知范围,并为人类感知的神经物理学研究提供新的方法。作为一个例子,我们说明了一个简单的实验,其中图像重建质量受到同时有意识处理和读出感知光强度的影响。
{"title":"Computational Ghost Imaging with the Human Brain","authors":"Gao Wang, Daniele Faccio","doi":"10.34133/icomputing.0014","DOIUrl":"https://doi.org/10.34133/icomputing.0014","url":null,"abstract":"Brain–computer interfaces are enabling a range of new possibilities and routes for augmenting human capability. Here, we propose brain–computer interfaces as a route towards forms of computation, i.e., computational imaging, that blend the brain with external silicon processing. We demonstrate ghost imaging of a hidden scene using the human visual system that is combined with an adaptive computational imaging scheme. This is achieved through a projection pattern “carving” technique that relies on real-time feedback from the brain to modify patterns at the light projector, thus enabling more efficient and higher-resolution imaging. This brain–computer connectivity demonstrates a form of augmented human computation that could, in the future, extend the sensing range of human vision and provide new approaches to the study of the neurophysics of human perception. As an example, we illustrate a simple experiment whereby image reconstruction quality is affected by simultaneous conscious processing and readout of the perceived light intensities.","PeriodicalId":45291,"journal":{"name":"International Journal of Intelligent Computing and Cybernetics","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2023-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"134996518","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Photonic Spiking Neural Networks with Highly Efficient Training Protocols for Ultrafast Neuromorphic Computing Systems 超高速神经形态计算系统中具有高效训练协议的光子脉冲神经网络
Q1 Computer Science Pub Date : 2023-01-01 DOI: 10.34133/icomputing.0031
Dafydd Owen-Newns, Joshua Robertson, Matěj Hejda, Antonio Hurtado
Photonic technologies offer great prospects for novel, ultrafast, energy-efficient, and hardware-friendly neuromorphic (brain-like) computing platforms. Moreover, neuromorphic photonic approaches based on ubiquitous, technology-mature, and low-cost vertical-cavity surface-emitting lasers (VCSELs) (devices found in fiber-optic transmitters, mobile phones, and automotive sensors) are of particular interest. Given that VCSELs have shown the ability to realize neuronal optical spiking responses (at ultrafast GHz rates), their use in spike-based information-processing systems has been proposed. In this study, spiking neural network (SNN) operation, based on a hardware-friendly photonic system of just one VCSEL, is reported alongside a novel binary weight “significance” training scheme that fully capitalizes on the discrete nature of the optical spikes used by the SNN to process input information. The VCSEL-based photonic SNN was tested with a highly complex multivariate classification task (MADELON) before its performance was compared using a traditional least-squares training method and an alternative novel binary weighting scheme. Excellent classification accuracies of >94% were achieved by both training methods, exceeding the benchmark performance of the dataset in a fraction of the processing time. The newly reported training scheme also dramatically reduces the training set size requirements and the number of trained nodes (≤1% of the total network node count). This VCSEL-based photonic SNN, in combination with the reported “significance” weighting scheme, therefore grants ultrafast spike-based optical processing highly reduced training requirements and hardware complexity for potential application in future neuromorphic systems and artificial intelligence applications.
光子技术为新型、超快、节能、硬件友好的神经形态(类脑)计算平台提供了巨大的前景。此外,基于无处不在、技术成熟、低成本的垂直腔面发射激光器(VCSELs)(光纤发射器、移动电话和汽车传感器中的设备)的神经形态光子方法尤其令人感兴趣。鉴于vcsel已经显示出实现神经元光尖峰响应(超快GHz速率)的能力,已经提出将其用于基于尖峰的信息处理系统。在本研究中,基于仅一个VCSEL的硬件友好光子系统的尖峰神经网络(SNN)运行,以及一种新的二元权重“显著性”训练方案,该方案充分利用了SNN用于处理输入信息的光学尖峰的离散性质。利用高度复杂的多元分类任务(MADELON)对基于vcsel的光子SNN进行了测试,然后使用传统的最小二乘训练方法和一种新的替代二元加权方案对其性能进行了比较。两种训练方法的分类准确率都达到了>94%,在一小部分处理时间内超过了数据集的基准性能。新报道的训练方案还显著降低了训练集的大小要求和训练节点的数量(≤网络总节点数的1%)。这种基于vcsel的光子SNN,结合报道的“显著性”加权方案,因此为未来神经形态系统和人工智能应用的潜在应用提供了基于超快尖峰的光学处理,大大降低了训练要求和硬件复杂性。
{"title":"Photonic Spiking Neural Networks with Highly Efficient Training Protocols for Ultrafast Neuromorphic Computing Systems","authors":"Dafydd Owen-Newns, Joshua Robertson, Matěj Hejda, Antonio Hurtado","doi":"10.34133/icomputing.0031","DOIUrl":"https://doi.org/10.34133/icomputing.0031","url":null,"abstract":"Photonic technologies offer great prospects for novel, ultrafast, energy-efficient, and hardware-friendly neuromorphic (brain-like) computing platforms. Moreover, neuromorphic photonic approaches based on ubiquitous, technology-mature, and low-cost vertical-cavity surface-emitting lasers (VCSELs) (devices found in fiber-optic transmitters, mobile phones, and automotive sensors) are of particular interest. Given that VCSELs have shown the ability to realize neuronal optical spiking responses (at ultrafast GHz rates), their use in spike-based information-processing systems has been proposed. In this study, spiking neural network (SNN) operation, based on a hardware-friendly photonic system of just one VCSEL, is reported alongside a novel binary weight “significance” training scheme that fully capitalizes on the discrete nature of the optical spikes used by the SNN to process input information. The VCSEL-based photonic SNN was tested with a highly complex multivariate classification task (MADELON) before its performance was compared using a traditional least-squares training method and an alternative novel binary weighting scheme. Excellent classification accuracies of >94% were achieved by both training methods, exceeding the benchmark performance of the dataset in a fraction of the processing time. The newly reported training scheme also dramatically reduces the training set size requirements and the number of trained nodes (≤1% of the total network node count). This VCSEL-based photonic SNN, in combination with the reported “significance” weighting scheme, therefore grants ultrafast spike-based optical processing highly reduced training requirements and hardware complexity for potential application in future neuromorphic systems and artificial intelligence applications.","PeriodicalId":45291,"journal":{"name":"International Journal of Intelligent Computing and Cybernetics","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2023-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135685682","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Software Systems Implementation and Domain-Specific Architectures towards Graph Analytics 面向图分析的软件系统实现和特定领域架构
IF 4.3 Q1 Computer Science Pub Date : 2022-10-29 DOI: 10.34133/2022/9806758
Hai Jin, Hao Qi, Jin Zhao, Xinyu Jiang, Yu Huang, Chuangyi Gui, Qinggang Wang, Xinyang Shen, Yi Zhang, Ao Hu, Dan Chen, Chao Liu, Haifeng Liu, Haiheng He, Xiangyu Ye, Runze Wang, Jingrui Yuan, Pengcheng Yao, Yu Zhang, Long Zheng, Xiaofei Liao
Graph analytics, which mainly includes graph processing, graph mining, and graph learning, has become increasingly important in several domains, including social network analysis, bioinformatics, and machine learning. However, graph analytics applications suffer from poor locality, limited bandwidth, and low parallelism owing to the irregular sparse structure, explosive growth, and dependencies of graph data. To address those challenges, several programming models, execution modes, and messaging strategies are proposed to improve the utilization of traditional hardware and performance. In recent years, novel computing and memory devices have emerged, e.g., HMCs, HBM, and ReRAM, providing massive bandwidth and parallelism resources, making it possible to address bottlenecks in graph applications. To facilitate understanding of the graph analytics domain, our study summarizes and categorizes current software systems implementation and domain-specific architectures. Finally, we discuss the future challenges of graph analytics.
图分析主要包括图处理、图挖掘和图学习,在社会网络分析、生物信息学和机器学习等多个领域变得越来越重要。然而,由于图数据的不规则稀疏结构、爆炸性增长和依赖性,图分析应用程序受到局部性差、带宽有限和低并行性的影响。为了应对这些挑战,提出了几种编程模型、执行模式和消息传递策略,以提高传统硬件的利用率和性能。近年来,新型计算和存储设备如hmc、HBM和ReRAM等出现,提供了大量的带宽和并行资源,使解决图形应用中的瓶颈成为可能。为了促进对图形分析领域的理解,我们的研究总结并分类了当前的软件系统实现和特定于领域的架构。最后,我们讨论了图分析未来的挑战。
{"title":"Software Systems Implementation and Domain-Specific Architectures towards Graph Analytics","authors":"Hai Jin, Hao Qi, Jin Zhao, Xinyu Jiang, Yu Huang, Chuangyi Gui, Qinggang Wang, Xinyang Shen, Yi Zhang, Ao Hu, Dan Chen, Chao Liu, Haifeng Liu, Haiheng He, Xiangyu Ye, Runze Wang, Jingrui Yuan, Pengcheng Yao, Yu Zhang, Long Zheng, Xiaofei Liao","doi":"10.34133/2022/9806758","DOIUrl":"https://doi.org/10.34133/2022/9806758","url":null,"abstract":"Graph analytics, which mainly includes graph processing, graph mining, and graph learning, has become increasingly important in several domains, including social network analysis, bioinformatics, and machine learning. However, graph analytics applications suffer from poor locality, limited bandwidth, and low parallelism owing to the irregular sparse structure, explosive growth, and dependencies of graph data. To address those challenges, several programming models, execution modes, and messaging strategies are proposed to improve the utilization of traditional hardware and performance. In recent years, novel computing and memory devices have emerged, e.g., HMCs, HBM, and ReRAM, providing massive bandwidth and parallelism resources, making it possible to address bottlenecks in graph applications. To facilitate understanding of the graph analytics domain, our study summarizes and categorizes current software systems implementation and domain-specific architectures. Finally, we discuss the future challenges of graph analytics.","PeriodicalId":45291,"journal":{"name":"International Journal of Intelligent Computing and Cybernetics","volume":null,"pages":null},"PeriodicalIF":4.3,"publicationDate":"2022-10-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"87690495","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
Resource Configuration Tuning for Stream Data Processing Systems via Bayesian Optimization 基于贝叶斯优化的流数据处理系统资源配置调优
IF 4.3 Q1 Computer Science Pub Date : 2022-10-06 DOI: 10.34133/2022/9820424
Shixin Huang, Chao Chen, Gangya Zhu, Jinhan Xin, Z. Wang, Kai Hwang, Zhibin Yu
Stream data processing systems are becoming increasingly popular in the big data era. Systems such as Apache Flink typically provide a number (e.g., 30) of configuration parameters to flexibly specify the amount of resources (e.g., CPU cores and memory) allocated for tasks. These parameters significantly affect task performance. However, it is hard to manually tune them for optimal performance for an unknown program running on a given cluster. An automatic as well as fast resource configuration tuning approach is therefore desired. To this end, we propose to leverage Bayesian optimization to automatically tune the resource configurations for stream data processing systems. We first select a machine learning model—Random Forest—to construct accurate performance models for a stream data processing program. We subsequently take the Bayesian optimization (BO) algorithm, along with the performance models, to iteratively search the optimal configurations for a stream data processing program. Experimental results show that our approach improves the 99th-percentile tail latency by a factor of 2.62× on average and up to 5.26× overall. Furthermore, our approach improves throughput by a factor of 1.05× on average and up to 1.21× overall.
在大数据时代,流数据处理系统越来越受欢迎。像Apache Flink这样的系统通常会提供一些配置参数(例如,30)来灵活地指定分配给任务的资源数量(例如,CPU内核和内存)。这些参数显著影响任务性能。但是,对于在给定集群上运行的未知程序,很难手动调优它们以获得最佳性能。因此,需要一种自动且快速的资源配置调优方法。为此,我们建议利用贝叶斯优化来自动调整流数据处理系统的资源配置。我们首先选择一个机器学习模型-随机森林-为流数据处理程序构建准确的性能模型。随后,我们采用贝叶斯优化(BO)算法,以及性能模型,迭代地搜索流数据处理程序的最佳配置。实验结果表明,该方法将第99百分位尾部延迟平均提高了2.62倍,总体提高了5.26倍。此外,我们的方法将吞吐量平均提高了1.05倍,总体提高了1.21倍。
{"title":"Resource Configuration Tuning for Stream Data Processing Systems via Bayesian Optimization","authors":"Shixin Huang, Chao Chen, Gangya Zhu, Jinhan Xin, Z. Wang, Kai Hwang, Zhibin Yu","doi":"10.34133/2022/9820424","DOIUrl":"https://doi.org/10.34133/2022/9820424","url":null,"abstract":"Stream data processing systems are becoming increasingly popular in the big data era. Systems such as Apache Flink typically provide a number (e.g., 30) of configuration parameters to flexibly specify the amount of resources (e.g., CPU cores and memory) allocated for tasks. These parameters significantly affect task performance. However, it is hard to manually tune them for optimal performance for an unknown program running on a given cluster. An automatic as well as fast resource configuration tuning approach is therefore desired. To this end, we propose to leverage Bayesian optimization to automatically tune the resource configurations for stream data processing systems. We first select a machine learning model—Random Forest—to construct accurate performance models for a stream data processing program. We subsequently take the Bayesian optimization (BO) algorithm, along with the performance models, to iteratively search the optimal configurations for a stream data processing program. Experimental results show that our approach improves the 99th-percentile tail latency by a factor of 2.62× on average and up to 5.26× overall. Furthermore, our approach improves throughput by a factor of 1.05× on average and up to 1.21× overall.","PeriodicalId":45291,"journal":{"name":"International Journal of Intelligent Computing and Cybernetics","volume":null,"pages":null},"PeriodicalIF":4.3,"publicationDate":"2022-10-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"86462802","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
SDCBench: A Benchmark Suite for Workload Colocation and Evaluation in Datacenters SDCBench:用于数据中心工作负载托管和评估的基准套件
IF 4.3 Q1 Computer Science Pub Date : 2022-09-07 DOI: 10.34133/2022/9810691
Yanan Yang, Xiangyu Kong, Laiping Zhao, Yiming Li, Huanyu Zhang, Jie Li, Heng Qi, Keqiu Li
Colocating workloads are commonly used in datacenters to improve server utilization. However, the unpredictable application performance degradation caused by the contention for shared resources makes the problem difficult and limits the efficiency of this approach. This problem has sparked research in hardware and software techniques that focus on enhancing the datacenters’ isolation abilities. There is still lack of a comprehensive benchmark suite to evaluate such techniques. To address this problem, we present SDCBench, a new benchmark suite that is specifically designed for workload colocation and characterization in datacenters. SDCBench includes 16 applications that span a wide range of cloud scenarios, which are carefully selected from the existing benchmarks using the clustering analysis method. SDCBench implements a robust statistical methodology to support workload colocation and proposes a concept of latency entropy for measuring the isolation ability of cloud systems. It enables cloud tenants to understand the performance isolation ability in datacenters and choose their best-fitted cloud services. For cloud providers, it also helps them to improve the quality of service to increase their revenues. Experimental results show that SDCBench can simulate different workload colocation scenarios by generating pressures on multidimensional resources with simple configurations. We also use SDCBench to compare the latency entropies in public cloud platforms such as Huawei Cloud and AWS Cloud and a local prototype system FlameCluster-II; the evaluation results show FlameCluster-II has the best performance isolation ability over these three cloud systems, with 0.99 of experience availability and 0.29 of latency entropy.
在数据中心中,协同工作负载通常用于提高服务器利用率。然而,由于共享资源的争用而导致的不可预测的应用程序性能下降使问题变得困难,并限制了这种方法的效率。这个问题引发了对硬件和软件技术的研究,这些技术的重点是增强数据中心的隔离能力。目前仍然缺乏一个全面的基准测试套件来评估这些技术。为了解决这个问题,我们提出了SDCBench,这是一个专门为数据中心的工作负载托管和表征而设计的新的基准套件。SDCBench包括16个应用程序,它们跨越了广泛的云场景,这些应用程序是使用聚类分析方法从现有的基准测试中精心挑选出来的。SDCBench实现了一种健壮的统计方法来支持工作负载托管,并提出了延迟熵的概念来测量云系统的隔离能力。它使云租户能够了解数据中心中的性能隔离功能,并选择最适合他们的云服务。对于云提供商来说,它还可以帮助他们提高服务质量,从而增加收入。实验结果表明,SDCBench可以通过简单的配置在多维资源上生成压力来模拟不同的工作负载托管场景。我们还使用SDCBench比较了公共云平台(如华为云和AWS云)和本地原型系统flameccluster - ii的延迟熵;评估结果表明,FlameCluster-II在这三个云系统中具有最佳的性能隔离能力,其体验可用性和延迟熵分别为0.99和0.29。
{"title":"SDCBench: A Benchmark Suite for Workload Colocation and Evaluation in Datacenters","authors":"Yanan Yang, Xiangyu Kong, Laiping Zhao, Yiming Li, Huanyu Zhang, Jie Li, Heng Qi, Keqiu Li","doi":"10.34133/2022/9810691","DOIUrl":"https://doi.org/10.34133/2022/9810691","url":null,"abstract":"Colocating workloads are commonly used in datacenters to improve server utilization. However, the unpredictable application performance degradation caused by the contention for shared resources makes the problem difficult and limits the efficiency of this approach. This problem has sparked research in hardware and software techniques that focus on enhancing the datacenters’ isolation abilities. There is still lack of a comprehensive benchmark suite to evaluate such techniques. To address this problem, we present SDCBench, a new benchmark suite that is specifically designed for workload colocation and characterization in datacenters. SDCBench includes 16 applications that span a wide range of cloud scenarios, which are carefully selected from the existing benchmarks using the clustering analysis method. SDCBench implements a robust statistical methodology to support workload colocation and proposes a concept of latency entropy for measuring the isolation ability of cloud systems. It enables cloud tenants to understand the performance isolation ability in datacenters and choose their best-fitted cloud services. For cloud providers, it also helps them to improve the quality of service to increase their revenues. Experimental results show that SDCBench can simulate different workload colocation scenarios by generating pressures on multidimensional resources with simple configurations. We also use SDCBench to compare the latency entropies in public cloud platforms such as Huawei Cloud and AWS Cloud and a local prototype system FlameCluster-II; the evaluation results show FlameCluster-II has the best performance isolation ability over these three cloud systems, with 0.99 of experience availability and 0.29 of latency entropy.","PeriodicalId":45291,"journal":{"name":"International Journal of Intelligent Computing and Cybernetics","volume":null,"pages":null},"PeriodicalIF":4.3,"publicationDate":"2022-09-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"85238626","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
International Journal of Intelligent Computing and Cybernetics
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1