{"title":"分布式系统中科学工作性能分析系统","authors":"D. Campis, A. Ilina, I. Pelevanyuk","doi":"10.1134/S1063779624030262","DOIUrl":null,"url":null,"abstract":"<p>Modern high-energy physics experiments require a large number of computations for simulation, data analysis, and reconstruction. These computations are distributed across hundreds of thousands of tasks on various computing resources. To analyze the performance of these resources, an automated system has been developed by the authors, which collects and processes data about resource usage and CPU core performance. This data is visualized through a web application, showing the relationship between execution time and CPU core performance. The system is used for analyzing tasks from BM@N, MPD, SPD, and Baikal-GVD experiments within the DIRAC system at the Joint Institute for Nuclear Research.</p>","PeriodicalId":729,"journal":{"name":"Physics of Particles and Nuclei","volume":"55 3","pages":"401 - 403"},"PeriodicalIF":0.5000,"publicationDate":"2024-06-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"System for Analysis of the Performance of Scientific Jobs in Distributed Systems\",\"authors\":\"D. Campis, A. Ilina, I. Pelevanyuk\",\"doi\":\"10.1134/S1063779624030262\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p>Modern high-energy physics experiments require a large number of computations for simulation, data analysis, and reconstruction. These computations are distributed across hundreds of thousands of tasks on various computing resources. To analyze the performance of these resources, an automated system has been developed by the authors, which collects and processes data about resource usage and CPU core performance. This data is visualized through a web application, showing the relationship between execution time and CPU core performance. The system is used for analyzing tasks from BM@N, MPD, SPD, and Baikal-GVD experiments within the DIRAC system at the Joint Institute for Nuclear Research.</p>\",\"PeriodicalId\":729,\"journal\":{\"name\":\"Physics of Particles and Nuclei\",\"volume\":\"55 3\",\"pages\":\"401 - 403\"},\"PeriodicalIF\":0.5000,\"publicationDate\":\"2024-06-06\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Physics of Particles and Nuclei\",\"FirstCategoryId\":\"101\",\"ListUrlMain\":\"https://link.springer.com/article/10.1134/S1063779624030262\",\"RegionNum\":4,\"RegionCategory\":\"物理与天体物理\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q4\",\"JCRName\":\"PHYSICS, PARTICLES & FIELDS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Physics of Particles and Nuclei","FirstCategoryId":"101","ListUrlMain":"https://link.springer.com/article/10.1134/S1063779624030262","RegionNum":4,"RegionCategory":"物理与天体物理","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q4","JCRName":"PHYSICS, PARTICLES & FIELDS","Score":null,"Total":0}
引用次数: 0
摘要
现代高能物理实验需要大量的计算来进行模拟、数据分析和重建。这些计算分布在各种计算资源上的成千上万个任务中。为了分析这些资源的性能,作者开发了一个自动化系统,用于收集和处理有关资源使用和 CPU 内核性能的数据。这些数据通过网络应用程序可视化,显示执行时间与 CPU 内核性能之间的关系。该系统用于分析联合核研究所 DIRAC 系统中 BM@N、MPD、SPD 和 Baikal-GVD 实验的任务。
System for Analysis of the Performance of Scientific Jobs in Distributed Systems
Modern high-energy physics experiments require a large number of computations for simulation, data analysis, and reconstruction. These computations are distributed across hundreds of thousands of tasks on various computing resources. To analyze the performance of these resources, an automated system has been developed by the authors, which collects and processes data about resource usage and CPU core performance. This data is visualized through a web application, showing the relationship between execution time and CPU core performance. The system is used for analyzing tasks from BM@N, MPD, SPD, and Baikal-GVD experiments within the DIRAC system at the Joint Institute for Nuclear Research.
期刊介绍:
The journal Fizika Elementarnykh Chastits i Atomnogo Yadr of the Joint Institute for Nuclear Research (JINR, Dubna) was founded by Academician N.N. Bogolyubov in August 1969. The Editors-in-chief of the journal were Academician N.N. Bogolyubov (1970–1992) and Academician A.M. Baldin (1992–2001). Its English translation, Physics of Particles and Nuclei, appears simultaneously with the original Russian-language edition. Published by leading physicists from the JINR member states, as well as by scientists from other countries, review articles in this journal examine problems of elementary particle physics, nuclear physics, condensed matter physics, experimental data processing, accelerators and related instrumentation ecology and radiology.