{"title":"Development of hybrid storage system based on Open CAS technology, optimized for HPC workload","authors":"Svetlana Lazareva, Ivan Petrov","doi":"10.1145/3579370.3594763","DOIUrl":null,"url":null,"abstract":"HPC runs in a distributed structure with a single shared pool of data. In our case, the distributed structure is Lustre file system [4], and the single shared pool of data is our declustered HDD RAID (denoted as DCR). To increase performance, it is suggested to use Open CAS technology [3] as a cache on RAM/NVDIMM with special parameters, optimized for heavy data-intensive sequential HPC workload and an online-algorithm which reduces the number of RMW operations, by merging sequential requests into one full-stripe one.","PeriodicalId":180024,"journal":{"name":"Proceedings of the 16th ACM International Conference on Systems and Storage","volume":null,"pages":null},"PeriodicalIF":0.0000,"publicationDate":"2023-06-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Proceedings of the 16th ACM International Conference on Systems and Storage","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1145/3579370.3594763","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
Abstract
HPC runs in a distributed structure with a single shared pool of data. In our case, the distributed structure is Lustre file system [4], and the single shared pool of data is our declustered HDD RAID (denoted as DCR). To increase performance, it is suggested to use Open CAS technology [3] as a cache on RAM/NVDIMM with special parameters, optimized for heavy data-intensive sequential HPC workload and an online-algorithm which reduces the number of RMW operations, by merging sequential requests into one full-stripe one.