zCeph: Design and implementation of a ZNS-friendly distributed file system

IF 6.2 2区 计算机科学 Q1 COMPUTER SCIENCE, THEORY & METHODS Future Generation Computer Systems-The International Journal of Escience Pub Date : 2025-03-05 DOI:10.1016/j.future.2025.107763
Jin Yong Ha , Yongseok Son
{"title":"zCeph: Design and implementation of a ZNS-friendly distributed file system","authors":"Jin Yong Ha ,&nbsp;Yongseok Son","doi":"10.1016/j.future.2025.107763","DOIUrl":null,"url":null,"abstract":"<div><div>This article presents <span>zCeph</span>, a ZNS-friendly distributed file system designed to efficiently utilize zoned namespace (ZNS) SSDs. Specifically, we first propose <span>MZAllocator</span> which enables multiple zones to be utilized simultaneously to maximize the performance of ZNS SSDs. Second, we adopt an <span>append</span> command to eliminate the need for synchronization in write ordering within distributed storage systems to improve scalability. Third, we present <span>zBlueFS</span>, a ZNS-aware user-level file system based on BlueFS to update the metadata on the ZNS SSD without a conventional SSD. Finally, we propose a delta write technique, <span>DeltaWriter</span>, which writes only a modified part of the metadata (i.e., onode) to reduce read–modify–write overhead whenever the metadata are updated. We implement <span>zCeph</span> with four techniques based on Ceph, an open-source distributed file system. Further, we evaluate <span>zCeph</span> on a pair of 48-core machines with ZNS SSDs using micro and macro benchmarks, and the results reveal that <span>zCeph</span> improves performance by up to 4.2<span><math><mo>×</mo></math></span> and 8.8<span><math><mo>×</mo></math></span> compared with Ceph, respectively.</div></div>","PeriodicalId":55132,"journal":{"name":"Future Generation Computer Systems-The International Journal of Escience","volume":"169 ","pages":"Article 107763"},"PeriodicalIF":6.2000,"publicationDate":"2025-03-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Future Generation Computer Systems-The International Journal of Escience","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0167739X25000585","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, THEORY & METHODS","Score":null,"Total":0}
引用次数: 0

Abstract

This article presents zCeph, a ZNS-friendly distributed file system designed to efficiently utilize zoned namespace (ZNS) SSDs. Specifically, we first propose MZAllocator which enables multiple zones to be utilized simultaneously to maximize the performance of ZNS SSDs. Second, we adopt an append command to eliminate the need for synchronization in write ordering within distributed storage systems to improve scalability. Third, we present zBlueFS, a ZNS-aware user-level file system based on BlueFS to update the metadata on the ZNS SSD without a conventional SSD. Finally, we propose a delta write technique, DeltaWriter, which writes only a modified part of the metadata (i.e., onode) to reduce read–modify–write overhead whenever the metadata are updated. We implement zCeph with four techniques based on Ceph, an open-source distributed file system. Further, we evaluate zCeph on a pair of 48-core machines with ZNS SSDs using micro and macro benchmarks, and the results reveal that zCeph improves performance by up to 4.2× and 8.8× compared with Ceph, respectively.

Abstract Image

查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
zCeph:一个zns友好的分布式文件系统的设计和实现
本文介绍了zCeph,这是一个ZNS友好的分布式文件系统,旨在有效地利用分区命名空间(ZNS) ssd。具体来说,我们首先提出了MZAllocator,它可以同时利用多个区域,以最大限度地提高ZNS ssd的性能。其次,我们采用了一个append命令来消除分布式存储系统中写顺序同步的需要,以提高可伸缩性。第三,我们提出了zBlueFS,这是一个基于BlueFS的ZNS感知用户级文件系统,可以在没有传统SSD的情况下更新ZNS SSD上的元数据。最后,我们提出了一种增量写入技术,DeltaWriter,它只写入元数据的修改部分(即onode),以减少元数据更新时的读-修改-写开销。我们使用基于Ceph的四种技术来实现zCeph, Ceph是一个开源的分布式文件系统。此外,我们在一对使用ZNS ssd的48核机器上使用微观和宏观基准测试来评估zCeph,结果表明zCeph与Ceph相比分别提高了4.2倍和8.8倍的性能。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
CiteScore
19.90
自引率
2.70%
发文量
376
审稿时长
10.6 months
期刊介绍: Computing infrastructures and systems are constantly evolving, resulting in increasingly complex and collaborative scientific applications. To cope with these advancements, there is a growing need for collaborative tools that can effectively map, control, and execute these applications. Furthermore, with the explosion of Big Data, there is a requirement for innovative methods and infrastructures to collect, analyze, and derive meaningful insights from the vast amount of data generated. This necessitates the integration of computational and storage capabilities, databases, sensors, and human collaboration. Future Generation Computer Systems aims to pioneer advancements in distributed systems, collaborative environments, high-performance computing, and Big Data analytics. It strives to stay at the forefront of developments in grids, clouds, and the Internet of Things (IoT) to effectively address the challenges posed by these wide-area, fully distributed sensing and computing systems.
期刊最新文献
A Swarm Intelligence Enabled Multi-agent Reinforcement Learning Scheme for Computational Task Offloading in Internet of Things Blockchain KnowAIDE: a FAIR-Compliant Data Environment to Accelerate AI Research Non-Intrusive Kernel-level Dispatching for MQTT Shared Subscriptions On the integration of Domain Adaptation and Causal Discovery in Digital Twins: A Case Study for Plastic Injection Molding GenSecure-CAEV: A Generative AI Framework for Proactive Vulnerability Discovery in Connected Autonomous Electric Vehicles
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1