基于分段LSM-Tree的键值存储优化

Kai Zhang, Yongsheng Xia, Yang Xia, Feng Ye
{"title":"基于分段LSM-Tree的键值存储优化","authors":"Kai Zhang, Yongsheng Xia, Yang Xia, Feng Ye","doi":"10.1109/ICCT46805.2019.8947217","DOIUrl":null,"url":null,"abstract":"Storage Engine is the core of the storage system, R/W performance (read and write performance) of the storage system depends on the performance of the storage engine. sLSM-Tree structure (LSM-Tree structure based on the segmented index) is proposed, which is based on the structure of LevelDB. Segmented index structure is introduced to solve the collisions brought by adding hash storage RAM index structure to the index structure parts of LSM-Tree, i.e. trie index and hash index segmentally. By this way, index speed is improved and the pressure of updating index terms by compacting is reduced. The contrast experiment was conducted about the novel segmented index method presented in this paper. From the analysis of experimental results, sLSM-Tree has a significant performance in the RAM index and R/W operation on the hard disk compared with LevelDB which uses conventional LSM-Tree storage engine.","PeriodicalId":306112,"journal":{"name":"2019 IEEE 19th International Conference on Communication Technology (ICCT)","volume":null,"pages":null},"PeriodicalIF":0.0000,"publicationDate":"2019-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"An Optimization of Key-Value Store Based on Segmented LSM-Tree\",\"authors\":\"Kai Zhang, Yongsheng Xia, Yang Xia, Feng Ye\",\"doi\":\"10.1109/ICCT46805.2019.8947217\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Storage Engine is the core of the storage system, R/W performance (read and write performance) of the storage system depends on the performance of the storage engine. sLSM-Tree structure (LSM-Tree structure based on the segmented index) is proposed, which is based on the structure of LevelDB. Segmented index structure is introduced to solve the collisions brought by adding hash storage RAM index structure to the index structure parts of LSM-Tree, i.e. trie index and hash index segmentally. By this way, index speed is improved and the pressure of updating index terms by compacting is reduced. The contrast experiment was conducted about the novel segmented index method presented in this paper. From the analysis of experimental results, sLSM-Tree has a significant performance in the RAM index and R/W operation on the hard disk compared with LevelDB which uses conventional LSM-Tree storage engine.\",\"PeriodicalId\":306112,\"journal\":{\"name\":\"2019 IEEE 19th International Conference on Communication Technology (ICCT)\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2019-10-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2019 IEEE 19th International Conference on Communication Technology (ICCT)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/ICCT46805.2019.8947217\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2019 IEEE 19th International Conference on Communication Technology (ICCT)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ICCT46805.2019.8947217","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

存储引擎是存储系统的核心,存储系统的读写性能(即读写性能)取决于存储引擎的性能。在LevelDB结构的基础上,提出了基于分段索引的sLSM-Tree结构。为了解决LSM-Tree的索引结构部分,即trie索引和hash索引分段添加哈希存储RAM索引结构所带来的冲突,引入了分段索引结构。通过这种方式,提高了索引速度,减少了通过压缩更新索引项的压力。对本文提出的新型分段索引方法进行了对比实验。从实验结果分析来看,与使用传统LSM-Tree存储引擎的LevelDB相比,sLSM-Tree在RAM索引和硬盘读写操作方面具有显著的性能。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
An Optimization of Key-Value Store Based on Segmented LSM-Tree
Storage Engine is the core of the storage system, R/W performance (read and write performance) of the storage system depends on the performance of the storage engine. sLSM-Tree structure (LSM-Tree structure based on the segmented index) is proposed, which is based on the structure of LevelDB. Segmented index structure is introduced to solve the collisions brought by adding hash storage RAM index structure to the index structure parts of LSM-Tree, i.e. trie index and hash index segmentally. By this way, index speed is improved and the pressure of updating index terms by compacting is reduced. The contrast experiment was conducted about the novel segmented index method presented in this paper. From the analysis of experimental results, sLSM-Tree has a significant performance in the RAM index and R/W operation on the hard disk compared with LevelDB which uses conventional LSM-Tree storage engine.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
期刊最新文献
An Improved Sound Source Location Method for MEMS Microphone Array A Spatio-Temporal Traffic Forecasting Model for Base Station in Cellular Network Fall Detection Based on Colorization Coded MHI Combining with Convolutional Neural Network Research on the Application of Visual Cryptography in Cultural and Creative Artworks Performance Comparison and Evaluation of Indoor Positioning Technology Based on Machine Learning Algorithms
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1