An autonomous configuration scheme of storage tiers for distributed file system

2017 18th IEEE/ACIS International Conference on Software Engineering, Artificial Intelligence, Networking and Parallel/Distributed Computing (SNPD) Pub Date : 2017-06-01 DOI:10.1109/SNPD.2017.8022761

S. Shimano, Atsushi Nunome, Y. Yokoi, Kiyoshi Shibayama, Hiroaki Hirata

{"title":"An autonomous configuration scheme of storage tiers for distributed file system","authors":"S. Shimano, Atsushi Nunome, Y. Yokoi, Kiyoshi Shibayama, Hiroaki Hirata","doi":"10.1109/SNPD.2017.8022761","DOIUrl":null,"url":null,"abstract":"We have proposed a distributed storage system which dynamically makes storage tiers and optimizes location of data blocks autonomously. This aims to enhance the I/O performance of the storage system without remarkable network overhead. Our system dynamically organizes storage tiers considering device characteristics. And the data blocks will be placed in a suitable storage tier according to their access pattern. In this paper, we propose a method to select the destination storage node for migration using an access characteristic of a data block to be migrated. This method ranks the storage nodes dynamically, and each storage node configures storage tiers autonomously. Simulation results show that our scheme can short the execution time of a program with file I/O by 49% at maximum, in comparison with the static migration without considering the access characteristics of the migration data.","PeriodicalId":186094,"journal":{"name":"2017 18th IEEE/ACIS International Conference on Software Engineering, Artificial Intelligence, Networking and Parallel/Distributed Computing (SNPD)","volume":"1 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2017-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2017 18th IEEE/ACIS International Conference on Software Engineering, Artificial Intelligence, Networking and Parallel/Distributed Computing (SNPD)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/SNPD.2017.8022761","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}

引用次数: 1

Abstract

We have proposed a distributed storage system which dynamically makes storage tiers and optimizes location of data blocks autonomously. This aims to enhance the I/O performance of the storage system without remarkable network overhead. Our system dynamically organizes storage tiers considering device characteristics. And the data blocks will be placed in a suitable storage tier according to their access pattern. In this paper, we propose a method to select the destination storage node for migration using an access characteristic of a data block to be migrated. This method ranks the storage nodes dynamically, and each storage node configures storage tiers autonomously. Simulation results show that our scheme can short the execution time of a program with file I/O by 49% at maximum, in comparison with the static migration without considering the access characteristics of the migration data.

查看原文

微信好友朋友圈 QQ好友复制链接

本刊更多论文

分布式文件系统存储层的自治配置方案

我们提出了一种分布式存储系统，它可以动态地划分存储层，并自主地优化数据块的位置。这样做的目的是在不增加网络开销的情况下提高存储系统的I/O性能。我们的系统根据设备特性动态组织存储层。根据数据块的访问模式，将数据块放置在合适的存储层中。在本文中，我们提出了一种利用待迁移数据块的访问特性来选择迁移目标存储节点的方法。该方法对存储节点进行动态排序，每个存储节点自主配置存储层。仿真结果表明，与不考虑迁移数据的访问特性的静态迁移相比，该方案最多可使具有文件I/O的程序的执行时间缩短49%。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文去求助

来源期刊

2017 18th IEEE/ACIS International Conference on Software Engineering, Artificial Intelligence, Networking and Parallel/Distributed Computing (SNPD)

自引率

0.00%

发文量