EDOS: Employing Mini-DB for High Semantic Object Store

Abstract

Storage management server, compatible with decoupled data and meta data fashion, is being employed frantically to build large-scale distributed storage system for performance and capacity. To design this hot commodity on flexibly managing the extracted data with little meta data but extended attributes has become a big challenge. This paper breaks a new way to object orient store and implement the dedicated prototype, called EDOS. We reexamine several new requirements and prior works, and employ Mini-DB as the back-end (\emph{like DBFS}) to guarantee the scalability and durability for EDOS. We design three kinds of object locators and multi-indices to improve retrieval performance and absorb random I/O, utilize a swap mechanism between internal and external objects for tunable throughput, which nested beneath the generic key-value database schema and benefited from memory pool technique. The replication component in Mini-DB helps to build the multi nodes in the distributed environment. It is easy to build up the object-based distributed file system by EDOS with ACID transaction semantics and high reliability. The experimental results show that our kernel-level implementation of EDOS performed better than the other existences in practice.