Big Data retrieval techniques based on Hash Indexing and MapReduce approach with NoSQL Database

Abstract

As the size of the data grows enormous day by day, there are challenges in storing, sorting and quick accessibility of the data. In order to overcome these challenges indexing of Big Data were made predominant so that these data can be ordered, addressed and located easily. Though there are lot of techniques to index data and map them, each has its own advantages and issues over its performance across various kinds of data. Two different techniques for Big Data retrieval namely MapReduce, a way of simplifying a huge collection into some useful aggregation values and Hash indexing, which is a method of generating key and storing the value of the tuples so that the data are addressed by the generated key on its tuples is compared using NoSQL database. An analysis is made to examine the retrieval efficiency of the data which are of varying size from the whole dataset and limiting the data to be retrieved using predicates through search queries is performed. The comparison is made using both singleton and distributed NoSQL MongoDB.