Mass Information Index Design Based on MapReduce

Abstract

With the rapid development of social informatization, there is a lot of new data generated every day, the focus of the IT industry is how to quickly find out the information you need. Inverted index based on MapReduce technology can achieve rapid retrieval, and it is a common index structure in the index engine information retrieval systems. At the same time, mass data need to be in a distributed platform for storage and processing, the corresponding file inverted index structure also needs to be run in a distributed platform, and MapReduce is currently the most common used technology of inverted index structure. Mass information index based on MapReduce is quicker, more convenient and suitable than the traditional index.