{"title":"Research and Practice of Distributed Parallel Search Algorithm on Hadoop_MapReduce","authors":"Ailing Duan, H. Si","doi":"10.1109/ICCECT.2012.131","DOIUrl":null,"url":null,"abstract":"Hadoop_Mapreduce is winning more and more attention with its open source distributed parallel computing technology, high efficiency and economy. This paper describes the Hadoop_Mapreduce and its related technologies, studies in detail the thought behind the Hadoop_MapReduce algorithm and the system architecture, and for the field of internet search relating massive amounts of data, discusses the algorithm parallelization method of the algorithm and its feasibility, and applies MapReduce model on the Hadoop platform to realize inverted index by means of parallelization.","PeriodicalId":153613,"journal":{"name":"2012 International Conference on Control Engineering and Communication Technology","volume":"51 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2012-12-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"8","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2012 International Conference on Control Engineering and Communication Technology","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ICCECT.2012.131","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 8
Abstract
Hadoop_Mapreduce is winning more and more attention with its open source distributed parallel computing technology, high efficiency and economy. This paper describes the Hadoop_Mapreduce and its related technologies, studies in detail the thought behind the Hadoop_MapReduce algorithm and the system architecture, and for the field of internet search relating massive amounts of data, discusses the algorithm parallelization method of the algorithm and its feasibility, and applies MapReduce model on the Hadoop platform to realize inverted index by means of parallelization.