{"title":"A Map Reduce Based Parallel Algorithm","authors":"Priyanka Gupta, Vinaya Sawant","doi":"10.51201/jusst12486","DOIUrl":null,"url":null,"abstract":"In Today’s world, Big Data became a vital role in our way of life. Growing rapidly and logical algorithms that will handle large datasets becoming a challenging task. This paper aim is to explain the HadoopMap Reduce Framework with Association rule Mining. One of the famous algorithm of ARM is that the Apriori algorithm, which is implemented in MapReduce artificial language, which is executed on the Hadoop framework. These rules are tradition to observe facts that always occur along with datasets. Using association rule, an issue arises when data becomes enormous. To beat this situation they used Hadoop. This paper provides an outline of the Hadoop – MapReduce framework. Our big challenge of this paper are to resolve the matter of scalability, apart from the other problems are execution time and communication overhead. This paper will solve the matter of reliable, scalable and distributed computing. Keywords—Data Mining, Association Rule Mining, Apriori Algorithm, Big Data, Hadoop, MapReduce","PeriodicalId":17520,"journal":{"name":"Journal of the University of Shanghai for Science and Technology","volume":"1 1","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2020-12-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of the University of Shanghai for Science and Technology","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.51201/jusst12486","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 1
Abstract
In Today’s world, Big Data became a vital role in our way of life. Growing rapidly and logical algorithms that will handle large datasets becoming a challenging task. This paper aim is to explain the HadoopMap Reduce Framework with Association rule Mining. One of the famous algorithm of ARM is that the Apriori algorithm, which is implemented in MapReduce artificial language, which is executed on the Hadoop framework. These rules are tradition to observe facts that always occur along with datasets. Using association rule, an issue arises when data becomes enormous. To beat this situation they used Hadoop. This paper provides an outline of the Hadoop – MapReduce framework. Our big challenge of this paper are to resolve the matter of scalability, apart from the other problems are execution time and communication overhead. This paper will solve the matter of reliable, scalable and distributed computing. Keywords—Data Mining, Association Rule Mining, Apriori Algorithm, Big Data, Hadoop, MapReduce