{"title":"基于MapReduce的数据密集型计算模型","authors":"A. Adamov","doi":"10.1109/AICT50176.2020.9368841","DOIUrl":null,"url":null,"abstract":"It becomes obvious that traditional platforms and processing paradigms can’t store and process huge amounts of data. The only solution is to use specially designed ad-hoc platform/architecture based on parallelization that distributes data across large cluster of physical machines. Data Intensive Computing is a subclass of general parallel computing concept which is based on division of large amounts of data into independent parts and processing them in parallel. In the paper the alternative parallelization architectures are reviewed. MapReduce Programming model associated with distributed massive parallel processing of large amount of data is examined. The main objective of this study is to investigate conceptual fundament behind very popular data-drive computation model MapReduce.","PeriodicalId":136491,"journal":{"name":"2020 IEEE 14th International Conference on Application of Information and Communication Technologies (AICT)","volume":"15 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2020-10-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":"{\"title\":\"Computation Model of Data Intensive Computing with MapReduce\",\"authors\":\"A. Adamov\",\"doi\":\"10.1109/AICT50176.2020.9368841\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"It becomes obvious that traditional platforms and processing paradigms can’t store and process huge amounts of data. The only solution is to use specially designed ad-hoc platform/architecture based on parallelization that distributes data across large cluster of physical machines. Data Intensive Computing is a subclass of general parallel computing concept which is based on division of large amounts of data into independent parts and processing them in parallel. In the paper the alternative parallelization architectures are reviewed. MapReduce Programming model associated with distributed massive parallel processing of large amount of data is examined. The main objective of this study is to investigate conceptual fundament behind very popular data-drive computation model MapReduce.\",\"PeriodicalId\":136491,\"journal\":{\"name\":\"2020 IEEE 14th International Conference on Application of Information and Communication Technologies (AICT)\",\"volume\":\"15 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2020-10-07\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"1\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2020 IEEE 14th International Conference on Application of Information and Communication Technologies (AICT)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/AICT50176.2020.9368841\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2020 IEEE 14th International Conference on Application of Information and Communication Technologies (AICT)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/AICT50176.2020.9368841","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Computation Model of Data Intensive Computing with MapReduce
It becomes obvious that traditional platforms and processing paradigms can’t store and process huge amounts of data. The only solution is to use specially designed ad-hoc platform/architecture based on parallelization that distributes data across large cluster of physical machines. Data Intensive Computing is a subclass of general parallel computing concept which is based on division of large amounts of data into independent parts and processing them in parallel. In the paper the alternative parallelization architectures are reviewed. MapReduce Programming model associated with distributed massive parallel processing of large amount of data is examined. The main objective of this study is to investigate conceptual fundament behind very popular data-drive computation model MapReduce.