{"title":"基于MapReduce的天文数据应用研究","authors":"Qingfa Cui, Sheng-Chuan Wu","doi":"10.1109/IAEAC.2018.8577233","DOIUrl":null,"url":null,"abstract":"MapReduce as an abstract distributed computing programming model could solve the issues of parallel computing, such as load balancing, network storage, data distribution, resource allocation, fault tolerance. This makes it easy for people to manipulate large scale cluster systems without considering hardware details. The paper discusses completely how to apply MapReduce. In the construction of the experimental platform, this paper successfully designs and implements the cone search service based on MapReduce, The final result proves that the astronomical data application method based on MapReduce greatly improves the processing capacity.","PeriodicalId":6573,"journal":{"name":"2018 IEEE 3rd Advanced Information Technology, Electronic and Automation Control Conference (IAEAC)","volume":"31 1","pages":"2345-2348"},"PeriodicalIF":0.0000,"publicationDate":"2018-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":"{\"title\":\"Astronomical Data Application Research Based on MapReduce\",\"authors\":\"Qingfa Cui, Sheng-Chuan Wu\",\"doi\":\"10.1109/IAEAC.2018.8577233\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"MapReduce as an abstract distributed computing programming model could solve the issues of parallel computing, such as load balancing, network storage, data distribution, resource allocation, fault tolerance. This makes it easy for people to manipulate large scale cluster systems without considering hardware details. The paper discusses completely how to apply MapReduce. In the construction of the experimental platform, this paper successfully designs and implements the cone search service based on MapReduce, The final result proves that the astronomical data application method based on MapReduce greatly improves the processing capacity.\",\"PeriodicalId\":6573,\"journal\":{\"name\":\"2018 IEEE 3rd Advanced Information Technology, Electronic and Automation Control Conference (IAEAC)\",\"volume\":\"31 1\",\"pages\":\"2345-2348\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2018-10-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"1\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2018 IEEE 3rd Advanced Information Technology, Electronic and Automation Control Conference (IAEAC)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/IAEAC.2018.8577233\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2018 IEEE 3rd Advanced Information Technology, Electronic and Automation Control Conference (IAEAC)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/IAEAC.2018.8577233","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Astronomical Data Application Research Based on MapReduce
MapReduce as an abstract distributed computing programming model could solve the issues of parallel computing, such as load balancing, network storage, data distribution, resource allocation, fault tolerance. This makes it easy for people to manipulate large scale cluster systems without considering hardware details. The paper discusses completely how to apply MapReduce. In the construction of the experimental platform, this paper successfully designs and implements the cone search service based on MapReduce, The final result proves that the astronomical data application method based on MapReduce greatly improves the processing capacity.