{"title":"用于社交网络分析的MapReduce设计模式","authors":"D. Ostrowski","doi":"10.1109/ICSC.2014.61","DOIUrl":null,"url":null,"abstract":"The MapReduce paradigm has become ubiquitous within Big Data Analytics. Within this field, Social Networks exist as an important area of applications as it relies on the large scale analysis of graphs. To enable the scalability of Social Networks, we consider the application of MapReduce design patterns for the determination of graph-based metrics. Specifically, we detail the application of a MapReduce-based solution for the metric of betweenness-centrality. The prevailing concept is separation of the graph topology from the actual graph analysis. Here, we consider the chaining of MapReduce jobs for the estimation of shortest paths in a graph as well as post processing statistics. Through our design pattern, we are able to leverage Big Data Technologies to determine metrics in the context of ever expanding internet-based data resources.","PeriodicalId":175352,"journal":{"name":"2014 IEEE International Conference on Semantic Computing","volume":"37 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2014-06-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"8","resultStr":"{\"title\":\"MapReduce Design Patterns for Social Networking Analysis\",\"authors\":\"D. Ostrowski\",\"doi\":\"10.1109/ICSC.2014.61\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"The MapReduce paradigm has become ubiquitous within Big Data Analytics. Within this field, Social Networks exist as an important area of applications as it relies on the large scale analysis of graphs. To enable the scalability of Social Networks, we consider the application of MapReduce design patterns for the determination of graph-based metrics. Specifically, we detail the application of a MapReduce-based solution for the metric of betweenness-centrality. The prevailing concept is separation of the graph topology from the actual graph analysis. Here, we consider the chaining of MapReduce jobs for the estimation of shortest paths in a graph as well as post processing statistics. Through our design pattern, we are able to leverage Big Data Technologies to determine metrics in the context of ever expanding internet-based data resources.\",\"PeriodicalId\":175352,\"journal\":{\"name\":\"2014 IEEE International Conference on Semantic Computing\",\"volume\":\"37 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2014-06-16\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"8\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2014 IEEE International Conference on Semantic Computing\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/ICSC.2014.61\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2014 IEEE International Conference on Semantic Computing","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ICSC.2014.61","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
MapReduce Design Patterns for Social Networking Analysis
The MapReduce paradigm has become ubiquitous within Big Data Analytics. Within this field, Social Networks exist as an important area of applications as it relies on the large scale analysis of graphs. To enable the scalability of Social Networks, we consider the application of MapReduce design patterns for the determination of graph-based metrics. Specifically, we detail the application of a MapReduce-based solution for the metric of betweenness-centrality. The prevailing concept is separation of the graph topology from the actual graph analysis. Here, we consider the chaining of MapReduce jobs for the estimation of shortest paths in a graph as well as post processing statistics. Through our design pattern, we are able to leverage Big Data Technologies to determine metrics in the context of ever expanding internet-based data resources.