Zhenghua Xue, Jianhui Li, Yuanchun Zhou, Yang Zhang, Geng Shen
{"title":"An Open Job Scheduling Service for Large-Scale Data Processing","authors":"Zhenghua Xue, Jianhui Li, Yuanchun Zhou, Yang Zhang, Geng Shen","doi":"10.1109/OCS.2011.11","DOIUrl":null,"url":null,"abstract":"Scientific Data Grid (SDG) of Chinese Academy of Sciences aims at integrating distributed scientific data, providing transparent data access mechanism and efficient data analysis, processing and visualization services. SDG Job Scheduler (SDGJS) adopts an open and service-oriented framework. The scheduling policy of SDGJS considers both performance of computing nodes and distribution of large data so that it can achieve an efficient job processing. SDGJS has successfully served for some data grid applications.","PeriodicalId":346897,"journal":{"name":"2011 Sixth Open Cirrus Summit","volume":"8 5 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2011-10-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2011 Sixth Open Cirrus Summit","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/OCS.2011.11","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
Abstract
Scientific Data Grid (SDG) of Chinese Academy of Sciences aims at integrating distributed scientific data, providing transparent data access mechanism and efficient data analysis, processing and visualization services. SDG Job Scheduler (SDGJS) adopts an open and service-oriented framework. The scheduling policy of SDGJS considers both performance of computing nodes and distribution of large data so that it can achieve an efficient job processing. SDGJS has successfully served for some data grid applications.