面向大数据环境下的提取-转换-加载操作

Int. J. Sociotechnology Knowl. Dev. Pub Date : 2020-04-01 DOI:10.4018/ijskd.2020040105

Hana Mallek, Faïza Ghozzi, F. Gargouri

{"title":"面向大数据环境下的提取-转换-加载操作","authors":"Hana Mallek, Faïza Ghozzi, F. Gargouri","doi":"10.4018/ijskd.2020040105","DOIUrl":null,"url":null,"abstract":"BigDataemergedafterabigexplosionofdatafromtheWeb2.0,digitalsensors,andsocialmedia applications such as Facebook, Twitter, etc. In this constant growth of data, many domains are influenced, especially thedecisional support systemdomain,where the integrationof processes shouldbeadaptedtosupportthishugeamountofdatatoimproveanalysisgoals.Thebasicpurpose ofthisresearcharticleistoadaptextract-transform-loadprocesseswithBigDatatechnologies,in order tosupportnotonlythisevolutionofdatabutalsotheknowledgediscovery.Inthisarticle, anewapproachcalledBigDimensionalETL(BigDimETL)issuggestedtodealwithETLbasic operationsandtakeintoaccountthemultidimensionalstructure.Inordertoacceleratedatahandling, theMapReduceparadigmisusedtoenhancedatawarehousingcapabilitiesandHBaseasadistributed storagemechanism.ExperimentalresultsconfirmthattheETLoperationperformswellespecially withadaptedoperations. KEywORDS Big Data, ETL, Hbase, Map Reduce, Multidimensional Structure","PeriodicalId":13656,"journal":{"name":"Int. J. Sociotechnology Knowl. Dev.","volume":"96 1","pages":"77-95"},"PeriodicalIF":0.0000,"publicationDate":"2020-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"10","resultStr":"{\"title\":\"Towards Extract-Transform-Load Operations in a Big Data context\",\"authors\":\"Hana Mallek, Faïza Ghozzi, F. Gargouri\",\"doi\":\"10.4018/ijskd.2020040105\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"BigDataemergedafterabigexplosionofdatafromtheWeb2.0,digitalsensors,andsocialmedia applications such as Facebook, Twitter, etc. In this constant growth of data, many domains are influenced, especially thedecisional support systemdomain,where the integrationof processes shouldbeadaptedtosupportthishugeamountofdatatoimproveanalysisgoals.Thebasicpurpose ofthisresearcharticleistoadaptextract-transform-loadprocesseswithBigDatatechnologies,in order tosupportnotonlythisevolutionofdatabutalsotheknowledgediscovery.Inthisarticle, anewapproachcalledBigDimensionalETL(BigDimETL)issuggestedtodealwithETLbasic operationsandtakeintoaccountthemultidimensionalstructure.Inordertoacceleratedatahandling, theMapReduceparadigmisusedtoenhancedatawarehousingcapabilitiesandHBaseasadistributed storagemechanism.ExperimentalresultsconfirmthattheETLoperationperformswellespecially withadaptedoperations. KEywORDS Big Data, ETL, Hbase, Map Reduce, Multidimensional Structure\",\"PeriodicalId\":13656,\"journal\":{\"name\":\"Int. J. Sociotechnology Knowl. Dev.\",\"volume\":\"96 1\",\"pages\":\"77-95\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2020-04-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"10\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Int. J. Sociotechnology Knowl. Dev.\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.4018/ijskd.2020040105\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Int. J. Sociotechnology Knowl. Dev.","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.4018/ijskd.2020040105","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}

引用次数: 10

摘要

BigDataemergedafterabigexplosionofdatafromtheWeb2.0，digitalsensors，andsocialmedia应用程序，如Facebook, Twitter等，在数据的不断增长中，许多领域都受到了影响，特别是thedecisional supportsystemdomain，where theintegrationof processesshouldbeadaptedtosupportthishugeamountofdatatoimproveanalysisgoals。Thebasicpurpose ofthisresearcharticleistoadaptextract-transform-loadprocesseswithBigDatatechnologies，in order_ tosupportnotonlythisevolutionofdatabutalsotheknowledgediscovery。Inthisarticle, anewapproachcalledBigDimensionalETL(BigDimETL)issuggestedtodealwithETLbasic operationsandtakeintoaccountthemultidimensionalstructure。Inordertoacceleratedatahandling, theMapReduceparadigmisusedtoenhancedatawarehousingcapabilitiesandHBaseasadistributed storagemechanism。ExperimentalresultsconfirmthattheETLoperationperformswellespecially withadaptedoperations。关键词:大数据，ETL, Hbase, Map Reduce，多维结构

本文章由计算机程序翻译，如有差异，请以英文原文为准。

查看原文

微信好友朋友圈 QQ好友复制链接

本刊更多论文

Towards Extract-Transform-Load Operations in a Big Data context

BigDataemergedafterabigexplosionofdatafromtheWeb2.0,digitalsensors,andsocialmedia applications such as Facebook, Twitter, etc. In this constant growth of data, many domains are influenced, especially thedecisional support systemdomain,where the integrationof processes shouldbeadaptedtosupportthishugeamountofdatatoimproveanalysisgoals.Thebasicpurpose ofthisresearcharticleistoadaptextract-transform-loadprocesseswithBigDatatechnologies,in order tosupportnotonlythisevolutionofdatabutalsotheknowledgediscovery.Inthisarticle, anewapproachcalledBigDimensionalETL(BigDimETL)issuggestedtodealwithETLbasic operationsandtakeintoaccountthemultidimensionalstructure.Inordertoacceleratedatahandling, theMapReduceparadigmisusedtoenhancedatawarehousingcapabilitiesandHBaseasadistributed storagemechanism.ExperimentalresultsconfirmthattheETLoperationperformswellespecially withadaptedoperations. KEywORDS Big Data, ETL, Hbase, Map Reduce, Multidimensional Structure

求助全文

通过发布文献求助，成功后即可免费获取论文全文。去求助

来源期刊

Int. J. Sociotechnology Knowl. Dev.

自引率

0.00%

发文量