{"title":"基于开源技术的ETL流程开发,解决数据向消费者传递的问题","authors":"V.V. Starkov, S.S. Gorbatova, V.I. Vodolaga","doi":"10.17759/mda.2023130210","DOIUrl":null,"url":null,"abstract":"<p>The article discusses the issues of developing an ETL process for a data warehouse based on open source technologies, instead of private software supplied by the vendor. The process allows you to deliver data from the source to the consumer, focusing on the speed of delivery, the resources spent and the convenience of development. The architecture for solving the problem with a description of the processes being replaced is presented, data transmission over a new process is implemented. Modern tools used to work with data are involved, methods of interaction with them and selection of technical characteristics for the process are described.</p>","PeriodicalId":498071,"journal":{"name":"Modelirovanie i analiz dannyh","volume":"37 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2023-05-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Development of an ETL Process Based on Open Source Technologies to Solve the Problem of Data Delivery to Consumers\",\"authors\":\"V.V. Starkov, S.S. Gorbatova, V.I. Vodolaga\",\"doi\":\"10.17759/mda.2023130210\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p>The article discusses the issues of developing an ETL process for a data warehouse based on open source technologies, instead of private software supplied by the vendor. The process allows you to deliver data from the source to the consumer, focusing on the speed of delivery, the resources spent and the convenience of development. The architecture for solving the problem with a description of the processes being replaced is presented, data transmission over a new process is implemented. Modern tools used to work with data are involved, methods of interaction with them and selection of technical characteristics for the process are described.</p>\",\"PeriodicalId\":498071,\"journal\":{\"name\":\"Modelirovanie i analiz dannyh\",\"volume\":\"37 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2023-05-12\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Modelirovanie i analiz dannyh\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.17759/mda.2023130210\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Modelirovanie i analiz dannyh","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.17759/mda.2023130210","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Development of an ETL Process Based on Open Source Technologies to Solve the Problem of Data Delivery to Consumers
The article discusses the issues of developing an ETL process for a data warehouse based on open source technologies, instead of private software supplied by the vendor. The process allows you to deliver data from the source to the consumer, focusing on the speed of delivery, the resources spent and the convenience of development. The architecture for solving the problem with a description of the processes being replaced is presented, data transmission over a new process is implemented. Modern tools used to work with data are involved, methods of interaction with them and selection of technical characteristics for the process are described.