{"title":"现代数据仓库中的数据建模:新分析平台中上下文中模型的比较","authors":"Raissa SILVA MENEZES DE SANTANA","doi":"10.35265/2236-6717-234-12613","DOIUrl":null,"url":null,"abstract":"After the second half of the 1980s, companies only stored data from their transactional systems. However, naturally, the need arose to obtain metrics based on data that could support decision makers in their management activities. As a result, several types of Decision Support Systems were developed, such as Data Warehouses. This is a technology in which data is extracted from transactional systems, subsequently transformed and loaded into a database. In this way, end users were able to perform analyses from multiple perspectives through a single, integrated source of data. This was a successful model for a long time, until the 2000s saw an exponential growth in the amount and variety of data generated by organizations. This spurred the development of technologies for distributed storage and processing such as Hadoop, and then cloud computing platforms such as Azure, AWS, and Google Cloud. This new context of analytical environments has brought about important changes, such as a significant decrease in data storage costs and the decoupling of processing and storage. In view of this, it is natural to ask questions such as: do traditional data models like Star Schema still make sense nowadays or is the best option to embrace bolder proposals like One Big Table? When investigating what data professionals are thinking about the subject, one realizes that there is no consensus around the topic. This is because each specific case presents its own peculiarities, so that no model will meet the needs of all situations. However, despite these limitations, it is possible to achieve a balanced result between storage, maintenance, and performance by knowing the advantages and disadvantages presented by each of them.","PeriodicalId":21289,"journal":{"name":"Revista Científica Semana Acadêmica","volume":"47 1","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2023-06-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"MODELAGEM DE DADOS EM DATA WAREHOUSES MODERNOS: COMPARAÇÃO ENTRE MODELOS NO CONTEXTO NAS NOVAS PLATAFORMAS ANALÍTICAS\",\"authors\":\"Raissa SILVA MENEZES DE SANTANA\",\"doi\":\"10.35265/2236-6717-234-12613\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"After the second half of the 1980s, companies only stored data from their transactional systems. However, naturally, the need arose to obtain metrics based on data that could support decision makers in their management activities. As a result, several types of Decision Support Systems were developed, such as Data Warehouses. This is a technology in which data is extracted from transactional systems, subsequently transformed and loaded into a database. In this way, end users were able to perform analyses from multiple perspectives through a single, integrated source of data. This was a successful model for a long time, until the 2000s saw an exponential growth in the amount and variety of data generated by organizations. This spurred the development of technologies for distributed storage and processing such as Hadoop, and then cloud computing platforms such as Azure, AWS, and Google Cloud. This new context of analytical environments has brought about important changes, such as a significant decrease in data storage costs and the decoupling of processing and storage. In view of this, it is natural to ask questions such as: do traditional data models like Star Schema still make sense nowadays or is the best option to embrace bolder proposals like One Big Table? When investigating what data professionals are thinking about the subject, one realizes that there is no consensus around the topic. This is because each specific case presents its own peculiarities, so that no model will meet the needs of all situations. However, despite these limitations, it is possible to achieve a balanced result between storage, maintenance, and performance by knowing the advantages and disadvantages presented by each of them.\",\"PeriodicalId\":21289,\"journal\":{\"name\":\"Revista Científica Semana Acadêmica\",\"volume\":\"47 1\",\"pages\":\"\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2023-06-06\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Revista Científica Semana Acadêmica\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.35265/2236-6717-234-12613\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Revista Científica Semana Acadêmica","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.35265/2236-6717-234-12613","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
摘要
在20世纪80年代后半期之后,公司只存储来自其事务系统的数据。然而,自然地,需要获得基于数据的度量,这些数据可以支持决策者的管理活动。因此,开发了几种类型的决策支持系统,例如数据仓库。这是一种从事务系统中提取数据的技术,随后转换并加载到数据库中。通过这种方式,最终用户能够通过单个集成数据源从多个角度执行分析。在很长一段时间内,这是一个成功的模式,直到2000年代,组织产生的数据数量和种类呈指数级增长。这刺激了分布式存储和处理技术的发展,如Hadoop,然后是云计算平台,如Azure、AWS和Google cloud。这种新的分析环境带来了重要的变化,例如数据存储成本的显著降低以及处理和存储的解耦。考虑到这一点,人们自然会提出这样的问题:像星型模式这样的传统数据模型在今天是否仍然有意义?还是接受像One Big Table这样更大胆的提议的最佳选择?在调查数据专业人员对该主题的看法时,人们意识到围绕该主题没有达成共识。这是因为每个具体的案例都有自己的特点,所以没有一个模型能够满足所有情况的需要。然而,尽管存在这些限制,通过了解存储、维护和性能各自的优缺点,还是有可能在存储、维护和性能之间取得平衡。
MODELAGEM DE DADOS EM DATA WAREHOUSES MODERNOS: COMPARAÇÃO ENTRE MODELOS NO CONTEXTO NAS NOVAS PLATAFORMAS ANALÍTICAS
After the second half of the 1980s, companies only stored data from their transactional systems. However, naturally, the need arose to obtain metrics based on data that could support decision makers in their management activities. As a result, several types of Decision Support Systems were developed, such as Data Warehouses. This is a technology in which data is extracted from transactional systems, subsequently transformed and loaded into a database. In this way, end users were able to perform analyses from multiple perspectives through a single, integrated source of data. This was a successful model for a long time, until the 2000s saw an exponential growth in the amount and variety of data generated by organizations. This spurred the development of technologies for distributed storage and processing such as Hadoop, and then cloud computing platforms such as Azure, AWS, and Google Cloud. This new context of analytical environments has brought about important changes, such as a significant decrease in data storage costs and the decoupling of processing and storage. In view of this, it is natural to ask questions such as: do traditional data models like Star Schema still make sense nowadays or is the best option to embrace bolder proposals like One Big Table? When investigating what data professionals are thinking about the subject, one realizes that there is no consensus around the topic. This is because each specific case presents its own peculiarities, so that no model will meet the needs of all situations. However, despite these limitations, it is possible to achieve a balanced result between storage, maintenance, and performance by knowing the advantages and disadvantages presented by each of them.