Basirudin Djamaluddin, P. Prabhakar, Baburaj James, Anas Muzakir, Hussain AlMayad
{"title":"基于多维方法和面向列存储的实时钻井作业活动分析数据建模","authors":"Basirudin Djamaluddin, P. Prabhakar, Baburaj James, Anas Muzakir, Hussain AlMayad","doi":"10.2118/194701-MS","DOIUrl":null,"url":null,"abstract":"\n Real-time data stream in the format of WITSML which can have frequency as low as 1 Hz is one of the best candidate to produce KPIs for the drilling operation activity. The KPIs generated from this calculation will have a relationship with other information from other data sources, known as metadata.\n The question is how can this KPI information be utilized for further analysis, wider/more complex analysis process which needs to be combined with metadata? An OLTP model is not the recommended model for data analytics but OLAP is. Another question is how will this data be stored in terms of the physical storage? We argue to use column-oriented for the physical storage which can perform analytical queries 10x to 30x faster than the row-oriented storage.\n The implementation of an OLAP model for storing KPIs data is proven to improve the performance of the analytical query significantly and combined with the implementation of column-oriented in the OLAP model improves more performance. This concludes that the implementation of OLAP with column-oriented data model can be used as the solid foundation for storing KPI data.","PeriodicalId":11321,"journal":{"name":"Day 3 Wed, March 20, 2019","volume":null,"pages":null},"PeriodicalIF":0.0000,"publicationDate":"2019-03-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"3","resultStr":"{\"title\":\"Real-Time Drilling Operation Activity Analysis Data Modelling with Multidimensional Approach and Column-Oriented Storage\",\"authors\":\"Basirudin Djamaluddin, P. Prabhakar, Baburaj James, Anas Muzakir, Hussain AlMayad\",\"doi\":\"10.2118/194701-MS\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"\\n Real-time data stream in the format of WITSML which can have frequency as low as 1 Hz is one of the best candidate to produce KPIs for the drilling operation activity. The KPIs generated from this calculation will have a relationship with other information from other data sources, known as metadata.\\n The question is how can this KPI information be utilized for further analysis, wider/more complex analysis process which needs to be combined with metadata? An OLTP model is not the recommended model for data analytics but OLAP is. Another question is how will this data be stored in terms of the physical storage? We argue to use column-oriented for the physical storage which can perform analytical queries 10x to 30x faster than the row-oriented storage.\\n The implementation of an OLAP model for storing KPIs data is proven to improve the performance of the analytical query significantly and combined with the implementation of column-oriented in the OLAP model improves more performance. This concludes that the implementation of OLAP with column-oriented data model can be used as the solid foundation for storing KPI data.\",\"PeriodicalId\":11321,\"journal\":{\"name\":\"Day 3 Wed, March 20, 2019\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2019-03-15\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"3\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Day 3 Wed, March 20, 2019\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.2118/194701-MS\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Day 3 Wed, March 20, 2019","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.2118/194701-MS","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Real-Time Drilling Operation Activity Analysis Data Modelling with Multidimensional Approach and Column-Oriented Storage
Real-time data stream in the format of WITSML which can have frequency as low as 1 Hz is one of the best candidate to produce KPIs for the drilling operation activity. The KPIs generated from this calculation will have a relationship with other information from other data sources, known as metadata.
The question is how can this KPI information be utilized for further analysis, wider/more complex analysis process which needs to be combined with metadata? An OLTP model is not the recommended model for data analytics but OLAP is. Another question is how will this data be stored in terms of the physical storage? We argue to use column-oriented for the physical storage which can perform analytical queries 10x to 30x faster than the row-oriented storage.
The implementation of an OLAP model for storing KPIs data is proven to improve the performance of the analytical query significantly and combined with the implementation of column-oriented in the OLAP model improves more performance. This concludes that the implementation of OLAP with column-oriented data model can be used as the solid foundation for storing KPI data.