Data analytics applications are deployed on large-scale distributed systems. In order to ensure high performance, troubleshooting for such applications and underlying systems is critical. In this thesis, we focus on efficient log analysis for troubleshooting distributed data analytics systems. We made the following contributions. 1) We designed a tool that collects logs and resource metrics of distributed data analytics systems to facilitate troubleshooting processes. 2) We designed a log analysis tool that is able to extract semantic meaning from logs and automatically report potential anomalies by leveraging natural language processing approaches.
{"title":"Troubleshooting distributed data analytics systems","authors":"Aidi Pi","doi":"10.1145/3366624.3368157","DOIUrl":"https://doi.org/10.1145/3366624.3368157","url":null,"abstract":"Data analytics applications are deployed on large-scale distributed systems. In order to ensure high performance, troubleshooting for such applications and underlying systems is critical. In this thesis, we focus on efficient log analysis for troubleshooting distributed data analytics systems. We made the following contributions. 1) We designed a tool that collects logs and resource metrics of distributed data analytics systems to facilitate troubleshooting processes. 2) We designed a log analysis tool that is able to extract semantic meaning from logs and automatically report potential anomalies by leveraging natural language processing approaches.","PeriodicalId":376496,"journal":{"name":"Proceedings of the 20th International Middleware Conference Doctoral Symposium","volume":"46 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-12-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124298827","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Collaborations across companies can improve revenue, productivity and customer relationship building. Therefore, it could be desirable to allow customers to exchange digital resources across organizations, e.g. to let customers collect and spend loyalty points across stores. In order to allow such exchange of resources, a secure and trustable environment, where customers are in full control of their resources, is required. In this PhD work, we will develop a generic framework for supporting the set-up of such exchange platforms by providing core functionality in combination with components that can be configured to the specific needs of the use cases.
{"title":"A trustable platform for exchange of resources across organizations and their customers","authors":"Kushal Soni","doi":"10.1145/3366624.3368160","DOIUrl":"https://doi.org/10.1145/3366624.3368160","url":null,"abstract":"Collaborations across companies can improve revenue, productivity and customer relationship building. Therefore, it could be desirable to allow customers to exchange digital resources across organizations, e.g. to let customers collect and spend loyalty points across stores. In order to allow such exchange of resources, a secure and trustable environment, where customers are in full control of their resources, is required. In this PhD work, we will develop a generic framework for supporting the set-up of such exchange platforms by providing core functionality in combination with components that can be configured to the specific needs of the use cases.","PeriodicalId":376496,"journal":{"name":"Proceedings of the 20th International Middleware Conference Doctoral Symposium","volume":"69 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-12-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125640274","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Publish-subscribe systems are the backbone for communications in distributed systems. Traditionally, publish-subscribe systems have evolved based on message topics and content. Our research is based on recent idea of graph-based publish-subscribe idea and to extend it to large dynamic graphs. Large dynamic graphs have far reaching applications and we believe graph-based publish-subscribe will benefit these applications by providing expressive semantics and optimized implementations. Our work will focus on two applications namely, Traffic navigation and Knowledge graphs which are modelled as dynamic graphs. We will formalize the notion of graph-based publish-subscribe, implement full-pledged systems, and run experiments to demonstrate the efficiencies gained.
{"title":"Publish-subscribe systems over large dynamic graphs","authors":"Suhail Kandanur","doi":"10.1145/3366624.3368162","DOIUrl":"https://doi.org/10.1145/3366624.3368162","url":null,"abstract":"Publish-subscribe systems are the backbone for communications in distributed systems. Traditionally, publish-subscribe systems have evolved based on message topics and content. Our research is based on recent idea of graph-based publish-subscribe idea and to extend it to large dynamic graphs. Large dynamic graphs have far reaching applications and we believe graph-based publish-subscribe will benefit these applications by providing expressive semantics and optimized implementations. Our work will focus on two applications namely, Traffic navigation and Knowledge graphs which are modelled as dynamic graphs. We will formalize the notion of graph-based publish-subscribe, implement full-pledged systems, and run experiments to demonstrate the efficiencies gained.","PeriodicalId":376496,"journal":{"name":"Proceedings of the 20th International Middleware Conference Doctoral Symposium","volume":"192 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-12-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132840482","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
The computation required by permissionless blockchains to securely moderate the block proposal rate is wasteful both in terms of energy and computation. We present BlockML, an alternative system that replaces Bitcoin's crypto puzzle with the training of Machine Learning (ML) models, providing a useful side product to the consensus protocol of permissionless blockchains.
{"title":"BlockML","authors":"Andrea Merlina","doi":"10.1145/3366624.3368156","DOIUrl":"https://doi.org/10.1145/3366624.3368156","url":null,"abstract":"The computation required by permissionless blockchains to securely moderate the block proposal rate is wasteful both in terms of energy and computation. We present BlockML, an alternative system that replaces Bitcoin's crypto puzzle with the training of Machine Learning (ML) models, providing a useful side product to the consensus protocol of permissionless blockchains.","PeriodicalId":376496,"journal":{"name":"Proceedings of the 20th International Middleware Conference Doctoral Symposium","volume":"228 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-12-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128595190","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Transaction processing has been an active area of research for several decades. A fundamental characteristic of classical transaction processing protocols is non-determinism, which causes them to suffer from performance issues on modern computing environments such as main-memory databases using many-core, and multi-socket CPUs and distributed environments. Recent proposals of deterministic transaction processing techniques have shown great potential in addressing these performance issues. In this position paper, I argue for a queue-oriented transaction processing paradigm that leads to better design and implementation of deterministic transaction processing protocols. I support my approach with extensive experimental evaluations and demonstrate significant performance gains.
{"title":"A queue-oriented transaction processing paradigm","authors":"Thamir M. Qadah","doi":"10.1145/3366624.3368163","DOIUrl":"https://doi.org/10.1145/3366624.3368163","url":null,"abstract":"Transaction processing has been an active area of research for several decades. A fundamental characteristic of classical transaction processing protocols is non-determinism, which causes them to suffer from performance issues on modern computing environments such as main-memory databases using many-core, and multi-socket CPUs and distributed environments. Recent proposals of deterministic transaction processing techniques have shown great potential in addressing these performance issues. In this position paper, I argue for a queue-oriented transaction processing paradigm that leads to better design and implementation of deterministic transaction processing protocols. I support my approach with extensive experimental evaluations and demonstrate significant performance gains.","PeriodicalId":376496,"journal":{"name":"Proceedings of the 20th International Middleware Conference Doctoral Symposium","volume":"60 1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-10-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124318830","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Proceedings of the 20th International Middleware Conference Doctoral Symposium","authors":"","doi":"10.1145/3366624","DOIUrl":"https://doi.org/10.1145/3366624","url":null,"abstract":"","PeriodicalId":376496,"journal":{"name":"Proceedings of the 20th International Middleware Conference Doctoral Symposium","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1900-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130188610","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
京公网安备 11010802042870号
京ICP备2023020795号-1
扫码关注我们
求助内容：
应助结果提醒方式：