Software systems for processing and analysis of big data and event streams

Abstract

Advances in sensor technologies, mobile positioning, IoT and wireless communications have led to development of applications for data collection, processing, analysis, mining and visualization for the purposes of real time responses and decision support, but have also brought new challenges to processing large amount of data in a real time. Various software systems are developed to provide a set of methods, technologies, algorithms and index structures for effective monitoring, processing, analysis and mining of continuous flow of data and events. This paper reviews recent developments in the field of data streams processing and analysis, gives an overview of existing systems and technologies, and demonstrates development of a stream processing application based on the contemporary stream processing frameworks.