THE ROLE OF BIG DATA IN SYSTEMS ENGINEERING: A REVIEW

Abstract

This research review explores the transformative intersection of Big Data and Systems Engineering (SE), a convergence that leverages the vast capabilities of Big Data analytics to enhance the design, analysis, and management of complex systems. As the digital era ushers in unprecedented volumes of data, traditional systems engineering approaches are challenged to adapt, necessitating a paradigm shift towards integrating Big Data technologies. This review draws on recent scholarly contributions to highlight the implications, challenges, and innovative solutions emerging at this intersection. The integration of Big Data into Systems Engineering introduces significant opportunities for innovation. By processing and analyzing vast datasets, systems engineers can uncover hidden patterns and insights, leading to more efficient, reliable, and adaptable systems. However, this integration is not without its challenges. Information security emerges as a paramount concern, with the risk of insider attacks necessitating the development of new architectural solutions. Furthermore, the benchmarking and evaluation of Big Data systems present unique challenges due to the diversity of data and workloads involved.  To address these challenges, this review examines several key contributions to the field. It discusses a formal framework for designing information systems that handle heterogeneous data, emphasizing the role of ontological models in separating system architecture from its implementation. The review also highlights the importance of security in Big Data systems, proposing a novel architecture for detecting insider attacks through data replication. Additionally, it explores the development of BigDataBench, a benchmark suite that facilitates the comprehensive evaluation of Big Data systems and architectures. Moreover, the review delves into the design of Big Data analytics architectures, focusing on goal-oriented modeling and the resolution of obstacles to quality goal achievement. It also introduces datar, a unified framework for Big Data Management Systems, showcasing a solution that manages Big Data in a pluggable, automatic, and intelligent manner. In conclusion, the intersection of Big Data and Systems Engineering heralds a new era of system design and management. By addressing the inherent challenges and leveraging innovative solutions, this convergence holds the potential to significantly enhance the capabilities of Systems Engineering, driving forward the development of complex, data-driven systems. Keywords: Big Data, Systems Engineering, Information Security, Data Management Systems, Benchmarking Big Data Systems.