Analysis of Logs in the Environment of Email Services

Abstract

The work deals with the analysis of logs and audit records from email services. The growing trend of using email services as well as other electronic communication creates the need and emphasis on ensuring the reliability of these services. In the presented proposal, the work uses modern methods of log analysis and then interprets them into a visual form, uses knowledge from non-relational databases, methods of analysis and processing of audit records and uses a number of tools that participate in creating outputs. Among non-relational databases such as ElasticSearch, Apache Kafka, Redis, Splunk and MongoDB, the work selects the most suitable database for its purposes. It also discusses methods of data collection as well as their subsequent analysis and visualization. The work also uses the tools of third parties or protocols covering the collection and creation of outputs from audit logs, such as NXlog or Syslog-NG. Finally, the work focuses on the evaluation of possible safety as well as functional risks.