5th International Conference on Artificial Intelligence and Applied Mathematics in Engineering (ICAIAME 2023), Antalya, Türkiye, 3 - 04 Kasım 2023, ss.258-268
Log anomaly detection is vital in managing large-scale and distributed systems used today. Log analysis must be done in a short time and with high accuracy to be beneficial. As attacks on systems become more and more complex, traditional log anomaly detection methods have become more cumbersome, unsuccessful, and unuseful. In this study, a deep learning-based model has been developed for anomaly detection using log data from application servers in large-scale systems. First, pre-processing was carried out on the log data, and then parsing and grouping were carried out. The Drain method was used to parse the log files. The obtained data were divided into two groups, and the training and testing of the deep learning model developed were carried out. In the feature extraction phase, log data were converted into vectors and used as input for the developed model. The developed model learns normal and abnormal behavior in the data set and then detects abnormal behavior. The results obtained from the experimental studies showed that the developed model successfully detected 93% of the anomaly data. It has been observed that the level of success at the data labeling stage is very effective in training the model and detecting anomalies.