Comparing Transformer-Based Log Anomaly Detection With LLM Explainability In CI/CD Pipelines

With the DevOps setups of today, automating Continuous Integration and Deployment (CI/CD) pipelines is a necessity for achieving rapid software delivery. These pipelines generate enormous logs, which, despite being useful for debugging and monitoring, become cumbersome to analyze manually. In this comparative study, comparison of anomaly detection models on CI/CD pipeline logs, including classical, deep learning, and transformer-based approaches such as LogBERT is performed. An enhanced LogBERT-based classifier i s p resented, incorporating focal loss, grouped anomaly detection, and temperature scaling for better calibration and comparison with other Log anomaly detection models. The evaluation framework includes a feedback loop that allows user-labeled predictions to be reused for iterative retraining.