Development of Contemporary Log Management Solution for the Software Infrastructure of the BM@N Experiment

In the course of developing a software ecosystem of the BM@N experiment, a multitude of systems and services has been implemented, including data processing and information systems. An integral component of the maintenance procedure is monitoring the operation of the systems of the BM@N software infrastructure and requests to them, which are logged to the corresponding files. The paper presents the implementation of a contemporary solution for the log management of the BM@N software complex. The log management solution has been implemented based on a high-performance and cost-effective technology stack of ClickHouse and Datadog Vector. The employment of the Metabase business intelligence platform and Grafana real-time monitoring tool further facilitates the analysis of the collected logs. As a result, the integration of these solutions enhances the resilience of the BM@N software infrastructure and facilitates security auditing.