Kibana Deployment in AWS for Log Analysis: A Research-Based Study on Observability and Elastic Stack Integration

Modern distributed applications produce an overwhelming amount of log data across services, nodes, and containers. Efficient log analysis and visualization are essential for maintaining operational integrity, security, and performance. Kibana [1], the visualization layer of the Elastic Stack (ELK), when deployed in AWS, enables scalable and interactive exploration of log data. This paper presents a research-driven study on deploying Kibana [1] in the AWS environment, integrating it with Elasticsearch and Logstash/Filebeat [3] for centralized log aggregation. It explores architectural patterns, deployment methods (including managed services like Amazon OpenSearch [2]), and the benefits of real-time log exploration for DevOps, security, and compliance.