BUILDING A REAL-TIME ANALYTICS PIPELINE WITH OPENSEARCH, EMR SPARK, AND AWS MANAGED GRAFANA

This article presents a comprehensive approach to building enterprise-grade realtime analytics pipelines leveraging AWS managed services, specifically OpenSearch, EMR Spark, and AWS Managed Grafana.It introduces a scalable architecture that addresses the challenges of high-throughput data ingestion, low-latency processing, and interactive visualization while minimizing operational overhead.The solution

Authors

Institutions

Publication Details

Journal
INTERNATIONAL JOURNAL OF COMPUTER ENGINEERING & TECHNOLOGY
Published
2025-02-12
DOI
https://doi.org/10.34218/ijcet_16_01_208
Primary Topic
Machine Learning and Data Classification
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

BUILDING A REAL-TIME ANALYTICS PIPELINE WITH OPENSEARCH, EMR SPARK, AND AWS MANAGED GRAFANA

Shubham Srivastava
INTERNATIONAL JOURNAL OF COMPUTER ENGINEERING & TECHNOLOGY
Machine Learning and Data Classification
article

BUILDING A REAL-TIME ANALYTICS PIPELINE WITH OPENSEARCH, EMR SPARK, AND AWS MANAGED GRAFANA

Shubham Srivastava
article en

Abstract

This article presents a comprehensive approach to building enterprise-grade realtime analytics pipelines leveraging AWS managed services, specifically OpenSearch, EMR Spark, and AWS Managed Grafana.It introduces a scalable architecture that addresses the challenges of high-throughput data ingestion, low-latency processing, and interactive visualization while minimizing operational overhead.The solution

INTERNATIONAL JOURNAL OF COMPUTER ENGINEERING & TECHNOLOGYVol. 16(1)
University of Washington (US)
Openalex Percentile: Top 99%
Machine Learning and Data Classification
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

BUILDING A REAL-TIME ANALYTICS PIPELINE WITH OPENSEARCH, EMR SPARK, AND AWS MANAGED GRAFANA — Shubham Srivastava · INTERNATIONAL JOURNAL OF COMPUTER ENGINEERING & TECHNOLOGY (2025) | TGRS Research Map | TGRS