Apache Wayang in Action: Enabling Data Systems Integration via a Unified Data Analytics Framework

Apache Wayang is an open-source framework, which provides a systematic and efficient solution for unifying data analytics over disparate data sources and via integrating multiple heterogeneous data systems. It achieves that by decoupling applications from the underlying systems. In addition, it provides an optimizer so that users do not have to specify the platforms on which their pipeline should run but the optimizer can determine the best way given a cost metric. In this demonstration, we showcase how the flexible architecture of Wayang enables seamless integration with multiple heterogeneous data systems and how the query optimizer can lead to better performance.

Authors

Institutions

Publication Details

Published
2025-06-17
DOI
https://doi.org/10.1145/3722212.3725081
Citations
1
Primary Topic
Advanced Database Systems and Queries
Type
article
Field-Weighted Citation Impact
1.49
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Apache Wayang in Action: Enabling Data Systems Integration via a Unified Data Analytics Framework

Volker Markl, Kaustubh Beedkar, Mads Sejer Pedersen, Mingxi Liu et al.
1 citations
Advanced Database Systems and Queries
1.49
article

Apache Wayang in Action: Enabling Data Systems Integration via a Unified Data Analytics Framework

Volker Markl, Kaustubh Beedkar, Mads Sejer Pedersen, Mingxi Liu, Victor de Paula Dornellas Ribeiro, Haralampos Gavriilidis, Fábio Porto, Augusto Fonseca, Alvin L. Bertrand, Zoi Kaoudi, Lara Giovanna de Andrade Tavares, Chen Xu, J. Petersen, Michalis Vargiamis
article en
1 citations

Abstract

Apache Wayang is an open-source framework, which provides a systematic and efficient solution for unifying data analytics over disparate data sources and via integrating multiple heterogeneous data systems. It achieves that by decoupling applications from the underlying systems. In addition, it provides an optimizer so that users do not have to specify the platforms on which their pipeline should run but the optimizer can determine the best way given a cost metric. In this demonstration, we showcase how the flexible architecture of Wayang enables seamless integration with multiple heterogeneous data systems and how the query optimizer can lead to better performance.

Faculdade de Medicina de Petrópolis (BR), Technische Universität Berlin (DE), East China Normal University (CN), Indian Institute of Technology Delhi (IN), IT University of Copenhagen (DK)
Openalex Percentile: Top 16%
Advanced Database Systems and Queries
1.49
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.