Counting Is All You Need for Instant Tuple Discovery: Enabling Real-Time HTAP in Standalone DBMSs
HTAP systems aim to unify operational and analytical workloads, yet real-time analytics remains constrained by the overhead of extract-transform-load (ETL) operations. Existing solutions often rely on dual-system architectures, incurring substantial resource costs and delays from data reformatting and relocation. We present TracerETL , a progressive ETL framework that enables real-time analytics in standalone DBMSs through instant tuple location discovery during transformation. At its core is Tracer , a counting-based tuple tracking mechanism that constructs a tuple trace vector using per-partition counters. This trace vector deterministically encodes each tuple's future relocation path with arrival order across transformation levels, enabling precise data access at any stage-without auxiliary indexes. We implement TracerETL in PostgreSQL and evaluate it against OLAP- and OLTP-optimized DBMSs. Experimental results show that PostgreSQL with TracerETL accelerates real-time HTAP queries by up to 127×, while efficiently handling progressive data conversion in a standalone DBMS.
Authors
- Alan Fekete (ORCID: https://orcid.org/0000-0003-3804-5450)
- Hyungsoo Jung (ORCID: https://orcid.org/0000-0002-5376-7200)
- K. S. Kim (ORCID: https://orcid.org/0009-0004-4954-1454)
- Min-Seok Yoon (ORCID: https://orcid.org/0009-0004-2496-1591)
- Kyoung Soo Lim (ORCID: https://orcid.org/0009-0007-6603-2397)
Institutions
- The University of Sydney (AU)
- Seoul National University (KR)
- Hanyang University (KR)
Publication Details
- Journal
- Proceedings of the ACM on Management of Data
- Published
- 2025-12-04
- DOI
- https://doi.org/10.1145/3769775
- Primary Topic
- Advanced Database Systems and Queries
- Type
- article
- Field-Weighted Citation Impact
- 0.00