FSST String Compression with Materialized View Integration
This document discloses a novel approach to integrating FSST (Fast Static Symbol Table) string compression with materialized views in embedded database systems. The implementation demonstrates adaptive compression strategies for VARCHAR and TEXT columns combined with automatic dictionary management, LRU-based caching, and SIMD-optimized batch processing. The system achieves 2-5x compression ratios with throughput exceeding 500 MB/sec for string encoding, while maintaining fullcompatibility with Parquet storage and RocksDB backends. This work establishes prior art for the integration of FSST compression with automatic materialized view refresh cycles, including dictionary training from Arrow string columns and adaptive symbol table optimization.
Authors
- Daniel Moya Vaca
Publication Details
- Journal
- Zenodo (CERN European Organization for Nuclear Research)
- Published
- 2026-03-27
- DOI
- https://doi.org/10.5281/zenodo.19243980
- Primary Topic
- Algorithms and Data Compression
- Type
- article
- Field-Weighted Citation Impact
- 0.00