USDB: Scaling Storage for Next-Generation Recommender Systems at ByteDance
Recommendation models consume increasingly long, attribute-rich user histories, making small continuous updates and repeated large reads a central storage asymmetry. We present USDB, ByteDance's unified sequence storage practice for streaming and batch workloads. CascadeLSM time-based compaction stages materialize application-specific histories; differentiated replicas share persistent files; partial dumps reconstruct inference inputs from captured recent state and versioned history; and a hybrid columnar format accelerates projected reads. These designs reuse maintenance results across ingestion, inference, and training. Production migration records show 85.8% lower mean write latency, while normalized deployment accounting shows 42.1% lower infrastructure cost. Controlled comparisons with an Optimized RocksDB sequence baseline show faster long-history reads across projections and client loads. Aggregation pushdown sustains 8.5x the throughput of ordinary reads under a constrained receive budget. Production reconstruction and direct-file training results demonstrate how shared sequence maintenance supports fresh serving and repeated historical access.
Authors
- Jieming Cai
- Shiru Ren (ORCID: https://orcid.org/0000-0002-2430-2009)
- Shu Cai (ORCID: https://orcid.org/0000-0002-9010-9653)
- Xiaoran Zhu (ORCID: https://orcid.org/0000-0002-5181-5037)
- Siqiang Luo (ORCID: https://orcid.org/0000-0001-8197-0903)
- Chai Junjun (ORCID: https://orcid.org/0009-0006-1664-7425)
- Yan Deng
- YIFAN XIAO (ORCID: https://orcid.org/0009-0004-6447-3242)
- Yu Lin
- Weiping Yu
- Peng Xu
- Yisha Zhou
- Jiahao Li
- Xi Chen
Publication Details
- Journal
- arXiv (Cornell University)
- Published
- 2026-11-02
- DOI
- https://doi.org/10.48550/arxiv.2611.02618
- Primary Topic
- Advanced Data Storage Technologies
- Type
- preprint