Lossless Compression with Trie-Based Shared Dictionary for Omics Data in Edge–Cloud Frameworks
The growing complexity and volume of genomic and omics data present critical challenges for storage, transfer, and analysis in edge–cloud platforms. Existing compression techniques often involve trade-offs between efficiency and speed, requiring innovative approaches that ensure scalability and cost-effectiveness. This paper introduces a lossless compression method that integrates Trie-based shared dictionaries within an edge–cloud architecture. It presents a software-centric scientific research process of the design and evaluation of the proposed compression method. By enabling localized preprocessing at the edge, our approach reduces data redundancy before cloud transmission, thereby optimizing both storage and network efficiency. A global shared dictionary is constructed using N-gram analysis to identify and prioritize repeated sequences across multiple files. A lightweight index derived from this dictionary is then pushed to edge nodes, where Trie-based sequence replacement is applied to eliminate redundancy locally. The preprocessed data are subsequently transmitted to the cloud, where advanced compression algorithms, such as Zstd, GZIP, Snappy, and LZ4, further compress them. Evaluation on real patient omics datasets from B-cell Acute Lymphoblastic Leukemia (B-ALL) and Chronic Lymphocytic Leukemia (CLL) demonstrates that edge preprocessing significantly improves compression ratios, reduces upload times, and enhances scalability in hybrid cloud frameworks.
Authors
- Daniel Catchpoole (ORCID: https://orcid.org/0000-0001-5836-1413)
- Simeon Simoff (ORCID: https://orcid.org/0000-0001-9895-4109)
- Paul Kennedy (ORCID: https://orcid.org/0000-0001-7837-3171)
- Quang Vinh Nguyễn (ORCID: https://orcid.org/0000-0002-0815-6224)
- Zhonglin Qu (ORCID: https://orcid.org/0000-0003-4500-004X)
- Rene C. Adam (ORCID: https://orcid.org/0009-0005-8239-6495)
Institutions
- University of Technology Sydney (AU)
- The University of Sydney (AU)
- Children's Hospital at Westmead (AU)
- Western Sydney University (AU)
Publication Details
- Journal
- Journal of Sensor and Actuator Networks
- Published
- 2025-04-09
- DOI
- https://doi.org/10.3390/jsan14020041
- Primary Topic
- Gene expression and cancer classification
- Type
- article
- Field-Weighted Citation Impact
- 0.00