Practicalizing Tree-Based Model Acceleration with CAM through Model Pruning and Data Placement Optimization
Tree-based model remains state-of-the-art for many tasks involving tabular data. While these models are favored in resource-constrained environments, the inherent characteristics result in inefficiency during inference, posing significant challenges for conventional accelerators. Recent research has achieved unprecedented acceleration with content-addressable memory (CAM), yet at the cost of overwhelming memory consumption with low utilization, which is impractical for numerous real-world applications. This work addresses these issues by introducing an end-to-end framework RETENTION. RETENTION incorporates (1) a pruning algorithm to minimize model complexity under a user-specified accuracy loss tolerance, and (2) two data placement strategies to enhance memory utilization and further reduce capacity requirement. Experiment results show that space efficiency can be improved from 4.35× to 207.12× with less than 3% accuracy loss.
Authors
- Camélia Slimani (ORCID: https://orcid.org/0000-0003-1484-5744)
- Yi-Chun Liao (ORCID: https://orcid.org/0000-0002-3065-2267)
- Jalil Boukhobza (ORCID: https://orcid.org/0000-0002-2194-4006)
- Tei‐Wei Kuo (ORCID: https://orcid.org/0000-0003-1974-0394)
- Yuan-Hao Chang (ORCID: https://orcid.org/0000-0002-1282-2111)
- Chieh-Lin Tsai (ORCID: https://orcid.org/0009-0001-4820-2790)
Institutions
- Centre National de la Recherche Scientifique (FR)
- University of California, Santa Barbara (US)
- Université de Bretagne Occidentale (FR)
- National Taiwan University (TW)
- École Nationale Supérieure de Techniques Avancées (FR)
- Institut National Polytechnique de Toulouse (FR)
- Laboratoire des Sciences et Techniques de l’Information de la Communication et de la Connaissance (FR)
- Delta Electronics (Taiwan) (TW)
- École nationale supérieure de techniques avancées Bretagne (FR)
- École Nationale Supérieure d'Électrotechnique, d'Électronique, d'Informatique, d'Hydraulique et des Télécommunications (FR)
- École Nationale Supérieure de Techniques Avancées Paris (FR)
- Korea Institute of Science & Technology Information (KR)
Publication Details
- Published
- 2025-09-28
- DOI
- https://doi.org/10.1145/3742873.3758342
- Primary Topic
- Network Packet Processing and Optimization
- Type
- article
- Field-Weighted Citation Impact
- 0.00