Turning Trash into Treasure: Accelerating Inference of Large Language Models with Token Recycling
Xianzhen Luo, Yixuan Wang, Qingfu Zhu, Zhiming Zhang, Xuanyu Zhang, Qing Yang, Dongliang Xu. Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 2025.
Authors
- Xianzhen Luo (ORCID: https://orcid.org/0000-0002-6629-9063)
- Xuanyu Zhang (ORCID: https://orcid.org/0009-0000-9240-7956)
- Zhiming Zhang (ORCID: https://orcid.org/0000-0002-5608-6590)
- Dongliang Xu (ORCID: https://orcid.org/0000-0002-6908-253X)
- Yixuan Wang (ORCID: https://orcid.org/0009-0002-2367-8335)
- Qingfu Zhu
- Qing Yang
Publication Details
- Published
- 2025-01-01
- DOI
- https://doi.org/10.18653/v1/2025.acl-long.338
- Citations
- 1
- Primary Topic
- Natural Language Processing Techniques
- Type
- article
- Field-Weighted Citation Impact
- 2.48
Funders
- National Natural Science Foundation of China