A Silver Bullet or a Compromise for Full Attention? A Comprehensive Study of Gist Token-based Context Compression
Chenlong Deng, Zhisong Zhang, Kelong Mao, Shuaiyi Li, Xinting Huang, Dong Yu, Zhicheng Dou. Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 2025.
Authors
- Dong Yu (ORCID: https://orcid.org/0000-0002-6769-1622)
- Shuaiyi Li (ORCID: https://orcid.org/0009-0008-0896-9189)
- Zhicheng Dou (ORCID: https://orcid.org/0000-0002-9781-948X)
- Kelong Mao (ORCID: https://orcid.org/0000-0002-5648-568X)
- Chenlong Deng (ORCID: https://orcid.org/0000-0002-0248-9765)
- Zhisong Zhang (ORCID: https://orcid.org/0000-0002-3680-8701)
- Xinting Huang (ORCID: https://orcid.org/0000-0001-6827-7426)
Publication Details
- Published
- 2025-01-01
- DOI
- https://doi.org/10.18653/v1/2025.acl-long.241
- Primary Topic
- Parallel Computing and Optimization Techniques
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- National Natural Science Foundation of China
- Renmin University of China
- Ministry of Education, India
- National Science and Technology Major Project