Pretraining Context Compressor for Large Language Models with Embedding-Based Memory
Yuhong Dai, Jianxun Lian, Yitian Huang, Wei Zhang, Mingyang Zhou, Mingqi Wu, Xing Xie, Hao Liao. Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 2025.
Authors
- Mingyang Zhou (ORCID: https://orcid.org/0000-0001-5996-3395)
- Yitian Huang (ORCID: https://orcid.org/0009-0002-0223-5519)
- Xing Xie (ORCID: https://orcid.org/0000-0002-8608-8482)
- Mingqi Wu
- Jianxun Lian (ORCID: https://orcid.org/0000-0003-3108-5601)
- Wei Zhang (ORCID: https://orcid.org/0000-0002-8208-3342)
- Hao Liao (ORCID: https://orcid.org/0000-0003-1223-6996)
- Yu‐Hong Dai (ORCID: https://orcid.org/0000-0002-6932-9512)
Publication Details
- Published
- 2025-01-01
- DOI
- https://doi.org/10.18653/v1/2025.acl-long.1394
- Primary Topic
- Context-Aware Activity Recognition Systems
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- National Natural Science Foundation of China
- Basic and Applied Basic Research Foundation of Guangdong Province