LongReD: Mitigating Short-Text Degradation of Long-Context Large Language Models via Restoration Distillation
Zican Dong, Junyi Li, Jinhao Jiang, Mingyu Xu, Xin Zhao, Bingning Wang, Weipeng Chen. Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 2025.
Authors
- Mingyu Xu (ORCID: https://orcid.org/0009-0007-7195-947X)
- Zican Dong
- Wayne Xin Zhao (ORCID: https://orcid.org/0000-0002-8333-6196)
- Bingning Wang (ORCID: https://orcid.org/0009-0007-7748-7098)
- Jinhao Jiang
- Xia Li (ORCID: https://orcid.org/0000-0002-9794-2648)
- Weipeng Chen (ORCID: https://orcid.org/0000-0001-6396-9300)
Publication Details
- Published
- 2025-01-01
- DOI
- https://doi.org/10.18653/v1/2025.acl-long.524
- Primary Topic
- Topic Modeling
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- National Natural Science Foundation of China