Sparse Logit Sampling: Accelerating Knowledge Distillation in LLMs
Anshumann Anshumann, Mohd Abbas Zaidi, Akhil Kedia, Jinwoo Ahn, Taehwak Kwon, Kangwook Lee, Haejun Lee, Joohyung Lee. Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 2025.
Authors
- Tae‐Geon Kwon (ORCID: https://orcid.org/0000-0003-2799-0510)
- Akhil Kedia
- Joo‐Hyung Lee (ORCID: https://orcid.org/0000-0001-5345-1102)
- Haejun Lee
- Mohd Abbas Zaidi (ORCID: https://orcid.org/0000-0003-2961-4404)
- Kangwook Lee (ORCID: https://orcid.org/0000-0002-9455-0163)
- Jin-Woo Ahn
- Anshumann Anshumann
Institutions
- Samsung (South Korea) (KR)
- Samsung Medical Center (KR)
Publication Details
- Published
- 2025-01-01
- DOI
- https://doi.org/10.18653/v1/2025.acl-long.885
- Primary Topic
- Data Stream Mining Techniques
- Type
- article
- Field-Weighted Citation Impact
- 0.00