Revisiting Scaling Laws for Language Models: The Role of Data Quality and Training Strategies
Zhengyu Chen, Siqi Wang, Teng Xiao, Yudong Wang, Shiqi Chen, Xunliang Cai, Junxian He, Jingang Wang. Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 2025.
Authors
- Shen‐Hsing Annabel Chen (ORCID: https://orcid.org/0000-0002-1540-5516)
- Yudong Wang (ORCID: https://orcid.org/0000-0002-0156-1294)
- Junxian He (ORCID: https://orcid.org/0009-0007-9559-6941)
- Siqi Wang (ORCID: https://orcid.org/0000-0002-8807-640X)
- Jingang Wang (ORCID: https://orcid.org/0000-0002-2999-3371)
- Xunliang Cai
- Zhengyu Chen (ORCID: https://orcid.org/0009-0003-8892-5699)
- Teng Xiao (ORCID: https://orcid.org/0000-0001-9180-1433)
Publication Details
- Published
- 2025-01-01
- DOI
- https://doi.org/10.18653/v1/2025.acl-long.1163
- Citations
- 5
- Primary Topic
- Data Quality and Management
- Type
- article
- Field-Weighted Citation Impact
- 10.53