TiC-LM: A Web-Scale Benchmark for Time-Continual LLM Pretraining
Jeffrey Li, Mohammadreza Armandpour, Seyed Iman Mirzadeh, Sachin Mehta, Vaishaal Shankar, Raviteja Vemulapalli, Samy Bengio, Oncel Tuzel, Mehrdad Farajtabar, Hadi Pouransari, Fartash Faghri. Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 2025.
Authors
- Seyed Iman Mirzadeh (ORCID: https://orcid.org/0000-0003-1586-0700)
- Samy Bengio
- Oncel Tuzel
- Fartash Faghri (ORCID: https://orcid.org/0000-0001-5975-5158)
- Mehrdad Farajtabar (ORCID: https://orcid.org/0000-0002-5510-518X)
- Mohammadreza Armandpour
- Hadi Pouransari
- Raviteja Vemulapalli (ORCID: https://orcid.org/0000-0003-0425-7797)
- Sachin Mehta (ORCID: https://orcid.org/0000-0002-5420-4725)
- Jeffrey Ji-Peng Li (ORCID: https://orcid.org/0009-0002-4393-5773)
- Vaishaal Shankar
Publication Details
- Published
- 2025-01-01
- DOI
- https://doi.org/10.18653/v1/2025.acl-long.1551
- Citations
- 1
- Primary Topic
- Metallurgy and Material Forming
- Type
- article
- Field-Weighted Citation Impact
- 0.86
Funders
- Institute for Catastrophic Loss Reduction
- Strong