Nemotron-CC: Transforming Common Crawl into a Refined Long-Horizon Pretraining Dataset
Dan Su, Kezhi Kong, Ying Lin, Joseph Jennings, Brandon Norick, Markus Kliegl, Mostofa Patwary, Mohammad Shoeybi, Bryan Catanzaro. Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 2025.
Authors
- Kezhi Kong
- Mostofa Patwary
- Joseph Jennings (ORCID: https://orcid.org/0000-0001-7093-355X)
- Brandon Norick
- Bryan Catanzaro (ORCID: https://orcid.org/0000-0003-0034-7728)
- Mohammad Shoeybi
- Dan Su (ORCID: https://orcid.org/0000-0001-5746-9545)
- Markus Kliegl (ORCID: https://orcid.org/0000-0001-6063-3959)
- Ying Lin (ORCID: https://orcid.org/0000-0003-0152-2436)
Publication Details
- Published
- 2025-01-01
- DOI
- https://doi.org/10.18653/v1/2025.acl-long.123
- Citations
- 1
- Primary Topic
- Image Processing and 3D Reconstruction
- Type
- article
- Field-Weighted Citation Impact
- 1.28