Training Dynamics Underlying Language Model Scaling Laws: Loss Deceleration and Zero-Sum Learning

Andrei Mircea, Supriyo Chakraborty, Nima Chitsazan, Irina Rish, Ekaterina Lobacheva. Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 2025.

Authors

Irina Rish (ORCID: https://orcid.org/0000-0001-6856-5057)
Sanjoy Chakraborty (ORCID: https://orcid.org/0000-0002-4799-2110)
Andrei Mircea
Nima Chitsazan
Ekaterina Lobacheva

Publication Details

Published: 2025-01-01
DOI: https://doi.org/10.18653/v1/2025.acl-long.1366
Primary Topic: Natural Language Processing Techniques
Type: article
Field-Weighted Citation Impact: 0.00

Controls

|||

ALL TIME

JAN

FEB

MAR

APR

MAY

JUN

JUL

AUG

SEP

OCT

article

Training Dynamics Underlying Language Model Scaling Laws: Loss Deceleration and Zero-Sum Learning

Irina Rish, Sanjoy Chakraborty, Andrei Mircea, Nima Chitsazan et al.

Jan 1, 2025

Natural Language Processing Techniques

article

Training Dynamics Underlying Language Model Scaling Laws: Loss Deceleration and Zero-Sum Learning

Irina Rish, Sanjoy Chakraborty, Andrei Mircea, Nima Chitsazan, Ekaterina Lobacheva

January 1, 2025article en

Abstract

Quality Education

Openalex Percentile: Top 90%

Natural Language Processing Techniques

DOI Open Access PDF OpenAlex

AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Training Dynamics Underlying Language Model Scaling Laws: Loss Deceleration and Zero-Sum Learning — Irina Rish, Sanjoy Chakraborty, et al. · (2025) | TGRS Research Map | TGRS