Generating particle physics Lagrangians with transformers

In physics, Lagrangians provide a systematic way to describe laws governing physical systems. In the context of particle physics, they encode the interactions and behavior of the fundamental building blocks of our universe. By treating Lagrangians as complex, rule-based constructs similar to linguistic expressions, we trained a transformer model — proven to be effective in natural language tasks — to predict the Lagrangian corresponding to a given list of particles. We report on the transformer’s performance in constructing Lagrangians respecting the Standard Model \mathrm{SU}(3)× \mathrm{SU}(2)× \mathrm{U}(1) <mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML" display="inline"> <mml:mrow> <mml:mrow> <mml:mi mathvariant="normal">S</mml:mi> <mml:mi mathvariant="normal">U</mml:mi> </mml:mrow> <mml:mo stretchy="false" form="prefix">(</mml:mo> <mml:mn>3</mml:mn> <mml:mo stretchy="false" form="postfix">)</mml:mo> <mml:mo>×</mml:mo> <mml:mrow> <mml:mi mathvariant="normal">S</mml:mi> <mml:mi mathvariant="normal">U</mml:mi> </mml:mrow> <mml:mo stretchy="false" form="prefix">(</mml:mo> <mml:mn>2</mml:mn> <mml:mo stretchy="false" form="postfix">)</mml:mo> <mml:mo>×</mml:mo> <mml:mi mathvariant="normal">U</mml:mi> <mml:mo stretchy="false" form="prefix">(</mml:mo> <mml:mn>1</mml:mn> <mml:mo stretchy="false" form="postfix">)</mml:mo> </mml:mrow> </mml:math> gauge symmetries. The resulting model is shown to achieve high accuracies (over 90%) with Lagrangians up to six matter fields, with the capacity to generalize beyond the training distribution, albeit within architectural constraints. We show through an analysis of input embeddings that the model has internalized concepts such as group representations and conjugation operations as it learned to generate Lagrangians. We make the model and training datasets available to the community. An interactive demonstration can be found at: https://huggingface.co/spaces/JoseEliel/generate-lagrangians.