The Fractal Graph Rewriting Framework: Dynamic Activation Geometry and a Runtime Thermodynamic Gate for Transformer Language Models

We extend the FGRF scale-dependent rigidity probe from static weight matrices (V3) to dynamic activation spaces, and convert the framework’s thermodynamic gate into a layer-specific runtime anomaly detector. A consolidated, registry-driven probe hooks all 24 attention output projections of Qwen2.5-0.5B, SmolLM2-360M, and GPT-2-medium, extracts the normalized squared-spectrum entropy Hσ and the two-peak decomposition of the complexity profile C(k) per layer, and applies a scaled Landauer gate to consecutive layer transitions.

Authors

Publication Details

Journal
Figshare
Published
2026-11-06
DOI
https://doi.org/10.6084/m9.figshare.34937449
Primary Topic
Topic Modeling
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
preprint

The Fractal Graph Rewriting Framework: Dynamic Activation Geometry and a Runtime Thermodynamic Gate for Transformer Language Models

Riccardo Pini
1 links
Figshare
Topic Modeling
preprint

The Fractal Graph Rewriting Framework: Dynamic Activation Geometry and a Runtime Thermodynamic Gate for Transformer Language Models

Riccardo Pini
preprint en

Abstract

We extend the FGRF scale-dependent rigidity probe from static weight matrices (V3) to dynamic activation spaces, and convert the framework’s thermodynamic gate into a layer-specific runtime anomaly detector. A consolidated, registry-driven probe hooks all 24 attention output projections of Qwen2.5-0.5B, SmolLM2-360M, and GPT-2-medium, extracts the normalized squared-spectrum entropy Hσ and the two-peak decomposition of the complexity profile C(k) per layer, and applies a scaled Landauer gate to consecutive layer transitions.

Figshare
Topic Modeling
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon
The Fractal Graph Rewriting Framework: Dynamic Activation Geometry and a Runtime Thermodynamic Gate for Transformer Language Models — Riccardo Pini · Figshare (2026) | TGRS Research Map | TGRS