Cekirge Perturbation Report v4

This report introduces a deterministic σ-regularized framework for transformer-style models that computes attention and decoding in closed form without iterative gradient descent. By constructing nonsingular query (Q), key (K), value (V), and output (W) matrices, the method ensures invertibility, numerical stability, and reproducibility. Stability is probed by uniform matrix perturbations of amplitude ε, and the resulting change in loss ΔL = L(ε) − L(0) is recorded. Empirically, ΔL increases nearly linearly with a gently decreasing slope (≈1.84 → ≈1.70 for ε = 0.01 → 0.10), confirming energy-bounded forward determinism. This linear ε–ΔL dependence distinguishes the Çekirge method from stochastic training, revealing a predictable, non-chaotic energy profile. The deterministic σ-regularized formulation provides a foundation for algebraic pretraining, analytical model verification, and thermodynamically aligned, energy-efficient artificial intelligence.

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2025-10-19
DOI
https://doi.org/10.5281/zenodo.17507105
Primary Topic
Model Reduction and Neural Networks
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Cekirge Perturbation Report v4

Zenodo (CERN European Organization for Nuclear Research)
Model Reduction and Neural Networks
article

Cekirge Perturbation Report v4

article en

Abstract

This report introduces a deterministic σ-regularized framework for transformer-style models that computes attention and decoding in closed form without iterative gradient descent. By constructing nonsingular query (Q), key (K), value (V), and output (W) matrices, the method ensures invertibility, numerical stability, and reproducibility. Stability is probed by uniform matrix perturbations of amplitude ε, and the resulting change in loss ΔL = L(ε) − L(0) is recorded. Empirically, ΔL increases nearly linearly with a gently decreasing slope (≈1.84 → ≈1.70 for ε = 0.01 → 0.10), confirming energy-bounded forward determinism. This linear ε–ΔL dependence distinguishes the Çekirge method from stochastic training, revealing a predictable, non-chaotic energy profile. The deterministic σ-regularized formulation provides a foundation for algebraic pretraining, analytical model verification, and thermodynamically aligned, energy-efficient artificial intelligence.

Zenodo (CERN European Organization for Nuclear Research)
Affordable and clean energy
Openalex Percentile: Top 45%
Model Reduction and Neural Networks
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.