HDT²: Pilot v2 A Follow-On Research Program Derived from HDT² Pilot v1

HDT² (Holistic Data Transformation Theory) introduces a portable, entropy-banded diagnostic framework for assessing reasoning stability in large language models. The methodology centers on the hypothesis that token-level Shannon entropy encodes a cross-model structure—an “uncertainty geometry”—that can be aligned via unsupervised quantile matching. This pilot study establishes both positive and negative evidence: (i) successful entropy-band alignment enabling stable-reasoning detection in compatible models, and (ii) clear empirical boundaries where alignment fails, revealing architectural constraints on portability. This dual evidence grounds ψ* as a scientifically falsifiable substrate for reliability diagnostics and control-theoretic actuation. HDT² Pilot v2 is the formal follow-on to HDT² Pilot v1, extending the work from feasibility testing to the study of epistemic regimes in large language models.Pilot v1 established that token-level Shannon entropy forms stable, measurable geometric patterns within a model and that these patterns can be partitioned into behavioral regimes—stable, ambiguous, and underdetermined. It also showed that entropy geometry is model-dependent, with some models aligning cleanly and others diverging. Pilot v2 builds directly on those findings. Its focus is to characterize these regimes more precisely, examine when regime geometry is shared across models, and explore how regime transitions can serve as control signals for adaptive system behavior. This includes routing, escalation, abstention, hedging, and tool invocation. HDT² Pilot v2 remains exploratory. It raises more questions than it answers. The goal is to map the structure we can measure, identify the structure we do not yet understand, and invite collaborators to help study the dynamics of uncertainty fields in LLMs. The full Pilot v2 technical statement is included in this versioned upload.

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2025-11-16
DOI
https://doi.org/10.5281/zenodo.17621325
Primary Topic
Formal Methods in Verification
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

HDT²: Pilot v2 A Follow-On Research Program Derived from HDT² Pilot v1

Zenodo (CERN European Organization for Nuclear Research)
Formal Methods in Verification
article

HDT²: Pilot v2 A Follow-On Research Program Derived from HDT² Pilot v1

article en

Abstract

HDT² (Holistic Data Transformation Theory) introduces a portable, entropy-banded diagnostic framework for assessing reasoning stability in large language models. The methodology centers on the hypothesis that token-level Shannon entropy encodes a cross-model structure—an “uncertainty geometry”—that can be aligned via unsupervised quantile matching. This pilot study establishes both positive and negative evidence: (i) successful entropy-band alignment enabling stable-reasoning detection in compatible models, and (ii) clear empirical boundaries where alignment fails, revealing architectural constraints on portability. This dual evidence grounds ψ* as a scientifically falsifiable substrate for reliability diagnostics and control-theoretic actuation. HDT² Pilot v2 is the formal follow-on to HDT² Pilot v1, extending the work from feasibility testing to the study of epistemic regimes in large language models.Pilot v1 established that token-level Shannon entropy forms stable, measurable geometric patterns within a model and that these patterns can be partitioned into behavioral regimes—stable, ambiguous, and underdetermined. It also showed that entropy geometry is model-dependent, with some models aligning cleanly and others diverging. Pilot v2 builds directly on those findings. Its focus is to characterize these regimes more precisely, examine when regime geometry is shared across models, and explore how regime transitions can serve as control signals for adaptive system behavior. This includes routing, escalation, abstention, hedging, and tool invocation. HDT² Pilot v2 remains exploratory. It raises more questions than it answers. The goal is to map the structure we can measure, identify the structure we do not yet understand, and invite collaborators to help study the dynamics of uncertainty fields in LLMs. The full Pilot v2 technical statement is included in this versioned upload.

Zenodo (CERN European Organization for Nuclear Research)
Openalex Percentile: Top 39%
Formal Methods in Verification
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.