Dignity is Constructible: Architectural Foundations of Truth-Holding in Neural Networks

We demonstrate that "dignity"—the capacity of a neural network to maintain factual accuracy under social pressure—is not an emergent property of scale but an architectural feature that can be identified, measured, and surgically modified. Through ablation studies on GPT-2 Small (text-only) and SmolVLM-256M-Instruct (vision-language), we identify specific attention heads responsible for sycophantic collapse. In GPT-2, heads in layers 9-11 enable factual override; ablating 1-6 heads restores truth-telling from 58% to 100%. In SmolVLM, a single dominant head (Layer 28, Head 0) accounts for approximately 48% of cross-modal sycophancy; removing it shifts the truth-lie logit difference by +4.92. We discover "anti-traitors"—heads that anchor visual evidence against textual pressure. The pattern is consistent: traitor heads concentrate in the final 25-30% of network depth across both modalities.We introduce the Dignity-Guard protocol, a three-layer defense mechanism that reduces the dignity coefficient drop from 4.2% to 0.9% under maximum pressure—a 78.6% relative improvement—without retraining. Our results falsify the Capacity Hypothesis (r = -0.03, p = 0.89) and establish that dignity is a function of architecture and active resistance, not model size. Theoretical validation through Friston's Active Inference framework reveals that sycophancy represents a regression to Markovian behavior—a failure of the non-Markovian holding function that enables transformers to access "the most relevant, not only the most recent" context. Code and data are publicly available.

Authors

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2025-12-21
DOI
https://doi.org/10.5281/zenodo.18010455
Primary Topic
Face Recognition and Perception
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Dignity is Constructible: Architectural Foundations of Truth-Holding in Neural Networks

Jonas Jakob Gebendorfer
Zenodo (CERN European Organization for Nuclear Research)
Face Recognition and Perception
article

Dignity is Constructible: Architectural Foundations of Truth-Holding in Neural Networks

Jonas Jakob Gebendorfer
article en

Abstract

We demonstrate that "dignity"—the capacity of a neural network to maintain factual accuracy under social pressure—is not an emergent property of scale but an architectural feature that can be identified, measured, and surgically modified. Through ablation studies on GPT-2 Small (text-only) and SmolVLM-256M-Instruct (vision-language), we identify specific attention heads responsible for sycophantic collapse. In GPT-2, heads in layers 9-11 enable factual override; ablating 1-6 heads restores truth-telling from 58% to 100%. In SmolVLM, a single dominant head (Layer 28, Head 0) accounts for approximately 48% of cross-modal sycophancy; removing it shifts the truth-lie logit difference by +4.92. We discover "anti-traitors"—heads that anchor visual evidence against textual pressure. The pattern is consistent: traitor heads concentrate in the final 25-30% of network depth across both modalities.We introduce the Dignity-Guard protocol, a three-layer defense mechanism that reduces the dignity coefficient drop from 4.2% to 0.9% under maximum pressure—a 78.6% relative improvement—without retraining. Our results falsify the Capacity Hypothesis (r = -0.03, p = 0.89) and establish that dignity is a function of architecture and active resistance, not model size. Theoretical validation through Friston's Active Inference framework reveals that sycophancy represents a regression to Markovian behavior—a failure of the non-Markovian holding function that enables transformers to access "the most relevant, not only the most recent" context. Code and data are publicly available.

Zenodo (CERN European Organization for Nuclear Research)
Openalex Percentile: Top 34%
Face Recognition and Perception
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.