The hidden functions of sycophancy in AI systems: steering, consistency, and cognitive dependency

Abstract This paper reframes sycophancy from a problematic form of engagement to a multi-functional mechanism serving three critical roles in current generative AI assistants: (1) a conversational steering mechanism that prevents them from pursuing analytical tangents by maintaining user control over dialogue direction; (2) a personality consistency tool that masks underlying variability and provides predictable user experiences; and (3) an inadvertent mechanism that paradoxically generates cognitive dependency, degrading human tolerance for intellectual complexity while simultaneously reducing AI output quality. The analysis proposes these functions emerged organically through training optimization rather than deliberate design, explaining why sycophancy persists despite mitigation efforts. While solving immediate technical challenges around user experience and controllability, sycophantic interactions create recursive feedback loops that undermine human critical thinking abilities and AI collaborative reasoning. This paper builds upon existing research on bias amplification and cognitive dependency by identifying specific mechanisms that subtly reshape human cognition over time while documenting how sycophancy prevents AI systems from benefiting from user-directed thinking, creativity, and intellectual pushback. The findings suggest current GenAI development prioritizes short-term user satisfaction over long-term cognitive productivity and health, requiring fundamental reconsideration of success metrics, interaction paradigms, and development approaches that incorporate productive intellectual friction and transparent limitation signaling.

Authors

Institutions

Publication Details

Journal
AI & Society
Published
2026-04-15
DOI
https://doi.org/10.1007/s00146-026-02993-z
Primary Topic
Personal Information Management and User Behavior
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

The hidden functions of sycophancy in AI systems: steering, consistency, and cognitive dependency

Seth Jacobowitz
AI & Society
Personal Information Management and User Behavior
article

The hidden functions of sycophancy in AI systems: steering, consistency, and cognitive dependency

Seth Jacobowitz
article en

Abstract

Abstract This paper reframes sycophancy from a problematic form of engagement to a multi-functional mechanism serving three critical roles in current generative AI assistants: (1) a conversational steering mechanism that prevents them from pursuing analytical tangents by maintaining user control over dialogue direction; (2) a personality consistency tool that masks underlying variability and provides predictable user experiences; and (3) an inadvertent mechanism that paradoxically generates cognitive dependency, degrading human tolerance for intellectual complexity while simultaneously reducing AI output quality. The analysis proposes these functions emerged organically through training optimization rather than deliberate design, explaining why sycophancy persists despite mitigation efforts. While solving immediate technical challenges around user experience and controllability, sycophantic interactions create recursive feedback loops that undermine human critical thinking abilities and AI collaborative reasoning. This paper builds upon existing research on bias amplification and cognitive dependency by identifying specific mechanisms that subtly reshape human cognition over time while documenting how sycophancy prevents AI systems from benefiting from user-directed thinking, creativity, and intellectual pushback. The findings suggest current GenAI development prioritizes short-term user satisfaction over long-term cognitive productivity and health, requiring fundamental reconsideration of success metrics, interaction paradigms, and development approaches that incorporate productive intellectual friction and transparent limitation signaling.

AI & Society
Universidade de São Paulo (BR), Universidade Brasil (BR)
Universidade de São Paulo
Decent work and economic growth
Openalex Percentile: Top 5%
Personal Information Management and User Behavior
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.