Protocol-dependent conformity in open-weight large language models under fixed wrong-peer signals

Large language models (LLMs) may revise decisions after observing peer answers or conversational history. We study wrong-peer conformity - the conditional switch from a private answer to a preselected incorrect option supported by controlled peer-style signals - under a fixed-signal design. On 500-item CommonsenseQA (CSQA) and Massive Multitask Language Understanding (MMLU) samples, Qwen2.5-3B-Instruct, Phi-3.5-mini-instruct, and Gemma2-2B-it receive identical wrong targets and answer-only signals while presentation schedule, response schedule, retained history, or source-label wording varies. Sequential-Stepwise sharply reduces wrong-target adoption relative to Sequential-Final for Qwen and Phi but increases it for Gemma on both datasets. A seven-condition ablation shows that extra calls without retained outputs do not explain the Qwen difference; for Qwen2.5-3B, the same broad retained-history pattern appears on both CommonsenseQA and MMLU, where token-matched neutral assistant history reproduces much of the reduction and a short acknowledgment does not. Gemma does not show the same large reduction. In a separate token-matched control, replacing “Source” with “Model” suppresses wrong-target adoption for Qwen and Gemma on both benchmarks. Exploratory Qwen2.5 extensions further reveal sensitivity to checkpoint choice, peer count, and generic-justification message format. Paired inference, 30 aligned subset draws, and pre-exposure target-plausibility stratification support the directional protocol result. Thus, interaction protocol and contextual wording alter the effective conversational input, with effects that remain model- and setting-dependent.

Authors

Institutions

Publication Details

Journal
AI Agent
Published
2026-10-26
DOI
https://doi.org/10.20517/aiagent.2026.19
Primary Topic
Topic Modeling
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Protocol-dependent conformity in open-weight large language models under fixed wrong-peer signals

Ling Xu, Ye Zhu, Xucheng Xue, Dechang Xu et al.
AI Agent
Topic Modeling
article

Protocol-dependent conformity in open-weight large language models under fixed wrong-peer signals

Ling Xu, Ye Zhu, Xucheng Xue, Dechang Xu, Junwen Zhang
article en

Abstract

Large language models (LLMs) may revise decisions after observing peer answers or conversational history. We study wrong-peer conformity - the conditional switch from a private answer to a preselected incorrect option supported by controlled peer-style signals - under a fixed-signal design. On 500-item CommonsenseQA (CSQA) and Massive Multitask Language Understanding (MMLU) samples, Qwen2.5-3B-Instruct, Phi-3.5-mini-instruct, and Gemma2-2B-it receive identical wrong targets and answer-only signals while presentation schedule, response schedule, retained history, or source-label wording varies. Sequential-Stepwise sharply reduces wrong-target adoption relative to Sequential-Final for Qwen and Phi but increases it for Gemma on both datasets. A seven-condition ablation shows that extra calls without retained outputs do not explain the Qwen difference; for Qwen2.5-3B, the same broad retained-history pattern appears on both CommonsenseQA and MMLU, where token-matched neutral assistant history reproduces much of the reduction and a short acknowledgment does not. Gemma does not show the same large reduction. In a separate token-matched control, replacing “Source” with “Model” suppresses wrong-target adoption for Qwen and Gemma on both benchmarks. Exploratory Qwen2.5 extensions further reveal sensitivity to checkpoint choice, peer count, and generic-justification message format. Paired inference, 30 aligned subset draws, and pre-exposure target-plausibility stratification support the directional protocol result. Thus, interaction protocol and contextual wording alter the effective conversational input, with effects that remain model- and setting-dependent.

AI AgentVol. 2(4)
Soochow University (CN), Xi’an Jiaotong-Liverpool University (CN)
Openalex Percentile: Top 14%
Topic Modeling
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon