Protocol-dependent conformity in open-weight large language models under fixed wrong-peer signals
Large language models (LLMs) may revise decisions after observing peer answers or conversational history. We study wrong-peer conformity - the conditional switch from a private answer to a preselected incorrect option supported by controlled peer-style signals - under a fixed-signal design. On 500-item CommonsenseQA (CSQA) and Massive Multitask Language Understanding (MMLU) samples, Qwen2.5-3B-Instruct, Phi-3.5-mini-instruct, and Gemma2-2B-it receive identical wrong targets and answer-only signals while presentation schedule, response schedule, retained history, or source-label wording varies. Sequential-Stepwise sharply reduces wrong-target adoption relative to Sequential-Final for Qwen and Phi but increases it for Gemma on both datasets. A seven-condition ablation shows that extra calls without retained outputs do not explain the Qwen difference; for Qwen2.5-3B, the same broad retained-history pattern appears on both CommonsenseQA and MMLU, where token-matched neutral assistant history reproduces much of the reduction and a short acknowledgment does not. Gemma does not show the same large reduction. In a separate token-matched control, replacing “Source” with “Model” suppresses wrong-target adoption for Qwen and Gemma on both benchmarks. Exploratory Qwen2.5 extensions further reveal sensitivity to checkpoint choice, peer count, and generic-justification message format. Paired inference, 30 aligned subset draws, and pre-exposure target-plausibility stratification support the directional protocol result. Thus, interaction protocol and contextual wording alter the effective conversational input, with effects that remain model- and setting-dependent.
Authors
- Ling Xu
- Ye Zhu
- Xucheng Xue
- Dechang Xu
- Junwen Zhang
Institutions
- Soochow University (CN)
- Xi’an Jiaotong-Liverpool University (CN)
Publication Details
- Journal
- AI Agent
- Published
- 2026-10-26
- DOI
- https://doi.org/10.20517/aiagent.2026.19
- Primary Topic
- Topic Modeling
- Type
- article
- Field-Weighted Citation Impact
- 0.00