People prefer AI to human advice in multi-turn conversations but neither changes incentivised behaviour
People increasingly ask AI chatbots for advice, yet large language models (LLMs) are sycophantic, overconfident, and can amplify human cognitive biases. In this article, we investigate how people perceive advice from humans versus LLMs and whether AI advice reshapes incentive-compatible donation decisions. Using Carrier, a new experimental platform, we designed an experiment where participants made a donation decision after discussing it with an AI chatbot advisor, another human, or receiving no advice. Participants judged LLM advisors to be significantly more rational, trustworthy, convincing, and sycophantic than human advisors. Analysis of chatlogs showed that LLMs were more engaged than human advisors: they shared more facts and more often stated their opinion and justified their recommendations. Despite this, donation decisions did not vary across conditions.
Authors
- Vanessa Cheung (ORCID: https://orcid.org/0009-0009-0849-9815)
- Falk Lieder (ORCID: https://orcid.org/0000-0003-2746-6110)
- Jiahao Eric Yang
- Tsz Kwan Emmy Wong
- Maximilian Maier
Publication Details
- Journal
- arXiv (Cornell University)
- Published
- 2026-11-12
- DOI
- https://doi.org/10.48550/arxiv.2611.16667
- Primary Topic
- Experimental Behavioral Economics Studies
- Type
- preprint