Cognitive Biases in Syllogistic Reasoning: A Comparative Study of Humans and Large Language Models

Understanding human cognitive processes for reasoning is a key step towards developing human-level AI reasoning systems. Syllogistic reasoning — a classical form of deductive reasoning — is a well-established paradigm for investigating human reasoning, known to elicit systematic cognitive biases such as belief bias and atmosphere effects. In this study, we compare the reasoning patterns of humans and three state-of-the-art Large Language Models (LLMs), namely GPT-4, GPT-4o and o4-mini, across multiple syllogism types with belief andatmosphere effects. Using an online questionnaire, we examine the biases in human syllogistic reasoning and compare this with the LLMs responses. We identify biases and differences in accuracy between different LLMs and humans. Belief-inconsistent statements, which contradict generally accepted common knowledge, and the atmosphere effect impact human and LLM answers. Our results show that, although LLMs outperform human participants, they exhibit human-like cognitive effects. We further evaluate the new reasoning model o4-mini, which performs nearly perfectly on the syllogism reasoning tasks and compare logic, human reasoning and LLM reasoning.

Authors

Institutions

Publication Details

Journal
Knowledge Commons Works (Michigan State University)
Published
2026-11-18
DOI
https://doi.org/10.17613/svsdb-r9j65
Primary Topic
Logic, Reasoning, and Knowledge
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

Cognitive Biases in Syllogistic Reasoning: A Comparative Study of Humans and Large Language Models

Frieder Stolzenburg, Stefanie Krause, Anna-Lena Henk
1 links
Knowledge Commons Works (Michigan State University)
Logic, Reasoning, and Knowledge
article

Cognitive Biases in Syllogistic Reasoning: A Comparative Study of Humans and Large Language Models

Frieder Stolzenburg, Stefanie Krause, Anna-Lena Henk
article en

Abstract

Understanding human cognitive processes for reasoning is a key step towards developing human-level AI reasoning systems. Syllogistic reasoning — a classical form of deductive reasoning — is a well-established paradigm for investigating human reasoning, known to elicit systematic cognitive biases such as belief bias and atmosphere effects. In this study, we compare the reasoning patterns of humans and three state-of-the-art Large Language Models (LLMs), namely GPT-4, GPT-4o and o4-mini, across multiple syllogism types with belief andatmosphere effects. Using an online questionnaire, we examine the biases in human syllogistic reasoning and compare this with the LLMs responses. We identify biases and differences in accuracy between different LLMs and humans. Belief-inconsistent statements, which contradict generally accepted common knowledge, and the atmosphere effect impact human and LLM answers. Our results show that, although LLMs outperform human participants, they exhibit human-like cognitive effects. We further evaluate the new reasoning model o4-mini, which performs nearly perfectly on the syllogism reasoning tasks and compare logic, human reasoning and LLM reasoning.

Knowledge Commons Works (Michigan State University)
University of Koblenz and Landau (DE), UNSW Sydney (AU), Research Institute for Music Theater Studies (DE), Fraunhofer Institute for Software and Systems Engineering (DE), International Hospital Kampala (UG), University of Bayreuth (DE), Harz University of Applied Sciences (DE)
Logic, Reasoning, and Knowledge
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon