Mind Over Machine: Evaluating Theory of Mind Reasoning in LLMs and Humans

As Large Language Models (LLMs) become increasingly integrated into applications demanding human-like understanding-such as mental health support, education, and social robotics-their capacity to exhibit Theory of Mind (ToM) reasoning is essential. Although previous research has evaluated LLMs' capability in ToM tasks, a critical gap remains as few studies have systematically investigated how LLMs' ToM reasoning diverges from human reasoning and the extent of these differences. This study introduces a reinforcement learning-based framework designed to bridge this gap. This approach seeks to enhance LLM alignment with human ToM reasoning, effectively narrowing the differences in their reasoning processes. Finally, future research directions to advance this field will be discussed, including strategies for developing LLMs that can better approximate human social cognition. This work lays a foundation for responsible LLM deployment, offering guidelines for applications in sensitive contexts where accurate ToM understanding is crucial.

Authors

Institutions

Publication Details

Published
2025-02-26
DOI
https://doi.org/10.1145/3701551.3707417
Citations
1
Primary Topic
Topic Modeling
Type
article
Field-Weighted Citation Impact
2.48
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Mind Over Machine: Evaluating Theory of Mind Reasoning in LLMs and Humans

Maryam Amirizaniani
1 citations
Topic Modeling
2.48
article

Mind Over Machine: Evaluating Theory of Mind Reasoning in LLMs and Humans

Maryam Amirizaniani
article en
1 citations

Abstract

As Large Language Models (LLMs) become increasingly integrated into applications demanding human-like understanding-such as mental health support, education, and social robotics-their capacity to exhibit Theory of Mind (ToM) reasoning is essential. Although previous research has evaluated LLMs' capability in ToM tasks, a critical gap remains as few studies have systematically investigated how LLMs' ToM reasoning diverges from human reasoning and the extent of these differences. This study introduces a reinforcement learning-based framework designed to bridge this gap. This approach seeks to enhance LLM alignment with human ToM reasoning, effectively narrowing the differences in their reasoning processes. Finally, future research directions to advance this field will be discussed, including strategies for developing LLMs that can better approximate human social cognition. This work lays a foundation for responsible LLM deployment, offering guidelines for applications in sensitive contexts where accurate ToM understanding is crucial.

University of Washington (US)
Openalex Percentile: Top 12%
Topic Modeling
2.48
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.