Rethinking Think-Aloud in the Age of Language Models
Understanding the human mind has long been a central goal of cognitive science, yet behavioral measures such as button presses provide only indirect traces of thought. Think-Aloud protocols, where participants verbalize their reasoning, offer a more direct probe but have long been criticized as unreliable and difficult to scale. Here we revisit this debate using one of the largest Think-Aloud datasets to date—44,038 paired transcripts and choices in risky decision-making. Our results make three contributions. First, concurrent Think-Aloud analyzed with large language models (LLMs) surpasses classic cognitive models and neural networks in predicting behavior, showing that verbal reports contain generative information beyond behavior alone. Second, Think-Aloud generalizes across individuals with only a few examples, reflecting shared cognitive patterns. Third, Think-Aloud guides LLMs toward more human-like reasoning. Together, these findings position Think-Aloud as a scalable complement to behavioral measures, reopening a foundational debate in cognitive science and informing human-aligned AI.
Authors
- Hua-Dong Xiong (ORCID: https://orcid.org/0000-0002-5875-4062)
- Hanbo Xie (ORCID: https://orcid.org/0000-0003-1133-8544)
- Robert C. Wilson (ORCID: https://orcid.org/0000-0002-2963-2971)
Institutions
- University of Arizona (US)
Publication Details
- Published
- 2025-08-31
- DOI
- https://doi.org/10.31234/osf.io/6ta3z_v1
- Citations
- 1
- Primary Topic
- Natural Language Processing Techniques
- Type
- article
- Field-Weighted Citation Impact
- 2.48
Funders
- Georgia Institute of Technology
- Research Corporation for Scientific Advancement