Do large language models solve verbal analogies like children do?

Analogy-making lies at the heart of human cognition.Adults solve analogies such as horse belongs to stable like chicken belongs to . . .? by mapping relations (kept in) and answering chicken coop.In contrast, young children often use association, e.g., answering egg.This paper investigates whether large language models (LLMs) solve verbal analogies in A:B::C:?form using associations, similar to what children do.We use verbal analogies extracted from an online learning environment, where 14,006 7-12 year-olds from the Netherlands solved 872 analogies in Dutch.The eight tested LLMs performed at or above the level of children, with some models approaching adult performance estimates.However, when we control for solving by association this picture changes.We conclude that the LLMs we tested rely heavily on association like young children do.However, LLMs make different errors than children, and association doesn't fully explain their superior performance on this children's verbal analogy task.Future work will investigate whether LLMs associations and errors are more similar to adult relational reasoning.

Authors

Publication Details

Published
2025-01-01
DOI
https://doi.org/10.18653/v1/2025.conll-1.40
Primary Topic
Natural Language Processing Techniques
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Do large language models solve verbal analogies like children do?

Ekaterina Shutova, Claire E. Stevenson, Han L. J. van der Maas, Mathilde ter Veen et al.
Natural Language Processing Techniques
article

Do large language models solve verbal analogies like children do?

Ekaterina Shutova, Claire E. Stevenson, Han L. J. van der Maas, Mathilde ter Veen, Rochelle Choenni, Tamar Johnson
article en

Abstract

Analogy-making lies at the heart of human cognition.Adults solve analogies such as horse belongs to stable like chicken belongs to . . .? by mapping relations (kept in) and answering chicken coop.In contrast, young children often use association, e.g., answering egg.This paper investigates whether large language models (LLMs) solve verbal analogies in A:B::C:?form using associations, similar to what children do.We use verbal analogies extracted from an online learning environment, where 14,006 7-12 year-olds from the Netherlands solved 872 analogies in Dutch.The eight tested LLMs performed at or above the level of children, with some models approaching adult performance estimates.However, when we control for solving by association this picture changes.We conclude that the LLMs we tested rely heavily on association like young children do.However, LLMs make different errors than children, and association doesn't fully explain their superior performance on this children's verbal analogy task.Future work will investigate whether LLMs associations and errors are more similar to adult relational reasoning.

Quality Education
Openalex Percentile: Top 90%
Natural Language Processing Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Do large language models solve verbal analogies like children do? — Ekaterina Shutova, Claire E. Stevenson, et al. · (2025) | TGRS Research Map | TGRS