How Humans and LLMs Organize Conceptual Knowledge: Exploring Subordinate Categories in Italian

People can categorize the same entity at multiple taxonomic levels, such as basic (bear), superordinate (animal), and subordinate (grizzly bear).While prior research has focused on basic-level categories, this study is the first attempt to examine the organization of categories by analyzing exemplars produced at the subordinate level.We present a new Italian psycholinguistic dataset of human-generated exemplars for 187 concrete words.We then use these data to evaluate whether textual and vision LLMs produce meaningful exemplars that align with human category organization across three key tasks: exemplar generation, category induction, and typicality judgment.Our findings show a low alignment between humans and LLMs, consistent with previous studies.However, their performance varies notably across different semantic domains.Ultimately, this study highlights both the promises and the constraints of using AI-generated exemplars to support psychological and linguistic research. 1

Authors

Publication Details

Published
2025-01-01
DOI
https://doi.org/10.18653/v1/2025.acl-long.224
Citations
1
Primary Topic
Natural Language Processing Techniques
Type
article
Field-Weighted Citation Impact
2.48

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

How Humans and LLMs Organize Conceptual Knowledge: Exploring Subordinate Categories in Italian

Marianna Bolognesi, Caterina Villani, Giulia Rambelli, Andrea Pedrotti
1 citations
Natural Language Processing Techniques
2.48
article

How Humans and LLMs Organize Conceptual Knowledge: Exploring Subordinate Categories in Italian

Marianna Bolognesi, Caterina Villani, Giulia Rambelli, Andrea Pedrotti
article en
1 citations

Abstract

People can categorize the same entity at multiple taxonomic levels, such as basic (bear), superordinate (animal), and subordinate (grizzly bear).While prior research has focused on basic-level categories, this study is the first attempt to examine the organization of categories by analyzing exemplars produced at the subordinate level.We present a new Italian psycholinguistic dataset of human-generated exemplars for 187 concrete words.We then use these data to evaluate whether textual and vision LLMs produce meaningful exemplars that align with human category organization across three key tasks: exemplar generation, category induction, and typicality judgment.Our findings show a low alignment between humans and LLMs, consistent with previous studies.However, their performance varies notably across different semantic domains.Ultimately, this study highlights both the promises and the constraints of using AI-generated exemplars to support psychological and linguistic research. 1

European Commission
Openalex Percentile: Top 9%
Natural Language Processing Techniques
2.48
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

How Humans and LLMs Organize Conceptual Knowledge: Exploring Subordinate Categories in Italian — Marianna Bolognesi, Caterina Villani, et al. · (2025) | TGRS Research Map | TGRS