Revealing emergent human-like conceptual representations from language prediction

People acquire concepts through rich physical and social experiences and use them to understand and navigate the world. In contrast, large language models (LLMs), trained solely through next-token prediction on text, exhibit strikingly human-like behaviors. Are these models developing concepts akin to those of humans? If so, how are such concepts represented, organized, and related to behavior? Here, we address these questions by investigating the representations formed by LLMs during an in-context concept inference task. We found that LLMs can flexibly derive concepts from linguistic descriptions in relation to contextual cues about other concepts. The derived representations converge toward a shared, context-independent structure, and alignment with this structure reliably predicts model performance across various understanding and reasoning tasks. Moreover, the convergent representations effectively capture human behavioral judgments and closely align with neural activity patterns in the human brain, providing evidence for biological plausibility. Together, these findings establish that structured, human-like conceptual representations can emerge purely from language prediction without real-world grounding, highlighting the role of conceptual structure in understanding intelligent behavior. More broadly, our work suggests that LLMs offer a tangible window into the nature of human concepts and lays the groundwork for advancing alignment between artificial and human intelligence.

Authors

Institutions

Publication Details

Journal
Proceedings of the National Academy of Sciences
Published
2025-10-31
DOI
https://doi.org/10.1073/pnas.2512514122
Citations
3
Primary Topic
Neurobiology of Language and Bilingualism
Type
article
Field-Weighted Citation Impact
4.29
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Revealing emergent human-like conceptual representations from language prediction

Chao Du, Qiang Luo, Xipeng Qiu, Ningyu Xu et al.
3 citations
Proceedings of the National Academy of Sciences
Neurobiology of Language and Bilingualism
4.29
article

Revealing emergent human-like conceptual representations from language prediction

Chao Du, Qiang Luo, Xipeng Qiu, Ningyu Xu, Xuanjing Huang, Qi Zhang, Menghan Zhang
article en
3 citations

Abstract

People acquire concepts through rich physical and social experiences and use them to understand and navigate the world. In contrast, large language models (LLMs), trained solely through next-token prediction on text, exhibit strikingly human-like behaviors. Are these models developing concepts akin to those of humans? If so, how are such concepts represented, organized, and related to behavior? Here, we address these questions by investigating the representations formed by LLMs during an in-context concept inference task. We found that LLMs can flexibly derive concepts from linguistic descriptions in relation to contextual cues about other concepts. The derived representations converge toward a shared, context-independent structure, and alignment with this structure reliably predicts model performance across various understanding and reasoning tasks. Moreover, the convergent representations effectively capture human behavioral judgments and closely align with neural activity patterns in the human brain, providing evidence for biological plausibility. Together, these findings establish that structured, human-like conceptual representations can emerge purely from language prediction without real-world grounding, highlighting the role of conceptual structure in understanding intelligent behavior. More broadly, our work suggests that LLMs offer a tangible window into the nature of human concepts and lays the groundwork for advancing alignment between artificial and human intelligence.

Proceedings of the National Academy of SciencesVol. 122(44)
Fudan University (CN), Intelligent Systems Research (United States) (US), Institute of Linguistics (CN), Institute of Genetics and Developmental Biology (CN), Shanghai Key Laboratory of Trustworthy Computing (CN), Intelligent Health (United Kingdom) (GB), Artificial Intelligence in Medicine (Canada) (CA)
Openalex Percentile: Top 5%
Neurobiology of Language and Bilingualism
4.29
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.