LLMs and Meaning: what the current semantic challenges in LLMs highlight about Natural Language

Recent advances in large language models (LLMs) have led to increasingly strong claims about their human-level linguistic competence and, by extension, their relevance for understanding natural language and cognition. While a growing interdisciplinary literature has used behavioural tests and psychometric tools to assess LLM performance, particularly in linguistics, such comparisons raise substantial conceptual and methodological concerns. This paper examines what current semantic limitations in LLMs reveal about the nature of meaning in natural language. Drawing on empirical findings from psycholinguistics, the analysis shows that, despite fluent surface-level performance, LLMs systematically lack core aspects of semantic competence, including real-world grounding, communicative intent, and stable grammatical judgment. These limitations are then situated within broader theoretical frameworks from the philosophy of cognitive science, focusing on Miracchi’s reformulation of the Frame Problem and the Relevance Realisation framework. Together, these approaches highlight the central role of embodied agency, environmental embeddedness, and socio-cultural context in human meaning-making, and clarify why current computational architectures struggle with semantic relevance. The paper concludes by arguing for a bio-cultural conception of language, suggesting that the semantic gaps observed in LLMs are not merely technical shortcomings but reflect fundamental differences between algorithmic systems and human linguistic cognition.

Authors

Publication Details

Journal
PhilPapers (PhilPapers Foundation)
Published
2026-01-21
Primary Topic
Neurobiology of Language and Bilingualism
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

LLMs and Meaning: what the current semantic challenges in LLMs highlight about Natural Language

Silvia Rondini
PhilPapers (PhilPapers Foundation)
Neurobiology of Language and Bilingualism
article

LLMs and Meaning: what the current semantic challenges in LLMs highlight about Natural Language

Silvia Rondini
article en

Abstract

Recent advances in large language models (LLMs) have led to increasingly strong claims about their human-level linguistic competence and, by extension, their relevance for understanding natural language and cognition. While a growing interdisciplinary literature has used behavioural tests and psychometric tools to assess LLM performance, particularly in linguistics, such comparisons raise substantial conceptual and methodological concerns. This paper examines what current semantic limitations in LLMs reveal about the nature of meaning in natural language. Drawing on empirical findings from psycholinguistics, the analysis shows that, despite fluent surface-level performance, LLMs systematically lack core aspects of semantic competence, including real-world grounding, communicative intent, and stable grammatical judgment. These limitations are then situated within broader theoretical frameworks from the philosophy of cognitive science, focusing on Miracchi’s reformulation of the Frame Problem and the Relevance Realisation framework. Together, these approaches highlight the central role of embodied agency, environmental embeddedness, and socio-cultural context in human meaning-making, and clarify why current computational architectures struggle with semantic relevance. The paper concludes by arguing for a bio-cultural conception of language, suggesting that the semantic gaps observed in LLMs are not merely technical shortcomings but reflect fundamental differences between algorithmic systems and human linguistic cognition.

PhilPapers (PhilPapers Foundation)
Quality Education
Openalex Percentile: Top 80%
Neurobiology of Language and Bilingualism
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.