More problems of large language models in comparison with human knowledge

Abstract This paper builds on an earlier paper in this journal (Collins’s, 2024, ‘Why artificial intelligence needs sociology of knowledge …’). In that paper, an attempt was made to explain why LLMs had no moral compass. Here, we first explain more carefully where humans get their knowledge from and fill out the problems of LLMs by comparing them with humans. We then provide a new classification of different ways in which LLMs fail. There is one main cause, which is to do with sources of information, and there are three sub-categories. The first is to do with failures of reflexivity and has three sub-divisions; the second relates to the way LLMs interact with humans and has four sub-divisions; the third is to do with simple technical mistakes and has six sub-divisions. Each of the 13 kinds of problem is illustrated with an example of failure. We hope this new classification is exhaustive, but invite additions if it is not.

Authors

Publication Details

Journal
AI & Society
Published
2026-06-16
DOI
https://doi.org/10.1007/s00146-026-03021-w
Primary Topic
Computational and Text Analysis Methods
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

More problems of large language models in comparison with human knowledge

Robert Evans, Paul Newbury, Harry Collins, Simon Thorne
AI & Society
Computational and Text Analysis Methods
article

More problems of large language models in comparison with human knowledge

Robert Evans, Paul Newbury, Harry Collins, Simon Thorne
article en

Abstract

Abstract This paper builds on an earlier paper in this journal (Collins’s, 2024, ‘Why artificial intelligence needs sociology of knowledge …’). In that paper, an attempt was made to explain why LLMs had no moral compass. Here, we first explain more carefully where humans get their knowledge from and fill out the problems of LLMs by comparing them with humans. We then provide a new classification of different ways in which LLMs fail. There is one main cause, which is to do with sources of information, and there are three sub-categories. The first is to do with failures of reflexivity and has three sub-divisions; the second relates to the way LLMs interact with humans and has four sub-divisions; the third is to do with simple technical mistakes and has six sub-divisions. Each of the 13 kinds of problem is illustrated with an example of failure. We hope this new classification is exhaustive, but invite additions if it is not.

AI & Society
Quality Education
Openalex Percentile: Top 3%
Computational and Text Analysis Methods
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.