Can the current generation of large language models (LLMs) produce an adequate book index?

Artificial intelligence (AI) is seen as a threat to many creative professions and book indexers are no exception. This paper supplements our previously published article by investigating the capacity of the current generation of large language models (LLMs) to index a book chapter. The previous article found that an earlier generation of LLMs performed poorly on the three criteria of completeness, navigability, and accuracy. While the current generation does not under-index as severely, it has issues with excessive subheadings and navigability, and continues to fail a standard indexing test for accuracy. LLMs still cannot produce an adequate index.

Authors

Institutions

Publication Details

Journal
The Indexer
Published
2026-03-14
DOI
https://doi.org/10.3828/index.2026.4
Primary Topic
Publishing and Scholarly Communication
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Can the current generation of large language models (LLMs) produce an adequate book index?

Elizabeth Bartmess, Michele R. Combs
The Indexer
Publishing and Scholarly Communication
article

Can the current generation of large language models (LLMs) produce an adequate book index?

Elizabeth Bartmess, Michele R. Combs
article en

Abstract

Artificial intelligence (AI) is seen as a threat to many creative professions and book indexers are no exception. This paper supplements our previously published article by investigating the capacity of the current generation of large language models (LLMs) to index a book chapter. The previous article found that an earlier generation of LLMs performed poorly on the three criteria of completeness, navigability, and accuracy. While the current generation does not under-index as severely, it has issues with excessive subheadings and navigability, and continues to fail a standard indexing test for accuracy. LLMs still cannot produce an adequate index.

The IndexerVol. 44(1)
American Society of Civil Engineers (US), Research & Development Corporation (CA)
Quality Education
Openalex Percentile: Top 19%
Publishing and Scholarly Communication
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.