Filling the Temporal Void: Recovering Missing Publication Years in the Project Gutenberg Corpus Using LLMs

Analyzing texts spanning long periods of time is critical for researchers in historical linguistics and related disciplines.However, publicly available corpora suitable for such analyses are scarce.The Project Gutenberg (PG) corpus presents a significant yet underutilized opportunity in this context, due to the absence of accurate temporal metadata.We take advantage of language models and information retrieval to explore four sources of information -Open Web, Wikipedia, Open Library API, and PG books texts -to add missing temporal metadata to the PG corpus.Through 20 experiments employing state-of-the-art Large Language Models (LLMs) and Retrieval-Augmented Generation (RAG) methods, we estimate the production years of all PG books.We curate an enriched metadata repository for the PG corpus and propose a refined version for it, which includes 53 774 books with a total of 3.8 billion tokens in 11 languages, produced between 1600 and 2000.This work provides a new resource for computational linguistics and humanities studies focusing on diachronic analyses.The final dataset and all experiments data are publicly available 1 .

Authors

Institutions

Publication Details

Published
2025-01-01
DOI
https://doi.org/10.18653/v1/2025.findings-acl.890
Primary Topic
Digital Humanities and Scholarship
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Filling the Temporal Void: Recovering Missing Publication Years in the Project Gutenberg Corpus Using LLMs

Omar Momen, Manuel Schaaf, Alexander Mehler
Digital Humanities and Scholarship
article

Filling the Temporal Void: Recovering Missing Publication Years in the Project Gutenberg Corpus Using LLMs

Omar Momen, Manuel Schaaf, Alexander Mehler
article en

Abstract

Analyzing texts spanning long periods of time is critical for researchers in historical linguistics and related disciplines.However, publicly available corpora suitable for such analyses are scarce.The Project Gutenberg (PG) corpus presents a significant yet underutilized opportunity in this context, due to the absence of accurate temporal metadata.We take advantage of language models and information retrieval to explore four sources of information -Open Web, Wikipedia, Open Library API, and PG books texts -to add missing temporal metadata to the PG corpus.Through 20 experiments employing state-of-the-art Large Language Models (LLMs) and Retrieval-Augmented Generation (RAG) methods, we estimate the production years of all PG books.We curate an enriched metadata repository for the PG corpus and propose a refined version for it, which includes 53 774 books with a total of 3.8 billion tokens in 11 languages, produced between 1600 and 2000.This work provides a new resource for computational linguistics and humanities studies focusing on diachronic analyses.The final dataset and all experiments data are publicly available 1 .

Goethe University Frankfurt (DE), Goethe-Institute United Kingdom (GB)
Deutsche Forschungsgemeinschaft
Openalex Percentile: Top 80%
Digital Humanities and Scholarship
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Filling the Temporal Void: Recovering Missing Publication Years in the Project Gutenberg Corpus Using LLMs — Omar Momen, Manuel Schaaf, et al. · (2025) | TGRS Research Map | TGRS