Between the Human Gaze and AI: a Human-in-the-Loop Approach to the Study of Late Medieval Illuminated Manuscripts

The application of artificial intelligence to cultural heritage is a multidisciplinary research field that brings together experts from different backgrounds, merging computer science and historical expertise. Recently, the systematic digitization of collections has opened up new possibilities for experimentation, but human-centered AI and qualitative approaches continue to be preferred over unsupervised quantitative ones. In the case of manuscript codices, a variety of deep neural networks have been developed for the automatic analysis of pages, the extraction of layout components, or the transcription of text. Multiple attempts have been also made in the illuminated specimens to detect miniatures and other decorative elements. Such models are usually intended for a specialist audience and developed to speed up the consultation process, but they can also be integrated into visualization interfaces and become valid tools for enhancing volumes. The paper presents the deep neural network developed in the “IlluminAI Project” of the CNR-ISPC and the incremental learning cycle used, at the same time, for its training and the semi-automatic labeling of an original dataset. After a brief introduction to contextualize the project, we will describe and discuss the cycle implemented to optimize human involvement to verify and correct the predictions made by the model.

Authors

Institutions

Publication Details

Journal
Umanistica Digitale
Published
2026-11-17
DOI
https://doi.org/10.60923/issn.2532-8816/25623
Primary Topic
Digital Humanities and Scholarship
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

Between the Human Gaze and AI: a Human-in-the-Loop Approach to the Study of Late Medieval Illuminated Manuscripts

Giorgio Gosti, Bruno Fanini, Valeria Minisini
5 links
Umanistica Digitale
Digital Humanities and Scholarship
article

Between the Human Gaze and AI: a Human-in-the-Loop Approach to the Study of Late Medieval Illuminated Manuscripts

Giorgio Gosti, Bruno Fanini, Valeria Minisini
article en

Abstract

The application of artificial intelligence to cultural heritage is a multidisciplinary research field that brings together experts from different backgrounds, merging computer science and historical expertise. Recently, the systematic digitization of collections has opened up new possibilities for experimentation, but human-centered AI and qualitative approaches continue to be preferred over unsupervised quantitative ones. In the case of manuscript codices, a variety of deep neural networks have been developed for the automatic analysis of pages, the extraction of layout components, or the transcription of text. Multiple attempts have been also made in the illuminated specimens to detect miniatures and other decorative elements. Such models are usually intended for a specialist audience and developed to speed up the consultation process, but they can also be integrated into visualization interfaces and become valid tools for enhancing volumes. The paper presents the deep neural network developed in the “IlluminAI Project” of the CNR-ISPC and the incremental learning cycle used, at the same time, for its training and the semi-automatic labeling of an original dataset. After a brief introduction to contextualize the project, we will describe and discuss the cycle implemented to optimize human involvement to verify and correct the predictions made by the model.

Umanistica Digitale(25)
Cineca (IT), National Research Council (IT), Confederazione Nazionale dell'Artigianato e Della Piccola e Media Impresa (IT), Sapienza University of Rome (IT)
European Commission, HORIZON EUROPE Framework Programme, NextGenerationEU
Digital Humanities and Scholarship
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon