AI-driven Metadata Extraction and Semantic Search for Audiovisual Archives

ArchiveVault is a next-generation digital archiving system designed to enhance access to audiovisual collections through automated metadata extraction and advanced retrieval mechanisms. Traditional archiving methods are labor-intensive, requiring extensive manual annotation that often leads to incomplete and inconsistent metadata. ArchiveVault addresses this challenge by employing AI-based transcription, named entity recognition (NER), speaker diarization, and pose detection to extract structured metadata from audiovisual archives. This allows for rich, searchable metadata that improves retrieval precision beyond traditional keyword-based approaches. By leveraging state-of-the-art AI techniques, ArchiveVault enables researchers, archivists, and content creators to perform semantic searches across large collections, discovering moments of interest more effectively. Our deployments in a national broadcast archive (RTS) and the Olympic Games media collection demonstrate how AI-driven processing unlocks previously inaccessible content, from spoken-word analysis to pose-based retrieval for sports footage.

Authors

Institutions

Publication Details

Journal
Archiving Conference
Published
2025-06-24
DOI
https://doi.org/10.2352/issn.2168-3204.2025.22.1.21
Primary Topic
Music and Audio Processing
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

AI-driven Metadata Extraction and Semantic Search for Audiovisual Archives

Giacomo Alliata, Sarah Kenderdine, André Rattinger, Kirell Benzi
Archiving Conference
Music and Audio Processing
article

AI-driven Metadata Extraction and Semantic Search for Audiovisual Archives

Giacomo Alliata, Sarah Kenderdine, André Rattinger, Kirell Benzi
article en

Abstract

ArchiveVault is a next-generation digital archiving system designed to enhance access to audiovisual collections through automated metadata extraction and advanced retrieval mechanisms. Traditional archiving methods are labor-intensive, requiring extensive manual annotation that often leads to incomplete and inconsistent metadata. ArchiveVault addresses this challenge by employing AI-based transcription, named entity recognition (NER), speaker diarization, and pose detection to extract structured metadata from audiovisual archives. This allows for rich, searchable metadata that improves retrieval precision beyond traditional keyword-based approaches. By leveraging state-of-the-art AI techniques, ArchiveVault enables researchers, archivists, and content creators to perform semantic searches across large collections, discovering moments of interest more effectively. Our deployments in a national broadcast archive (RTS) and the Olympic Games media collection demonstrate how AI-driven processing unlocks previously inaccessible content, from spoken-word analysis to pose-based retrieval for sports footage.

Archiving ConferenceVol. 22(1)
École Polytechnique Fédérale de Lausanne (CH)
Openalex Percentile: Top 68%
Music and Audio Processing
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.