Extending Lifelog Retrieval to Multi-stream Video Retrieval at the CASTLE Challenge 2025

We present the DCU team's system for the CASTLE Challenge at ACM Multimedia 2025, which explores video retrieval and question answering in egocentric, multi-user environments. Our system adapts techniques developed for lifelogging, particularly event-based semantic retrieval and QA pipelines, to the CASTLE dataset with minimal architectural changes. It combines vision-language embeddings, transcript-based retrieval, and person tracking to support both automatic and interactive search workflows. In the interactive track, we introduce a modular interface for narrative reconstruction and exploratory search. Qualitative results show that the system can generate plausible, evidence-based answers to complex multimodal queries. These findings suggest that lifelog retrieval systems offer a viable foundation for broader egocentric video analysis.

Authors

Institutions

Publication Details

Published
2025-10-25
DOI
https://doi.org/10.1145/3746027.3760244
Citations
1
Primary Topic
Multimodal Machine Learning Applications
Type
article
Field-Weighted Citation Impact
1.28
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Extending Lifelog Retrieval to Multi-stream Video Retrieval at the CASTLE Challenge 2025

Ly-Duyen Tran, Thang-Long Nguyen-Ho, Hoang-Bao Le, Graham Healy et al.
1 citations
Multimodal Machine Learning Applications
1.28
article

Extending Lifelog Retrieval to Multi-stream Video Retrieval at the CASTLE Challenge 2025

Ly-Duyen Tran, Thang-Long Nguyen-Ho, Hoang-Bao Le, Graham Healy, Quang-Linh Tran, Liting Zhou
article en
1 citations

Abstract

We present the DCU team's system for the CASTLE Challenge at ACM Multimedia 2025, which explores video retrieval and question answering in egocentric, multi-user environments. Our system adapts techniques developed for lifelogging, particularly event-based semantic retrieval and QA pipelines, to the CASTLE dataset with minimal architectural changes. It combines vision-language embeddings, transcript-based retrieval, and person tracking to support both automatic and interactive search workflows. In the interactive track, we introduce a modular interface for narrative reconstruction and exploratory search. Qualitative results show that the system can generate plausible, evidence-based answers to complex multimodal queries. These findings suggest that lifelog retrieval systems offer a viable foundation for broader egocentric video analysis.

Dublin City University (IE)
Openalex Percentile: Top 15%
Multimodal Machine Learning Applications
1.28
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.