Extending Lifelog Retrieval to Multi-stream Video Retrieval at the CASTLE Challenge 2025
We present the DCU team's system for the CASTLE Challenge at ACM Multimedia 2025, which explores video retrieval and question answering in egocentric, multi-user environments. Our system adapts techniques developed for lifelogging, particularly event-based semantic retrieval and QA pipelines, to the CASTLE dataset with minimal architectural changes. It combines vision-language embeddings, transcript-based retrieval, and person tracking to support both automatic and interactive search workflows. In the interactive track, we introduce a modular interface for narrative reconstruction and exploratory search. Qualitative results show that the system can generate plausible, evidence-based answers to complex multimodal queries. These findings suggest that lifelog retrieval systems offer a viable foundation for broader egocentric video analysis.
Authors
- Ly-Duyen Tran (ORCID: https://orcid.org/0000-0002-9597-1832)
- Thang-Long Nguyen-Ho (ORCID: https://orcid.org/0000-0003-1953-7679)
- Hoang-Bao Le (ORCID: https://orcid.org/0009-0000-2496-4347)
- Graham Healy (ORCID: https://orcid.org/0000-0001-6429-6339)
- Quang-Linh Tran (ORCID: https://orcid.org/0000-0002-5409-0916)
- Liting Zhou (ORCID: https://orcid.org/0000-0002-7778-8743)
Institutions
- Dublin City University (IE)
Publication Details
- Published
- 2025-10-25
- DOI
- https://doi.org/10.1145/3746027.3760244
- Citations
- 1
- Primary Topic
- Multimodal Machine Learning Applications
- Type
- article
- Field-Weighted Citation Impact
- 1.28