Interactive Retrieval System for Multi-Stream Collections: multiXview at CASTLE 2025 Interactive Grand Challenge
We introduce multiXview, an interactive retrieval framework for synchronized multi-camera video collections. It features a multi-index search engine that supports natural-language queries over visual embeddings, speech transcripts, and scene descriptions. It supports a synchronized multi-stream player offering parallel playback, and a timeline-based navigation view for temporal scoping and faceted exploration. These components address the redundancy and fragmentation of overlapping egocentric and exocentric video feeds and enable users to locate, aggregate, and reconstruct events across partial perspectives. This paper focuses on system design and implementation, with quantitative and qualitative evaluation to take place at the CASTLE 2025 Grand Challenge Interactive Track.
Authors
- Gonçalo Marcelino
- Aaron Duane (ORCID: https://orcid.org/0000-0002-9825-1654)
- Ujjwal Sharma (ORCID: https://orcid.org/0000-0003-0285-1303)
- Marcel Worring (ORCID: https://orcid.org/0000-0003-4097-4136)
- Omar Shahbaz Khan (ORCID: https://orcid.org/0000-0001-9720-3645)
- Stevan Rudinac (ORCID: https://orcid.org/0000-0003-1904-8736)
- Björn Þór Jónsson (ORCID: https://orcid.org/0000-0003-0889-3491)
Institutions
- Reykjavík University (IS)
- Copenhagen Hospitality College (DK)
- Amsterdam University of the Arts (NL)
- University of Amsterdam (NL)
Publication Details
- Published
- 2025-10-25
- DOI
- https://doi.org/10.1145/3746027.3760243
- Citations
- 1
- Primary Topic
- Advanced Image and Video Retrieval Techniques
- Type
- article
- Field-Weighted Citation Impact
- 1.28