The State-of-the-Art in Lifelog Retrieval: A Review of Progress at the ACM Lifelog Search Challenge Workshop 2022-2024
The ACM Lifelog Search Challenge (LSC) is an annual interactive competition that evaluates interactive systems for searching and exploring lifelog data. This paper reviews the recent advances in interactive lifelog retrieval as demonstrated at the ACM LSC from 2022 to 2024. Through a detailed comparative analysis, we highlight key improvements across three main retrieval tasks: known-item search, question answering, and ad-hoc search. Our analysis identifies trends such as the widespread adoption of embedding-based retrieval methods (e.g., CLIP, BLIP), increased integration of large language models (LLMs) for conversational retrieval, and continued innovation in multimodal and collaborative search interfaces. We further discuss how specific retrieval techniques and user interface (UI) designs have impacted system performance, emphasizing the importance of balancing retrieval complexity with usability. Our findings indicate that embedding-driven approaches combined with LLMs show promise for lifelog retrieval systems. Likewise, improving UI design can enhance usability and efficiency. Additionally, we recommend reconsidering multi-instance system evaluations within the expert track to better manage variability in user familiarity.
Authors
- Cathal Gurrin (ORCID: https://orcid.org/0000-0003-2903-3968)
- Klaus Schoeffmann (ORCID: https://orcid.org/0000-0002-9218-1704)
- Ly-Duyen Tran (ORCID: https://orcid.org/0000-0002-9597-1832)
- Steve E. Hodges (ORCID: https://orcid.org/0000-0001-9314-7762)
- Luca Rossetto (ORCID: https://orcid.org/0000-0002-5389-9465)
- Graham Healy (ORCID: https://orcid.org/0000-0001-6429-6339)
- Minh–Triet Tran (ORCID: https://orcid.org/0000-0003-3046-3041)
- Werner Bailer (ORCID: https://orcid.org/0000-0003-2442-4900)
- Lucia Vadicamo (ORCID: https://orcid.org/0000-0001-7182-7038)
- Björn Þór Jónsson (ORCID: https://orcid.org/0000-0003-0889-3491)
- Duc-Tien Dang-Nguyen
Institutions
- Istituto di Scienza e Tecnologie dell'Informazione "Alessandro Faedo" (IT)
- Reykjavík University (IS)
- Vietnam National University Ho Chi Minh City (VN)
- Joanneum Research (AT)
- Ho Chi Minh City University of Science (VN)
- Klinikum Klagenfurt (AT)
- National Research Council (IT)
- University of Klagenfurt (AT)
- Dublin City University (IE)
- University of Bergen (NO)
- Lancaster University (GB)
Publication Details
- Journal
- IEEE Access
- Published
- 2025-01-01
- DOI
- https://doi.org/10.1109/access.2025.3644952
- Primary Topic
- Topic Modeling
- Type
- article
- Field-Weighted Citation Impact
- 0.00