Report on the 1st Workshop on Large Language Model for Evaluation in Information Retrieval (LLM4Eval 2024) at SIGIR 2024
The first edition of the workshop on Large Language Model for Evaluation in Information Retrieval (LLM4Eval 2024) took place in July 2024, co-located with the ACM SIGIR Conference 2024 in the USA (SIGIR 2024). The aim was to bring information retrieval researchers together around the topic of LLMs for evaluation in information retrieval that gathered attention with the advancement of large language models and generative AI. Given the novelty of the topic, the workshop was focused around multi-sided discussions, namely panels and poster sessions of the accepted proceedings papers. Date : 18 July 2024. Website : https://llm4eval.github.io.
Authors
- Charles L. A. Clarke (ORCID: https://orcid.org/0000-0001-8178-9194)
- Paul Thomas (ORCID: https://orcid.org/0000-0003-1671-9274)
- Hossein A. Rahmani (ORCID: https://orcid.org/0000-0002-2779-4942)
- Bhaskar Mitra (ORCID: https://orcid.org/0000-0002-5270-5550)
- Clemencia Siro (ORCID: https://orcid.org/0000-0001-5301-4244)
- Nick Craswell (ORCID: https://orcid.org/0000-0002-9351-8137)
- Mohammad Aliannejadi (ORCID: https://orcid.org/0000-0002-9447-4172)
- Guglielmo Faggioli (ORCID: https://orcid.org/0000-0002-5070-2049)
- Emine Yilmaz (ORCID: https://orcid.org/0000-0003-4734-4532)
Institutions
- Microsoft (United States) (US)
- University of Padua (IT)
- University of Waterloo (CA)
- Microsoft (Canada) (CA)
- University College London (GB)
- Seattle University (US)
- University of Amsterdam (NL)
Publication Details
- Journal
- ACM SIGIR Forum
- Published
- 2024-12-01
- DOI
- https://doi.org/10.1145/3722449.3722461
- Citations
- 6
- Primary Topic
- Topic Modeling
- Type
- article
- Field-Weighted Citation Impact
- 2.08