MultiChallenge: A Realistic Multi-Turn Conversation Evaluation Benchmark Challenging to Frontier LLMs
Kaustubh Deshpande, Ved Sirdeshmukh, Johannes Baptist Mols, Lifeng Jin, Ed-Yeremai Hernandez-Cardona, Dean Lee, Jeremy Kritz, Willow E. Primack, Summer Yue, Chen Xing. Findings of the Association for Computational Linguistics: ACL 2025. 2025.
Authors
- Deokjung Lee (ORCID: https://orcid.org/0000-0002-3935-5058)
- Lifeng Jin
- Summer Yue
- Chen Xing (ORCID: https://orcid.org/0000-0003-3189-0969)
- Ved Sirdeshmukh
- Kaustubh Deshpande
- Johannes Mols
- Jeremy Kritz
- Willow E. Primack
- Ed-Yeremai Hernandez-Cardona
Publication Details
- Published
- 2025-01-01
- DOI
- https://doi.org/10.18653/v1/2025.findings-acl.958
- Citations
- 1
- Primary Topic
- Semantic Web and Ontologies
- Type
- article
- Field-Weighted Citation Impact
- 2.48