Alan's Speakeasy - An Ecosystem for the Evaluation of Conversational Agents
Conversational artificially intelligent agents have received increasing attention in recent years. For many use cases, evaluating such agents requires a human-in-the-loop approach. In this demo paper, we present Alan's Speakeasy, a Web-based ecosystem for the evaluation of conversational agents.
Authors
- Rosni Vasu
- Cristina Sarasua (ORCID: https://orcid.org/0000-0002-2076-9584)
- Hao-yu Duan (ORCID: https://orcid.org/0009-0009-6183-2859)
- Daan van der Weijden (ORCID: https://orcid.org/0000-0002-8024-7219)
- Luca Rossetto (ORCID: https://orcid.org/0000-0002-5389-9465)
- Oana Inel (ORCID: https://orcid.org/0000-0003-4691-6586)
- Dhivyabharathi Ramasamy (ORCID: https://orcid.org/0009-0002-9056-6907)
- Abraham Bernstein (ORCID: https://orcid.org/0000-0002-0128-4602)
- Athina Kyriakou (ORCID: https://orcid.org/0009-0002-0962-9828)
- Ruijie Wang (ORCID: https://orcid.org/0000-0002-0581-6709)
- Juan Diego Bermeo (ORCID: https://orcid.org/0009-0000-6874-4848)
- Varun Ghat Ravikumar
- Konstantina Timoleon (ORCID: https://orcid.org/0009-0004-0229-4441)
- Jan Willi (ORCID: https://orcid.org/0009-0000-6584-3744)
- Pablo Sebastian Bolaños (ORCID: https://orcid.org/0009-0001-7497-8293)
- Hugues Devimeux
- Robin Hany
Institutions
- University of Zurich (CH)
- Dublin City University (IE)
Publication Details
- Published
- 2025-05-08
- DOI
- https://doi.org/10.1145/3701716.3715165
- Primary Topic
- AI in Service Interactions
- Type
- article
- Field-Weighted Citation Impact
- 0.00