Global MMLU: Understanding and Addressing Cultural and Linguistic Biases in Multilingual Evaluation
Shivalika Singh, Angelika Romanou, Clémentine Fourrier, David Ifeoluwa Adelani, Jian Gang Ngui, Daniel Vila-Suero, Peerat Limkonchotiwat, Kelly Marchisio, Wei Qi Leong, Yosephine Susanto, Raymond Ng, Shayne Longpre, Sebastian Ruder, Wei-Yin Ko, Antoine Bosselut, Alice Oh, Andre Martins, Leshem Choshen, Daphne Ippolito, Enzo Ferrante, Marzieh Fadaee, Beyza Ermis, Sara Hooker. Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 2025.
Authors
- Shayne Longpre
- Jian Gang Ngui
- Daphne Ippolito (ORCID: https://orcid.org/0000-0001-9328-8995)
- Kelly Marchisio
- Enzo Ferrante
- Yosephine Susanto
- Sebastian Ruder
- Peerat Limkonchotiwat (ORCID: https://orcid.org/0000-0002-7212-8228)
- Wei Qi Leong (ORCID: https://orcid.org/0009-0002-0645-1112)
- Leshem Choshen (ORCID: https://orcid.org/0000-0002-0085-6496)
- Daniel Vila-Suero
- Shivalika Singh
- Alice Oh (ORCID: https://orcid.org/0000-0002-7884-3038)
- Beyza Ermiş
- Clémentine Fourrier (ORCID: https://orcid.org/0000-0001-6500-6030)
- Wei-Yin Ko
- André L. Martins (ORCID: https://orcid.org/0000-0002-4794-0644)
- Marzieh Fadaee (ORCID: https://orcid.org/0000-0002-4447-1213)
- Sara Hooker (ORCID: https://orcid.org/0000-0002-0190-6459)
- Antoine Bosselut (ORCID: https://orcid.org/0000-0001-8968-9649)
- David Ifeoluwa Adelani (ORCID: https://orcid.org/0000-0002-0193-2083)
- Angelika Romanou
- Raymond T. Ng (ORCID: https://orcid.org/0000-0003-3692-8524)
Publication Details
- Published
- 2025-01-01
- DOI
- https://doi.org/10.18653/v1/2025.acl-long.919
- Citations
- 4
- Primary Topic
- Second Language Learning and Teaching
- Type
- article
- Field-Weighted Citation Impact
- 60.70
Funders
- Institute for Catastrophic Loss Reduction