MaXIFE: Multilingual and Cross-lingual Instruction Following Evaluation
With the rapid adoption of large language models (LLMs) in natural language processing, the ability to follow instructions has emerged as a key metric for evaluating their practical utility.However, existing evaluation methods often focus on single-language scenarios, overlooking the challenges and differences present in multilingual and cross-lingual contexts.To address this gap, we introduce MaXIFE: a comprehensive evaluation benchmark designed to assess instruction-following capabilities across 23 different languages with 1667 verifiable instruction tasks.MaXIFE integrates both Rule-Based Evaluation and Model-Based Evaluation, ensuring a balance of efficiency and accuracy.We applied MaXIFE to evaluate several leading commercial LLMs, establishing baseline results for future comparisons.By providing a standardized tool for multilingual instructionfollowing evaluation, MaXIFE aims to advance research and development in natural language processing.
Authors
- Yile Liu
- Jinglu Hu (ORCID: https://orcid.org/0000-0002-5601-7261)
- Xiu Jiang
- Liang Li (ORCID: https://orcid.org/0000-0001-9381-8888)
- Ziwei Ma
- ChangJing ChangJing
Publication Details
- Published
- 2025-01-01
- DOI
- https://doi.org/10.18653/v1/2025.acl-long.698
- Primary Topic
- Second Language Learning and Teaching
- Type
- article
- Field-Weighted Citation Impact
- 0.00