A Spanish Language Proficiency Dataset for AI Evaluation

Benchmarking Spanish reading comprehension remains challenging due to the scarcity of proficiency-calibrated resources grounded in authentic human assessments. We introduce IC-UNED-RC-ES, a benchmark comprising more than 6000 items derived from Instituto Cervantes examinations, converted to a machine-readable format while preserving exam structure, proficiency levels, and scoring criteria. Unlike many existing resources, IC-UNED-RC-ES includes a diverse set of exercise formats, combining common multiple-choice questions with new formats such as matching and fill-in-the-gap, which support a broader assessment of reading skills. The benchmark supports evaluation at both the item and exam levels and includes an exercise taxonomy with category-specific metrics. Baseline results with current AI systems reveal a strong difficulty effect (a 15-point drop from lower to advanced levels) and substantial variation across exercise types, with inference- and discourse-heavy categories reaching only 41%. IC-UNED-RC-ES provides a human-aligned, interpretable testbed for diagnosing strengths and weaknesses in Spanish reading comprehension and for tracking progress across model generations.

Authors

Institutions

Publication Details

Journal
Information
Published
2026-02-05
DOI
https://doi.org/10.3390/info17020159
Primary Topic
Text Readability and Simplification
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A Spanish Language Proficiency Dataset for AI Evaluation

Sergio Moreno‐Álvarez, Julio Reyes-Montesinos, Álvaro Rodrigo, Javier Fruns-Jiménez et al.
Information
Text Readability and Simplification
article

A Spanish Language Proficiency Dataset for AI Evaluation

Sergio Moreno‐Álvarez, Julio Reyes-Montesinos, Álvaro Rodrigo, Javier Fruns-Jiménez, Alberto Pérez, Inés Soria-Pastor
article en

Abstract

Benchmarking Spanish reading comprehension remains challenging due to the scarcity of proficiency-calibrated resources grounded in authentic human assessments. We introduce IC-UNED-RC-ES, a benchmark comprising more than 6000 items derived from Instituto Cervantes examinations, converted to a machine-readable format while preserving exam structure, proficiency levels, and scoring criteria. Unlike many existing resources, IC-UNED-RC-ES includes a diverse set of exercise formats, combining common multiple-choice questions with new formats such as matching and fill-in-the-gap, which support a broader assessment of reading skills. The benchmark supports evaluation at both the item and exam levels and includes an exercise taxonomy with category-specific metrics. Baseline results with current AI systems reveal a strong difficulty effect (a 15-point drop from lower to advanced levels) and substantial variation across exercise types, with inference- and discourse-heavy categories reaching only 41%. IC-UNED-RC-ES provides a human-aligned, interpretable testbed for diagnosing strengths and weaknesses in Spanish reading comprehension and for tracking progress across model generations.

InformationVol. 17(2)
Cervantes Institute (ES), Universidad Nacional de Educación a Distancia (ES)
Quality Education
Openalex Percentile: Top 66%
Text Readability and Simplification
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.