ESNformer: A Hybrid Reservoir–Transformer Architecture for Interpretable, Position-Aware Classification of Structured Assessment Data, with a Braille-Literacy Case Study
We present ESNformer, a hybrid architecture that couples an Echo State Network (ESN) reservoir with a Transformer encoder for classification of structured, multi-indicator assessment data: a fixed-order vector of complementary indicators per assessment instance rather than a repeated-measures time series. The reservoir acts as a fixed nonlinear feature map over the indicator vector, while self-attention, made position-aware over the fixed column order, learns how each indicator’s evidence contributes to the final decision, so the two components, together, capture local, indicator-level detail and global, cross-indicator interactions within a single, end-to-end trainable model. Interpretability is treated as a first-class design requirement rather than an afterthought: the architecture is paired with an explainability layer combining SHAP feature attribution (reported both globally and per class), the model’s own attention weights, a deletion/insertion faithfulness test that quantitatively verifies which inputs the model actually relies on, and counterfactual maps that translate a prediction into an actionable, inspectable recommendation. We evaluate the architecture on a concrete case study, classifying Braille-literacy instructional recommendations from 15 pedagogical indicators grouped into three categories (Mangold’s, ABKL, and Progresar), using a benchmark of 900 real assessment instances (630 used, together with a class-conditional augmentation procedure, to build a 2100-instance training set) with validation and test partitions (135 instances each) kept exclusively real. On this benchmark, the tuned model reached 85.33% accuracy, 85.90% macro-precision, 85.33% macro-recall, an F1 score of 85.25%, and an AUC of 0.95 on the real test set. SHAP attribution, attention weights, and the faithfulness test converge on the same two dominant indicators (response time and error count): removing them alone collapses accuracy to chance, while retaining only them recovers most of the model’s accuracy. We report this transparently alongside a comparison against ESN-only, Transformer-only, and tabular baselines (logistic regression, decision tree, random forest, XGBoost, and an MLP) on the same data and discuss what the hybrid architecture and its explainability pipeline add beyond what the two dominant indicators already explain and how the approach generalizes to other tabular and mixed-granularity assessment settings that require both predictive accuracy and a verifiable account of what drove each decision.
Authors
- César Hernando Valencia Niño (ORCID: https://orcid.org/0000-0001-6077-6458)
- Rafael A. Núñez-Rodríguez (ORCID: https://orcid.org/0000-0001-6775-776X)
- Marley Vellasco (ORCID: https://orcid.org/0000-0002-9790-1328)
- Jeison Marín (ORCID: https://orcid.org/0009-0003-2079-3642)
Institutions
- Pontifícia Universidade Católica do Rio de Janeiro (BR)
- Universidad Santo Tomás (CO)
- Unidades Tecnológicas de Santander (CO)
Publication Details
- Journal
- Technologies
- Published
- 2026-08-21
- DOI
- https://doi.org/10.3390/technologies14080517
- Primary Topic
- Neural Networks and Reservoir Computing
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- Instituto Colombiano de Crédito Educativo y Estudios Técnicos en el Exterior