ESNformer: A Hybrid Reservoir–Transformer Architecture for Interpretable, Position-Aware Classification of Structured Assessment Data, with a Braille-Literacy Case Study

We present ESNformer, a hybrid architecture that couples an Echo State Network (ESN) reservoir with a Transformer encoder for classification of structured, multi-indicator assessment data: a fixed-order vector of complementary indicators per assessment instance rather than a repeated-measures time series. The reservoir acts as a fixed nonlinear feature map over the indicator vector, while self-attention, made position-aware over the fixed column order, learns how each indicator’s evidence contributes to the final decision, so the two components, together, capture local, indicator-level detail and global, cross-indicator interactions within a single, end-to-end trainable model. Interpretability is treated as a first-class design requirement rather than an afterthought: the architecture is paired with an explainability layer combining SHAP feature attribution (reported both globally and per class), the model’s own attention weights, a deletion/insertion faithfulness test that quantitatively verifies which inputs the model actually relies on, and counterfactual maps that translate a prediction into an actionable, inspectable recommendation. We evaluate the architecture on a concrete case study, classifying Braille-literacy instructional recommendations from 15 pedagogical indicators grouped into three categories (Mangold’s, ABKL, and Progresar), using a benchmark of 900 real assessment instances (630 used, together with a class-conditional augmentation procedure, to build a 2100-instance training set) with validation and test partitions (135 instances each) kept exclusively real. On this benchmark, the tuned model reached 85.33% accuracy, 85.90% macro-precision, 85.33% macro-recall, an F1 score of 85.25%, and an AUC of 0.95 on the real test set. SHAP attribution, attention weights, and the faithfulness test converge on the same two dominant indicators (response time and error count): removing them alone collapses accuracy to chance, while retaining only them recovers most of the model’s accuracy. We report this transparently alongside a comparison against ESN-only, Transformer-only, and tabular baselines (logistic regression, decision tree, random forest, XGBoost, and an MLP) on the same data and discuss what the hybrid architecture and its explainability pipeline add beyond what the two dominant indicators already explain and how the approach generalizes to other tabular and mixed-granularity assessment settings that require both predictive accuracy and a verifiable account of what drove each decision.

Authors

Institutions

Publication Details

Journal
Technologies
Published
2026-08-21
DOI
https://doi.org/10.3390/technologies14080517
Primary Topic
Neural Networks and Reservoir Computing
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

ESNformer: A Hybrid Reservoir–Transformer Architecture for Interpretable, Position-Aware Classification of Structured Assessment Data, with a Braille-Literacy Case Study

César Hernando Valencia Niño, Rafael A. Núñez-Rodríguez, Marley Vellasco, Jeison Marín
Technologies
Neural Networks and Reservoir Computing
article

ESNformer: A Hybrid Reservoir–Transformer Architecture for Interpretable, Position-Aware Classification of Structured Assessment Data, with a Braille-Literacy Case Study

César Hernando Valencia Niño, Rafael A. Núñez-Rodríguez, Marley Vellasco, Jeison Marín
article en

Abstract

We present ESNformer, a hybrid architecture that couples an Echo State Network (ESN) reservoir with a Transformer encoder for classification of structured, multi-indicator assessment data: a fixed-order vector of complementary indicators per assessment instance rather than a repeated-measures time series. The reservoir acts as a fixed nonlinear feature map over the indicator vector, while self-attention, made position-aware over the fixed column order, learns how each indicator’s evidence contributes to the final decision, so the two components, together, capture local, indicator-level detail and global, cross-indicator interactions within a single, end-to-end trainable model. Interpretability is treated as a first-class design requirement rather than an afterthought: the architecture is paired with an explainability layer combining SHAP feature attribution (reported both globally and per class), the model’s own attention weights, a deletion/insertion faithfulness test that quantitatively verifies which inputs the model actually relies on, and counterfactual maps that translate a prediction into an actionable, inspectable recommendation. We evaluate the architecture on a concrete case study, classifying Braille-literacy instructional recommendations from 15 pedagogical indicators grouped into three categories (Mangold’s, ABKL, and Progresar), using a benchmark of 900 real assessment instances (630 used, together with a class-conditional augmentation procedure, to build a 2100-instance training set) with validation and test partitions (135 instances each) kept exclusively real. On this benchmark, the tuned model reached 85.33% accuracy, 85.90% macro-precision, 85.33% macro-recall, an F1 score of 85.25%, and an AUC of 0.95 on the real test set. SHAP attribution, attention weights, and the faithfulness test converge on the same two dominant indicators (response time and error count): removing them alone collapses accuracy to chance, while retaining only them recovers most of the model’s accuracy. We report this transparently alongside a comparison against ESN-only, Transformer-only, and tabular baselines (logistic regression, decision tree, random forest, XGBoost, and an MLP) on the same data and discuss what the hybrid architecture and its explainability pipeline add beyond what the two dominant indicators already explain and how the approach generalizes to other tabular and mixed-granularity assessment settings that require both predictive accuracy and a verifiable account of what drove each decision.

TechnologiesVol. 14(8)
Pontifícia Universidade Católica do Rio de Janeiro (BR), Universidad Santo Tomás (CO), Unidades Tecnológicas de Santander (CO)
Instituto Colombiano de Crédito Educativo y Estudios Técnicos en el Exterior
Quality Education
Openalex Percentile: Top 8%
Neural Networks and Reservoir Computing
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.