Beyond Predictive Accuracy: Reference-Aligned Evaluation of Explainable AI in Distribution Networks

Feature attributions can describe a fitted predictor while differing from a declared engineering reference. This study develops a reference-aligned audit that keeps predictive performance, attribution agreement, estimator precision, and reference evidential status separate. Two public distribution-network datasets provide exact additive controls: 53,567 Swiss meter records and 240 Ecuadorian utility-month records. Under a common finite-background marginal game, the Swiss multilayer perceptron achieved R2=0.99979 with normalized attribution distance 0.037, whereas gradient boosting and random forest retained R2>0.97 with distances of 0.480 and 0.706. In Ecuador, exact enumeration of all 16 coalitions yielded R2=0.99846 and a distance of 0.399 for the MLP, despite perfect four-feature rank agreement. Replacing the three billed-and-delivered outflow variables jointly in a two-group game preserved this result (0.405). Clustered-bootstrap associations between prediction error and zero-sum attribution discrepancy were weak for the MLP in Switzerland (ρs=0.238, 95% CI [0.025,0.440]) and Ecuador (ρs=0.071, 95% CI [−0.361,0.460]); these estimates do not establish independence. Company-balanced analysis exposed a CNEL-Sucumbíos failure hidden by pooled performance, while sample-size and multi-seed audits preserved the qualitative attribution-distance ordering. An all-meter voltage audit did not qualify observational regressions as physical ground truth. The conclusions are restricted to declared additive references and attribution games and do not constitute general physical validation.

Authors

Institutions

Publication Details

Journal
Machine Learning and Knowledge Extraction
Published
2026-10-26
DOI
https://doi.org/10.3390/make8110354
Primary Topic
Explainable Artificial Intelligence (XAI)
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Beyond Predictive Accuracy: Reference-Aligned Evaluation of Explainable AI in Distribution Networks

Luis Fernando Tipán
Machine Learning and Knowledge Extraction
Explainable Artificial Intelligence (XAI)
article

Beyond Predictive Accuracy: Reference-Aligned Evaluation of Explainable AI in Distribution Networks

Luis Fernando Tipán
article en

Abstract

Feature attributions can describe a fitted predictor while differing from a declared engineering reference. This study develops a reference-aligned audit that keeps predictive performance, attribution agreement, estimator precision, and reference evidential status separate. Two public distribution-network datasets provide exact additive controls: 53,567 Swiss meter records and 240 Ecuadorian utility-month records. Under a common finite-background marginal game, the Swiss multilayer perceptron achieved R2=0.99979 with normalized attribution distance 0.037, whereas gradient boosting and random forest retained R2>0.97 with distances of 0.480 and 0.706. In Ecuador, exact enumeration of all 16 coalitions yielded R2=0.99846 and a distance of 0.399 for the MLP, despite perfect four-feature rank agreement. Replacing the three billed-and-delivered outflow variables jointly in a two-group game preserved this result (0.405). Clustered-bootstrap associations between prediction error and zero-sum attribution discrepancy were weak for the MLP in Switzerland (ρs=0.238, 95% CI [0.025,0.440]) and Ecuador (ρs=0.071, 95% CI [−0.361,0.460]); these estimates do not establish independence. Company-balanced analysis exposed a CNEL-Sucumbíos failure hidden by pooled performance, while sample-size and multi-seed audits preserved the qualitative attribution-distance ordering. An all-meter voltage audit did not qualify observational regressions as physical ground truth. The conclusions are restricted to declared additive references and attribution games and do not constitute general physical validation.

Machine Learning and Knowledge ExtractionVol. 8(11)
Politecnica Salesiana University (EC)
Openalex Percentile: Top 13%
Explainable Artificial Intelligence (XAI)
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon