Building of transformer-based RUL predictors supported by explainability techniques: Application on real industrial datasets

• Hybrid deep learning architectures benchmark for RUL. • RUL applied on synthetics and real datasets. • Use of local XAI techniques to achieve trustworthy, transparent, and usable models. • Code and datasets of these experiments public available to contribute to future research. One of the key aspects of Industry 4.0 is using intelligent systems to optimize manufacturing processes by improving productivity and reducing costs. These systems have greatly impacted in different areas, such as demand prediction and quality assessment. However, the prognostics and health management of industrial equipment is one of the areas with greater potential. This paper presents a comparative analysis of deep learning architectures applied to the prediction of the remaining useful life (RUL) on public real industrial datasets. The analysis includes some of the most commonly employed recurrent neural network variations and a novel approach based on a hybrid architecture using transformers. Moreover, we apply explainability techniques to provide comprehensive insights into the model’s decision-making process. The contributions of the work are: (1) a novel transformer-based architecture for RUL prediction that outperforms traditional recurrent neural networks; (2) a detailed description of the design strategies used to construct the models on two under-explored datasets; (3) the use of explainability techniques to understand the feature importance and to explain the model’s prediction and (4) making models built for reproducibility available to other researchers.

Authors

Institutions

Publication Details

Journal
Information Fusion
Published
2025-11-08
DOI
https://doi.org/10.1016/j.inffus.2025.103892
Primary Topic
Explainable Artificial Intelligence (XAI)
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Building of transformer-based RUL predictors supported by explainability techniques: Application on real industrial datasets

Bruno Veloso, Ricardo Dintén, Marta Zorrilla, João Gama
Information Fusion
Explainable Artificial Intelligence (XAI)
article

Building of transformer-based RUL predictors supported by explainability techniques: Application on real industrial datasets

Bruno Veloso, Ricardo Dintén, Marta Zorrilla, João Gama
article en

Abstract

• Hybrid deep learning architectures benchmark for RUL. • RUL applied on synthetics and real datasets. • Use of local XAI techniques to achieve trustworthy, transparent, and usable models. • Code and datasets of these experiments public available to contribute to future research. One of the key aspects of Industry 4.0 is using intelligent systems to optimize manufacturing processes by improving productivity and reducing costs. These systems have greatly impacted in different areas, such as demand prediction and quality assessment. However, the prognostics and health management of industrial equipment is one of the areas with greater potential. This paper presents a comparative analysis of deep learning architectures applied to the prediction of the remaining useful life (RUL) on public real industrial datasets. The analysis includes some of the most commonly employed recurrent neural network variations and a novel approach based on a hybrid architecture using transformers. Moreover, we apply explainability techniques to provide comprehensive insights into the model’s decision-making process. The contributions of the work are: (1) a novel transformer-based architecture for RUL prediction that outperforms traditional recurrent neural networks; (2) a detailed description of the design strategies used to construct the models on two under-explored datasets; (3) the use of explainability techniques to understand the feature importance and to explain the model’s prediction and (4) making models built for reproducibility available to other researchers.

Information FusionVol. 127
Universidad de Cantabria (ES), Universidade do Porto (PT), INESC TEC (PT)
Universidad de Cantabria, Fundação para a Ciência e a Tecnologia, European Regional Development Fund, Agencia Estatal de Investigación
Openalex Percentile: Top 82%
Explainable Artificial Intelligence (XAI)
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.