Degradation Prediction of Proton Exchange Membrane Fuel Cell Based on Multi-Head Attention Neural Network and Transformer Model

Proton exchange membrane fuel cells are a clean energy technology with wide application in transportation and stationary energy systems. Due to the problem of voltage degradation under long-term dynamic loads, predicting their performance degradation trend is of great significance for extending the life of proton exchange membrane fuel cells and improving system reliability. This study adopts a data-driven approach to construct a degradation prediction model. In view of the problem of many input parameters and complex distribution of degradation features, a neural network model based on a multi-head attention mechanism and class token is first proposed to analyze the impact of different operating parameters on the output voltage prediction. The importance of each input variable is quantified by the attention weight matrix to assist feature screening. Subsequently, a prediction model is constructed based on Transformer to characterize the voltage degradation trend of fuel cells under dynamic conditions. The experimental results show that the root mean square error and mean absolute error of the model in the test phase are 0.008954 and 0.006590, showing strong prediction performance. Based on the importance evaluation provided by the first model, 11 key parameters were selected as inputs. After this input simplification, the model still maintained a prediction accuracy comparable to that of the full-feature model. This result verifies the effectiveness of the feature screening strategy and demonstrates its contribution to improved generalization and robustness.

Authors

Institutions

Publication Details

Journal
Energies
Published
2025-06-17
DOI
https://doi.org/10.3390/en18123177
Citations
9
Primary Topic
Fuel Cells and Related Materials
Type
article
Field-Weighted Citation Impact
6.57
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Degradation Prediction of Proton Exchange Membrane Fuel Cell Based on Multi-Head Attention Neural Network and Transformer Model

Ke Song, Yanju Li, Haoran Ma, Xing Huang et al.
9 citations
Energies
Fuel Cells and Related Materials
6.57
article

Degradation Prediction of Proton Exchange Membrane Fuel Cell Based on Multi-Head Attention Neural Network and Transformer Model

Ke Song, Yanju Li, Haoran Ma, Xing Huang, Yao Tang, Kai Zhang
article en
9 citations

Abstract

Proton exchange membrane fuel cells are a clean energy technology with wide application in transportation and stationary energy systems. Due to the problem of voltage degradation under long-term dynamic loads, predicting their performance degradation trend is of great significance for extending the life of proton exchange membrane fuel cells and improving system reliability. This study adopts a data-driven approach to construct a degradation prediction model. In view of the problem of many input parameters and complex distribution of degradation features, a neural network model based on a multi-head attention mechanism and class token is first proposed to analyze the impact of different operating parameters on the output voltage prediction. The importance of each input variable is quantified by the attention weight matrix to assist feature screening. Subsequently, a prediction model is constructed based on Transformer to characterize the voltage degradation trend of fuel cells under dynamic conditions. The experimental results show that the root mean square error and mean absolute error of the model in the test phase are 0.008954 and 0.006590, showing strong prediction performance. Based on the importance evaluation provided by the first model, 11 key parameters were selected as inputs. After this input simplification, the model still maintained a prediction accuracy comparable to that of the full-feature model. This result verifies the effectiveness of the feature screening strategy and demonstrates its contribution to improved generalization and robustness.

EnergiesVol. 18(12)
Tongji University (CN)
Openalex Percentile: Top 3%
Fuel Cells and Related Materials
6.57
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Degradation Prediction of Proton Exchange Membrane Fuel Cell Based on Multi-Head Attention Neural Network and Transformer Model — Ke Song, Yanju Li, et al. · Energies (2025) | TGRS Research Map | TGRS