Safe reinforcement learning-based energy management for fuel cell hybrid electric aircraft with longevity considerations

Fuel Cell Hybrid Electric Aircraft (FCHEA) represent a promising solution for decarbonizing short- to medium-range aviation. However, the hybrid-electric architecture introduces increased control complexity and poses challenges in ensuring component longevity and operational safety. Although reinforcement learning (RL)-based energy management strategies (EMS) have been explored in ground vehicle application, they often prioritize fuel efficiency while neglecting component degradation and safety-critical constraints, both of which are vital for the reliability of electric aviation. This study presents a Longevity-Conscious Safe Energy Management Strategy (LC-SEMS) to minimize operational and degradation-related costs over long-term use, while ensuring the satisfaction of multi-type constraint. The strategy is implemented within a multidisciplinary simulation framework that integrates propulsion, aerodynamics, hybrid powertrain, and flight dynamics models for mission-level evaluation. The EMS problem is formulated as a Constrained Markov Decision Process (CMDP) incorporating physical, cumulative, and instantaneous constraints. Instantaneous safety is enforced via an adaptive shielding mechanism that leverages a pretrained transition model to detect potential constraint violations and applies minimal corrective actions without interfering with policy learning. The proposed strategy is validated on a simulated FCHEA retrofitted from the NASA X-57 Maxwell, achieving fast convergence and strict constraint adherence across turbulent and multi-mission scenarios. It achieves a 26.96% reduction in depreciation cost compared to baseline RL-based EMS, with a minimal 4.21% performance gap relative to the globally optimal Dynamic Programming (DP) benchmark, demonstrating its adaptability and robustness under uncertain and unseen mission scenarios. • A multidisciplinary analysis framework is built for fuel cell hybrid aircraft • A safe RL-based EMS is developed with consideration of component degradation • An adaptive shielding mechanism enforces constraints with lightweight computation • The strategy achieves safety-guaranteed optimal energy management under uncertainty

Authors

Institutions

Publication Details

Journal
Energy
Published
2025-10-04
DOI
https://doi.org/10.1016/j.energy.2025.138782
Citations
1
Primary Topic
Electric and Hybrid Vehicle Technologies
Type
article
Field-Weighted Citation Impact
0.68
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Safe reinforcement learning-based energy management for fuel cell hybrid electric aircraft with longevity considerations

H. S. Ruiz, Yajing Xiao, Ioannis Roumeliotis, Xin Zhang et al.
1 citations
Energy
Electric and Hybrid Vehicle Technologies
0.68
article

Safe reinforcement learning-based energy management for fuel cell hybrid electric aircraft with longevity considerations

H. S. Ruiz, Yajing Xiao, Ioannis Roumeliotis, Xin Zhang, Jinning Zhang
article en
1 citations

Abstract

Fuel Cell Hybrid Electric Aircraft (FCHEA) represent a promising solution for decarbonizing short- to medium-range aviation. However, the hybrid-electric architecture introduces increased control complexity and poses challenges in ensuring component longevity and operational safety. Although reinforcement learning (RL)-based energy management strategies (EMS) have been explored in ground vehicle application, they often prioritize fuel efficiency while neglecting component degradation and safety-critical constraints, both of which are vital for the reliability of electric aviation. This study presents a Longevity-Conscious Safe Energy Management Strategy (LC-SEMS) to minimize operational and degradation-related costs over long-term use, while ensuring the satisfaction of multi-type constraint. The strategy is implemented within a multidisciplinary simulation framework that integrates propulsion, aerodynamics, hybrid powertrain, and flight dynamics models for mission-level evaluation. The EMS problem is formulated as a Constrained Markov Decision Process (CMDP) incorporating physical, cumulative, and instantaneous constraints. Instantaneous safety is enforced via an adaptive shielding mechanism that leverages a pretrained transition model to detect potential constraint violations and applies minimal corrective actions without interfering with policy learning. The proposed strategy is validated on a simulated FCHEA retrofitted from the NASA X-57 Maxwell, achieving fast convergence and strict constraint adherence across turbulent and multi-mission scenarios. It achieves a 26.96% reduction in depreciation cost compared to baseline RL-based EMS, with a minimal 4.21% performance gap relative to the globally optimal Dynamic Programming (DP) benchmark, demonstrating its adaptability and robustness under uncertain and unseen mission scenarios. • A multidisciplinary analysis framework is built for fuel cell hybrid aircraft • A safe RL-based EMS is developed with consideration of component degradation • An adaptive shielding mechanism enforces constraints with lightweight computation • The strategy achieves safety-guaranteed optimal energy management under uncertainty

EnergyVol. 338
University of Leicester (GB), Cranfield University (GB), University of Sheffield (GB)
Openalex Percentile: Top 25%
Electric and Hybrid Vehicle Technologies
0.68
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.