Safe reinforcement learning-based energy management for fuel cell hybrid electric aircraft with longevity considerations
Fuel Cell Hybrid Electric Aircraft (FCHEA) represent a promising solution for decarbonizing short- to medium-range aviation. However, the hybrid-electric architecture introduces increased control complexity and poses challenges in ensuring component longevity and operational safety. Although reinforcement learning (RL)-based energy management strategies (EMS) have been explored in ground vehicle application, they often prioritize fuel efficiency while neglecting component degradation and safety-critical constraints, both of which are vital for the reliability of electric aviation. This study presents a Longevity-Conscious Safe Energy Management Strategy (LC-SEMS) to minimize operational and degradation-related costs over long-term use, while ensuring the satisfaction of multi-type constraint. The strategy is implemented within a multidisciplinary simulation framework that integrates propulsion, aerodynamics, hybrid powertrain, and flight dynamics models for mission-level evaluation. The EMS problem is formulated as a Constrained Markov Decision Process (CMDP) incorporating physical, cumulative, and instantaneous constraints. Instantaneous safety is enforced via an adaptive shielding mechanism that leverages a pretrained transition model to detect potential constraint violations and applies minimal corrective actions without interfering with policy learning. The proposed strategy is validated on a simulated FCHEA retrofitted from the NASA X-57 Maxwell, achieving fast convergence and strict constraint adherence across turbulent and multi-mission scenarios. It achieves a 26.96% reduction in depreciation cost compared to baseline RL-based EMS, with a minimal 4.21% performance gap relative to the globally optimal Dynamic Programming (DP) benchmark, demonstrating its adaptability and robustness under uncertain and unseen mission scenarios. • A multidisciplinary analysis framework is built for fuel cell hybrid aircraft • A safe RL-based EMS is developed with consideration of component degradation • An adaptive shielding mechanism enforces constraints with lightweight computation • The strategy achieves safety-guaranteed optimal energy management under uncertainty
Authors
- H. S. Ruiz (ORCID: https://orcid.org/0000-0002-6100-1918)
- Yajing Xiao
- Ioannis Roumeliotis (ORCID: https://orcid.org/0000-0001-7420-6018)
- Xin Zhang (ORCID: https://orcid.org/0000-0001-5647-2777)
- Jinning Zhang (ORCID: https://orcid.org/0000-0002-6188-4108)
Institutions
- University of Leicester (GB)
- Cranfield University (GB)
- University of Sheffield (GB)
Publication Details
- Journal
- Energy
- Published
- 2025-10-04
- DOI
- https://doi.org/10.1016/j.energy.2025.138782
- Citations
- 1
- Primary Topic
- Electric and Hybrid Vehicle Technologies
- Type
- article
- Field-Weighted Citation Impact
- 0.68