Hierarchical Multi-Objective Dispatch of a Multi-Use Floating Offshore Wind–Hydrogen–Aquaculture System with OpenFAST-Informed Environmental Modeling

Co-locating hydrogen production and aquaculture on floating offshore wind platforms requires dispatch policies that jointly optimize energy trading, electrolyzer longevity, and cage water quality—objectives that scalarized reinforcement learning struggles to reconcile. We develop a conservation-closed reduced-order model of a 20 MW-class floating wind system, driven by ERA5 North Sea reanalysis and cross-checked against OpenFAST, and cast dispatch as a Markov decision process. Scalarized twin delayed deep deterministic policy gradient (TD3) agents achieved nominally higher revenue than rule-based control (+0.033 M€; Hedges’ g = 0.94) but converged to a degenerate, hydrogen-abandoning equilibrium in 7% of independent runs (2/27). A hierarchical TD3 agent (H-TD3) with an annealed logarithmic Nash-bargaining reward showed no collapse across 20 seeds (Fisher’s exact test, p = 0.32), reached 95% of its final physical-objective level at the earliest observable episode in every seed, and exhibited an order-of-magnitude smaller plateau dispersion than scalarized baselines, with revenue statistically indistinguishable from rule-based control (1.216 ± 0.040 M€). Over 1000 h, H-TD3 increased cage biomass by 22.6% and yielded an electrolyzer-subsystem hydrogen cost of €3.05/kg (excluding electricity, wind-farm, and aquaculture costs), or €6.45/kg at €60/MWh wind electricity. These results frame multi-objective offshore dispatch as a risk-control problem: Nash-bargaining rewards produced fewer collapses than linear scalarization, though the difference was not significant.

Authors

Institutions

Publication Details

Journal
Energies
Published
2026-11-16
DOI
https://doi.org/10.3390/en19225521
Primary Topic
Hybrid Renewable Energy Systems
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

Hierarchical Multi-Objective Dispatch of a Multi-Use Floating Offshore Wind–Hydrogen–Aquaculture System with OpenFAST-Informed Environmental Modeling

Lingang Yang, Chunxiang Fu, Xiaohe Wang, Mao Lyu et al.
Energies
Hybrid Renewable Energy Systems
article

Hierarchical Multi-Objective Dispatch of a Multi-Use Floating Offshore Wind–Hydrogen–Aquaculture System with OpenFAST-Informed Environmental Modeling

Lingang Yang, Chunxiang Fu, Xiaohe Wang, Mao Lyu, Xiong Zhou, Huaijie He
article en

Abstract

Co-locating hydrogen production and aquaculture on floating offshore wind platforms requires dispatch policies that jointly optimize energy trading, electrolyzer longevity, and cage water quality—objectives that scalarized reinforcement learning struggles to reconcile. We develop a conservation-closed reduced-order model of a 20 MW-class floating wind system, driven by ERA5 North Sea reanalysis and cross-checked against OpenFAST, and cast dispatch as a Markov decision process. Scalarized twin delayed deep deterministic policy gradient (TD3) agents achieved nominally higher revenue than rule-based control (+0.033 M€; Hedges’ g = 0.94) but converged to a degenerate, hydrogen-abandoning equilibrium in 7% of independent runs (2/27). A hierarchical TD3 agent (H-TD3) with an annealed logarithmic Nash-bargaining reward showed no collapse across 20 seeds (Fisher’s exact test, p = 0.32), reached 95% of its final physical-objective level at the earliest observable episode in every seed, and exhibited an order-of-magnitude smaller plateau dispersion than scalarized baselines, with revenue statistically indistinguishable from rule-based control (1.216 ± 0.040 M€). Over 1000 h, H-TD3 increased cage biomass by 22.6% and yielded an electrolyzer-subsystem hydrogen cost of €3.05/kg (excluding electricity, wind-farm, and aquaculture costs), or €6.45/kg at €60/MWh wind electricity. These results frame multi-objective offshore dispatch as a risk-control problem: Nash-bargaining rewards produced fewer collapses than linear scalarization, though the difference was not significant.

EnergiesVol. 19(22)
China Three Gorges Corporation (China) (CN), PowerChina (China) (CN), Powerchina Huadong Engineering Corporation (China) (CN)
Hybrid Renewable Energy Systems
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon