Deep reinforcement learning-driven multi-objective optimization and its applications on lighting infrastructure operation and maintenance strategy

This study addresses the challenges facing tunnel lighting system maintenance, where conventional single-objective optimization strategies and traditional maintenance approaches struggle to balance multidimensional requirements. Focusing on lifecycle maintenance management of tunnel lighting infrastructure, the research transforms multi-objective optimization into a set of Pareto-optimal subproblems through decomposition strategies. The proposed framework establishes a dynamic topological network within the solution space by integrating the Double Deep Q-Network(DDQN) algorithm from deep reinforcement learning with neighborhood gradient transfer strategies. This study proposes an innovative integration of Wiener degradation processes and the DDQN algorithm to establish a dynamic reliability-cost coupling model for equipment performance analysis. A multi-objective deep reinforcement learning (MODRL)-driven intelligent maintenance framework is developed, systematically coordinating degradation dynamics and economic constraints through computational learning mechanisms. The results show that incorporating maintenance costs and reliability as reward components in the multi-objective optimization problem (MOP) simultaneously enhances operational reliability and reduces comprehensive maintenance expenditures by 29.7%. The neighborhood-based parameter transfer strategy reduced single-episode training time by 41.9% and parameter synchronization time by 68.3%, while improving GPU utilization by 34.9%. It achieved faster convergence with 22.8 fewer threshold steps and reduced multi-objective conflict rates by 17.0%. The developed multi-objective optimization framework for tunnel lighting systems overcomes fixed maintenance threshold limitations. The framework demonstrated a 68.5% reliability decline near lighting failure conditions while effectively addressing overconfidence issues. The weight-combination-based adaptive mechanism enables scenario-specific customization of optimization objectives, offering scalable solutions for cost-prioritized, reliability-focused, or balanced operational strategies.

Authors

Institutions

Publication Details

Journal
Scientific Reports
Published
2026-02-13
DOI
https://doi.org/10.1038/s41598-026-37811-5
Primary Topic
Impact of Light on Environment and Health
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Deep reinforcement learning-driven multi-objective optimization and its applications on lighting infrastructure operation and maintenance strategy

Zhiliu Wang, Jiabao Tang, Yulong Wang, Weihong Yang et al.
Scientific Reports
Impact of Light on Environment and Health
article

Deep reinforcement learning-driven multi-objective optimization and its applications on lighting infrastructure operation and maintenance strategy

Zhiliu Wang, Jiabao Tang, Yulong Wang, Weihong Yang, Hui Xiao, Wenhao Lun, Pengda Wei
article en

Abstract

This study addresses the challenges facing tunnel lighting system maintenance, where conventional single-objective optimization strategies and traditional maintenance approaches struggle to balance multidimensional requirements. Focusing on lifecycle maintenance management of tunnel lighting infrastructure, the research transforms multi-objective optimization into a set of Pareto-optimal subproblems through decomposition strategies. The proposed framework establishes a dynamic topological network within the solution space by integrating the Double Deep Q-Network(DDQN) algorithm from deep reinforcement learning with neighborhood gradient transfer strategies. This study proposes an innovative integration of Wiener degradation processes and the DDQN algorithm to establish a dynamic reliability-cost coupling model for equipment performance analysis. A multi-objective deep reinforcement learning (MODRL)-driven intelligent maintenance framework is developed, systematically coordinating degradation dynamics and economic constraints through computational learning mechanisms. The results show that incorporating maintenance costs and reliability as reward components in the multi-objective optimization problem (MOP) simultaneously enhances operational reliability and reduces comprehensive maintenance expenditures by 29.7%. The neighborhood-based parameter transfer strategy reduced single-episode training time by 41.9% and parameter synchronization time by 68.3%, while improving GPU utilization by 34.9%. It achieved faster convergence with 22.8 fewer threshold steps and reduced multi-objective conflict rates by 17.0%. The developed multi-objective optimization framework for tunnel lighting systems overcomes fixed maintenance threshold limitations. The framework demonstrated a 68.5% reliability decline near lighting failure conditions while effectively addressing overconfidence issues. The weight-combination-based adaptive mechanism enables scenario-specific customization of optimization objectives, offering scalable solutions for cost-prioritized, reliability-focused, or balanced operational strategies.

Scientific ReportsVol. 16(1)
Zhongyuan University of Technology (CN), China University of Mining and Technology (CN), Beijing Building Construction Research Institute (China) (CN)
Zhongyuan University of Technology, National Key Research and Development Program of China, Henan Provincial Science and Technology Research Project
Industry, innovation and infrastructure
Openalex Percentile: Top 69%
Impact of Light on Environment and Health
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.