Deep Reinforcement Learning-Based Microservices Placement Under Zero Trust Security Framework in Smart Grid

The microservice architecture has become vital in power grid systems, providing scalability, flexibility and resilience through independent deployment. However, its numerous access points introduce severe security challenges. The zero trust model, guided by the principle of “never trust, always verify,” offers a promising solution, yet integrating it with microservice deployment under strict resource and trust constraints remains difficult. This paper models the secure deployment task as a microservice placement optimization problem and formulates it as an integer linear program (ILP). To address ILP scalability limits, a hybrid linear programming (LP) approach enhanced by a Soft Actor–Critic (SAC) reinforcement learning agent and iterative rounding is proposed. The SAC agent learns adaptive rounding strategies to balance efficiency and solution quality. Results show that the proposed LP+SAC framework achieves near-optimal deployment with significantly reduced runtime and strong robustness under complex zero trust conditions, demonstrating the potential of reinforcement-guided rounding for secure and efficient scheduling in large-scale power grid systems.

Authors

Institutions

Publication Details

Journal
Journal of Circuits Systems and Computers
Published
2026-02-06
DOI
https://doi.org/10.1142/s0218126626501355
Primary Topic
Software System Performance and Reliability
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Deep Reinforcement Learning-Based Microservices Placement Under Zero Trust Security Framework in Smart Grid

X. L. Wang, Yuan La, Zengchao Wang
Journal of Circuits Systems and Computers
Software System Performance and Reliability
article

Deep Reinforcement Learning-Based Microservices Placement Under Zero Trust Security Framework in Smart Grid

X. L. Wang, Yuan La, Zengchao Wang
article en

Abstract

The microservice architecture has become vital in power grid systems, providing scalability, flexibility and resilience through independent deployment. However, its numerous access points introduce severe security challenges. The zero trust model, guided by the principle of “never trust, always verify,” offers a promising solution, yet integrating it with microservice deployment under strict resource and trust constraints remains difficult. This paper models the secure deployment task as a microservice placement optimization problem and formulates it as an integer linear program (ILP). To address ILP scalability limits, a hybrid linear programming (LP) approach enhanced by a Soft Actor–Critic (SAC) reinforcement learning agent and iterative rounding is proposed. The SAC agent learns adaptive rounding strategies to balance efficiency and solution quality. Results show that the proposed LP+SAC framework achieves near-optimal deployment with significantly reduced runtime and strong robustness under complex zero trust conditions, demonstrating the potential of reinforcement-guided rounding for secure and efficient scheduling in large-scale power grid systems.

Journal of Circuits Systems and Computers
China Southern Power Grid (China) (CN)
Openalex Percentile: Top 71%
Software System Performance and Reliability
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.