Technical Middleware Microservice Orchestration and Fault-Tolerant Mechanism Algorithms for Containerized Deployment

Due to the containerized deployment environment, microservice orchestration requires coordination of multiple independently running services. This highly decoupled and distributed architecture increases the complexity of orchestration, and existing static resource allocation strategies are difficult to provide sufficient fault tolerance in the face of sudden failures. Therefore, this article introduced a dynamic fault-tolerant scheduling algorithm based on Qlearning, which monitored service status in real-time, predicted potential faults, and dynamically adjusted resource allocation to improve system stability and fault tolerance. Firstly, microservices are modularized using the container orchestration tool Kubernetes, and containerization technology is utilized to encapsulate each service in a separate Pod for operation. Elastic allocation of resources can be achieved through Kubernetes’ automated scheduling mechanism, while efficient service communication and load balancing can be achieved through service mesh; Secondly, a dynamic faulttolerant scheduling algorithm based on Q-learning is introduced, combined with real-time monitoring data of CPU (Central Processing Unit), memory, network traffic, etc., deployed in containers, to establish a fault prediction model. Finally, long short-term memory networks can be used to dynamically analyze and predict the load status and historical fault records of each service node, identify potential faults in real time, and automatically adjust resource allocation strategies based on the prediction results, reallocate service loads or start backup instances. The experimental results show that the Q-learningbased dynamic fault-tolerant scheduling algorithm effectively improves the system’s fault tolerance and stability. The analysis of fault recovery time showed that the recovery time for CPU overload, memory leakage, and network congestion was significantly reduced within 48 hours, to 7 seconds, 9 seconds, and 12 seconds, respectively. This algorithm effectively solves the key problems of microservice orchestration and fault tolerance in containerized deployment environments, providing important support for improving system stability.

Authors

Institutions

Publication Details

Published
2024-10-23
DOI
https://doi.org/10.1109/iccasit62299.2024.10828011
Citations
2
Primary Topic
Software System Performance and Reliability
Type
article
Field-Weighted Citation Impact
0.70
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Technical Middleware Microservice Orchestration and Fault-Tolerant Mechanism Algorithms for Containerized Deployment

Haoqi Dai, Shaoguang Liu, Jinhe Wang, Bo Liu et al.
2 citations
Software System Performance and Reliability
0.70
article

Technical Middleware Microservice Orchestration and Fault-Tolerant Mechanism Algorithms for Containerized Deployment

Haoqi Dai, Shaoguang Liu, Jinhe Wang, Bo Liu, Zhongkai Fan
article en
2 citations

Abstract

Due to the containerized deployment environment, microservice orchestration requires coordination of multiple independently running services. This highly decoupled and distributed architecture increases the complexity of orchestration, and existing static resource allocation strategies are difficult to provide sufficient fault tolerance in the face of sudden failures. Therefore, this article introduced a dynamic fault-tolerant scheduling algorithm based on Qlearning, which monitored service status in real-time, predicted potential faults, and dynamically adjusted resource allocation to improve system stability and fault tolerance. Firstly, microservices are modularized using the container orchestration tool Kubernetes, and containerization technology is utilized to encapsulate each service in a separate Pod for operation. Elastic allocation of resources can be achieved through Kubernetes’ automated scheduling mechanism, while efficient service communication and load balancing can be achieved through service mesh; Secondly, a dynamic faulttolerant scheduling algorithm based on Q-learning is introduced, combined with real-time monitoring data of CPU (Central Processing Unit), memory, network traffic, etc., deployed in containers, to establish a fault prediction model. Finally, long short-term memory networks can be used to dynamically analyze and predict the load status and historical fault records of each service node, identify potential faults in real time, and automatically adjust resource allocation strategies based on the prediction results, reallocate service loads or start backup instances. The experimental results show that the Q-learningbased dynamic fault-tolerant scheduling algorithm effectively improves the system’s fault tolerance and stability. The analysis of fault recovery time showed that the recovery time for CPU overload, memory leakage, and network congestion was significantly reduced within 48 hours, to 7 seconds, 9 seconds, and 12 seconds, respectively. This algorithm effectively solves the key problems of microservice orchestration and fault tolerance in containerized deployment environments, providing important support for improving system stability.

China Southern Power Grid (China) (CN)
Openalex Percentile: Top 25%
Software System Performance and Reliability
0.70
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.