Log-Driven Proximal Policy Optimization for Adaptive Traffic Control in Software-Defined Networks

Software-Defined Networking (SDN) enables centralised and programmable traffic control, but adaptive optimization in operational networks remains challenging when safe online exploration is limited and only historical controller traces are available. This study proposes a log-driven Proximal Policy Optimisation (PPO) framework for adaptive SDN traffic control that learns directly from recorded state–action–reward transitions. The method uses a replay-based pseudo-environment constructed from controller logs. It combines clipped PPO updates with action-consistency regularisation and running state normalisation to improve stability under logged-data constraints. The empirical evaluation shows that the learned model reconstructs the dominant response pattern observed in the traces, preserves a positive relationship between the principal control-related predictor and the response, and reveals a non-uniform interaction structure across telemetry features. The framework also differentiates systematically across operating conditions and experimental groups, with category means ranging from 0.78 to 1.24 and group medians ranging from −0.12 to 1.12, while receiver operating characteristic analysis yields an area under the curve of 0.714. The practical network evaluation further shows that the PPO-controlled setting improves overall throughput, packet loss, jitter, and flow-completion success relative to the baseline controller. These results indicate that log-driven, stability-constrained PPO can provide a stable and informative basis for adaptive SDN traffic control when policy learning must rely on historical controller data rather than unrestricted live-network experimentation.

Authors

Institutions

Publication Details

Journal
Applied Sciences
Published
2026-05-01
DOI
https://doi.org/10.3390/app16094424
Primary Topic
Software-Defined Networks and 5G
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Log-Driven Proximal Policy Optimization for Adaptive Traffic Control in Software-Defined Networks

Zhenis Otarbay, Danil V. Lebedev, Yedil S. Nurakhov, Abzal E. Kyzyrkanov
Applied Sciences
Software-Defined Networks and 5G
article

Log-Driven Proximal Policy Optimization for Adaptive Traffic Control in Software-Defined Networks

Zhenis Otarbay, Danil V. Lebedev, Yedil S. Nurakhov, Abzal E. Kyzyrkanov
article en

Abstract

Software-Defined Networking (SDN) enables centralised and programmable traffic control, but adaptive optimization in operational networks remains challenging when safe online exploration is limited and only historical controller traces are available. This study proposes a log-driven Proximal Policy Optimisation (PPO) framework for adaptive SDN traffic control that learns directly from recorded state–action–reward transitions. The method uses a replay-based pseudo-environment constructed from controller logs. It combines clipped PPO updates with action-consistency regularisation and running state normalisation to improve stability under logged-data constraints. The empirical evaluation shows that the learned model reconstructs the dominant response pattern observed in the traces, preserves a positive relationship between the principal control-related predictor and the response, and reveals a non-uniform interaction structure across telemetry features. The framework also differentiates systematically across operating conditions and experimental groups, with category means ranging from 0.78 to 1.24 and group medians ranging from −0.12 to 1.12, while receiver operating characteristic analysis yields an area under the curve of 0.714. The practical network evaluation further shows that the PPO-controlled setting improves overall throughput, packet loss, jitter, and flow-completion success relative to the baseline controller. These results indicate that log-driven, stability-constrained PPO can provide a stable and informative basis for adaptive SDN traffic control when policy learning must rely on historical controller data rather than unrestricted live-network experimentation.

Applied SciencesVol. 16(9)
Al-Farabi Kazakh National University (KZ), Astana Medical University (KZ), Nazarbayev University (KZ)
Openalex Percentile: Top 7%
Software-Defined Networks and 5G
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.