Optimal Control for Networked Control Systems with Stochastic Transmission Delay and Packet Dropouts

This paper investigates an optimal decision-making and optimization framework for networked systems operating under the coupled effects of stochastic transmission delays, packet dropouts, and input delays, which is a critical unresolved challenge in data-driven intelligent systems deployed over shared communication networks. Such uncertainty-aware optimization problems exhibit strong similarities to modern recommender and decision support systems, where multiple performance criteria must be balanced under dynamic and resource-constrained environments while addressing the disruptive impact of coupled network-induced uncertainties. By explicitly modeling stochastic transmission delays and packet losses in the sensor to controller channel, together with input delays in the actuation loop, the problem is formulated as a stochastic optimal control task with multi-stage decision coupling that captures the interdependency of communication uncertainties and system performance. An optimal feedback policy is derived based on a discrete time Riccati recursion explicitly quantifying and mitigating the cumulative impact of network-induced uncertainties on the expected performance cost, which is a capability lacking in existing frameworks that treat uncertainties separately. Numerical simulations using realistic traffic models validate the effectiveness of the proposed framework. The results demonstrate that the proposed decision optimization approach offers a principled foundation for uncertainty-aware optimization with potential applicability to data-driven recommender and intelligent decision systems where coupled uncertainties and multi-criteria trade-offs are pervasive.