Structured Optimal Policy for a Capacity Expansion Model Using Markov Decision Processes

This paper presents a stochastic dynamic capacity expansion planning model, formulated using a Markov Decision Process (MDP). We characterize the optimal policy and prove the existence of a threshold-type structured policy. In particular, we provide a novel proof by demonstrating the subadditivity of the cost model, resulting in increased computational efficiency.