Performance Evaluation of Post-Quantum Digital Signature in QPSK- and 16QAM-Based WDM Communication Systems

The integration of post-quantum digital signature (PQDS) algorithms into coherent wavelength-division multiplexing (WDM) optical networks introduces a non-negligible cryptographic overhead that fundamentally alters physical-layer performance characteristics. Unlike conventional studies that treat security and transmission independently, this work provides a cross-layer evaluation of PQDS-induced payload expansion and its direct impact on coherent optical system behavior under realistic, DSP-aligned conditions. A structured and reproducible evaluation framework is proposed to systematically analyze this interaction across multiple transmission scenarios, ranging from a single-channel QPSK baseline to a 16-channel WDM system employing both QPSK and 16QAM modulation formats. Key system parameters—including launch power, local oscillator power, bit rate, and fiber length—are jointly optimized, while performance is rigorously assessed in terms of bit error rate (BER), Q-factor, and maximum transmission reach. The results demonstrate a clear performance degradation trend driven by both spectral efficiency scaling and cryptographic payload expansion. The single-channel QPSK system achieves a maximum reach of 203 km, which decreases to 194 km in the 16-channel WDM QPSK configuration due to inter-channel interference and nonlinear effects. In contrast, the 16-channel WDM 16QAM system exhibits a significantly reduced reach of 103 km, reflecting its heightened sensitivity to noise, chromatic dispersion, and fiber nonlinearities. Furthermore, increased payload size associated with PQDS schemes is shown to exacerbate transmission impairments by extending frame duration and intensifying inter-channel interactions. These findings identify PQDS-induced overhead as a critical system-level constraint that directly governs transmission efficiency, scalability, and performance limits. The study highlights the necessity of cross-layer co-design strategies, where cryptographic mechanisms and physical-layer parameters are jointly optimized to enable efficient, reliable, and quantum-safe coherent optical communication systems.