Advanced modulation format indicator for nonlinear impairments mitigation in optical transmission system: a comprehensive analytical and experimental-based approach

The installation of future optical transmission system (OTS) is impossible without addressing the nonlinearities, particularly transmission over long distances. Despite the advancement in modulation formats (MFs) and digital signal processing (DSP) techniques, existing models lacks to address the nonlinear distortions in high capacity and multi-channel systems. Furthermore, current techniques lack to the flexibility to dynamically adapt to varying modulation schemes in heterogeneous network (HetNet). Therefore, a smart mechanism is needed through which the nonlinearities can be minimized and huge capacity data can be easily transformed up to long range. To tackle above limitations, a novel modulation format indicator (MFI) procedure is proposed in terms of amplitude deviation (AD) analysis at the received side of the optical transmission system. Firstly, a comprehensive analytical model is developed to model the nonlinear distortions, arising from high data rates, long distance and multi-channel transmissions. Secondly, the proposed MFI technique is designed to accurately identify and compensate for MFs variations, thereby improving the quality signal and reducing error rates. Thirdly, the validation and simulation are estimated using bit error rate (BER) and optical signal to noise ratio (OSNR) across various MFs like polarization division multiplexing (PDM) and high order quadrature amplitude modulation (QAM) schemes. The proposed scheme is discussed using a detailed mathematical background, which is then validated with simulation model. The outcomes of the simulation model declare that proposed model generates the results below forward error correction (FEC) threshold. Furthermore, the proposed system has successfully minimized the impacts of nonlinearities on long haul OTS.