Meta-Learning-Based Adaptive Hyperparameter Tuning for Nonlinear Compensation in Optical Transmission

Abstract To break the nonlinear Shannon capacity bottleneck, next-generation coherent systems are widely adopting probabilistic constellation shaping (PCS) and ultra-wideband multiplexing. However, these critically exacerbate nonlinear impairments. While neural network-based nonlinear equalizers (NNLEs) offer a promising mitigation path, their practical deployment is fundamentally crippled by the prohibitive manual overhead and fragile convergence of hyperparameter tuning (HT). We introduce a meta-learning-based adaptive HT framework (MAHT) that breaks this barrier by establishing a differentiable co-optimization across training dynamics and data rebalancing, enabling NNLEs to self-adapt without human intervention. We experimentally demonstrate an S+C+L-band DP-PCS-128QAM transmission over 150 km fiber, attaining an achievable information rate (AIR) of 215.35 Tbps. Moreover, MAHT delivers exceptional weight efficiency, outperforming conventional methods by nearly 150%, and automatically optimizes across multiple channels. This work establishes a self-optimizing, resource-efficient paradigm that bridges machine learning with practical high-speed optical networks, paving the way for truly autonomous transceiver systems.

Authors

Institutions

Publication Details

Journal
Research Square
Published
2026-11-12
DOI
https://doi.org/10.21203/rs.3.rs-10362749/v1
Primary Topic
Optical Network Technologies
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
preprint

Meta-Learning-Based Adaptive Hyperparameter Tuning for Nonlinear Compensation in Optical Transmission

Zicai Cao, Lei Deng, Mengfan Cheng, Ming Tang et al.
Research Square
Optical Network Technologies
preprint

Meta-Learning-Based Adaptive Hyperparameter Tuning for Nonlinear Compensation in Optical Transmission

Zicai Cao, Lei Deng, Mengfan Cheng, Ming Tang, Ziheng Zhang, Deming Liu, Xiangyu Xie
preprint en

Abstract

Abstract To break the nonlinear Shannon capacity bottleneck, next-generation coherent systems are widely adopting probabilistic constellation shaping (PCS) and ultra-wideband multiplexing. However, these critically exacerbate nonlinear impairments. While neural network-based nonlinear equalizers (NNLEs) offer a promising mitigation path, their practical deployment is fundamentally crippled by the prohibitive manual overhead and fragile convergence of hyperparameter tuning (HT). We introduce a meta-learning-based adaptive HT framework (MAHT) that breaks this barrier by establishing a differentiable co-optimization across training dynamics and data rebalancing, enabling NNLEs to self-adapt without human intervention. We experimentally demonstrate an S+C+L-band DP-PCS-128QAM transmission over 150 km fiber, attaining an achievable information rate (AIR) of 215.35 Tbps. Moreover, MAHT delivers exceptional weight efficiency, outperforming conventional methods by nearly 150%, and automatically optimizes across multiple channels. This work establishes a self-optimizing, resource-efficient paradigm that bridges machine learning with practical high-speed optical networks, paving the way for truly autonomous transceiver systems.

Research Square
Huazhong University of Science and Technology (CN)
Industry, innovation and infrastructure
Optical Network Technologies
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon