INT-Partition: Hierarchical and Fault-Tolerant In-Band Network Telemetry

With the expansion of production networks, new challenges arise in scaling telemetry systems to accommodate the massive number of network devices. In-band Network Telemetry (INT) is widely adopted for its fine-grained and accurate measurements. However, system robustness and performance scalability remain key challenges for INT-based network-wide telemetry systems. Existing INT-based measurements manage the network as a whole and rely on a centralized controller for path planning and telemetry data collection. As networks scale and the probability of failures increases, frequent re-planning leads to prolonged telemetry interruptions. In this work, we propose INT-Partition, a hierarchical and fault-tolerant in-band network telemetry system with a divide-and-conquer paradigm. INT-Partition conducts telemetry in two stages: network partitioning and telemetry within each partition, enabling scalability for mega-scale networks. Our evaluations, including mega-scale simulations using BMv2 software switches and small-scale validations on Tofino hardware switches, demonstrate the effectiveness of our approach. With 1% of network equipment out of order, INT-Partition covers over 89.67% of the area and accurately locates faults. As the network scales, telemetry planning and deployment time is reduced by 75.62% to 96.02%, and hot reloading enables seamless switching of telemetry deployment.