Graph-Constrained Diffusion with Progressive Distillation for Traveling Salesman Problem

Diffusion models have shown strong promise for neural combinatorial optimization, yet existing approaches define the forward noising process over a fully connected graph, discarding the sparse topological structure inherent to the Traveling Salesman Problem (TSP), and their multi-step inference incurs prohibitive latency. We address these two limitations through a pair of complementary models. First, we propose GCDTSP, a graph-constrained diffusion model that replaces the topology-agnostic uniform transition matrix with an instance-dependent graph Laplacian-based heat-kernel transition matrix, so that the evolution of the edge-valued state is governed by the topology of each TSP instance; a feasibility constraint loss combining degree conservation, symmetry, and locality priors further guides the GatedGCN denoising network toward valid Hamiltonian cycles. GCDTSP outperforms autoregressive baselines and prior diffusion solvers under greedy decoding, and generalizes zero-shot to real-world TSPLIB instances. Building upon GCDTSP, we introduce GCDTSP-D, a progressive distillation framework that iteratively halves the required denoising steps via teacher–student parameter inheritance, combined with a cosine noise schedule that concentrates inference capacity in the constraint-sensitive low-noise regime. GCDTSP-D attains an approximately 37× speedup on TSP50 with a favorable quality–speed trade-off, and on the larger TSP500 benchmark even surpasses its teacher in both solution quality and speed.

Authors

Institutions

Publication Details

Journal
Big Data and Cognitive Computing
Published
2026-09-27
DOI
https://doi.org/10.3390/bdcc10100329
Primary Topic
Advanced Graph Neural Networks
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
article

Graph-Constrained Diffusion with Progressive Distillation for Traveling Salesman Problem

Yunshuo Li, Yuanshu Li, You Zhou, Chulei Zhang et al.
Big Data and Cognitive Computing
Advanced Graph Neural Networks
article

Graph-Constrained Diffusion with Progressive Distillation for Traveling Salesman Problem

Yunshuo Li, Yuanshu Li, You Zhou, Chulei Zhang, Xuan Wu, Fushuo Li, Yubin Xiao
article en

Abstract

Diffusion models have shown strong promise for neural combinatorial optimization, yet existing approaches define the forward noising process over a fully connected graph, discarding the sparse topological structure inherent to the Traveling Salesman Problem (TSP), and their multi-step inference incurs prohibitive latency. We address these two limitations through a pair of complementary models. First, we propose GCDTSP, a graph-constrained diffusion model that replaces the topology-agnostic uniform transition matrix with an instance-dependent graph Laplacian-based heat-kernel transition matrix, so that the evolution of the edge-valued state is governed by the topology of each TSP instance; a feasibility constraint loss combining degree conservation, symmetry, and locality priors further guides the GatedGCN denoising network toward valid Hamiltonian cycles. GCDTSP outperforms autoregressive baselines and prior diffusion solvers under greedy decoding, and generalizes zero-shot to real-world TSPLIB instances. Building upon GCDTSP, we introduce GCDTSP-D, a progressive distillation framework that iteratively halves the required denoising steps via teacher–student parameter inheritance, combined with a cosine noise schedule that concentrates inference capacity in the constraint-sensitive low-noise regime. GCDTSP-D attains an approximately 37× speedup on TSP50 with a favorable quality–speed trade-off, and on the larger TSP500 benchmark even surpasses its teacher in both solution quality and speed.

Big Data and Cognitive ComputingVol. 10(10)
Jilin University (CN), Zhuhai College of Science and Technology (CN)
Openalex Percentile: Top 9%
Advanced Graph Neural Networks
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.