Text-Free Multi-domain Graph Pre-training: Toward Graph Foundation Models
Graphs arise across a wide spectrum of real-world applications, spanning biology, e-commerce, social networks, and more. This ubiquity naturally raises a fundamental question: Can we build a graph foundation model that leverages knowledge from multiple domains and generalizes effectively to entirely new ones? Achieving this goal, however, is challenging due to the substantial variation in graph characteristics across domains. While early efforts have explored cross-domain graph pre-training, many rely on auxiliary textual data to bridge semantic gaps between graphs, limiting their applicability to text-attributed graphs. In addition, integrating multiple source domains can introduce domain conflicts and uneven relevance to the target task, ultimately hindering robust generalization. To overcome these challenges, we propose MDGPT , a text-free graph learning framework that unifies and transfers knowledge across different graph domains. We begin by introducing a set of domain tokens that align diverse features from various domains, enabling coherent representation learning during pre-training. Then, we develop a two-stage prompting mechanism: the unifying prompt encodes domain-invariant semantics shared across multiple sources, while the mixing prompt selectively composes domain-specific signals to adapt the model to the target domain. We evaluate our approach on six benchmark datasets, where MDGPT achieves up to a 10.2% improvement over state-of-the-art methods, demonstrating its effectiveness in cross-domain generalization. (Codes are available at https://github.com/Nashchou/MDGPT .)
Authors
- Xingtong Yu (ORCID: https://orcid.org/0000-0002-2884-8578)
- Yuan Fang (ORCID: https://orcid.org/0000-0002-4265-5289)
- Chang Zhou (ORCID: https://orcid.org/0000-0001-9241-702X)
- Xinming Zhang (ORCID: https://orcid.org/0009-0002-1505-5752)
Institutions
- University of Science and Technology of China (CN)
- Chinese University of Hong Kong (HK)
- Singapore Management University (SG)
Publication Details
- Journal
- ACM Transactions on Knowledge Discovery from Data
- Published
- 2026-11-21
- DOI
- https://doi.org/10.1145/3862859
- Citations
- 50
- Primary Topic
- Advanced Graph Neural Networks
- Type
- article
- Field-Weighted Citation Impact
- 29.78