EvoPath: Evolutionary meta-path discovery with large language models for complex heterogeneous information networks
Heterogeneous Information Networks (HINs) encapsulate diverse entity and relation types, with meta-paths providing essential meta-level semantics for knowledge reasoning, although their utility is constrained by discovery challenges. While Large Language Models (LLMs) offer new prospects for meta-path discovery due to their extensive knowledge encoding and efficiency, their adaptation faces challenges such as corpora bias, lexical discrepancies, and hallucination. This paper pioneers the mitigation of these challenges by presenting EvoPath, an innovative framework that leverages LLMs to efficiently identify high-quality meta-paths. EvoPath is carefully designed, with each component aimed at addressing issues that could lead to potential knowledge conflicts. With a minimal subset of HIN facts, EvoPath iteratively generates and evolves meta-paths by dynamically replaying meta-paths in the buffer with prioritization based on their scores. Comprehensive experiments on three large, complex HINs with hundreds of relations demonstrate that our framework, EvoPath, enables LLMs to generate high-quality meta-paths through effective prompting, confirming its superior performance in HIN reasoning tasks. Further ablation studies validate the effectiveness of each module within the framework. • We use LLMs to discover meta-paths for better reasoning in complex HINs. • Our framework resolves conflicts between LLMs’ parametric knowledge and HINs’ contextual knowledge. • Experiments show that our generated meta-paths excel in reasoning tasks.
Authors
- Yunfei Wang (ORCID: https://orcid.org/0009-0003-5614-9074)
- Yue He (ORCID: https://orcid.org/0009-0009-1536-1179)
- Shixuan Liu (ORCID: https://orcid.org/0000-0003-4780-3890)
- Haoxiang Cheng
- Changjun Fan (ORCID: https://orcid.org/0000-0002-3138-1104)
- Zhong Liu
Institutions
- National University of Defense Technology (CN)
- Tsinghua University (CN)
Publication Details
- Journal
- Information Processing & Management
- Published
- 2024-10-18
- DOI
- https://doi.org/10.1016/j.ipm.2024.103920
- Citations
- 9
- Primary Topic
- Advanced Graph Neural Networks
- Type
- article
- Field-Weighted Citation Impact
- 3.13
Funders
- National Natural Science Foundation of China
- Science and Technology Program of Hunan Province