Closer through commonality: Enhancing hypergraph contrastive learning with shared groups
Hypergraphs provide a superior modeling frame-work for representing complex multidimensional relationships in the context of real-world interactions that often occur in groups, overcoming the limitations of traditional homogeneous graphs. However, there have been few studies on hypergraph-based contrastive learning, and existing graph-based contrastive learning methods have not been able to fully exploit the high-order correlation information in hypergraphs. Here, we propose a Hypergraph Fine-grained contrastive learning (HyFi) method designed to exploit the complex high-dimensional information inherent in hypergraphs. While avoiding traditional graph augmentation methods that corrupt the hypergraph topology, the proposed method provides a simple and efficient learning augmentation function by adding noise to node features. Furthermore, we expands beyond the traditional dichotomous relationship between positive and negative samples in contrastive learning by introducing a new relationship of weak positives. It demonstrates the importance of fine-graining positive samples in contrastive learning. Therefore, HyFi is able to produce high-quality embeddings, and outperforms both supervised and unsupervised baselines in average rank on node classification across 10 datasets. Our approach effectively exploits high-dimensional hypergraph information, shows significant improvement over existing graph-based contrastive learning methods, and is efficient in terms of training speed and GPU memory cost. The source code is available at https://github.com/Noverse0/HyFi.git.
Authors
- Daehee Kim (ORCID: https://orcid.org/0009-0005-1108-5112)
- Donghee Han (ORCID: https://orcid.org/0000-0002-4560-6810)
- Daeyoung Roh (ORCID: https://orcid.org/0009-0008-9496-2265)
- Mun Yong Yi (ORCID: https://orcid.org/0000-0003-1784-8983)
- Keejun Han (ORCID: https://orcid.org/0000-0002-2948-8375)
Institutions
- Korea Advanced Institute of Science and Technology (KR)
- Hansung University (KR)
Publication Details
- Published
- 2024-12-15
- DOI
- https://doi.org/10.1109/bigdata62323.2024.10826090
- Primary Topic
- Topic Modeling
- Type
- article
- Field-Weighted Citation Impact
- 0.00