Have Our Cake and Eat It: Augmentation Diversity and Semantic Consistency Balanced Graph Contrastive Learning

Self-supervised learning on graph neural networks is receiving increasing attention due to the difficulty of obtaining graph labels in many real applications. Graph contrastive learning (GCL), a recently popular method for self-supervised learning on graphs, has achieved great success in many tasks. The key to the effectiveness of GCL is the construction of suitable contrasting pairs to capture important attributes of the data through the data augmentation modules. However, most of the existing approaches fail to fully consider both data diversity and the semantic consistency when conducting data augmentation. To fill this gap, we propose an augmentation diversity and semantic consistency balanced graph contrastive learning model (ADSCB for short), which enhances the representation ability of the CL model through richer contrasting objectives. In particular, we first introduce a semantic consistency module to extract the subgraph from the original graph through optimizing a carefully designed semantic consistency loss. Then, we introduce an augmentation diversity module and perform data augmentation and cross-scale mix-up operations on the original graph and the extracted semantic preserved subgraph to generate more diverse contrasting pairs. With the above two modules, our model ultimately achieves two contrasting objectives: diversity contrasting and semantic contrasting. The tradeoff between these two contrasting objectives allows our model to benefit from both the augmentation diversity and the semantic consistency. We evaluate ADSCB for graph classification in unsupervised, semi-supervised, and transfer learning settings using standard graph contrastive learning benchmarks. The results demonstrate the superiority of our method against several state-of-the-art baselines.