DMGAE: An interpretable representation learning method for directed scale-free networks based on autoencoder and masking

Although existing graph self-supervised learning approaches have paid attention to the directed nature of networks, they have often overlooked the ubiquitous scale-free attributes. This oversight has resulted in a theoretical gap in understanding graph self-supervised learning from the perspective of network structure. In this paper, we study the degree distribution characteristics of source and target nodes in directed scale-free networks, encompassing node and edge dimensions. Our theoretical analysis reveals the relationship between the average degree of nodes and their average in-degree and out-degree, which is instrumental in discerning positive and negative edges, as well as edge directionality . Here positive edges are the ones that exists in the original graph, and negative edges are the ones that not exists in the original graph. Furthermore, we uncover negative edges connecting to central nodes and positive edges to peripheral nodes to be less predictable. Based on these crucial theoretical insights, we propose DMGAE (Directed Masked Graph Autoencoder), a novel representation learning method for directed scale-free networks that offers interpretability . The DMGAE method employs a weighted graph based on edges to replace the original graph structure. It integrates a masking approach based on the weight of the edges. Additionally, it incorporates an adaptive negative sampling method, edge decoder and a degree decoder based on the difference between the in-degree and out-degree of the node. This enhances the model’s capability to learn edges and discern their directions. Empirical studies on extensive real-world network data show that, compared to the state-of-the-art methods, DMGAE not only generally has superior learning performance on directed networks, but also performs exceedingly well on undirected networks . • DMGAE: An interpretable representation learning method for directed scale-free networks is proposed. • The interpretability lies in the theoretically derived relationship between average degree and network structure. • A new masked autoencoder representation learning approach based on the edge weights is proposed. • An adaptive negative sampling method based on edge weights is presented. • DMGAE is effective not only in accurately learning edges but also in discerning the directionality.

Authors

Institutions

Publication Details

Journal
Information Processing & Management
Published
2024-12-06
DOI
https://doi.org/10.1016/j.ipm.2024.104007
Citations
1
Primary Topic
Neural Networks and Applications
Type
article
Field-Weighted Citation Impact
0.35

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

DMGAE: An interpretable representation learning method for directed scale-free networks based on autoencoder and masking

Zhao-Long Hu, Qiang Yang, Kai‐Cheng Yang, Jianping Li
1 citations
Information Processing & Management
Neural Networks and Applications
0.35
article

DMGAE: An interpretable representation learning method for directed scale-free networks based on autoencoder and masking

Zhao-Long Hu, Qiang Yang, Kai‐Cheng Yang, Jianping Li
article en
1 citations

Abstract

Although existing graph self-supervised learning approaches have paid attention to the directed nature of networks, they have often overlooked the ubiquitous scale-free attributes. This oversight has resulted in a theoretical gap in understanding graph self-supervised learning from the perspective of network structure. In this paper, we study the degree distribution characteristics of source and target nodes in directed scale-free networks, encompassing node and edge dimensions. Our theoretical analysis reveals the relationship between the average degree of nodes and their average in-degree and out-degree, which is instrumental in discerning positive and negative edges, as well as edge directionality . Here positive edges are the ones that exists in the original graph, and negative edges are the ones that not exists in the original graph. Furthermore, we uncover negative edges connecting to central nodes and positive edges to peripheral nodes to be less predictable. Based on these crucial theoretical insights, we propose DMGAE (Directed Masked Graph Autoencoder), a novel representation learning method for directed scale-free networks that offers interpretability . The DMGAE method employs a weighted graph based on edges to replace the original graph structure. It integrates a masking approach based on the weight of the edges. Additionally, it incorporates an adaptive negative sampling method, edge decoder and a degree decoder based on the difference between the in-degree and out-degree of the node. This enhances the model’s capability to learn edges and discern their directions. Empirical studies on extensive real-world network data show that, compared to the state-of-the-art methods, DMGAE not only generally has superior learning performance on directed networks, but also performs exceedingly well on undirected networks . • DMGAE: An interpretable representation learning method for directed scale-free networks is proposed. • The interpretability lies in the theoretically derived relationship between average degree and network structure. • A new masked autoencoder representation learning approach based on the edge weights is proposed. • An adaptive negative sampling method based on edge weights is presented. • DMGAE is effective not only in accurately learning edges but also in discerning the directionality.

Information Processing & ManagementVol. 62(3)
Zhejiang Normal University (CN), Yangzhou University (CN)
Zhejiang Office of Philosophy and Social Science, National Natural Science Foundation of China, Humanities and Social Science Fund of Ministry of Education of China, Natural Science Foundation of Zhejiang Province
Openalex Percentile: Top 31%
Neural Networks and Applications
0.35
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.