Virtual-Coordinate Based Sampling and Embedding for Machine Learning with Graph Data

Graph embedding techniques remains the only alternative for Graph Neural Networks (GNNs) in machine learning for applications for which data in the form of graphs. GNNs, however, require substantial computational resources and are not able to provide certain advantages of conventional neural networks, such as transfer learning. The existing embedding based techniques, however, rely on random walk based strategies, which are not efficient in capturing the topology information, or use more structured strategies followed by feature engineering to achieve the required embedding. We propose VCNN (VirtualCoordinate based Neural Networks) technique that directly uses distances to an extremely small set (< 1 %) of random nodes (anchors) for network sampling and embedding, thus eliminating the feature engineering step. Experiments with two benchmark datasets show that a simple shallow neural network configuration using VC can achieve comparable performance to existing embedding-based techniques requiring deeper neural networks, thus also eliminating the need to experiment with multiple neural network configurations. This finding is particularly relevant for applications where computational efficiency is crucial. This research extends the machine learning toolbox for networks and data in the form of networks, highlighting the importance of strategic parameter use and model simplicity.

Authors

Institutions

Publication Details

Published
2024-12-18
DOI
https://doi.org/10.1109/icmla61862.2024.00184
Citations
1
Primary Topic
Advanced Graph Neural Networks
Type
article
Field-Weighted Citation Impact
0.35

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Virtual-Coordinate Based Sampling and Embedding for Machine Learning with Graph Data

Anura P. Jayasumana, Randy Paffenroth, Zheyi Qin
1 citations
Advanced Graph Neural Networks
0.35
article

Virtual-Coordinate Based Sampling and Embedding for Machine Learning with Graph Data

Anura P. Jayasumana, Randy Paffenroth, Zheyi Qin
article en
1 citations

Abstract

Graph embedding techniques remains the only alternative for Graph Neural Networks (GNNs) in machine learning for applications for which data in the form of graphs. GNNs, however, require substantial computational resources and are not able to provide certain advantages of conventional neural networks, such as transfer learning. The existing embedding based techniques, however, rely on random walk based strategies, which are not efficient in capturing the topology information, or use more structured strategies followed by feature engineering to achieve the required embedding. We propose VCNN (VirtualCoordinate based Neural Networks) technique that directly uses distances to an extremely small set (< 1 %) of random nodes (anchors) for network sampling and embedding, thus eliminating the feature engineering step. Experiments with two benchmark datasets show that a simple shallow neural network configuration using VC can achieve comparable performance to existing embedding-based techniques requiring deeper neural networks, thus also eliminating the need to experiment with multiple neural network configurations. This finding is particularly relevant for applications where computational efficiency is crucial. This research extends the machine learning toolbox for networks and data in the form of networks, highlighting the importance of strategic parameter use and model simplicity.

Worcester Polytechnic Institute (US), Colorado State University (US)
National Science Foundation
Openalex Percentile: Top 29%
Advanced Graph Neural Networks
0.35
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Virtual-Coordinate Based Sampling and Embedding for Machine Learning with Graph Data — Anura P. Jayasumana, Randy Paffenroth, et al. · (2024) | TGRS Research Map | TGRS