Improving Node Classification for Graphs with Weak Feature Signals: A Similarity-Entropy Aggregation Approach

Graph Neural Networks (GNNs) have established themselves as powerful tools for graph-structured data. However, when feature separability among nodes is low, conventional neighborhood aggregation strategies often result in performance degradation due to over-smoothing and noisy information propagation. In this work, we introduce a novel GNN framework that refines the aggregation process by integrating feature similarity and neighborhood entropy into node message passing. Unlike standard models that uniformly aggregate neighbor information, this new model dynamically adjusts neighbor influence, prioritizing nodes with high similarity and low entropy. We evaluate the model on synthetic graphs generated using the Stochastic Block Model (SBM), varying homophily and class imbalance conditions to simulate challenging classification scenarios. Our experiments demonstrate that our method consistently outperforms the GraphSAGE model across Accuracy, Balanced Accuracy, F1 Score, and Matthews Correlation Coefficient, particularly in graphs with weak class signal and high structural noise. Statistical significance tests confirm the robustness of the observed improvements. Furthermore, the optimization of aggregation weights provides information about the model’s adaptation to different graph structures, enhancing interpretability. These findings suggest that integrating structural information selectively during aggregation can significantly improve GNN performance in complex graph environments, offering a new course toward more explainable graph-based models.

Institutions

Publication Details

Journal
Arrow - TU Dublin (Technological University Dublin)
Published
2025-09-09
DOI
https://doi.org/10.21427/fggr-jf50
Primary Topic
Geochemistry and Geologic Mapping
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Improving Node Classification for Graphs with Weak Feature Signals: A Similarity-Entropy Aggregation Approach

Arrow - TU Dublin (Technological University Dublin)
Geochemistry and Geologic Mapping
article

Improving Node Classification for Graphs with Weak Feature Signals: A Similarity-Entropy Aggregation Approach

article en

Abstract

Graph Neural Networks (GNNs) have established themselves as powerful tools for graph-structured data. However, when feature separability among nodes is low, conventional neighborhood aggregation strategies often result in performance degradation due to over-smoothing and noisy information propagation. In this work, we introduce a novel GNN framework that refines the aggregation process by integrating feature similarity and neighborhood entropy into node message passing. Unlike standard models that uniformly aggregate neighbor information, this new model dynamically adjusts neighbor influence, prioritizing nodes with high similarity and low entropy. We evaluate the model on synthetic graphs generated using the Stochastic Block Model (SBM), varying homophily and class imbalance conditions to simulate challenging classification scenarios. Our experiments demonstrate that our method consistently outperforms the GraphSAGE model across Accuracy, Balanced Accuracy, F1 Score, and Matthews Correlation Coefficient, particularly in graphs with weak class signal and high structural noise. Statistical significance tests confirm the robustness of the observed improvements. Furthermore, the optimization of aggregation weights provides information about the model’s adaptation to different graph structures, enhancing interpretability. These findings suggest that integrating structural information selectively during aggregation can significantly improve GNN performance in complex graph environments, offering a new course toward more explainable graph-based models.

Arrow - TU Dublin (Technological University Dublin)
Università degli studi di Cassino e del Lazio Meridionale (IT)
Openalex Percentile: Top 47%
Geochemistry and Geologic Mapping
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.