Investigating the Robustness of Graph Neural Networks to Data Drift: A Case Study on Financial Transaction Data

The performance of machine learning models in real-world applications is often challenged by data drift, in which the statistical properties of the data evolve over time. This phenomenon is particularly acute in dynamic domains such as financial fraud detection, where adversarial behaviors constantly change. Graph Neural Networks (GNNs), valued for their ability to model complex relational data, are increasingly applied in this domain; however, their inherent robustness to temporal data shifts remains underexplored. This study systematically investigates the impact of natural data drift on the robustness of three foundational GNN architectures: Graph Convolutional Networks (GCNs), Graph Attention Networks (GATs), and Graph Sample and Aggregate (GraphSAGE). Using the large-scale and highly imbalanced IEEE-CIS dataset as a challenging case study, we constructed homogeneous transaction graphs and employed a strict temporal data splitting methodology to simulate a realistic deployment scenario. Model performance was evaluated over 50 sequential, nonoverlapping monitoring windows, using AUC-PR and F2-Score as primary metrics due to their sensitivity in imbalanced contexts. Our findings confirm that all evaluated GNNs suffer from significant performance degradation over time, with GCN and GAT showing pronounced declines. A comparative analysis revealed that GraphSAGE exhibited substantially greater robustness, maintaining more stable and resilient performance. These results highlight that architectural choice is a critical factor for GNNs deployed in dynamic environments and underscore the need to develop adaptive strategies.

Authors

Institutions

Publication Details

Journal
IEEE Access
Published
2025-01-01
DOI
https://doi.org/10.1109/access.2025.3611817
Citations
1
Primary Topic
Neural Networks and Applications
Type
article
Field-Weighted Citation Impact
2.48
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Investigating the Robustness of Graph Neural Networks to Data Drift: A Case Study on Financial Transaction Data

Raimir Holanda Filho, R. Menezes
1 citations
IEEE Access
Neural Networks and Applications
2.48
article

Investigating the Robustness of Graph Neural Networks to Data Drift: A Case Study on Financial Transaction Data

Raimir Holanda Filho, R. Menezes
article en
1 citations

Abstract

The performance of machine learning models in real-world applications is often challenged by data drift, in which the statistical properties of the data evolve over time. This phenomenon is particularly acute in dynamic domains such as financial fraud detection, where adversarial behaviors constantly change. Graph Neural Networks (GNNs), valued for their ability to model complex relational data, are increasingly applied in this domain; however, their inherent robustness to temporal data shifts remains underexplored. This study systematically investigates the impact of natural data drift on the robustness of three foundational GNN architectures: Graph Convolutional Networks (GCNs), Graph Attention Networks (GATs), and Graph Sample and Aggregate (GraphSAGE). Using the large-scale and highly imbalanced IEEE-CIS dataset as a challenging case study, we constructed homogeneous transaction graphs and employed a strict temporal data splitting methodology to simulate a realistic deployment scenario. Model performance was evaluated over 50 sequential, nonoverlapping monitoring windows, using AUC-PR and F2-Score as primary metrics due to their sensitivity in imbalanced contexts. Our findings confirm that all evaluated GNNs suffer from significant performance degradation over time, with GCN and GAT showing pronounced declines. A comparative analysis revealed that GraphSAGE exhibited substantially greater robustness, maintaining more stable and resilient performance. These results highlight that architectural choice is a critical factor for GNNs deployed in dynamic environments and underscore the need to develop adaptive strategies.

IEEE AccessVol. 13
Universidade de Fortaleza (BR)
Openalex Percentile: Top 9%
Neural Networks and Applications
2.48
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Investigating the Robustness of Graph Neural Networks to Data Drift: A Case Study on Financial Transaction Data — Raimir Holanda Filho, R. Menezes · IEEE Access (2025) | TGRS Research Map | TGRS