DriftShield: Autonomous Fraud Detection via Actor-Critic Reinforcement Learning With Dynamic Feature Reweighting
Financial fraud detection systems confront the persistent challenge of concept drift, where fraudulent patterns evolve continuously to evade detection mechanisms. Traditional rule-based methods and static machine learning models require frequent manual updates, failing to autonomously adapt to emerging fraud strategies. This paper presents DriftShield, a novel adaptive fraud detection framework that addresses these limitations through four key technical innovations: (1) the first application of Soft Actor-Critic (SAC) reinforcement learning with continuous action spaces to fraud detection, enabling simultaneous fine-grained optimization of detection thresholds and feature importance weights; (2) a dynamic feature reweighting mechanism that automatically adapts to evolving fraud patterns while providing interpretable insights into changing fraud strategies; (3) an adaptive experience replay buffer combining sliding windows with prioritized sampling to balance catastrophic forgetting prevention with rapid concept drift adaptation; and (4) an entropy-driven exploration framework with automatic temperature tuning that intelligently balances exploitation of known fraud patterns with discovery of emerging threats. Experimental evaluation demonstrates that DriftShield achieves 18% higher fraud detection rates while maintaining lower false positive rates compared to static models. The system demonstrates 57% faster adaptation times, recovering optimal performance within 280 transactions after significant concept drift compared to 650 transactions for the next-best reinforcement learning approach. DriftShield attains a cumulative detection rate of 0.849, representing a 7.7% improvement over existing methods and establishing the efficacy of continuous-action reinforcement learning for autonomous adaptation in dynamic adversarial environments.
Authors
- Jiyuan Wang (ORCID: https://orcid.org/0009-0009-7957-777X)
- Wanhua Zheng (ORCID: https://orcid.org/0000-0001-9158-6681)
- Yao Ge (ORCID: https://orcid.org/0000-0001-6314-3891)
- Jialei Cao (ORCID: https://orcid.org/0009-0002-9966-5768)
Institutions
- University of Miami (US)
- Duke University (US)
- University of Pennsylvania (US)
- Texas A&M University (US)
Publication Details
- Journal
- IEEE Open Journal of the Computer Society
- Published
- 2025-01-01
- DOI
- https://doi.org/10.1109/ojcs.2025.3587001
- Citations
- 11
- Primary Topic
- Imbalanced Data Classification Techniques
- Type
- article
- Field-Weighted Citation Impact
- 27.29