Robust Phishing URL Detection Under Cross-Dataset and Temporal Shifts Using Tail-Aware Residual Adaptation
This study presents Tail-Aware Residual Adaptation (TARA), a hybrid framework for supervised cross-dataset phishing URL detection designed to preserve ranking performance at low false-positive rates (FPRs). The evaluation employs 55 URL-derived features, chronological domain-disjoint partitions, and independent probability and threshold calibration. On a locked test set of 46,942 URLs from 33,428 domains, TARA achieved a ROC-AUC of 0.9443, standardized pAUC at FPR ≤ 1% of 0.8109, and TPR at FPR ≤ 0.1% of 0.4582. Three of 16 primary low-FPR comparisons remained statistically significant after Holm correction. TARA and TailTree-only achieved identical performance at FPR ≤ 0.1%, while TARA improved global ROC-AUC by 0.0140. In an additional temporal source-target configuration, TARA achieved a ROC-AUC of 0.9651 and pAUC at FPR ≤ 1% of 0.8040, although its advantage over TailTree-only was not statistically significant. Evaluation on a third, independently collected target dataset yielded a ROC-AUC of 0.9365 and a standardized pAUC at FPR ≤ 1% of 0.7206, without establishing a statistically significant low-FPR advantage over competing models. A nominal 0.1% FPR threshold yielded an observed FPR of 0.3178%, which weekly recalibration failed to reduce. These findings demonstrate the conditional benefits and operational limitations of TARA under temporal distribution shifts.
Authors
- Жанат Манбетова (ORCID: https://orcid.org/0000-0002-6716-4646)
- Saule ZHUMAGULOVA
- Г. Т. Даненова (ORCID: https://orcid.org/0000-0003-3301-7282)
- Natalya Glazyrina (ORCID: https://orcid.org/0000-0002-0259-774X)
- Zhanar Beldeubayeva (ORCID: https://orcid.org/0000-0003-4056-6220)
- Madi Akhmetzhanov (ORCID: https://orcid.org/0000-0003-3160-4328)
- Ainagul Alimagambetova
- Zhazira Shinysherova
- Gulim Tursyngaliyeva
Institutions
- L. N. Gumilyov Eurasian National University (KZ)
- Karaganda Buketov University (KZ)
- M. Kh Dulati Taraz State University (KZ)
- S.Seifullin Kazakh Agro Technical University (KZ)
- Abylkas Saginov Karaganda Technical University (KZ)
- Dulaty University (KZ)
- Astana IT University (KZ)
Publication Details
- Journal
- Technologies
- Published
- 2026-11-18
- DOI
- https://doi.org/10.3390/technologies14110766
- Primary Topic
- Spam and Phishing Detection
- Type
- article
- Field-Weighted Citation Impact
- 0.00