Improving the robustness of binary classifiers in cryptocurrency exchange rate forecasts

Abstract Binary direction classifiers can appear stable on one chronological split while offering little predictive or economic value out of sample. We revisit this problem using three relative-value cryptocurrency price ratios constructed from 28,157,374 public Binance USDS-M futures trades observed from March to May 2025. The original experiment combined event-time bars, LightGBM, a trend-continuation rule, and a rolling Hurst-regime condition. The revision retains the original fixed-split results as a descriptive record and adds an independent audit with three expanding walk-forward folds, four model benchmarks, rule-only controls, component ablations, three random seeds, uncertainty intervals, signal coverage, and 0/10/20-basis-point cost scenarios. The original table showed a smaller validation-to-test precision gap in seven of nine cells, but the exact sign and Wilcoxon tests were not significant at 5%. In the independent audit, LightGBM alone obtained mean precision 0.511, recall 0.213, F1 0.251, and 20.8% positive-signal coverage. The full logical AND-gate obtained precision 0.473, recall 0.014, F1 0.026, and 1.34% coverage. Its unlevered accepted-signal return averaged -0.16 basis points before costs and -10.16 basis points after a 10-basis-point round-trip cost. These results do not establish a general or cost-robust trading edge. They show instead why generalization gap, discrimination, coverage, and economic value must be reported separately when a regime gate suppresses predictions.

Authors

Institutions

Publication Details

Journal
Scientific Reports
Published
2026-09-21
DOI
https://doi.org/10.1038/s41598-026-70423-7
Primary Topic
Stock Market Forecasting Methods
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
article

Improving the robustness of binary classifiers in cryptocurrency exchange rate forecasts

Souad Hassanie, Iftikhar Ahmed, Raja Hashim Ali, Talha Ali Khan et al.
Scientific Reports
Stock Market Forecasting Methods
article

Improving the robustness of binary classifiers in cryptocurrency exchange rate forecasts

Souad Hassanie, Iftikhar Ahmed, Raja Hashim Ali, Talha Ali Khan, Cristhian David Caceres Mateus, Can Atalay
article en

Abstract

Abstract Binary direction classifiers can appear stable on one chronological split while offering little predictive or economic value out of sample. We revisit this problem using three relative-value cryptocurrency price ratios constructed from 28,157,374 public Binance USDS-M futures trades observed from March to May 2025. The original experiment combined event-time bars, LightGBM, a trend-continuation rule, and a rolling Hurst-regime condition. The revision retains the original fixed-split results as a descriptive record and adds an independent audit with three expanding walk-forward folds, four model benchmarks, rule-only controls, component ablations, three random seeds, uncertainty intervals, signal coverage, and 0/10/20-basis-point cost scenarios. The original table showed a smaller validation-to-test precision gap in seven of nine cells, but the exact sign and Wilcoxon tests were not significant at 5%. In the independent audit, LightGBM alone obtained mean precision 0.511, recall 0.213, F1 0.251, and 20.8% positive-signal coverage. The full logical AND-gate obtained precision 0.473, recall 0.014, F1 0.026, and 1.34% coverage. Its unlevered accepted-signal return averaged -0.16 basis points before costs and -10.16 basis points after a 10-basis-point round-trip cost. These results do not establish a general or cost-robust trading edge. They show instead why generalization gap, discrimination, coverage, and economic value must be reported separately when a regime gate suppresses predictions.

Scientific ReportsVol. 16(1)
University of Potsdam (DE), Holy Spirit University of Kaslik (LB), University of Applied Sciences Potsdam (DE)
Peace, Justice and strong institutions, Reduced inequalities
Openalex Percentile: Top 7%
Stock Market Forecasting Methods
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Improving the robustness of binary classifiers in cryptocurrency exchange rate forecasts — Souad Hassanie, Iftikhar Ahmed, et al. · Scientific Reports (2026) | TGRS Research Map | TGRS