INTERPRETABLE NETWORK INTRUSION DETECTION ON CICIDS2017 USING CORRELATION-BASED FEATURE SELECTION, A HYBRID CNN-LSTM CLASSIFIER AND SMOTE-BALANCED XGBOOST COMPARISON

Modern enterprise networks generate millions of flows per day, and signature-based intrusion detection cannot keep pace with novel attack patterns. Deep learning has narrowed the detection gap, but at the cost of high computational overhead, opacity to security analysts, and persistent sensitivity to class imbalance. This project addresses the three concerns simultaneously on the CICIDS2017 benchmark by combining (i) correlation-based feature selection (CFS), which prunes seventy-eight raw features to a compact non-redundant subset; (ii) a four-way comparative evaluation of a Random Forest baseline, a stacked LSTM in the style of the Donkol et al. (2023) base paper, a hybrid CNN-LSTM following Alsaiari and Ilyas (2025), and an XGBoost classifier trained on data balanced with the Synthetic Minority Over-sampling Technique (SMOTE); and (iii) post-hoc SHapley Additive exPlanations (SHAP) attribution applied to the strongest classifier, exposing the features that drive attack-class predictions. Experimental results on a stratified 200,000-flow sample show that the Random Forest achieves the highest F1-score (0.9926) with the lowest false positive rate (0.07 percent), XGBoost+SMOTE achieves the highest attack recall (0.9932) at one twenty-fifth of the deep-model training time, the proposed CNN-LSTM beats the plain LSTM by 2.4 F1 percentage points, and SHAP attribution identifies backward-direction packet length statistics as the dominant features driving attack predictions. The findings answer three research questions about feature selection, model architecture, and interpretability in operational IDS deployment, and contradict the common assumption that deep models always dominate on tabular IDS data.

Authors

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-08-14
DOI
https://doi.org/10.5281/zenodo.21926600
Primary Topic
Network Security and Intrusion Detection
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
preprint

INTERPRETABLE NETWORK INTRUSION DETECTION ON CICIDS2017 USING CORRELATION-BASED FEATURE SELECTION, A HYBRID CNN-LSTM CLASSIFIER AND SMOTE-BALANCED XGBOOST COMPARISON

Palani Udhaya Kumar
Zenodo (CERN European Organization for Nuclear Research)
Network Security and Intrusion Detection
preprint

INTERPRETABLE NETWORK INTRUSION DETECTION ON CICIDS2017 USING CORRELATION-BASED FEATURE SELECTION, A HYBRID CNN-LSTM CLASSIFIER AND SMOTE-BALANCED XGBOOST COMPARISON

Palani Udhaya Kumar
preprint en

Abstract

Modern enterprise networks generate millions of flows per day, and signature-based intrusion detection cannot keep pace with novel attack patterns. Deep learning has narrowed the detection gap, but at the cost of high computational overhead, opacity to security analysts, and persistent sensitivity to class imbalance. This project addresses the three concerns simultaneously on the CICIDS2017 benchmark by combining (i) correlation-based feature selection (CFS), which prunes seventy-eight raw features to a compact non-redundant subset; (ii) a four-way comparative evaluation of a Random Forest baseline, a stacked LSTM in the style of the Donkol et al. (2023) base paper, a hybrid CNN-LSTM following Alsaiari and Ilyas (2025), and an XGBoost classifier trained on data balanced with the Synthetic Minority Over-sampling Technique (SMOTE); and (iii) post-hoc SHapley Additive exPlanations (SHAP) attribution applied to the strongest classifier, exposing the features that drive attack-class predictions. Experimental results on a stratified 200,000-flow sample show that the Random Forest achieves the highest F1-score (0.9926) with the lowest false positive rate (0.07 percent), XGBoost+SMOTE achieves the highest attack recall (0.9932) at one twenty-fifth of the deep-model training time, the proposed CNN-LSTM beats the plain LSTM by 2.4 F1 percentage points, and SHAP attribution identifies backward-direction packet length statistics as the dominant features driving attack predictions. The findings answer three research questions about feature selection, model architecture, and interpretability in operational IDS deployment, and contradict the common assumption that deep models always dominate on tabular IDS data.

Zenodo (CERN European Organization for Nuclear Research)
Life in Land
Network Security and Intrusion Detection
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.