Today's cat is tomorrow's dog: accounting for time-based changes in the labels of ML vulnerability detection approaches (Replication Package Part 1: NVD Vuldeepecker Dataset)

The Replication Package of "Today's cat is tomorrow's dog: accounting for time-based changes in the labels of ML vulnerability detection approaches" Part 1 (NVD Vuldeepecker Dataset) This repository includes zip files: Code.zip that contains the codes to replicate some parts of this study:a. 1_generate_datasets implements our methodology to generate the datasets.b. 2_run_models runs the ML models during the evaluation.c. 3_result_replication generates charts presented in the paper from the ML evaluation results. Datasets.zip that contain 2 folders:a. original datasets: 1 from NVD Vuldeepecker and 3 extracted from BigVul.b. NVD Vuldeepecker datasets: train, validation, test sets for each time of observation extracted using our methodology from NVD Vuldeepecker dataset. Pretrained-models.zip that we generated during our evaluation (3 test results for each time point in the timeline [2008-2019]). Results.zip of our evaluation, the folder ALL contains the overall results and other folders are results by model. UPDATED version 8- added a GLOBAL_README.md which contains the 3 stages and how they are connected to each other- updated LineVul.ipynb: import AdamW from torch.optim instead of transformers- updated README.md in Code2Vec with the prerequisites of Java to run gradlew for astminer UPDATED version 9- updated CodeBert.ipynb: import AdamW from torch.optim instead of transformers Documentations INSTALL.pdf : how to install the codes README.pdf: readme file REQUIREMENTS.pdf: hardware and software requirements STATUS.pdf : status for artifact submission LICENSE.pdf: the license of this artifact PAPER.pdf: the camera-ready version of the paper Please refer to the following repositories for the other datasets and pre-trained models:- Part 2 LINUX : https://doi.org/10.5281/zenodo.10960662- Part 3 OPENSSL : https://doi.org/10.5281/zenodo.10966117- Part 4 POPPLER : https://doi.org/10.5281/zenodo.14713143 This work was partly funded by the EU under the H2020 Program AssureMOSS (Grant n. 952647) and the Horizon Europe Program Sec4AI4Sec (Grant n. 101120393), by the Italian Ministry of University and Research (MUR) under the P.N.R.R. – NextGenerationEU grant n.\ PE00000014 (SERICS subproject COVERT), and by the Dutch Research Council (NWO) under the grant NWA.1215.18.006 (Theseus) and grant KIC1.VE01.20.004 (HEWSTI).

Institutions

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2025-05-17
DOI
https://doi.org/10.5281/zenodo.15447664
Primary Topic
Web Application Security Vulnerabilities
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Today's cat is tomorrow's dog: accounting for time-based changes in the labels of ML vulnerability detection approaches (Replication Package Part 1: NVD Vuldeepecker Dataset)

Zenodo (CERN European Organization for Nuclear Research)
Web Application Security Vulnerabilities
article

Today's cat is tomorrow's dog: accounting for time-based changes in the labels of ML vulnerability detection approaches (Replication Package Part 1: NVD Vuldeepecker Dataset)

article en

Abstract

The Replication Package of "Today's cat is tomorrow's dog: accounting for time-based changes in the labels of ML vulnerability detection approaches" Part 1 (NVD Vuldeepecker Dataset) This repository includes zip files: Code.zip that contains the codes to replicate some parts of this study:a. 1_generate_datasets implements our methodology to generate the datasets.b. 2_run_models runs the ML models during the evaluation.c. 3_result_replication generates charts presented in the paper from the ML evaluation results. Datasets.zip that contain 2 folders:a. original datasets: 1 from NVD Vuldeepecker and 3 extracted from BigVul.b. NVD Vuldeepecker datasets: train, validation, test sets for each time of observation extracted using our methodology from NVD Vuldeepecker dataset. Pretrained-models.zip that we generated during our evaluation (3 test results for each time point in the timeline [2008-2019]). Results.zip of our evaluation, the folder ALL contains the overall results and other folders are results by model. UPDATED version 8- added a GLOBAL_README.md which contains the 3 stages and how they are connected to each other- updated LineVul.ipynb: import AdamW from torch.optim instead of transformers- updated README.md in Code2Vec with the prerequisites of Java to run gradlew for astminer UPDATED version 9- updated CodeBert.ipynb: import AdamW from torch.optim instead of transformers Documentations INSTALL.pdf : how to install the codes README.pdf: readme file REQUIREMENTS.pdf: hardware and software requirements STATUS.pdf : status for artifact submission LICENSE.pdf: the license of this artifact PAPER.pdf: the camera-ready version of the paper Please refer to the following repositories for the other datasets and pre-trained models:- Part 2 LINUX : https://doi.org/10.5281/zenodo.10960662- Part 3 OPENSSL : https://doi.org/10.5281/zenodo.10966117- Part 4 POPPLER : https://doi.org/10.5281/zenodo.14713143 This work was partly funded by the EU under the H2020 Program AssureMOSS (Grant n. 952647) and the Horizon Europe Program Sec4AI4Sec (Grant n. 101120393), by the Italian Ministry of University and Research (MUR) under the P.N.R.R. – NextGenerationEU grant n.\ PE00000014 (SERICS subproject COVERT), and by the Dutch Research Council (NWO) under the grant NWA.1215.18.006 (Theseus) and grant KIC1.VE01.20.004 (HEWSTI).

Zenodo (CERN European Organization for Nuclear Research)
University of Trento (IT), Vrije Universiteit Amsterdam (NL)
Openalex Percentile: Top 39%
Web Application Security Vulnerabilities
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.