Today's cat is tomorrow's dog: accounting for time-based changes in the labels of ML vulnerability detection approaches (Replication Package Part 1: NVD Vuldeepecker Dataset)

The Replication Package of "Today's cat is tomorrow's dog: accounting for time-based changes in the labels of ML vulnerability detection approaches" Part 1 (NVD Vuldeepecker Dataset) This repository includes zip files: Code.zip that contains the codes to replicate some parts of this study:a. 1_generate_datasets implements our methodology to generate the datasets.b. 2_run_models runs the ML models during the evaluation.c. 3_result_replication generates charts presented in the paper from the ML evaluation results. Datasets.zip that contain 2 folders:a. original datasets: 1 from NVD Vuldeepecker and 3 extracted from BigVul.b. NVD Vuldeepecker datasets: train, validation, test sets for each time of observation extracted using our methodology from NVD Vuldeepecker dataset. Pretrained-models.zip that we generated during our evaluation (3 test results for each time point in the timeline [2008-2019]). Results.zip of our evaluation, the folder ALL contains the overall results and other folders are results by model. UPDATED version 8- added a GLOBAL_README.md which contains the 3 stages and how they are connected to each other- updated LineVul.ipynb: import AdamW from torch.optim instead of transformers- updated README.md in Code2Vec with the prerequisites of Java to run gradlew for astminer UPDATED version 9- updated CodeBert.ipynb: import AdamW from torch.optim instead of transformers Documentations INSTALL.pdf : how to install the codes README.pdf: readme file REQUIREMENTS.pdf: hardware and software requirements STATUS.pdf : status for artifact submission LICENSE.pdf: the license of this artifact PAPER.pdf: the camera-ready version of the paper Please refer to the following repositories for the other datasets and pre-trained models:- Part 2 LINUX : https://doi.org/10.5281/zenodo.10960662- Part 3 OPENSSL : https://doi.org/10.5281/zenodo.10966117- Part 4 POPPLER : https://doi.org/10.5281/zenodo.14713143 This work was partly funded by the EU under the H2020 Program AssureMOSS (Grant n. 952647) and the Horizon Europe Program Sec4AI4Sec (Grant n. 101120393), by the Italian Ministry of University and Research (MUR) under the P.N.R.R. – NextGenerationEU grant n.\ PE00000014 (SERICS subproject COVERT), and by the Dutch Research Council (NWO) under the grant NWA.1215.18.006 (Theseus) and grant KIC1.VE01.20.004 (HEWSTI).

Institutions

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2025-05-17
DOI
https://doi.org/10.5281/zenodo.8207883
Citations
1
Primary Topic
Information and Cyber Security
Type
article
Field-Weighted Citation Impact
3.25
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Today's cat is tomorrow's dog: accounting for time-based changes in the labels of ML vulnerability detection approaches (Replication Package Part 1: NVD Vuldeepecker Dataset)

1 citations
Zenodo (CERN European Organization for Nuclear Research)
Information and Cyber Security
3.25
article

Today's cat is tomorrow's dog: accounting for time-based changes in the labels of ML vulnerability detection approaches (Replication Package Part 1: NVD Vuldeepecker Dataset)

article en
1 citations

Abstract

The Replication Package of "Today's cat is tomorrow's dog: accounting for time-based changes in the labels of ML vulnerability detection approaches" Part 1 (NVD Vuldeepecker Dataset) This repository includes zip files: Code.zip that contains the codes to replicate some parts of this study:a. 1_generate_datasets implements our methodology to generate the datasets.b. 2_run_models runs the ML models during the evaluation.c. 3_result_replication generates charts presented in the paper from the ML evaluation results. Datasets.zip that contain 2 folders:a. original datasets: 1 from NVD Vuldeepecker and 3 extracted from BigVul.b. NVD Vuldeepecker datasets: train, validation, test sets for each time of observation extracted using our methodology from NVD Vuldeepecker dataset. Pretrained-models.zip that we generated during our evaluation (3 test results for each time point in the timeline [2008-2019]). Results.zip of our evaluation, the folder ALL contains the overall results and other folders are results by model. UPDATED version 8- added a GLOBAL_README.md which contains the 3 stages and how they are connected to each other- updated LineVul.ipynb: import AdamW from torch.optim instead of transformers- updated README.md in Code2Vec with the prerequisites of Java to run gradlew for astminer UPDATED version 9- updated CodeBert.ipynb: import AdamW from torch.optim instead of transformers Documentations INSTALL.pdf : how to install the codes README.pdf: readme file REQUIREMENTS.pdf: hardware and software requirements STATUS.pdf : status for artifact submission LICENSE.pdf: the license of this artifact PAPER.pdf: the camera-ready version of the paper Please refer to the following repositories for the other datasets and pre-trained models:- Part 2 LINUX : https://doi.org/10.5281/zenodo.10960662- Part 3 OPENSSL : https://doi.org/10.5281/zenodo.10966117- Part 4 POPPLER : https://doi.org/10.5281/zenodo.14713143 This work was partly funded by the EU under the H2020 Program AssureMOSS (Grant n. 952647) and the Horizon Europe Program Sec4AI4Sec (Grant n. 101120393), by the Italian Ministry of University and Research (MUR) under the P.N.R.R. – NextGenerationEU grant n.\ PE00000014 (SERICS subproject COVERT), and by the Dutch Research Council (NWO) under the grant NWA.1215.18.006 (Theseus) and grant KIC1.VE01.20.004 (HEWSTI).

Zenodo (CERN European Organization for Nuclear Research)
University of Trento (IT), Vrije Universiteit Amsterdam (NL)
Peace, Justice and strong institutions
Openalex Percentile: Top 5%
Information and Cyber Security
3.25
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.