Performance Dataset for Hardware Model Checking on Btor2 Benchmarks (Technical Report, May 2025)

This technical report presents a performance evaluation of several hardware model-checking tools on a collection of benchmark tasks in the Btor2 format.The resulting dataset is intended to support machine-learning research for hardware model checking, particularly in areas such as algorithm selection,performance prediction, and automated tool configuration. It has been used, for example, in the development and evaluation of Btor2-Select, a machine-learning-based algorithm selection framework for hardware model checking. To construct the dataset, we benchmarked a diverse set of model-checking tools and algorithmic configurations. Each verification engine was evaluated on a common set of Btor2 tasks and the performance measurements, including CPU time, wall time, and memory usage, were collected. All data, including scripts and files required to reproduce the experiments, are publicly available at: https://gitlab.com/sosy-lab/research/data/perf-eval-hwmc/-/tree/1.0.

Institutions

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2025-05-01
DOI
https://doi.org/10.5281/zenodo.15605218
Citations
1
Primary Topic
Adversarial Robustness in Machine Learning
Type
article
Field-Weighted Citation Impact
2.48
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Performance Dataset for Hardware Model Checking on Btor2 Benchmarks (Technical Report, May 2025)

1 citations
Zenodo (CERN European Organization for Nuclear Research)
Adversarial Robustness in Machine Learning
2.48
article

Performance Dataset for Hardware Model Checking on Btor2 Benchmarks (Technical Report, May 2025)

article en
1 citations

Abstract

This technical report presents a performance evaluation of several hardware model-checking tools on a collection of benchmark tasks in the Btor2 format.The resulting dataset is intended to support machine-learning research for hardware model checking, particularly in areas such as algorithm selection,performance prediction, and automated tool configuration. It has been used, for example, in the development and evaluation of Btor2-Select, a machine-learning-based algorithm selection framework for hardware model checking. To construct the dataset, we benchmarked a diverse set of model-checking tools and algorithmic configurations. Each verification engine was evaluated on a common set of Btor2 tasks and the performance measurements, including CPU time, wall time, and memory usage, were collected. All data, including scripts and files required to reproduce the experiments, are publicly available at: https://gitlab.com/sosy-lab/research/data/perf-eval-hwmc/-/tree/1.0.

Zenodo (CERN European Organization for Nuclear Research)
University of Waterloo (CA), National Taiwan University (TW), Ludwig-Maximilians-Universität München (DE)
Openalex Percentile: Top 8%
Adversarial Robustness in Machine Learning
2.48
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Performance Dataset for Hardware Model Checking on Btor2 Benchmarks (Technical Report, May 2025) · Zenodo (CERN European Organization for Nuclear Research) (2025) | TGRS Research Map | TGRS