Automated Generation and Compilation of Fuzz Driver Based on Large Language Models

Fuzz drivers are essential components of library fuzz testing, yet automatically generating correct and robust fuzz drivers and executing them is challenging. The predominant approach to fuzz testing libraries and their function interfaces involves security experts manually writing test drivers for fuzz testers. In contrast, generation based on LLMs (Large Language Models) is a promising direction, as it can operate with lower requirements on consumer programs, utilizes API (Application Programming Interface) usage information across multiple dimensions, and generates user-friendly output code. However, there is currently no fully automated method for driver generation and compilation. To address this issue, this paper has designed an automated method for generating and compiling drivers, and has evaluated the quality of the drivers it produces. Evaluation results indicate that drivers generated by large language models perform nearly as well in coverage as those written manually, and the generated compilation commands achieve an accuracy of 75%.

Authors

Institutions

Publication Details

Published
2024-09-15
DOI
https://doi.org/10.1145/3689236.3689272
Citations
2
Primary Topic
Software Testing and Debugging Techniques
Type
article
Field-Weighted Citation Impact
0.97
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Automated Generation and Compilation of Fuzz Driver Based on Large Language Models

Yuxuan Sun
2 citations
Software Testing and Debugging Techniques
0.97
article

Automated Generation and Compilation of Fuzz Driver Based on Large Language Models

Yuxuan Sun
article en
2 citations

Abstract

Fuzz drivers are essential components of library fuzz testing, yet automatically generating correct and robust fuzz drivers and executing them is challenging. The predominant approach to fuzz testing libraries and their function interfaces involves security experts manually writing test drivers for fuzz testers. In contrast, generation based on LLMs (Large Language Models) is a promising direction, as it can operate with lower requirements on consumer programs, utilizes API (Application Programming Interface) usage information across multiple dimensions, and generates user-friendly output code. However, there is currently no fully automated method for driver generation and compilation. To address this issue, this paper has designed an automated method for generating and compiling drivers, and has evaluated the quality of the drivers it produces. Evaluation results indicate that drivers generated by large language models perform nearly as well in coverage as those written manually, and the generated compilation commands achieve an accuracy of 75%.

National University of Defense Technology (CN)
Openalex Percentile: Top 20%
Software Testing and Debugging Techniques
0.97
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Automated Generation and Compilation of Fuzz Driver Based on Large Language Models — Yuxuan Sun · (2024) | TGRS Research Map | TGRS