Separate Bombs from Firecrackers: Intention-guided Vulnerability Assessment via LLM

Although modern vulnerability detection tools enable developers to efficiently identify numerous security flaws, indiscriminate remediation efforts often result in unnecessary development expenses. This is particularly true given that a substantial portion of detected vulnerabilities are either lowly exploitable or have a negligible impact in practical operational environments. Consequently, vulnerability severity assessment has emerged as a critical component in optimizing software development efficiency. Existing vulnerability assessment methods typically rely on manually crafted descriptions associated with source code artifacts. However, due to variability in description quality and subjectivity in intention interpretation, the performance of these methods is seriously limited. To address this issue, this paper introduces VulStamp, a novel intention-guided framework that facilitates description-free vulnerability assessment. Specifically, VulStamp employs static analysis in conjunction with a Large Language Model (LLM) to extract the intention information from vulnerable code. Based on the intention information, VulStamp employs a prompt-tuned model for vulnerability assessment. Furthermore, to mitigate the problem of imbalanced data associated with vulnerability types, VulStamp integrates a Reinforcement Learning (RL)-based prompt-tuning method to train the assessment model. Extensive experimental results demonstrate that VulStamp outperforms the state-of-the-art baselines by an average of 12.9%, 102.6%, 18.3%, and 54.1% in terms of AUC, precision, recall, and F1-score, respectively.

Authors

Institutions

Publication Details

Journal
ACM Transactions on Software Engineering and Methodology
Published
2026-02-16
DOI
https://doi.org/10.1145/3797896
Primary Topic
Software Engineering Research
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Separate Bombs from Firecrackers: Intention-guided Vulnerability Assessment via LLM

Ming Hu, Jie Li, Xiaofei Xie, Hao Shen
ACM Transactions on Software Engineering and Methodology
Software Engineering Research
article

Separate Bombs from Firecrackers: Intention-guided Vulnerability Assessment via LLM

Ming Hu, Jie Li, Xiaofei Xie, Hao Shen
article en

Abstract

Although modern vulnerability detection tools enable developers to efficiently identify numerous security flaws, indiscriminate remediation efforts often result in unnecessary development expenses. This is particularly true given that a substantial portion of detected vulnerabilities are either lowly exploitable or have a negligible impact in practical operational environments. Consequently, vulnerability severity assessment has emerged as a critical component in optimizing software development efficiency. Existing vulnerability assessment methods typically rely on manually crafted descriptions associated with source code artifacts. However, due to variability in description quality and subjectivity in intention interpretation, the performance of these methods is seriously limited. To address this issue, this paper introduces VulStamp, a novel intention-guided framework that facilitates description-free vulnerability assessment. Specifically, VulStamp employs static analysis in conjunction with a Large Language Model (LLM) to extract the intention information from vulnerable code. Based on the intention information, VulStamp employs a prompt-tuned model for vulnerability assessment. Furthermore, to mitigate the problem of imbalanced data associated with vulnerability types, VulStamp integrates a Reinforcement Learning (RL)-based prompt-tuning method to train the assessment model. Extensive experimental results demonstrate that VulStamp outperforms the state-of-the-art baselines by an average of 12.9%, 102.6%, 18.3%, and 54.1% in terms of AUC, precision, recall, and F1-score, respectively.

ACM Transactions on Software Engineering and Methodology
East China Normal University (CN), Singapore Management University (SG)
Reduced inequalities
Openalex Percentile: Top 68%
Software Engineering Research
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.