AIDetectVul: Software Vulnerability Detection Method Based on Feature Fusion of Pre-trained Models

Data-driven deep learning models are constrained by the scale and diversity of training data, making them vulnerable to data bias. While large language models (LLMs) exhibit superior generalization in vulnerability detection, their low inference efficiency and high computational costs hinder practical deployment in industrial settings. To address these limitations, we propose AIDetectVul, a novel vulnerability detection framework leveraging feature fusion from pre-trained models. Our approach concurrently utilizes encoder-only and decoder-only architectures to extract complementary code embeddings, with feature fusion enhancing semantic diversity. These enriched representations are then processed by a Transformer model, where the self-attention mechanism effectively captures long-range code dependencies, ultimately improving both detection accuracy and generalization capability. Comprehensive evaluations on proprietary enterprise datasets and open-source benchmarks demonstrate that AIDetectVul achieves comparable detection accuracy to the state-of-the-art LineVul model while demonstrating measurable improvements in generalization performance. Compared to LLM-based approaches, our solution maintains significantly lower computational overhead and training costs, making it particularly suitable for industrial applications.

Authors

Institutions

Publication Details

Published
2025-02-28
DOI
https://doi.org/10.1109/iccece65250.2025.10985370
Primary Topic
Software Reliability and Analysis Research
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

AIDetectVul: Software Vulnerability Detection Method Based on Feature Fusion of Pre-trained Models

Lin Li, Tao Li, Song Xue, Haodong Chen et al.
Software Reliability and Analysis Research
article

AIDetectVul: Software Vulnerability Detection Method Based on Feature Fusion of Pre-trained Models

Lin Li, Tao Li, Song Xue, Haodong Chen, Yonghui Qin, Jiawei Li
article en

Abstract

Data-driven deep learning models are constrained by the scale and diversity of training data, making them vulnerable to data bias. While large language models (LLMs) exhibit superior generalization in vulnerability detection, their low inference efficiency and high computational costs hinder practical deployment in industrial settings. To address these limitations, we propose AIDetectVul, a novel vulnerability detection framework leveraging feature fusion from pre-trained models. Our approach concurrently utilizes encoder-only and decoder-only architectures to extract complementary code embeddings, with feature fusion enhancing semantic diversity. These enriched representations are then processed by a Transformer model, where the self-attention mechanism effectively captures long-range code dependencies, ultimately improving both detection accuracy and generalization capability. Comprehensive evaluations on proprietary enterprise datasets and open-source benchmarks demonstrate that AIDetectVul achieves comparable detection accuracy to the state-of-the-art LineVul model while demonstrating measurable improvements in generalization performance. Compared to LLM-based approaches, our solution maintains significantly lower computational overhead and training costs, making it particularly suitable for industrial applications.

Hongzhiwei Technology (China) (CN), Wuhan University of Science and Technology (CN)
Openalex Percentile: Top 90%
Software Reliability and Analysis Research
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.