AIDetectVul: Software Vulnerability Detection Method Based on Feature Fusion of Pre-trained Models
Data-driven deep learning models are constrained by the scale and diversity of training data, making them vulnerable to data bias. While large language models (LLMs) exhibit superior generalization in vulnerability detection, their low inference efficiency and high computational costs hinder practical deployment in industrial settings. To address these limitations, we propose AIDetectVul, a novel vulnerability detection framework leveraging feature fusion from pre-trained models. Our approach concurrently utilizes encoder-only and decoder-only architectures to extract complementary code embeddings, with feature fusion enhancing semantic diversity. These enriched representations are then processed by a Transformer model, where the self-attention mechanism effectively captures long-range code dependencies, ultimately improving both detection accuracy and generalization capability. Comprehensive evaluations on proprietary enterprise datasets and open-source benchmarks demonstrate that AIDetectVul achieves comparable detection accuracy to the state-of-the-art LineVul model while demonstrating measurable improvements in generalization performance. Compared to LLM-based approaches, our solution maintains significantly lower computational overhead and training costs, making it particularly suitable for industrial applications.
Authors
- Lin Li (ORCID: https://orcid.org/0000-0003-0426-6546)
- Tao Li (ORCID: https://orcid.org/0000-0003-1697-8022)
- Song Xue (ORCID: https://orcid.org/0000-0001-8910-7290)
- Haodong Chen (ORCID: https://orcid.org/0000-0003-2428-870X)
- Yonghui Qin (ORCID: https://orcid.org/0000-0003-2020-4257)
- Jiawei Li (ORCID: https://orcid.org/0009-0007-0695-0196)
Institutions
- Hongzhiwei Technology (China) (CN)
- Wuhan University of Science and Technology (CN)
Publication Details
- Published
- 2025-02-28
- DOI
- https://doi.org/10.1109/iccece65250.2025.10985370
- Primary Topic
- Software Reliability and Analysis Research
- Type
- article
- Field-Weighted Citation Impact
- 0.00