DupLLM:Duplicate Pull Requests Detection Based on Large Language Model
As the scale of projects expands, the concurrent development model adopted by the open source community leads to an increasingly prominent problem of repetitive pull requests (PRs). The large number of rejections caused by duplicate pull requests increases the review workload of project maintainers and reduces the efficiency of pull request review. Therefore, it is very necessary to conduct automated duplicate PR detection. In this study, we propose DupLLM, a framework designed to detect duplicate PRs. The framework generates refined sum-maries by feeding the content of individual PRs into a large language model (LLM). Subsequently, the resulting summary is vectorized, converting the textual content into a numerical representation. The similarity between PRs is evaluated by calculating the similarity score between PR summary vectors. Ultimately, the model showed better performance than the best existing model, achieving an effect of 0.929 on P@l. This confirms that LLM can also achieve equivalent results in the field of duplicate PR detection as deep learning is used to train on this task, providing a new direction for the application of LLM in the field of software engineering.
Authors
- Zhifang Liao (ORCID: https://orcid.org/0000-0002-5525-904X)
- Peng Lan (ORCID: https://orcid.org/0000-0003-3558-6139)
- Peng Liu (ORCID: https://orcid.org/0000-0002-1667-6617)
- Ke Sun (ORCID: https://orcid.org/0009-0005-8737-0411)
Institutions
- Central South University (CN)
Publication Details
- Published
- 2024-12-03
- DOI
- https://doi.org/10.1109/apsec65559.2024.00023
- Citations
- 1
- Primary Topic
- Network Security and Intrusion Detection
- Type
- article
- Field-Weighted Citation Impact
- 0.35