The NLBSE'25 Tool Competition
We report on the organization and results of the tool competition of the fourth International Workshop on Natural Language-based Software Engineering (NLBSE'25). As in prior editions, we organized the competition on automated code comment classification, with a larger dataset. In this tool competition edition, six teams submitted multiple classification models to automatically classify code comments. The submitted models were fine-tuned and evaluated on a benchmark dataset of 14,875 code comments, respectively. This paper reports details of the competition, including the rules, the teams and contestant models, and the ranking of models based on their average classification performance across issue report and code comment types.
Authors
- Pooja Rani (ORCID: https://orcid.org/0000-0001-5127-4042)
- Nataliia Stulova (ORCID: https://orcid.org/0000-0002-6804-2253)
- Ali Al-Kaswan (ORCID: https://orcid.org/0000-0001-7338-2044)
- Giuseppe Colavito (ORCID: https://orcid.org/0000-0003-3871-401X)
Institutions
- University of Zurich (CH)
- University of Bari Aldo Moro (IT)
- Delft University of Technology (NL)
Publication Details
- Published
- 2025-04-27
- DOI
- https://doi.org/10.1109/nlbse66842.2025.00012
- Citations
- 5
- Primary Topic
- Software Engineering Research
- Type
- article
- Field-Weighted Citation Impact
- 16.23
Funders
- Schweizerischer Nationalfonds zur Förderung der Wissenschaftlichen Forschung