Challenges in Evaluating OSS Quality: Results from SLR on Quality Evaluation Tools

Open Source Software (OSS) quality evaluation is essential for ensuring the adoption and effective use of OSS projects across various domains.Most works on OSS quality evaluation have focused on the development of models or frameworks rather than providing practical implementations.These proposals can be challenging to use for inexperienced users, which highlights the need for user-friendly tools.This paper presents preliminary findings from a Systematic Literature Review (SLR) that investigates the characteristics, limitations, and gaps of current Quality Evaluation Tools (QETs) for OSS.Our analysis reveals the diversity of quality models underlying these tools and the absence of standardization, which impedes the comparability and reliability of evaluation results.This work also informs the next steps in improving OSS quality evaluation practices.

Authors

Institutions

Publication Details

Journal
Annals of Computer Science and Information Systems
Published
2025-10-15
DOI
https://doi.org/10.15439/2025f2661
Primary Topic
Software System Performance and Reliability
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Challenges in Evaluating OSS Quality: Results from SLR on Quality Evaluation Tools

Ayça Tarhan, Aslı Taşgetiren
Annals of Computer Science and Information Systems
Software System Performance and Reliability
article

Challenges in Evaluating OSS Quality: Results from SLR on Quality Evaluation Tools

Ayça Tarhan, Aslı Taşgetiren
article en

Abstract

Open Source Software (OSS) quality evaluation is essential for ensuring the adoption and effective use of OSS projects across various domains.Most works on OSS quality evaluation have focused on the development of models or frameworks rather than providing practical implementations.These proposals can be challenging to use for inexperienced users, which highlights the need for user-friendly tools.This paper presents preliminary findings from a Systematic Literature Review (SLR) that investigates the characteristics, limitations, and gaps of current Quality Evaluation Tools (QETs) for OSS.Our analysis reveals the diversity of quality models underlying these tools and the absence of standardization, which impedes the comparability and reliability of evaluation results.This work also informs the next steps in improving OSS quality evaluation practices.

Annals of Computer Science and Information SystemsVol. 43
Hacettepe University (TR)
Openalex Percentile: Top 35%
Software System Performance and Reliability
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.