SkillScope: A Tool to Predict Fine-Grained Skills Needed to Solve Issues on GitHub

New contributors often struggle to find tasks that they can tackle when onboarding onto a new Open Source Software (OSS) project. One reason for this difficulty is that issue trackers lack explanations about the knowledge or skills needed to complete a given task successfully. These explanations can be complex and time-consuming to produce. Past research has partially addressed this problem by labeling issues with issue types, issue difficulty levels, and issue skills. However, current approaches are limited to a small set of labels and lack indepth details about their semantics, which may not sufficiently help contributors identify suitable issues. To surmount this limitation, this paper explores large language models (LLMs) and Random Forest (RF) to predict the multilevel skills required to solve the open issues. We introduce a novel tool, SkiliScope, which retrieves current issues from Java projects hosted on GitHub and predicts the multilevel programming skills required to resolve these issues. In a case study, we demonstrate that SkillScope could predict 217 multilevel skills for tasks with 91% precision, 88% recall, and 89% F-measure on average. Practitioners can use this tool to better delegate or choose tasks to solve in OSS projects. A demo video is available at https://youtu.be/gqU/vDcT_0o

Authors

Institutions

Publication Details

Published
2025-04-27
DOI
https://doi.org/10.1109/nlbse66842.2025.00007
Primary Topic
Software Engineering Research
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

SkillScope: A Tool to Predict Fine-Grained Skills Needed to Solve Issues on GitHub

Marco Aurélio Gerosa, Prakash Acharya, Herbert Jenkins, Jacob Penney et al.
Software Engineering Research
article

SkillScope: A Tool to Predict Fine-Grained Skills Needed to Solve Issues on GitHub

Marco Aurélio Gerosa, Prakash Acharya, Herbert Jenkins, Jacob Penney, Igor Steinmacher, Julio R. Contreras, Benjamin Carter, Fabio Santos, Dylan Johnson, Carlos A. Llanes Villegas, Jack Utzerath, Adonijah O. Farner
article en

Abstract

New contributors often struggle to find tasks that they can tackle when onboarding onto a new Open Source Software (OSS) project. One reason for this difficulty is that issue trackers lack explanations about the knowledge or skills needed to complete a given task successfully. These explanations can be complex and time-consuming to produce. Past research has partially addressed this problem by labeling issues with issue types, issue difficulty levels, and issue skills. However, current approaches are limited to a small set of labels and lack indepth details about their semantics, which may not sufficiently help contributors identify suitable issues. To surmount this limitation, this paper explores large language models (LLMs) and Random Forest (RF) to predict the multilevel skills required to solve the open issues. We introduce a novel tool, SkiliScope, which retrieves current issues from Java projects hosted on GitHub and predicts the multilevel programming skills required to resolve these issues. In a case study, we demonstrate that SkillScope could predict 217 multilevel skills for tasks with 91% precision, 88% recall, and 89% F-measure on average. Practitioners can use this tool to better delegate or choose tasks to solve in OSS projects. A demo video is available at https://youtu.be/gqU/vDcT_0o

Northern Arizona University (US), Grand Canyon University (US), Colorado State University (US)
Quality Education
Openalex Percentile: Top 81%
Software Engineering Research
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.