DATSO: A Difficulty Assessment Tool for Stack Overflow Questions

Stack Overflow is one of the prominent resources in the software community where developers seek technical assistance. Owing to its popularity, the platform witnesses questions of varying difficulty levels. Since not all practitioners are equally adept at addressing these queries, many queries remain unanswered or experience delays in receiving responses. However, the current framework of the site primarily categorizes the questions based on programming languages and specific topics, not considering the complexity level of the post. To bridge this gap, we introduce DATSO, a Difficulty Assessment Tool for Stack Overflow Questions. DATSO is a Chrome extension that assigns “difficulty level tags” to Stack Overflow posts by leveraging the textual and context-dependent features of the questions. Unlike previous works, which face issues like data imbalance and cold start problems, DATSO overcomes these limitations, achieving 72.3% accuracy on a benchmark dataset of Java questions, surpassing existing baseline works by 7%. The video demonstration and code repository can be found at https://youtu.be/VSu2Q0zb-X0 and https://github.com/krish10924/Difficulty-tag-Generator.

Authors

Institutions

Publication Details

Published
2025-03-04
DOI
https://doi.org/10.1109/saner64311.2025.00085
Primary Topic
Software Engineering Research
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

DATSO: A Difficulty Assessment Tool for Stack Overflow Questions

Aman Swaraj, Sandeep Kumar, Krishna Kant Agarwal, Neha Gujar et al.
Software Engineering Research
article

DATSO: A Difficulty Assessment Tool for Stack Overflow Questions

Aman Swaraj, Sandeep Kumar, Krishna Kant Agarwal, Neha Gujar, Manashree Kalode, Bhoomi Bonal
article en

Abstract

Stack Overflow is one of the prominent resources in the software community where developers seek technical assistance. Owing to its popularity, the platform witnesses questions of varying difficulty levels. Since not all practitioners are equally adept at addressing these queries, many queries remain unanswered or experience delays in receiving responses. However, the current framework of the site primarily categorizes the questions based on programming languages and specific topics, not considering the complexity level of the post. To bridge this gap, we introduce DATSO, a Difficulty Assessment Tool for Stack Overflow Questions. DATSO is a Chrome extension that assigns “difficulty level tags” to Stack Overflow posts by leveraging the textual and context-dependent features of the questions. Unlike previous works, which face issues like data imbalance and cold start problems, DATSO overcomes these limitations, achieving 72.3% accuracy on a benchmark dataset of Java questions, surpassing existing baseline works by 7%. The video demonstration and code repository can be found at https://youtu.be/VSu2Q0zb-X0 and https://github.com/krish10924/Difficulty-tag-Generator.

Indian Institute of Technology Roorkee (IN)
Climate action
Openalex Percentile: Top 85%
Software Engineering Research
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.