Report from the ASE 2024 Workshop on Replications and Negative Results

This report summarizes the organization and outcomes of the Replications and Negative Results (RENE) Workshop at the Automated Software Engineering (ASE) conference in 2024. This workshop solicited two types of papers: (a) papers replicating prior work, and extending that work to other datasets, domains, or methods to see if the conclusions of the original work hold; (b) negative results papers, focused on experiments that other researchers may have thought reasonable to try, but did not work, accompanied by some hypothesis. Discussion at the workshop included topics such as the replication issue in SE, how that affects graduate students performing research, and ways to improve the replicability of research and how to disseminate negative results in the community.

Authors

Institutions

Publication Details

Journal
ACM SIGSOFT Software Engineering Notes
Published
2025-07-18
DOI
https://doi.org/10.1145/3743095.3743107
Primary Topic
Scientific Computing and Data Management
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Report from the ASE 2024 Workshop on Replications and Negative Results

Rahul Yedida, Tim Menzies
ACM SIGSOFT Software Engineering Notes
Scientific Computing and Data Management
article

Report from the ASE 2024 Workshop on Replications and Negative Results

Rahul Yedida, Tim Menzies
article en

Abstract

This report summarizes the organization and outcomes of the Replications and Negative Results (RENE) Workshop at the Automated Software Engineering (ASE) conference in 2024. This workshop solicited two types of papers: (a) papers replicating prior work, and extending that work to other datasets, domains, or methods to see if the conclusions of the original work hold; (b) negative results papers, focused on experiments that other researchers may have thought reasonable to try, but did not work, accompanied by some hypothesis. Discussion at the workshop included topics such as the replication issue in SE, how that affects graduate students performing research, and ways to improve the replicability of research and how to disseminate negative results in the community.

ACM SIGSOFT Software Engineering NotesVol. 50(3)
North Carolina State University (US), North Central State College (US), Lexicon Pharmaceuticals (United States) (US)
Openalex Percentile: Top 70%
Scientific Computing and Data Management
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.