Summary of the 2nd International Flaky Test Workshop (FTW 2025)

Test flakiness refers to the unpredictable behavior of software tests, where a test may pass or fail even when neither the test code nor the system under test has changed. This results in reduced developer productivity, costly and repeated test reruns, hidden or overlooked defects, and diminished confidence in test suites. While the problem has received increasing attention from both practitioners and researchers in recent years, opportunities for focused discussion remain limited. The 2nd International Flaky TestWorkshop (FTW 2025) was held on April 27th, 2025, in conjunction with the 47th International Conference on Software Engineering (ICSE 2025). The program emphasized two main themes, flakiness in specific and previously neglected domains and improving flakiness mitigation techniques, and also included demonstrations of new datasets and tools to support research and practice.

Authors

Institutions

Publication Details

Journal
ACM SIGSOFT Software Engineering Notes
Published
2025-10-27
DOI
https://doi.org/10.1145/3772008.3772016
Primary Topic
Software Testing and Debugging Techniques
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Summary of the 2nd International Flaky Test Workshop (FTW 2025)

Martin Grůber, Owain Parry, August Shi, Wing Lam
ACM SIGSOFT Software Engineering Notes
Software Testing and Debugging Techniques
article

Summary of the 2nd International Flaky Test Workshop (FTW 2025)

Martin Grůber, Owain Parry, August Shi, Wing Lam
article en

Abstract

Test flakiness refers to the unpredictable behavior of software tests, where a test may pass or fail even when neither the test code nor the system under test has changed. This results in reduced developer productivity, costly and repeated test reruns, hidden or overlooked defects, and diminished confidence in test suites. While the problem has received increasing attention from both practitioners and researchers in recent years, opportunities for focused discussion remain limited. The 2nd International Flaky TestWorkshop (FTW 2025) was held on April 27th, 2025, in conjunction with the 47th International Conference on Software Engineering (ICSE 2025). The program emphasized two main themes, flakiness in specific and previously neglected domains and improving flakiness mitigation techniques, and also included demonstrations of new datasets and tools to support research and practice.

ACM SIGSOFT Software Engineering NotesVol. 50(4)
George Mason University (US), BMW Group (Germany) (DE), The University of Texas at Austin (US), University of Sheffield (GB)
Openalex Percentile: Top 67%
Software Testing and Debugging Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.