Automatiserad generering av visuella regressionstester genom tillståndsutforskning

As web applications become increasingly central to digital experiences, ensuring visual consistency across user interfaces is crucial. Unintended visual changes, or visual regressions, can harm user experience and lead to significant issues for organisations. Visual Regression Testing (VRT) helps address this by detecting visual anomalies during the development process. This study explores how state exploration can enhance VRT suites for React component libraries using Storybook and Playwright. We present AutoVRT, a novel tool that automatically generates interaction-based VRT tests and evaluates them using first-order mutation analysis. Applied to five components from an industrial project: OSTTRA’s React library, AutoVRT produced 86 new interaction-based tests, improving the mutation score from 0.22 to 0.53, a 130% increase per component on average. Remaining limitations suggest a need for more well-defined component stories to support more effective test generation.

Publication Details

Journal
KTH Publication Database DiVA (KTH Royal Institute of Technology)
Published
2025-01-01
Primary Topic
Software Engineering Research
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Automatiserad generering av visuella regressionstester genom tillståndsutforskning

KTH Publication Database DiVA (KTH Royal Institute of Technology)
Software Engineering Research
article

Automatiserad generering av visuella regressionstester genom tillståndsutforskning

article en

Abstract

As web applications become increasingly central to digital experiences, ensuring visual consistency across user interfaces is crucial. Unintended visual changes, or visual regressions, can harm user experience and lead to significant issues for organisations. Visual Regression Testing (VRT) helps address this by detecting visual anomalies during the development process. This study explores how state exploration can enhance VRT suites for React component libraries using Storybook and Playwright. We present AutoVRT, a novel tool that automatically generates interaction-based VRT tests and evaluates them using first-order mutation analysis. Applied to five components from an industrial project: OSTTRA’s React library, AutoVRT produced 86 new interaction-based tests, improving the mutation score from 0.22 to 0.53, a 130% increase per component on average. Remaining limitations suggest a need for more well-defined component stories to support more effective test generation.

KTH Publication Database DiVA (KTH Royal Institute of Technology)
Openalex Percentile: Top 36%
Software Engineering Research
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.