Weak-Model Proxy Users and Coverage Round-Trip Testing: A Practical Playbook for QA and UX Evaluation of Data-Driven UIs

Data-driven UIs — dashboards, assessment reports, solver visualizers — must be both correct (they show the right data in the right state) and usable (a first-time user reaches the answer without excessive effort). Both properties are typically checked by hand, which is slow and error-prone. We present a five-part, human-effort-minimizing playbook: (1) coverage round-trip testing, which enumerates the full data/state space, programmatically reconstructs the application into each state, and asserts correct display and timing; (2) test-of-the-test meta-validation, which deliberately corrupts data/UI to prove the tests are not vacuously passing; (3) automatable accessibility checks (colour-vision-deficiency distance, contrast, label completeness); (4) weak-model proxy-user testing, in which LLM agents weaker than the developer, given only a goal and the live UI (no source), act as naive users while logging surprises, retries, and click/scroll/time metrics; and (5) metrics-driven UX improvement targeting reductions in clicks-, scrolls-, and time-to-answer. We report a case study on a data-driven poker-strategy visualizer backed by a public GTO dataset. Coverage round-trip testing verified 100% of 23,368 data nodes; meta-validation caught a real bug in our own test; and weak-model proxy users reproduced, and quantified, usability barriers a human developer had personally hit — including a confidently-wrong weak model that reached a high-confidence but incorrect conclusion by misreading UI affordances. We distill design principles: prefer design-level clarity over textual guidance; separate "strictly correct" from "correct but unkind"; and treat a weaker model as a cognitive-load meter.

Authors

Institutions

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-08-17
DOI
https://doi.org/10.5281/zenodo.21973412
Primary Topic
Software Testing and Debugging Techniques
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
preprint

Weak-Model Proxy Users and Coverage Round-Trip Testing: A Practical Playbook for QA and UX Evaluation of Data-Driven UIs

Shinobu Tsuchiya
Zenodo (CERN European Organization for Nuclear Research)
Software Testing and Debugging Techniques
preprint

Weak-Model Proxy Users and Coverage Round-Trip Testing: A Practical Playbook for QA and UX Evaluation of Data-Driven UIs

Shinobu Tsuchiya
preprint en

Abstract

Data-driven UIs — dashboards, assessment reports, solver visualizers — must be both correct (they show the right data in the right state) and usable (a first-time user reaches the answer without excessive effort). Both properties are typically checked by hand, which is slow and error-prone. We present a five-part, human-effort-minimizing playbook: (1) coverage round-trip testing, which enumerates the full data/state space, programmatically reconstructs the application into each state, and asserts correct display and timing; (2) test-of-the-test meta-validation, which deliberately corrupts data/UI to prove the tests are not vacuously passing; (3) automatable accessibility checks (colour-vision-deficiency distance, contrast, label completeness); (4) weak-model proxy-user testing, in which LLM agents weaker than the developer, given only a goal and the live UI (no source), act as naive users while logging surprises, retries, and click/scroll/time metrics; and (5) metrics-driven UX improvement targeting reductions in clicks-, scrolls-, and time-to-answer. We report a case study on a data-driven poker-strategy visualizer backed by a public GTO dataset. Coverage round-trip testing verified 100% of 23,368 data nodes; meta-validation caught a real bug in our own test; and weak-model proxy users reproduced, and quantified, usability barriers a human developer had personally hit — including a confidently-wrong weak model that reached a high-confidence but incorrect conclusion by misreading UI affordances. We distill design principles: prefer design-level clarity over textual guidance; separate "strictly correct" from "correct but unkind"; and treat a weaker model as a cognitive-load meter.

Zenodo (CERN European Organization for Nuclear Research)
Copernicus Therapeutics (United States) (US)
Peace, Justice and strong institutions
Software Testing and Debugging Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Weak-Model Proxy Users and Coverage Round-Trip Testing: A Practical Playbook for QA and UX Evaluation of Data-Driven UIs — Shinobu Tsuchiya · Zenodo (CERN European Organization for Nuclear Research) (2026) | TGRS Research Map | TGRS