Conducting User Experiments in Recommender Systems

This tutorial provides practical training in designing and conducting online user experiments with recommender systems, and in statistically analyzing the results of such experiments. It covers the development of a research question and hypotheses, the selection of study participants, the manipulation of system aspects and measurement of behaviors, perceptions and user experiences, and the evaluation of subjective measurement scales and study hypotheses. Interested parties can find the slides, example datset, and other resources at https://www.usabart.nl/QRMS/.