<i>ARTigo</i>: Lessons From Social Image Tagging in an Art-Historical Game With a Purpose

Since 2010, <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">ARTigo</i> has been leveraging games with a purpose (GWAPs) to engage citizen scientists in the tagging of artworks. In these games, two players collaboratively annotate images under time constraints. This paper introduces <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">ARTigo</i> as an easily customizable framework for image labeling tailored to elicit specific domain knowledge. It also outlines a two-pronged evaluation strategy to assess the impact of <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">ARTigo</i>’s front-end design on visual aesthetics, usability, and cognitive workload, as well as on users' tagging behavior. Comparisons between <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">ARTigo</i> version <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><tex-math notation="LaTeX">$\boldsymbol {1}$</tex-math></inline-formula>, developed from 2010 to 2013, and version <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><tex-math notation="LaTeX">$\boldsymbol {2}$</tex-math></inline-formula>, developed in 2022, indicate significant improvements: the System Usability Scale rating improved from grade <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">B</i> to <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">A-</i>, and the Short Visual Aesthetics of Websites Inventory rating from 4.42 to 5.34 points (<inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><tex-math notation="LaTeX">$\boldsymbol {p &lt; 0.05}$</tex-math></inline-formula>). Moreover, the graphical user interface in version <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><tex-math notation="LaTeX">$\boldsymbol {2}$</tex-math></inline-formula> promotes more frequent and complex tagging, thus collecting a similar amount of tags with higher entropy in fewer rounds—which is especially beneficial for GWAP with smaller, active communities.