A design science approach to mixed-methods evaluation in serious game research

For a serious game to be effective, it must undergo rigorous validation process. A Design Science approach advocates the use of quantitative or qualitative research methodologies within the creation and validation of artifacts, an approach suitable for evaluating serious games as educational tools. This study presents a methodological framework that integrates quantitative measurement and qualitative inquiry to assess the effectiveness of a serious game designed for ethics education. We provide access to the quantitative questionnaire, its codebook, and the dataset generated during the validation of the authors' approach using a serious game for teaching business ethics. The integration of both methods allowed us to validate the game as a relevant and effective strategy for promoting ethical reflection among university students. These findings support the consistency and reliability of the method used for validating serious games. Methodological Highlights•The quantitative assessment is based on the Technology Acceptance Model III (TAM III) and the Theory of Planned Behavior (TPB).•Qualitative inquiry analyzes students' group work to understand their perceptions of ethical phenomena after gameplay.•Professors can use insights from students' perceptions as a starting point or framework for takeaways in future game applications.

Authors

Institutions

Publication Details

Journal
MethodsX
Published
2025-04-03
DOI
https://doi.org/10.1016/j.mex.2025.103299
Citations
1
Primary Topic
Educational Games and Gamification
Type
article
Field-Weighted Citation Impact
3.44

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A design science approach to mixed-methods evaluation in serious game research

Gloria María Zambrano Aranda, Emerson Jesús Toledo Concha, Gómez García
1 citations
MethodsX
Educational Games and Gamification
3.44
article

A design science approach to mixed-methods evaluation in serious game research

Gloria María Zambrano Aranda, Emerson Jesús Toledo Concha, Gómez García
article en
1 citations

Abstract

For a serious game to be effective, it must undergo rigorous validation process. A Design Science approach advocates the use of quantitative or qualitative research methodologies within the creation and validation of artifacts, an approach suitable for evaluating serious games as educational tools. This study presents a methodological framework that integrates quantitative measurement and qualitative inquiry to assess the effectiveness of a serious game designed for ethics education. We provide access to the quantitative questionnaire, its codebook, and the dataset generated during the validation of the authors' approach using a serious game for teaching business ethics. The integration of both methods allowed us to validate the game as a relevant and effective strategy for promoting ethical reflection among university students. These findings support the consistency and reliability of the method used for validating serious games. Methodological Highlights•The quantitative assessment is based on the Technology Acceptance Model III (TAM III) and the Theory of Planned Behavior (TPB).•Qualitative inquiry analyzes students' group work to understand their perceptions of ethical phenomena after gameplay.•Professors can use insights from students' perceptions as a starting point or framework for takeaways in future game applications.

MethodsXVol. 14
Pontificia Universidad Católica del Perú (PE)
Pontificia Universidad Católica del Perú
Openalex Percentile: Top 11%
Educational Games and Gamification
3.44
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

A design science approach to mixed-methods evaluation in serious game research — Gloria María Zambrano Aranda, Emerson Jesús Toledo Concha, et al. · MethodsX (2025) | TGRS Research Map | TGRS