Measuring ethics training effectiveness – introducing a toolbox

Abstract The current paper is an overview to present a toolbox for measures to evaluate the effectiveness of research ethics and integrity training. The mapping of existing tools (based on the literature review) revealed that while there were measures for different group sizes, the feasibility was often hindered by tools being discipline specific, not openly accessible, requiring a lot of work to be implemented and/or in piloting phase. In addition, most tools measured either short-term or mid-term effects of training by collecting participant reactions or testing the content of the training. Additional tools were sought and designed (all having been used in ethics context) that could be used for different group sizes, that would be feasible to use (i.e. that would be openly accessible, usable in different disciplines, tested in REI training context, and that would utilize analysis frameworks that make comparison of results of different training formats possible), and that would provide information about the short-, mid- and long-term effects of training. Measuring training effectiveness has two components: the tool to collect learning outputs (preferably one that also has a pedagogical function) and an instrument or framework to analyse the collected information – a list is provide for both aspects. There is also a table in the appendix that provides a suggestion of whether short-, mid- and long-term effects could be measured with the tool, what the functionality of it is, there are suggested instruments of analysis, feasibility, temporal dimension and potential manipulativeness by Gen AI.