D3.3 Evaluation of outcomes and refinement strategy

This report evaluates the first round of training pilots conducted within the PATTERN project (Piloting open and responsible Activities and Trainings Towards the Enhancement of Researchers Networks), which aims to develop and implement high-quality trainings in open and responsible research and innovation (RRI) across Europe. The project focuses on widening participation and fostering capacity-building within the European Research Area, particularly through training activities that address themes such as FAIR data, Citizen Science, Open Access, and others. This report presents the findings of a formative evaluation of the first cycle of training implementation, providing concrete recommendations for refining the second and final cycle of PATTERN trainings. The evaluation is based on a consolidated framework of criteria, capturing perspectives at three levels: the training activities themselves, the participants, and—planned for a later stage—the institutions carrying out the trainings. The evaluation focuses on the trainings’ content quality, appropriateness for target audiences, communication and presentation, perceived learning outcomes, and anticipated practical application. Data were gathered from 27 pilot trainings implemented between May 2024 and February 2025. Evaluation instruments included quantitative participant questionnaires (441 responses), interactive evaluation activities (18 implementations), and facilitator reflection templates (25 submissions). Triangulation of these three evaluation instruments provides multi-faceted insights into training effectiveness and outcomes from two perspectives – training participants and training implementation. Key findings indicate that the trainings were generally well-received across diverse disciplines, career stages, and formats. Participants found the content relevant, clearly structured, and appropriately challenging. Interactive elements and practical relevance were particularly valued. While most participants reported high satisfaction and perceived learning gains, younger participants and those in larger training groups tended to rate experiences slightly less favourably, highlighting a need for more tailored approaches for early-career researchers and students. Furthermore, trainings using the Projects platform were generally evaluated less positively, indicating a need for upcoming training plans to focus more on how the platform can be flexibly integrated across various training formats. The report concludes with specific recommendations for the second pilot round, including: Prioritising smaller training groups and longer sessions to facilitate participant engagement. Improving the adaptability and relevance of training content, especially for students and early-career researchers. Improving the usability and application of digital tools, particularly the Projects platform. Retaining or expanding the interactive, flexible formats as they were widely appreciated by participants. These findings will guide the refinement of the next PATTERN training cycle and possibly inform broader strategies to strengthen research capacity in the European Research Area. **This version of the document is still under approval of the EC.