Personalization Is No Miracle Cure: Evaluation of a Technology-Enhanced Self-Regulated Learning Intervention for Continuing Education

• The effectiveness of TEPSIs in supporting SRL may depend on the learning content • TEPSIs should provide holistic support considering both learning time and content • TEPSIs may have negative side effects when not implemented properly Self-regulated learning (SRL) has been considered essential for learning success in continuing education (CE), especially in online learning settings. This paper employs a mixed-methods approach to evaluate a technology-enhanced personalized SRL intervention (TEPSI) that provides a goal-setting functionality, a personalized learning plan, and a personalized dashboard to support SRL in CE. We conducted an experimental study in which participants ( N = 146) could choose one of three self-paced online learning paths (Agile Management, Data Reporting, or Leadership in Practice) and were asked to complete this learning path within a 12-week learning period. Participants were randomly assigned to an intervention condition, in which the TEPSI was available, and a control condition, in which the TEPSI was not available. The availability of the TEPSI positively affected learners’ self-reported time and study environment in the Data Reporting learning path. Still, it did not affect learning processes in the other two learning paths. Further analyses revealed that interacting with the TEPSI could also negatively affect SRL. Moreover, we conducted a qualitative interview study ( N = 20) using the think-aloud method to gain deeper insights into the benefits and weaknesses of the TEPSI. We identified several issues regarding learners’ perceived ease of use and usefulness of the intervention. Our findings show that personalization is no miracle cure and may have negative side effects when not implemented properly. The findings provide several implications for designing TEPSIs for CE.