Development of a framework of potential adverse effects of interventions to improve critical thinking about health choices: A mixed methods study.

<ns3:p>Background People need critical thinking skills to make well-informed health choices and avoid waste and unnecessary suffering. However, educational interventions can have adverse effects, which is often overlooked. We created a framework of potential harms of interventions to improve critical thinking about health choices. The objective was to identify potential effects and articulate potential mechanisms. We intended to use the framework to inform the development and evaluation of an intervention in Kenya, Rwanda, and Uganda. Methods We created an initial framework drawing on two earlier frameworks. We surveyed external experts using Likert-scale and open-ended items, including researchers, educators, and others, in a variety of relevant fields. We emailed the survey to an international advisory network, and all other experts recommended by respondents. We analyzed the quantitative data using descriptive statistics. We conducted a thematic analysis of the qualitative data. We revised the framework based on those results. To identify any effects missing from the revised framework, we individually interviewed a convenience sample of one teacher from each of Kenya, Rwanda, and Uganda. Results We received responses from 38 of 70 external experts (54%). The quantitative survey data suggested respondents agreed with the initial framework overall. However, the qualitative data led to substantial revisions. The revised framework consists of categories of adverse outcomes; outcomes within each category; sub-outcomes; individuals, groups, and populations that might experience each adverse outcome; beneficial outcomes corresponding with adverse outcomes; and potential mechanisms of adverse effects. There are six categories: decision-making harms, psychological harms, equity harms, group and social harms, waste, and other harms. In the interviews with teachers, we did not identify any effects missing from the revised framework. Conclusions As far as we know, the framework is the first tool of its kind for education research. It can be improved upon and adapted.</ns3:p>