Utility of comics to support member-checking in realist evaluation

<h3>Context:</h3> In realist evaluation (RE), as in many qualitative approaches, member-checking significantly enhances the credibility of findings. Because RE is relatively novel and continuously evolving, integrating new tools is pivotal in democratizing its practice. However, despite the significance of member-checking within the RE framework, researchers currently face a lack of tools tailored to supporting this crucial aspect of the evaluation process. <h3>Objective:</h3> This study aims to develop and test a novel tool based on comics to explore perceptions of Context-Mechanism-Outcome (CMO) configurations and propose a new method for conducting member-checking in the RE context. <h3>Study Design and Analysis:</h3> Based on a refined program theory, comics were created to represent each CMO configuration. These comics were used in group discussions to determine whether the CMOs accurately reflected participants9 experiences. <h3>Setting:</h3> The refined program theory emerged from a Canadian study on the role of the champion in promoting continuous quality improvement (CQI) initiatives in primary healthcare (PHC). <h3>Population Studied:</h3> Group discussions with PHC professionals and experts from across Canada with experience in CQI were organized to evaluate the use of comics for member-checking in RE studies. <h3>Instrument:</h3> Researchers employed a creative combination of comic strips and open-ended questions to facilitate participants9 articulation of their experiences about the depicted scenarios. <h3>Results:</h3> These engaging methods fostered a conducive environment for sharing insights. Three focus groups, each spanning 90 minutes, were conducted via Teams. They comprised 3 to 5 participants, allowing for interactive discussions and rich data exchange. Comics effectively contextualized the discussions and allowed participants to easily understand CMO configurations without needing to grasp the definitions of the mechanisms, a core component of CMO configurations that can be challenging for non-experts. Comics provided a playful, engaging way to lead the groups and encourage exchanges. <h3>Conclusions:</h3> This method streamlines the focus on CMO configurations without having to explain all RE principles to participants. Simplifying explanations for participants fosters an effective member-checking process.

Authors

Publication Details

Journal
The Annals of Family Medicine
Published
2024-11-20
DOI
https://doi.org/10.1370/afm.22.s1.6869
Citations
1
Primary Topic
Educational and Psychological Assessments
Type
article
Field-Weighted Citation Impact
0.79
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Utility of comics to support member-checking in realist evaluation

Isabelle Gaboury, Dave A. Bergeron, Élisabeth Martin
1 citations
The Annals of Family Medicine
Educational and Psychological Assessments
0.79
article

Utility of comics to support member-checking in realist evaluation

Isabelle Gaboury, Dave A. Bergeron, Élisabeth Martin
article en
1 citations

Abstract

<h3>Context:</h3> In realist evaluation (RE), as in many qualitative approaches, member-checking significantly enhances the credibility of findings. Because RE is relatively novel and continuously evolving, integrating new tools is pivotal in democratizing its practice. However, despite the significance of member-checking within the RE framework, researchers currently face a lack of tools tailored to supporting this crucial aspect of the evaluation process. <h3>Objective:</h3> This study aims to develop and test a novel tool based on comics to explore perceptions of Context-Mechanism-Outcome (CMO) configurations and propose a new method for conducting member-checking in the RE context. <h3>Study Design and Analysis:</h3> Based on a refined program theory, comics were created to represent each CMO configuration. These comics were used in group discussions to determine whether the CMOs accurately reflected participants9 experiences. <h3>Setting:</h3> The refined program theory emerged from a Canadian study on the role of the champion in promoting continuous quality improvement (CQI) initiatives in primary healthcare (PHC). <h3>Population Studied:</h3> Group discussions with PHC professionals and experts from across Canada with experience in CQI were organized to evaluate the use of comics for member-checking in RE studies. <h3>Instrument:</h3> Researchers employed a creative combination of comic strips and open-ended questions to facilitate participants9 articulation of their experiences about the depicted scenarios. <h3>Results:</h3> These engaging methods fostered a conducive environment for sharing insights. Three focus groups, each spanning 90 minutes, were conducted via Teams. They comprised 3 to 5 participants, allowing for interactive discussions and rich data exchange. Comics effectively contextualized the discussions and allowed participants to easily understand CMO configurations without needing to grasp the definitions of the mechanisms, a core component of CMO configurations that can be challenging for non-experts. Comics provided a playful, engaging way to lead the groups and encourage exchanges. <h3>Conclusions:</h3> This method streamlines the focus on CMO configurations without having to explain all RE principles to participants. Simplifying explanations for participants fosters an effective member-checking process.

The Annals of Family MedicineVol. 22(Supplement 1)
Openalex Percentile: Top 22%
Educational and Psychological Assessments
0.79
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.