The Need to Understand Medical Student-Specific Validity of Well-Being Scales

To the Editor: Bynum and colleagues1 reported on the systematic development of the Shame Frequency Questionnaire in Medical Students. We agree there is a need for well-being measures with validity evidence in medical students. Furthermore, we suggest that convergent validity is best established using reference measures that have been validated in medical students. In their article, the authors use the 10-item Center for Epidemiological Studies Depression Scale (CES-D-10) as a measure of depression. This scale was originally developed for use in older adults2 and does not seem to have been validated in the medical student population. Therefore, if we are unsure that the CES-D-10 accurately reflects depression in medical students, how confident can we be that correlation with the CES-D-10 supports the validity of another scale? We suggest that validity evidence for the Shame Frequency Questionnaire in Medical Students could be strengthened by comparing it to the 20-item CES-D3 or the Patient Health Questionnaire-9 (PHQ-9),4 which have been validated in medical students as accurate surrogate measures of diagnostic interviews. As Bynum and colleagues correctly suggest, using existing scales from other contexts without validity evidence to support their intended use in medical students impairs our ability to understand phenomena in undergraduate medical education. Thorough investigations of medical student well-being scale validity are therefore necessary to not only support the selection of measures but also provide trustworthy reference points for use in the development and validation of new scales that may measure different constructs. Given the wide array of scales currently being used to measure medical student well-being,5 it would be inconceivable to pursue complete evaluations of every such scale. We suggest that a robust synthesis of existing validity evidence could help identify scales for each construct (i.e., depression, burnout, etc.) that hold promise for further use and validation. In addition, consensus-based activities with key stakeholders, including learners, could highlight important constructs to measure as part of medical student well-being. Ensuring that we use consistent and psychometrically sound tools can enhance our efforts to advance well-being in medical education and ultimately the delivery of health care. Henry Li, MDResident, Department of Emergency Medicine, Faculty of Medicine & Dentistry, University of Alberta, Edmonton, Alberta, Canada; email: [email protected]; X (formerly Twitter): @HenryLiCDN; ORCID: https://orcid.org/0000-0002-1594-347XVictor Do, MD, MScClinical assistant professor, Department of Pediatrics, Faculty of Medicine & Dentistry, University of Alberta, Edmonton, Alberta, CanadaAliya Kassam, MSc, PhDAssociate professor, Department of Community Health Sciences and Office of Postgraduate Medical Education, Cumming School of Medicine, University of Calgary, Calgary, Alberta, Canada; ORCID: https://orcid.org/0000-0002-7081-6377

Authors

Institutions

Publication Details

Journal
Academic Medicine
Published
2024-09-17
DOI
https://doi.org/10.1097/acm.0000000000005880
Primary Topic
Healthcare professionals’ stress and burnout
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

The Need to Understand Medical Student-Specific Validity of Well-Being Scales

Henry Li, Victor Do, Aliya Kassam
Academic Medicine
Healthcare professionals’ stress and burnout
article

The Need to Understand Medical Student-Specific Validity of Well-Being Scales

Henry Li, Victor Do, Aliya Kassam
article en

Abstract

To the Editor: Bynum and colleagues1 reported on the systematic development of the Shame Frequency Questionnaire in Medical Students. We agree there is a need for well-being measures with validity evidence in medical students. Furthermore, we suggest that convergent validity is best established using reference measures that have been validated in medical students. In their article, the authors use the 10-item Center for Epidemiological Studies Depression Scale (CES-D-10) as a measure of depression. This scale was originally developed for use in older adults2 and does not seem to have been validated in the medical student population. Therefore, if we are unsure that the CES-D-10 accurately reflects depression in medical students, how confident can we be that correlation with the CES-D-10 supports the validity of another scale? We suggest that validity evidence for the Shame Frequency Questionnaire in Medical Students could be strengthened by comparing it to the 20-item CES-D3 or the Patient Health Questionnaire-9 (PHQ-9),4 which have been validated in medical students as accurate surrogate measures of diagnostic interviews. As Bynum and colleagues correctly suggest, using existing scales from other contexts without validity evidence to support their intended use in medical students impairs our ability to understand phenomena in undergraduate medical education. Thorough investigations of medical student well-being scale validity are therefore necessary to not only support the selection of measures but also provide trustworthy reference points for use in the development and validation of new scales that may measure different constructs. Given the wide array of scales currently being used to measure medical student well-being,5 it would be inconceivable to pursue complete evaluations of every such scale. We suggest that a robust synthesis of existing validity evidence could help identify scales for each construct (i.e., depression, burnout, etc.) that hold promise for further use and validation. In addition, consensus-based activities with key stakeholders, including learners, could highlight important constructs to measure as part of medical student well-being. Ensuring that we use consistent and psychometrically sound tools can enhance our efforts to advance well-being in medical education and ultimately the delivery of health care. Henry Li, MDResident, Department of Emergency Medicine, Faculty of Medicine & Dentistry, University of Alberta, Edmonton, Alberta, Canada; email: [email protected]; X (formerly Twitter): @HenryLiCDN; ORCID: https://orcid.org/0000-0002-1594-347XVictor Do, MD, MScClinical assistant professor, Department of Pediatrics, Faculty of Medicine & Dentistry, University of Alberta, Edmonton, Alberta, CanadaAliya Kassam, MSc, PhDAssociate professor, Department of Community Health Sciences and Office of Postgraduate Medical Education, Cumming School of Medicine, University of Calgary, Calgary, Alberta, Canada; ORCID: https://orcid.org/0000-0002-7081-6377

Academic MedicineVol. 99(12)
University of Alberta (CA), University of Calgary (CA)
Reduced inequalities
Openalex Percentile: Top 73%
Healthcare professionals’ stress and burnout
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.