Content Analysis in Counseling Research: A Meta‐Study of Methodological Components and Agreement Procedures

ABSTRACT This study examined content analysis (CA) reporting practices in counseling research, with emphasis on methodological reporting and coder agreement. We analyzed 373 CA articles published from 1953 to 2024 across 28 counseling journals using a deductive coding framework based on Krippendorff's model of unitizing, sampling, recording, and reducing. We also examined reporting of coder agreement procedures and interrater reliability (IRR). Most articles reported sampling procedures (98%) and a coding scheme (80%), whereas fewer reported coder preparation (20%) or pilot testing (26%). Only 37% reported a specific IRR index. Reporting of coding schemes, pilot testing, use of multiple coders, and coding guides increased significantly across historical eras ( p s < 0.001); reporting of coder agreement also differed significantly by era ( p < 0.001). Findings suggest increased transparency over time but highlight persistent gaps in reporting practices, underscoring the need for clearer reporting standards that support evaluation of analytic procedures and reproducibility in counseling research.

Authors

Institutions

Publication Details

Journal
Journal of Counseling & Development
Published
2026-10-14
DOI
https://doi.org/10.1002/jcad.70076
Primary Topic
Reliability and Agreement in Measurement
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Content Analysis in Counseling Research: A Meta‐Study of Methodological Components and Agreement Procedures

Edward Wahesh, William Bradley McKibben, Phillip L. Waalkes, Daniel Andrew DeCino et al.
Journal of Counseling & Development
Reliability and Agreement in Measurement
article

Content Analysis in Counseling Research: A Meta‐Study of Methodological Components and Agreement Procedures

Edward Wahesh, William Bradley McKibben, Phillip L. Waalkes, Daniel Andrew DeCino, Lucy L. Purgason, Monica Maria Phelps‐Pineda, Avery Peffer
article en

Abstract

ABSTRACT This study examined content analysis (CA) reporting practices in counseling research, with emphasis on methodological reporting and coder agreement. We analyzed 373 CA articles published from 1953 to 2024 across 28 counseling journals using a deductive coding framework based on Krippendorff's model of unitizing, sampling, recording, and reducing. We also examined reporting of coder agreement procedures and interrater reliability (IRR). Most articles reported sampling procedures (98%) and a coding scheme (80%), whereas fewer reported coder preparation (20%) or pilot testing (26%). Only 37% reported a specific IRR index. Reporting of coding schemes, pilot testing, use of multiple coders, and coding guides increased significantly across historical eras ( p s < 0.001); reporting of coder agreement also differed significantly by era ( p < 0.001). Findings suggest increased transparency over time but highlight persistent gaps in reporting practices, underscoring the need for clearer reporting standards that support evaluation of analytic procedures and reproducibility in counseling research.

Journal of Counseling & Development
University of South Dakota (US), University of Missouri–St. Louis (US), Oregon State University Cascades (US), Villanova University (US), Stetson University (US)
Openalex Percentile: Top 11%
Reliability and Agreement in Measurement
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.