Research on Evaluation Outside Journal Publications: An Analysis of Proposals Accepted for the 2019 American Evaluation Association Annual Conference

Many evaluators may be conducting and presenting research on evaluation (RoE) without realizing it. Proposals accepted to present at the AEA 2019 conference were analyzed for whether or not they were RoE (i.e., systematic, empirical, and focused on evaluation). RoE proposals were then coded using a framework by Mark (2008) to determine the common trends across those identified as RoE. Non-RoE proposals were coded for why they were not RoE, including that they were not systematic, empirical, and/or focused on evaluation. A total of 15% of the 732 proposals analyzed were coded as RoE; most proposals examined evaluation activities using the descriptive mode of inquiry. Furthermore, most non-RoE proposals were coded as not RoE because they presented an evaluation rather than a research study on evaluation or because they were reflections on evaluation. This study presents multiple opportunities and future directions for RoE.

Authors

Institutions

Publication Details

Journal
Journal of MultiDisciplinary Evaluation
Published
2025-08-09
DOI
https://doi.org/10.56645/jmde.v21i51.995
Primary Topic
Evaluation and Performance Assessment
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Research on Evaluation Outside Journal Publications: An Analysis of Proposals Accepted for the 2019 American Evaluation Association Annual Conference

Seema Mahato, Dana Linnell Wanzer, Michael A. Harnar, Travis R. Moore et al.
1 links
Journal of MultiDisciplinary Evaluation
Evaluation and Performance Assessment
article

Research on Evaluation Outside Journal Publications: An Analysis of Proposals Accepted for the 2019 American Evaluation Association Annual Conference

Seema Mahato, Dana Linnell Wanzer, Michael A. Harnar, Travis R. Moore, Esther C. Nolton
article en

Abstract

Many evaluators may be conducting and presenting research on evaluation (RoE) without realizing it. Proposals accepted to present at the AEA 2019 conference were analyzed for whether or not they were RoE (i.e., systematic, empirical, and focused on evaluation). RoE proposals were then coded using a framework by Mark (2008) to determine the common trends across those identified as RoE. Non-RoE proposals were coded for why they were not RoE, including that they were not systematic, empirical, and/or focused on evaluation. A total of 15% of the 732 proposals analyzed were coded as RoE; most proposals examined evaluation activities using the descriptive mode of inquiry. Furthermore, most non-RoE proposals were coded as not RoE because they presented an evaluation rather than a research study on evaluation or because they were reflections on evaluation. This study presents multiple opportunities and future directions for RoE.

Journal of MultiDisciplinary EvaluationVol. 21(51)
Tufts University (US), Western Michigan University (US), University of Wisconsin–Stout (US), Washington University in St. Louis (US), Vital Strategies (US)
Western Michigan University
Openalex Percentile: Top 75%
Evaluation and Performance Assessment
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.