What value do standardized observation systems add to summative teacher evaluation systems?

Teacher evaluation systems work to balance summative and formative goals. Instructional observations are an important part of such systems, allowing evaluation to directly impact instruction. Research shows that summative and formative goals can conflict with each other. This paper examines whether the summative usage of observation scores contributes to summative evaluation. We find that, after accounting for traditional principal ratings, observation scores provide little predictive validity for identifying high quality teachers. Given the reviewed negative impacts of summative uses of observation scores in teacher evaluation, teacher evaluation systems should reconsider the summative usage of observation scores. • Observation Systems are used within teacher evaluation systems to address both summative and formative goals. • The summative usage of observation systems has negative consequences for their formative usage. • Our analyses suggest little positive benefit of using observation systems summatively. • Holistic principal ratings are equally predictive of teacher quality as scores from observation systems. • The summative usage of observation systems should be strongly reconsidered.

Authors

Institutions

Publication Details

Journal
Studies In Educational Evaluation
Published
2024-10-31
DOI
https://doi.org/10.1016/j.stueduc.2024.101414
Primary Topic
Educational Assessment and Improvement
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

What value do standardized observation systems add to summative teacher evaluation systems?

Mark White, Bridget Maher
Studies In Educational Evaluation
Educational Assessment and Improvement
article

What value do standardized observation systems add to summative teacher evaluation systems?

Mark White, Bridget Maher
article en

Abstract

Teacher evaluation systems work to balance summative and formative goals. Instructional observations are an important part of such systems, allowing evaluation to directly impact instruction. Research shows that summative and formative goals can conflict with each other. This paper examines whether the summative usage of observation scores contributes to summative evaluation. We find that, after accounting for traditional principal ratings, observation scores provide little predictive validity for identifying high quality teachers. Given the reviewed negative impacts of summative uses of observation scores in teacher evaluation, teacher evaluation systems should reconsider the summative usage of observation scores. • Observation Systems are used within teacher evaluation systems to address both summative and formative goals. • The summative usage of observation systems has negative consequences for their formative usage. • Our analyses suggest little positive benefit of using observation systems summatively. • Holistic principal ratings are equally predictive of teacher quality as scores from observation systems. • The summative usage of observation systems should be strongly reconsidered.

Studies In Educational EvaluationVol. 83
Statistics Norway (NO), Institute for Social Research (NO)
William T. Grant Foundation, Spencer Foundation, NordForsk
Quality Education
Openalex Percentile: Top 78%
Educational Assessment and Improvement
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.