A Hybrid Modified Angoff Standard Setting Method for Polytomous Items

Abstract This research evaluates a Hybrid Angoff Method for standard setting procedures that utilize polytomous items. The method combines an Option Angoff with a Mean Angoff method to reduce the complexity of implementing judgments on polytomous items. The results were encouraging both with support for utilizing the method and panelist perceptions. The hybrid method provides a potential option for programs using polytomously scored items on their exams when implementing a standard setting panel.

Authors

Institutions

Publication Details

Journal
Educational Measurement Issues and Practice
Published
2026-08-27
DOI
https://doi.org/10.1111/emip.70044
Primary Topic
Psychometric Methodologies and Testing
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A Hybrid Modified Angoff Standard Setting Method for Polytomous Items

Joe Betts, Shu-chuan Kao, Cary Lin, William Muntean
Educational Measurement Issues and Practice
Psychometric Methodologies and Testing
article

A Hybrid Modified Angoff Standard Setting Method for Polytomous Items

Joe Betts, Shu-chuan Kao, Cary Lin, William Muntean
article en

Abstract

Abstract This research evaluates a Hybrid Angoff Method for standard setting procedures that utilize polytomous items. The method combines an Option Angoff with a Mean Angoff method to reduce the complexity of implementing judgments on polytomous items. The results were encouraging both with support for utilizing the method and panelist perceptions. The hybrid method provides a potential option for programs using polytomously scored items on their exams when implementing a standard setting panel.

Educational Measurement Issues and PracticeVol. 45(3)
Council of State (FI)
Openalex Percentile: Top 6%
Psychometric Methodologies and Testing
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.