Does “Selective Mapping” Impede Depth and Breadth? A Method for Performing Meta-Analysis on Curriculum and Assessment Maps

ABSTRACT Whereas curriculum maps depict all alignments between a program’s learning outcomes and courses, assessment maps may examine a subset of courses during a given program review cycle, to measure attainment of those outcomes. The purpose of this study was to understand if such “selective mapping” negatively impacts depth and breadth of analysis. Data were collected from 129 maps at a private university in Southern California to answer the research question. A process was created to quantify assessment and curriculum maps for the purpose of meta-analysis. The quantifiable measures that were developed include triangulation breadth (TB), outcomes coverage load (OCL), alignment saturation (AS), and outcome level depth (LD). The findings show that despite selectivity in assessment mapping, the degrees of triangulation, program coverage, and outcome level depth remain robust. The meta-analysis of curriculum and assessment maps also revealed norms and outliers, which can be used to establish “best practices” for mapping.

Authors

Institutions

Publication Details

Journal
Journal of Assessment and Institutional Effectiveness
Published
2025-10-01
DOI
https://doi.org/10.5325/jasseinsteffe.15.1-2.0104
Primary Topic
Educational Assessment and Improvement
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Does “Selective Mapping” Impede Depth and Breadth? A Method for Performing Meta-Analysis on Curriculum and Assessment Maps

Kenneth Nehrbass
Journal of Assessment and Institutional Effectiveness
Educational Assessment and Improvement
article

Does “Selective Mapping” Impede Depth and Breadth? A Method for Performing Meta-Analysis on Curriculum and Assessment Maps

Kenneth Nehrbass
article en

Abstract

ABSTRACT Whereas curriculum maps depict all alignments between a program’s learning outcomes and courses, assessment maps may examine a subset of courses during a given program review cycle, to measure attainment of those outcomes. The purpose of this study was to understand if such “selective mapping” negatively impacts depth and breadth of analysis. Data were collected from 129 maps at a private university in Southern California to answer the research question. A process was created to quantify assessment and curriculum maps for the purpose of meta-analysis. The quantifiable measures that were developed include triangulation breadth (TB), outcomes coverage load (OCL), alignment saturation (AS), and outcome level depth (LD). The findings show that despite selectivity in assessment mapping, the degrees of triangulation, program coverage, and outcome level depth remain robust. The meta-analysis of curriculum and assessment maps also revealed norms and outliers, which can be used to establish “best practices” for mapping.

Journal of Assessment and Institutional EffectivenessVol. 15(1-2)
California Baptist University (US)
Openalex Percentile: Top 70%
Educational Assessment and Improvement
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.