The Case for an Objective Score for Open Educational Resources: Proposing the OpenBook QR Score

Judging whether an openly licensed textbook is good, and whether it can be reused, still rests on opinion. A systematic review of 14 published OER quality rubrics found that five specify no rating scale, only three provide a detailed scoring guide, and only six report any empirical testing. This position paper argues that open educational resources need an objective score, anchored by descriptors and evidence, reported as separate quality and reusability halves, reproducible by human and AI-agent reviewers, and validated before use. We propose the OpenBook QR Score, ten metrics worth ten points each, five for quality (Q) and five for reusability (R), reported in the form QR 76 (Q 37 / R 39), with a decision rule that stops a high total hiding a failed metric. As an illustration, not a validation, AI-agent reviewers scored each of ten widely used open textbooks in two independent passes, using about 86,000 tokens and two minutes per title; totals ranged from 60 to 81, and the passes agreed within one point on 88 percent of metric scores. Metadata was the weakest metric (mean 5.5), editable source the strongest (8.9); eight of ten titles carry a NonCommercial clause that the descriptors do not yet score consistently. Scripted checks on 101 MkDocs book projects apply part of a rubric in seconds per book. This is a fast, low-cost first step; verifying chapter content with a low-cost model is next, then the reliability, validity and gaming studies required before scores guide adoption.

Authors

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-10-31
DOI
https://doi.org/10.5281/zenodo.23844586
Primary Topic
Open Education and E-Learning
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

The Case for an Objective Score for Open Educational Resources: Proposing the OpenBook QR Score

Dan McCreary
Zenodo (CERN European Organization for Nuclear Research)
Open Education and E-Learning
article

The Case for an Objective Score for Open Educational Resources: Proposing the OpenBook QR Score

Dan McCreary
article en

Abstract

Judging whether an openly licensed textbook is good, and whether it can be reused, still rests on opinion. A systematic review of 14 published OER quality rubrics found that five specify no rating scale, only three provide a detailed scoring guide, and only six report any empirical testing. This position paper argues that open educational resources need an objective score, anchored by descriptors and evidence, reported as separate quality and reusability halves, reproducible by human and AI-agent reviewers, and validated before use. We propose the OpenBook QR Score, ten metrics worth ten points each, five for quality (Q) and five for reusability (R), reported in the form QR 76 (Q 37 / R 39), with a decision rule that stops a high total hiding a failed metric. As an illustration, not a validation, AI-agent reviewers scored each of ten widely used open textbooks in two independent passes, using about 86,000 tokens and two minutes per title; totals ranged from 60 to 81, and the passes agreed within one point on 88 percent of metric scores. Metadata was the weakest metric (mean 5.5), editable source the strongest (8.9); eight of ten titles carry a NonCommercial clause that the descriptors do not yet score consistently. Scripted checks on 101 MkDocs book projects apply part of a rubric in seconds per book. This is a fast, low-cost first step; verifying chapter content with a low-cost model is next, then the reliability, validity and gaming studies required before scores guide adoption.

Zenodo (CERN European Organization for Nuclear Research)
Openalex Percentile: Top 6%
Open Education and E-Learning
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon