Two Numbers, One Record: A Study Protocol for Testing Whether Separate Reporting of Planned and Extra Output Makes IMF Records Comparable as Creative-Campus Data

Indicator Measurement Factor Analysis (IMF) records creative-campus projects as missions with planned outputs, extra outputs and an achievement percentage. A concept analysis earlier in this series proposed (P4) that reporting planned achievement and extra output as two separate numbers makes IMF records comparable across missions and cohorts and therefore usable as campus-level creative-economy data. This paper is a conceptual and study-protocol paper that prepares the test of that proposition; it reports no empirical results. We show that a single combined percentage admits at least three defensible readings once a mission produces extra output, and model a reported figure as a record component plus a reader component with a judgement part and a convention part, the latter removed by two-number reporting. We state four hypotheses with pre-specified decision rules, and give a fully crossed rater protocol in which independent, trained raters recompute figures from the same de-identified records under a single-percentage condition, a two-number condition and a sensitivity condition with a fully specified single formula. The analysis plan uses the absolute-agreement intraclass correlation ICC(A,1) and Krippendorff's alpha with paired bootstrap comparisons, limits of agreement, a mixed model for moderation by the share of extra output, robustness checks and a planning simulation for sample size (80 records, four raters). A worked example applying the protocol to six missions shows the computations end to end and how the convention part alone can lower agreement on a single figure without any rater error. The protocol is designed so that support for the two-number convention, support for a precisely specified single rule, or a negative result would each be informative for campuses that report creative-economy outputs.

Authors

Institutions

Publication Details

Published
2026-10-13
DOI
https://doi.org/10.33050/creaticampus.v1i1.7
Primary Topic
Reliability and Agreement in Measurement
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Two Numbers, One Record: A Study Protocol for Testing Whether Separate Reporting of Planned and Extra Output Makes IMF Records Comparable as Creative-Campus Data

Marviola Grace Hardini, Nuke Puji Lestari Santoso, Qurotul Aini, Fitra Putri Oganda et al.
Reliability and Agreement in Measurement
article

Two Numbers, One Record: A Study Protocol for Testing Whether Separate Reporting of Planned and Extra Output Makes IMF Records Comparable as Creative-Campus Data

Marviola Grace Hardini, Nuke Puji Lestari Santoso, Qurotul Aini, Fitra Putri Oganda, Untung Rahardja
article en

Abstract

Indicator Measurement Factor Analysis (IMF) records creative-campus projects as missions with planned outputs, extra outputs and an achievement percentage. A concept analysis earlier in this series proposed (P4) that reporting planned achievement and extra output as two separate numbers makes IMF records comparable across missions and cohorts and therefore usable as campus-level creative-economy data. This paper is a conceptual and study-protocol paper that prepares the test of that proposition; it reports no empirical results. We show that a single combined percentage admits at least three defensible readings once a mission produces extra output, and model a reported figure as a record component plus a reader component with a judgement part and a convention part, the latter removed by two-number reporting. We state four hypotheses with pre-specified decision rules, and give a fully crossed rater protocol in which independent, trained raters recompute figures from the same de-identified records under a single-percentage condition, a two-number condition and a sensitivity condition with a fully specified single formula. The analysis plan uses the absolute-agreement intraclass correlation ICC(A,1) and Krippendorff's alpha with paired bootstrap comparisons, limits of agreement, a mixed model for moderation by the share of extra output, robustness checks and a planning simulation for sample size (80 records, four raters). A worked example applying the protocol to six missions shows the computations end to end and how the convention part alone can lower agreement on a single figure without any rater error. The protocol is designed so that support for the two-number convention, support for a precisely specified single rule, or a negative result would each be informative for campuses that report creative-economy outputs.

Vol. 1(1)
Universitas Raharja (ID)
Openalex Percentile: Top 10%
Reliability and Agreement in Measurement
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.