Two Numbers, One Record: A Study Protocol for Testing Whether Separate Reporting of Planned and Extra Output Makes IMF Records Comparable as Creative-Campus Data
Indicator Measurement Factor Analysis (IMF) records creative-campus projects as missions with planned outputs, extra outputs and an achievement percentage. A concept analysis earlier in this series proposed (P4) that reporting planned achievement and extra output as two separate numbers makes IMF records comparable across missions and cohorts and therefore usable as campus-level creative-economy data. This paper is a conceptual and study-protocol paper that prepares the test of that proposition; it reports no empirical results. We show that a single combined percentage admits at least three defensible readings once a mission produces extra output, and model a reported figure as a record component plus a reader component with a judgement part and a convention part, the latter removed by two-number reporting. We state four hypotheses with pre-specified decision rules, and give a fully crossed rater protocol in which independent, trained raters recompute figures from the same de-identified records under a single-percentage condition, a two-number condition and a sensitivity condition with a fully specified single formula. The analysis plan uses the absolute-agreement intraclass correlation ICC(A,1) and Krippendorff's alpha with paired bootstrap comparisons, limits of agreement, a mixed model for moderation by the share of extra output, robustness checks and a planning simulation for sample size (80 records, four raters). A worked example applying the protocol to six missions shows the computations end to end and how the convention part alone can lower agreement on a single figure without any rater error. The protocol is designed so that support for the two-number convention, support for a precisely specified single rule, or a negative result would each be informative for campuses that report creative-economy outputs.
Authors
- Marviola Grace Hardini (ORCID: https://orcid.org/0000-0003-3336-2131)
- Nuke Puji Lestari Santoso (ORCID: https://orcid.org/0000-0002-4414-2102)
- Qurotul Aini (ORCID: https://orcid.org/0000-0002-7546-5721)
- Fitra Putri Oganda (ORCID: https://orcid.org/0000-0002-4590-0657)
- Untung Rahardja (ORCID: https://orcid.org/0000-0002-2166-2412)
Institutions
- Universitas Raharja (ID)
Publication Details
- Published
- 2026-10-13
- DOI
- https://doi.org/10.33050/creaticampus.v1i1.7
- Primary Topic
- Reliability and Agreement in Measurement
- Type
- article
- Field-Weighted Citation Impact
- 0.00