Primary Evaluation outcomEs for Research on peer review – A Core Outcome Set (PEER-COS): A Scoping Review to Inform Item Development (Protocol)

This protocol describes a scoping review that will identify, map, and synthesize the outcomes and measurement tools used in empirical research on manuscript peer review, providing the initial evidence base for the Primary Evaluation outcomEs for Research on peer review - A Core Outcome Set (PEER-COS). Guided by JBI methodology and the COMET Handbook and COS-STAD principles, the review will search seven bibliographic databases, preprint servers, and 69 grey-literature sources for eligible English-language systematic reviews, experimental, quasi-experimental, and observational studies published from 1986 onwards. Eligible studies must evaluate an empirically measured outcome related to peer review of scholarly manuscripts, including, for example, quality, timeliness, transparency, fairness, reliability, or stakeholder experience. Screening and data extraction will be supported by the otto-SR artificial-intelligence platform and subject to predefined human quality checks; identified outcomes will be synthesized quantitatively and thematically into unique outcome concepts and broader domains. The resulting candidate outcome list will inform a three-round international Delphi consensus process involving relevant interest holders—including researchers, editors, peer reviewers, funders, statisticians, and patient and public partners—to establish a core outcome set for future research evaluating manuscript peer review and peer-review interventions.