Proposal for a critical appraisal tool for studies using the Delphi method (DCAT)

The number of published studies using the Delphi method has increased considerably in recent years. The Delphi method is now used extensively to develop guidelines, methodological standards, and quality indicators. Delphi studies are implemented in various ways and can differ in their design, conduct, analysis, and reporting; however, no critical appraisal instrument currently exists for the Delphi method. This Special Paper presents a tool that has been developed by the authors, based on over 15 years of experience conducting Delphi studies and a comprehensive analysis of the of the literature on the Delphi method since its inception. Following the structure of established critical appraisal tools for other research methods, DCAT (Delphi critical appraisal tool) has been developed to evaluate Delphi studies. The DCAT checklist consists of 16 items (four core and 12 additional items) that can be applied to and used to inform an overall judgment about the quality of a Delphi study. DCAT aims to assist in identifying the extent to which a Delphi study provides a sufficiently reasonable representation of expert and stakeholder views to inform decision making.