Integrating real-time polling into modified Delphi methodology: lessons from a consensus study on cardiac implantable electronic device remote monitoring

The Delphi technique is widely used to develop consensus among experts, particularly in clinical guideline development. However, traditional Delphi methods can be time-consuming, resource-intensive, and challenging to implement across geographically dispersed regions. This study presents a novel adaptation of the modified Delphi method using real-time polling software to enhance efficiency, engagement, and consensus-building. We conducted a four-round modified Delphi study involving clinicians across Australia and New Zealand. Real-time polling software (Mentimeter) was integrated into two rounds, enabling anonymous voting, immediate display of aggregated results, and iterative discussion during hybrid meetings. The method was applied to develop clinical appropriateness recommendations for remote monitoring of cardiac implantable electronic devices (CIEDs), serving as an exemplar for broader methodological innovation. Fifty-seven participants completed Round 1, with sustained engagement across subsequent rounds. Real-time polling facilitated consensus on multiple recommendations within a single session, reducing study duration and enhancing participant interaction. Anonymity was preserved throughout, and geographic barriers were mitigated through hybrid participation. The approach enabled efficient refinement of recommendations and supported broad expert input. This study demonstrates the feasibility and value of integrating real-time polling platforms into modified Delphi studies. The method offers a scalable, cost-effective, and accessible alternative to traditional approaches, particularly suited to time-sensitive research and geographically dispersed panels.

Authors

Institutions

Publication Details

Journal
BMC Medical Research Methodology
Published
2026-02-25
DOI
https://doi.org/10.1186/s12874-026-02807-2
Primary Topic
Healthcare Technology and Patient Monitoring
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Integrating real-time polling into modified Delphi methodology: lessons from a consensus study on cardiac implantable electronic device remote monitoring

Kenneth Cho, Zoe Rock, Samual Turnbull, Edel O’Hagan et al.
BMC Medical Research Methodology
Healthcare Technology and Patient Monitoring
article

Integrating real-time polling into modified Delphi methodology: lessons from a consensus study on cardiac implantable electronic device remote monitoring

Kenneth Cho, Zoe Rock, Samual Turnbull, Edel O’Hagan, Kam Cheong Wong, Clara K Chow, Brodie Sheahen
article en

Abstract

The Delphi technique is widely used to develop consensus among experts, particularly in clinical guideline development. However, traditional Delphi methods can be time-consuming, resource-intensive, and challenging to implement across geographically dispersed regions. This study presents a novel adaptation of the modified Delphi method using real-time polling software to enhance efficiency, engagement, and consensus-building. We conducted a four-round modified Delphi study involving clinicians across Australia and New Zealand. Real-time polling software (Mentimeter) was integrated into two rounds, enabling anonymous voting, immediate display of aggregated results, and iterative discussion during hybrid meetings. The method was applied to develop clinical appropriateness recommendations for remote monitoring of cardiac implantable electronic devices (CIEDs), serving as an exemplar for broader methodological innovation. Fifty-seven participants completed Round 1, with sustained engagement across subsequent rounds. Real-time polling facilitated consensus on multiple recommendations within a single session, reducing study duration and enhancing participant interaction. Anonymity was preserved throughout, and geographic barriers were mitigated through hybrid participation. The approach enabled efficient refinement of recommendations and supported broad expert input. This study demonstrates the feasibility and value of integrating real-time polling platforms into modified Delphi studies. The method offers a scalable, cost-effective, and accessible alternative to traditional approaches, particularly suited to time-sensitive research and geographically dispersed panels.

BMC Medical Research Methodology
The University of Sydney (AU), Baker Heart and Diabetes Institute (AU), The Alfred Hospital (AU), Westmead Hospital (AU), Westmead Institute (AU), Western Sydney University (AU)
Openalex Percentile: Top 44%
Healthcare Technology and Patient Monitoring
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.