Testing the Stable Unit Treatment Variance Assumption (SUTVA) Within Cochrane Reviews of Antimicrobial-Based Pneumonia Prevention Interventions Among Mechanically Ventilated Patients Using Caterpillar Plots

<b>Background/Objectives</b>: Causal inference requires validating the stable unit treatment variance assumption (SUTVA). Whilst antimicrobial-based interventions, being topical chlorhexidine and topical antibiotics prophylaxis (TAP), appear effective in preventing ventilator-associated pneumonia (VAP) among ICU patients receiving mechanical ventilation (MV) within randomized concurrent controlled trials (RCCT), SUTVA has never been tested for this inference. <b>Methods</b>: Caterpillar plots of the VAP incidence proportions for control and intervention groups within RCCTs obtained from recent Cochrane reviews of antimicrobial-based VAP prevention interventions were derived using random effects methods to enable comparison versus the expert VAP incidence reference range (5 to 40%). <b>Results</b>: The summary VAP prevention effect size derived from three categories of 57 RCCTs of antimicrobial-based interventions was recapitulated. The VAP incidences of 24 control groups and 6 intervention group incidences were above, whereas only 1 and 6, respectively, were below the expert VAP incidence reference range (5 to 40%) (<i>p</i> < 0.001; chi-square = 17.42; df = 2). The results after excluding 18 low-quality studies were similar. Paradoxically, the 90% prediction limits in association with the summary control group incidences are each approximately 20 percentage points wider than for those associated with the intervention group summaries. <b>Conclusions</b>: Control group VAP incidences above and more dispersed versus the expert opinion VAP range are common within the Cochrane reviews of antimicrobial-based VAP prevention interventions. Recognition requires an arms-based analysis using caterpillar plots. The SUTVAs that underlie the inference of prevention from the effect size estimates are not valid.

Authors

Institutions

Publication Details

Journal
Journal of Clinical Medicine
Published
2025-09-26
DOI
https://doi.org/10.3390/jcm14196841
Citations
1
Primary Topic
Nosocomial Infections in ICU
Type
article
Field-Weighted Citation Impact
1.55
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Testing the Stable Unit Treatment Variance Assumption (SUTVA) Within Cochrane Reviews of Antimicrobial-Based Pneumonia Prevention Interventions Among Mechanically Ventilated Patients Using Caterpillar Plots

James C. Hurley
1 citations
Journal of Clinical Medicine
Nosocomial Infections in ICU
1.55
article

Testing the Stable Unit Treatment Variance Assumption (SUTVA) Within Cochrane Reviews of Antimicrobial-Based Pneumonia Prevention Interventions Among Mechanically Ventilated Patients Using Caterpillar Plots

James C. Hurley
article en
1 citations

Abstract

<b>Background/Objectives</b>: Causal inference requires validating the stable unit treatment variance assumption (SUTVA). Whilst antimicrobial-based interventions, being topical chlorhexidine and topical antibiotics prophylaxis (TAP), appear effective in preventing ventilator-associated pneumonia (VAP) among ICU patients receiving mechanical ventilation (MV) within randomized concurrent controlled trials (RCCT), SUTVA has never been tested for this inference. <b>Methods</b>: Caterpillar plots of the VAP incidence proportions for control and intervention groups within RCCTs obtained from recent Cochrane reviews of antimicrobial-based VAP prevention interventions were derived using random effects methods to enable comparison versus the expert VAP incidence reference range (5 to 40%). <b>Results</b>: The summary VAP prevention effect size derived from three categories of 57 RCCTs of antimicrobial-based interventions was recapitulated. The VAP incidences of 24 control groups and 6 intervention group incidences were above, whereas only 1 and 6, respectively, were below the expert VAP incidence reference range (5 to 40%) (<i>p</i> < 0.001; chi-square = 17.42; df = 2). The results after excluding 18 low-quality studies were similar. Paradoxically, the 90% prediction limits in association with the summary control group incidences are each approximately 20 percentage points wider than for those associated with the intervention group summaries. <b>Conclusions</b>: Control group VAP incidences above and more dispersed versus the expert opinion VAP range are common within the Cochrane reviews of antimicrobial-based VAP prevention interventions. Recognition requires an arms-based analysis using caterpillar plots. The SUTVAs that underlie the inference of prevention from the effect size estimates are not valid.

Journal of Clinical MedicineVol. 14(19)
Federation University (AU), Deakin University (AU), Ballarat Health Services (AU), Grampians Health
Openalex Percentile: Top 15%
Nosocomial Infections in ICU
1.55
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.