Abstract TP237: Automated large vessel occlusion detection on CT angiography: a prospective comparison of two software packages

Introduction: AI-driven software has been recommended as a means of triaging suspected large vessel occlusions (LVOs) on CT angiography (CTA), and different solutions are now commercially available. This study compared the performance of two software packages, Brainomix 360 Triage LVO and Rapid LVO, in prospective, real-world use. Methods: Consecutive patients scanned for suspected stroke at 3 comprehensive stroke centres from May to July 2024 (3 months) were included in the study. CTA, where available, was processed in real time by both Rapid and Brainomix software. Ground truth on vessel occlusion was ascertained using clinical review of electronic medical records. Occlusion location was coded as intracranial internal carotid artery terminus (ICA-T), middle cerebral artery (MCA) M1 or MCA M2. If more than one occlusion was observed, the most proximal of these was taken as the primary vessel affected. Results: There were 561 suspected stroke patients scanned during the study period across the three sites. Of these, CTA was sent for processing by both Rapid LVO and Brainomix 360 Triage LVO for 359 cases. Cases were excluded if no contrast was detected (n=17), leaving 342 cases (Table 1). Of these, proximal LVO (ICA-T or MCA M1) was confirmed in 14 cases and MCA M2 occlusions were present in 6 cases. Table 2 shows the LVO detection results for all cases from the two software packages. For both devices, sensitivity was higher when considering only proximal occlusions (ICA-T or M1). Performance was similar overall, but there was a trend towards differing sensitivity for more distal occlusions. As a composite measure, area under the curve (AUC) was higher for Brainomix than Rapid (Figure 1) but this difference was not significant. The positive predictive value (PPV) was low for both software packages due to the low incidence of LVO in the patient population. Conclusions: This study demonstrated consistent performance of two AI software devices, Brainomix 360 Triage LVO and Rapid LVO, for detection of LVO on CTA imaging, in prospective, real-world use. The low number of positive cases in the dataset (N=21) is a limitation of the study. There was a trend towards different performance for more distal vessel occlusion locations. Overall, the sensitivity observed in this dataset was in line with reports from previous retrospective studies for both software packages and underlines the importance of prospective evaluation to understand real-world performance.