Late Breaking Abstract - SPIROmetry interpretation in primary care with or without Artificial Intelligence Decision support software (SPIRO-AID)

<bold>Introduction:</bold> Quality and interpretation accuracy of spirometry are variable in primary care. We aimed to evaluate whether an AI decision support software (ArtiQ. Spiro) improves the diagnostic prediction of primary care clinicians. <bold>Methods:</bold> A parallel, two-group, randomised controlled trial of primary care clinicians in the UK who refer for, or interpret, spirometry. Clinicians were randomised 1:1 to independently interpret fifty de-identified, real-world patient spirometry sessions through an on-line platform either with (AI+) or without (AI-) an AI decision support software report. The primary outcome was diagnostic prediction performance (proportion of the fifty spirometry sessions where clinicians’ preferred diagnosis matched the reference diagnosis, derived by consensus from independent review of primary and secondary care notes and investigations by 3 pulmonologists). A Welch t test was used for analysis. Planned subgroup analysis of cases with a reference diagnosis of COPD (20/50) was performed. <bold>Results:</bold> 234 participants were recruited and randomised from June 2023 to April 2024, 133 completed the study (AI+ n=66, AI- n=67): 73% female, 42% general practitioner, 54% on national spirometry register. The mean (SD) correct diagnostic prediction performance was significantly better for AI+ than AI- (58.7 [7.0]% versus 49.7 [16.6]%; mean [95%CI] treatment effect: 9.0 [4.5-13.3]%, p<0.01), and for reference COPD cases (mean [95% CI] treatment effect: 15.9 [9.0-22.7] %, p<0.0001). <bold>Conclusion:</bold> Addition of AI decision support software improved diagnostic prediction performance in primary care clinicians assessing real-world spirometry, especially for cases of COPD.

Authors

Institutions

Publication Details

Published
2024-09-14
DOI
https://doi.org/10.1183/13993003.congress-2024.rct999
Primary Topic
Artificial Intelligence in Healthcare and Education
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Late Breaking Abstract - SPIROmetry interpretation in primary care with or without Artificial Intelligence Decision support software (SPIRO-AID)

Ethaar El-Emir, Nicholas S Hopkinson, Elena Smets, Stephanie Taylor et al.
Artificial Intelligence in Healthcare and Education
article

Late Breaking Abstract - SPIROmetry interpretation in primary care with or without Artificial Intelligence Decision support software (SPIRO-AID)

Ethaar El-Emir, Nicholas S Hopkinson, Elena Smets, Stephanie Taylor, David A. Scott, Samantha S.C. Kon, Karl Sylvester, Richard E. K. Russell, William D‐C Man, Gillian Doe, Rachael A Evans, Anthony Paulo Sunjaya, A Toby Prevost, George Edwards, Ian Jarrold, Karolien Van Orshoven, Marko Topalovic, Winston Banya, Nannette Spain
article en

Abstract

<bold>Introduction:</bold> Quality and interpretation accuracy of spirometry are variable in primary care. We aimed to evaluate whether an AI decision support software (ArtiQ. Spiro) improves the diagnostic prediction of primary care clinicians. <bold>Methods:</bold> A parallel, two-group, randomised controlled trial of primary care clinicians in the UK who refer for, or interpret, spirometry. Clinicians were randomised 1:1 to independently interpret fifty de-identified, real-world patient spirometry sessions through an on-line platform either with (AI+) or without (AI-) an AI decision support software report. The primary outcome was diagnostic prediction performance (proportion of the fifty spirometry sessions where clinicians’ preferred diagnosis matched the reference diagnosis, derived by consensus from independent review of primary and secondary care notes and investigations by 3 pulmonologists). A Welch t test was used for analysis. Planned subgroup analysis of cases with a reference diagnosis of COPD (20/50) was performed. <bold>Results:</bold> 234 participants were recruited and randomised from June 2023 to April 2024, 133 completed the study (AI+ n=66, AI- n=67): 73% female, 42% general practitioner, 54% on national spirometry register. The mean (SD) correct diagnostic prediction performance was significantly better for AI+ than AI- (58.7 [7.0]% versus 49.7 [16.6]%; mean [95%CI] treatment effect: 9.0 [4.5-13.3]%, p<0.01), and for reference COPD cases (mean [95% CI] treatment effect: 15.9 [9.0-22.7] %, p<0.0001). <bold>Conclusion:</bold> Addition of AI decision support software improved diagnostic prediction performance in primary care clinicians assessing real-world spirometry, especially for cases of COPD.

Queen Mary University of London (GB), The George Institute for Global Health (GB), King's College London (GB), Hillingdon Hospitals NHS Foundation Trust (GB), Royal Brompton & Harefield NHS Foundation Trust (GB), House of Representatives (NL), British Lung Foundation (GB), Harefield Hospital (GB), Lung Institute (US), Papworth Hospital NHS Foundation Trust (GB), The George Institute for Global Health (AU), Cicely Saunders International (GB), NIHR Leicester Biomedical Research Centre (GB), University of Southampton (GB), KU Leuven (BE)
Peace, Justice and strong institutions
Openalex Percentile: Top 85%
Artificial Intelligence in Healthcare and Education
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.