Late Breaking Abstract - SPIROmetry interpretation in primary care with or without Artificial Intelligence Decision support software (SPIRO-AID)
<bold>Introduction:</bold> Quality and interpretation accuracy of spirometry are variable in primary care. We aimed to evaluate whether an AI decision support software (ArtiQ. Spiro) improves the diagnostic prediction of primary care clinicians. <bold>Methods:</bold> A parallel, two-group, randomised controlled trial of primary care clinicians in the UK who refer for, or interpret, spirometry. Clinicians were randomised 1:1 to independently interpret fifty de-identified, real-world patient spirometry sessions through an on-line platform either with (AI+) or without (AI-) an AI decision support software report. The primary outcome was diagnostic prediction performance (proportion of the fifty spirometry sessions where clinicians’ preferred diagnosis matched the reference diagnosis, derived by consensus from independent review of primary and secondary care notes and investigations by 3 pulmonologists). A Welch t test was used for analysis. Planned subgroup analysis of cases with a reference diagnosis of COPD (20/50) was performed. <bold>Results:</bold> 234 participants were recruited and randomised from June 2023 to April 2024, 133 completed the study (AI+ n=66, AI- n=67): 73% female, 42% general practitioner, 54% on national spirometry register. The mean (SD) correct diagnostic prediction performance was significantly better for AI+ than AI- (58.7 [7.0]% versus 49.7 [16.6]%; mean [95%CI] treatment effect: 9.0 [4.5-13.3]%, p<0.01), and for reference COPD cases (mean [95% CI] treatment effect: 15.9 [9.0-22.7] %, p<0.0001). <bold>Conclusion:</bold> Addition of AI decision support software improved diagnostic prediction performance in primary care clinicians assessing real-world spirometry, especially for cases of COPD.
Authors
- Ethaar El-Emir
- Nicholas S Hopkinson (ORCID: https://orcid.org/0000-0003-3235-0454)
- Elena Smets (ORCID: https://orcid.org/0000-0002-7617-1119)
- Stephanie Taylor (ORCID: https://orcid.org/0000-0001-7454-6354)
- David A. Scott (ORCID: https://orcid.org/0000-0001-6475-8046)
- Samantha S.C. Kon (ORCID: https://orcid.org/0000-0003-1949-4453)
- Karl Sylvester (ORCID: https://orcid.org/0000-0001-6851-1219)
- Richard E. K. Russell (ORCID: https://orcid.org/0000-0002-3890-7201)
- William D‐C Man (ORCID: https://orcid.org/0000-0002-3782-659X)
- Gillian Doe (ORCID: https://orcid.org/0000-0003-4782-5811)
- Rachael A Evans (ORCID: https://orcid.org/0000-0002-1667-868X)
- Anthony Paulo Sunjaya (ORCID: https://orcid.org/0000-0003-2257-4374)
- A Toby Prevost (ORCID: https://orcid.org/0000-0003-1723-0796)
- George Edwards
- Ian Jarrold
- Karolien Van Orshoven (ORCID: https://orcid.org/0009-0001-6375-215X)
- Marko Topalovic (ORCID: https://orcid.org/0000-0001-6150-1122)
- Winston Banya
- Nannette Spain
Institutions
- Queen Mary University of London (GB)
- The George Institute for Global Health (GB)
- King's College London (GB)
- Hillingdon Hospitals NHS Foundation Trust (GB)
- Royal Brompton & Harefield NHS Foundation Trust (GB)
- House of Representatives (NL)
- British Lung Foundation (GB)
- Harefield Hospital (GB)
- Lung Institute (US)
- Papworth Hospital NHS Foundation Trust (GB)
- The George Institute for Global Health (AU)
- Cicely Saunders International (GB)
- NIHR Leicester Biomedical Research Centre (GB)
- University of Southampton (GB)
- KU Leuven (BE)
Publication Details
- Published
- 2024-09-14
- DOI
- https://doi.org/10.1183/13993003.congress-2024.rct999
- Primary Topic
- Artificial Intelligence in Healthcare and Education
- Type
- article
- Field-Weighted Citation Impact
- 0.00