Validation of a Mobile App for Remote Autism Screening in Toddlers
Early detection of autism is important for timely access to diagnostic evaluation and early intervention services, which improve children's outcomes. Despite the ability of clinicians to reliably diagnose autism in toddlers, diagnosis is often delayed. SenseToKnow is a mobile autism screening application (app) delivered on a smartphone or tablet that provides an objective and quantitative assessment of early behavioral signs of autism based on computer vision (CV) and machine learning (ML). This study examined the accuracy of SenseToKnow for autism detection when the app was downloaded and administered remotely at home by caregivers using their own devices. The SenseToKnow app was administered by caregivers of 620 toddlers between 16 and 40 months of age, 188 of whom were subsequently diagnosed with autism by expert clinicians. The app displayed strategically designed movies and a bubble-popping game on an iPhone or iPad while recording the child's behavioral responses through the device's front-facing camera and touch/inertial sensors. Recordings of the child's behavior were then automatically analyzed using CV. Multiple behavioral phenotypes were quantified and combined using ML in an algorithm for autism prediction. SenseToKnow demonstrated a high level of diagnostic accuracy with area under the receiver operating characteristic curve of 0.92, sensitivity of 83.0%, specificity of 93.3%, positive predictive value of 84.3%, and negative predictive value of 92.6%. Accuracy of the app for detecting autism was similar when administered on either a caregiver's iPhone or iPad. These results demonstrate that a mobile autism screening app based on CV can be delivered remotely by caregivers at home on their own devices and can provide a high level of accuracy for autism detection. Remote screening for autism potentially lowers barriers to autism screening, which could reduce disparities in early access to services and support and improve children's outcomes.
Authors
- Saritha Vermeer (ORCID: https://orcid.org/0000-0003-0285-4205)
- Guillermo Sapiro (ORCID: https://orcid.org/0000-0001-9190-6964)
- J. Matías Di Martino (ORCID: https://orcid.org/0000-0002-4679-8666)
- Rachel Aiello (ORCID: https://orcid.org/0000-0002-5739-6304)
- Brian Eichner (ORCID: https://orcid.org/0000-0002-4509-1060)
- Géraldine Dawson (ORCID: https://orcid.org/0000-0003-1410-2764)
- Pradeep Raj Krishnappa Babu
- Sam Perochon
- Marina Spanos (ORCID: https://orcid.org/0000-0002-4601-8498)
- Jill Howard (ORCID: https://orcid.org/0000-0003-2668-5194)
- Steven Espinosa
- Jennifer Green
Institutions
- École Normale Supérieure Paris-Saclay (FR)
- Duke University (US)
- Princeton University (US)
- Office of the National Coordinator for Health Information Technology (US)
- Laboratoire de Biologie et Pharmacologie Appliquée (FR)
- Universidad Católica del Uruguay (UY)
- Center for Autism and Related Disorders (US)
Publication Details
- Journal
- NEJM AI
- Published
- 2024-09-26
- DOI
- https://doi.org/10.1056/aics2400510
- Citations
- 7
- Primary Topic
- Autism Spectrum Disorder Research
- Type
- article
- Field-Weighted Citation Impact
- 2.40
Funders
- National Institutes of Health
- National Institute of Mental Health