Validation of a Mobile App for Remote Autism Screening in Toddlers

Early detection of autism is important for timely access to diagnostic evaluation and early intervention services, which improve children's outcomes. Despite the ability of clinicians to reliably diagnose autism in toddlers, diagnosis is often delayed. SenseToKnow is a mobile autism screening application (app) delivered on a smartphone or tablet that provides an objective and quantitative assessment of early behavioral signs of autism based on computer vision (CV) and machine learning (ML). This study examined the accuracy of SenseToKnow for autism detection when the app was downloaded and administered remotely at home by caregivers using their own devices. The SenseToKnow app was administered by caregivers of 620 toddlers between 16 and 40 months of age, 188 of whom were subsequently diagnosed with autism by expert clinicians. The app displayed strategically designed movies and a bubble-popping game on an iPhone or iPad while recording the child's behavioral responses through the device's front-facing camera and touch/inertial sensors. Recordings of the child's behavior were then automatically analyzed using CV. Multiple behavioral phenotypes were quantified and combined using ML in an algorithm for autism prediction. SenseToKnow demonstrated a high level of diagnostic accuracy with area under the receiver operating characteristic curve of 0.92, sensitivity of 83.0%, specificity of 93.3%, positive predictive value of 84.3%, and negative predictive value of 92.6%. Accuracy of the app for detecting autism was similar when administered on either a caregiver's iPhone or iPad. These results demonstrate that a mobile autism screening app based on CV can be delivered remotely by caregivers at home on their own devices and can provide a high level of accuracy for autism detection. Remote screening for autism potentially lowers barriers to autism screening, which could reduce disparities in early access to services and support and improve children's outcomes.

Authors

Institutions

Publication Details

Journal
NEJM AI
Published
2024-09-26
DOI
https://doi.org/10.1056/aics2400510
Citations
7
Primary Topic
Autism Spectrum Disorder Research
Type
article
Field-Weighted Citation Impact
2.40

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Validation of a Mobile App for Remote Autism Screening in Toddlers

Saritha Vermeer, Guillermo Sapiro, J. Matías Di Martino, Rachel Aiello et al.
7 citations
NEJM AI
Autism Spectrum Disorder Research
2.40
article

Validation of a Mobile App for Remote Autism Screening in Toddlers

Saritha Vermeer, Guillermo Sapiro, J. Matías Di Martino, Rachel Aiello, Brian Eichner, Géraldine Dawson, Pradeep Raj Krishnappa Babu, Sam Perochon, Marina Spanos, Jill Howard, Steven Espinosa, Jennifer Green
article en
7 citations

Abstract

Early detection of autism is important for timely access to diagnostic evaluation and early intervention services, which improve children's outcomes. Despite the ability of clinicians to reliably diagnose autism in toddlers, diagnosis is often delayed. SenseToKnow is a mobile autism screening application (app) delivered on a smartphone or tablet that provides an objective and quantitative assessment of early behavioral signs of autism based on computer vision (CV) and machine learning (ML). This study examined the accuracy of SenseToKnow for autism detection when the app was downloaded and administered remotely at home by caregivers using their own devices. The SenseToKnow app was administered by caregivers of 620 toddlers between 16 and 40 months of age, 188 of whom were subsequently diagnosed with autism by expert clinicians. The app displayed strategically designed movies and a bubble-popping game on an iPhone or iPad while recording the child's behavioral responses through the device's front-facing camera and touch/inertial sensors. Recordings of the child's behavior were then automatically analyzed using CV. Multiple behavioral phenotypes were quantified and combined using ML in an algorithm for autism prediction. SenseToKnow demonstrated a high level of diagnostic accuracy with area under the receiver operating characteristic curve of 0.92, sensitivity of 83.0%, specificity of 93.3%, positive predictive value of 84.3%, and negative predictive value of 92.6%. Accuracy of the app for detecting autism was similar when administered on either a caregiver's iPhone or iPad. These results demonstrate that a mobile autism screening app based on CV can be delivered remotely by caregivers at home on their own devices and can provide a high level of accuracy for autism detection. Remote screening for autism potentially lowers barriers to autism screening, which could reduce disparities in early access to services and support and improve children's outcomes.

NEJM AIVol. 1(10)
École Normale Supérieure Paris-Saclay (FR), Duke University (US), Princeton University (US), Office of the National Coordinator for Health Information Technology (US), Laboratoire de Biologie et Pharmacologie Appliquée (FR), Universidad Católica del Uruguay (UY), Center for Autism and Related Disorders (US)
National Institutes of Health, National Institute of Mental Health
Openalex Percentile: Top 11%
Autism Spectrum Disorder Research
2.40
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.