Prospective Validation and Usability Evaluation of a Mobile Diagnostic App for Obstructive Sleep Apnea

<b>Background/Objectives</b>: Obstructive sleep apnea (OSA) classification relies on polysomnography (PSG) results. Current guidelines recommend the development of clinical prediction algorithms in screening prior to PSG. A recent intuitive and user-friendly tool (OSABayes), based on a Bayesian network model using six clinical variables, has been proposed to quantify the probability of OSA. Our aims are (1) to validate OSABayes prospectively, (2) to build a smartphone app based on the proposed model, and (3) to evaluate app usability. <b>Methods</b>: We prospectively included adult patients suspected of OSA, without suspicion of other sleep disorders, who underwent level I or III diagnostic PSG. Apnea-hypopnea index (AHI) and OSABayes probabilities were obtained and compared using the area under the ROC curve (AUC [95%CI]) for OSA diagnosis (AHI ≥ 5/h) and higher severity levels (AHI ≥ 15/h) prediction. We built the OSABayes app on 'App Inventor 2', and the usability was assessed with a cognitive walkthrough method and a general evaluation. <b>Results</b>: 216 subjects were included in the validation cohort, performing PSG levels I (34%) and III (66%). OSABayes presented an AUC of 83.6% [77.3-90.0%] for OSA diagnosis and 76.3% [69.9-82.7%] for moderate/severe OSA prediction, showing good response for both types of PSG. The OSABayes smartphone application allows one to calculate the probability of having OSA and consult information about OSA and the tool. In the usability evaluation, 96% of the proposed tasks were carried out. <b>Conclusions</b>: These results show the good discrimination power of OSABayes and validate its applicability in identifying patients with a high pre-test probability of OSA. The tool is available as an online form and as a smartphone app, allowing a quick and accessible calculation of OSA probability.

Authors

Institutions

Publication Details

Journal
Diagnostics
Published
2024-11-11
DOI
https://doi.org/10.3390/diagnostics14222519
Citations
2
Primary Topic
Obstructive Sleep Apnea Research
Type
article
Field-Weighted Citation Impact
0.65
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Prospective Validation and Usability Evaluation of a Mobile Diagnostic App for Obstructive Sleep Apnea

Pedro Pereira Rodrigues, Daniela Ferreira‐Santos, Marta Drummond, Pedro Amorim
2 citations
Diagnostics
Obstructive Sleep Apnea Research
0.65
article

Prospective Validation and Usability Evaluation of a Mobile Diagnostic App for Obstructive Sleep Apnea

Pedro Pereira Rodrigues, Daniela Ferreira‐Santos, Marta Drummond, Pedro Amorim
article en
2 citations

Abstract

<b>Background/Objectives</b>: Obstructive sleep apnea (OSA) classification relies on polysomnography (PSG) results. Current guidelines recommend the development of clinical prediction algorithms in screening prior to PSG. A recent intuitive and user-friendly tool (OSABayes), based on a Bayesian network model using six clinical variables, has been proposed to quantify the probability of OSA. Our aims are (1) to validate OSABayes prospectively, (2) to build a smartphone app based on the proposed model, and (3) to evaluate app usability. <b>Methods</b>: We prospectively included adult patients suspected of OSA, without suspicion of other sleep disorders, who underwent level I or III diagnostic PSG. Apnea-hypopnea index (AHI) and OSABayes probabilities were obtained and compared using the area under the ROC curve (AUC [95%CI]) for OSA diagnosis (AHI ≥ 5/h) and higher severity levels (AHI ≥ 15/h) prediction. We built the OSABayes app on 'App Inventor 2', and the usability was assessed with a cognitive walkthrough method and a general evaluation. <b>Results</b>: 216 subjects were included in the validation cohort, performing PSG levels I (34%) and III (66%). OSABayes presented an AUC of 83.6% [77.3-90.0%] for OSA diagnosis and 76.3% [69.9-82.7%] for moderate/severe OSA prediction, showing good response for both types of PSG. The OSABayes smartphone application allows one to calculate the probability of having OSA and consult information about OSA and the tool. In the usability evaluation, 96% of the proposed tasks were carried out. <b>Conclusions</b>: These results show the good discrimination power of OSABayes and validate its applicability in identifying patients with a high pre-test probability of OSA. The tool is available as an online form and as a smartphone app, allowing a quick and accessible calculation of OSA probability.

DiagnosticsVol. 14(22)
Universidade do Porto (PT), Hospital de São João (PT), Centre for Health Technology and Services Research (PT), INESC TEC (PT)
Openalex Percentile: Top 28%
Obstructive Sleep Apnea Research
0.65
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.