0352 A Novel Open-Source GUI Application for Efficient Actigraphy Sleep and Nap Scoring

Abstract Introduction Manual actigraphy sleep scoring is time-intensive and requires managing multiple data sources simultaneously. Automated approaches are quicker but often lack validated, accurate nap detection and interpretability. Graphical user interface (GUI) applications such as ActiSleep Tracker and ActiLife address some issues but have performance and customizability limitations. We developed a novel open-source GUI application to streamline sleep scoring, implementing a user-friendly interface for a previously established manual scoring method. We preliminarily validated the application to establish sleep/wake metric and inter-rater reliability equivalence with the original method. Methods The application was developed to integrate data from wrist-worn Ametris wGT3X-BT devices, ActiLife epoch and non-wear sensor exports, the Sadeh sleep-wake algorithm, Choi non-wear algorithm, onset/offset scoring rules, and sleep diaries, all originally used for the manual method. Ten-day actigraphy data from thirty 3–5-year-old children in free-living conditions with minimal non-wear time were scored by three raters using both the manual (M) method and application (App). Scoring time was recorded using a separate application, and IDs were randomized. Inter-rater reliability for scorers’ onset/offset ranges and inter-method agreement for sleep-wake metric/algorithm implementations were evaluated with intraclass correlations assuming representative random sampling for raters and data (ICC(2,1)). Results The application improved scoring speed by 3.3×, reducing mean scoring time by 14.9 minutes/participant (n=88; M: 21.5±8.9 min; App: 6.6±1.8 min, p< 0.001, d=1.72). For matched sleep periods including naps (n=391), both methods showed excellent interrater reliability ICCs (App_onset=0.99, App_offset=0.99; M_onset=0.99, M_offset=0.98). Excluding naps (n=295), manual was significantly less reliable for offset (App_onset=0.95, App_offset= 0.99; M_onset=0.96, M_offset=0.82. Inter-method agreement for sleep metrics from pooled, matched sleep periods from all raters (n=1240) yielded ICCs of 0.99 (Total Sleep Time), 0.90 (Wake After Sleep Onset), 0.89 (Sleep Efficiency), 0.98 (Time in Bed). However, all variance was explained by scorers’ different onset/offsets between methods (Lin’s CCC=1.00), confirming algorithmic and metric equivalence. Conclusion The application demonstrates significantly faster scoring speed, maintains inter-rater reliability for naps and improves/maintains it for main sleep periods, while preserving algorithmic and metric equivalence. Its open-source nature and modular architecture support integration of numerous features. Future work will compare against consensus validation and incorporate additional algorithms. Support (if any) 1P01HD109876

Authors

Institutions

Publication Details

Journal
SLEEP
Published
2026-05-01
DOI
https://doi.org/10.1093/sleep/zsag091.0352
Primary Topic
Sleep and related disorders
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

0352 A Novel Open-Source GUI Application for Efficient Actigraphy Sleep and Nap Scoring

Rohitaa Ravikumar, Salma Musaad, Uzair Alam, Maurice Puyau et al.
SLEEP
Sleep and related disorders
article

0352 A Novel Open-Source GUI Application for Efficient Actigraphy Sleep and Nap Scoring

Rohitaa Ravikumar, Salma Musaad, Uzair Alam, Maurice Puyau, Akane Sano, Jennette Moreno, Sai Vemu, Teresia O'Connor
article en

Abstract

Abstract Introduction Manual actigraphy sleep scoring is time-intensive and requires managing multiple data sources simultaneously. Automated approaches are quicker but often lack validated, accurate nap detection and interpretability. Graphical user interface (GUI) applications such as ActiSleep Tracker and ActiLife address some issues but have performance and customizability limitations. We developed a novel open-source GUI application to streamline sleep scoring, implementing a user-friendly interface for a previously established manual scoring method. We preliminarily validated the application to establish sleep/wake metric and inter-rater reliability equivalence with the original method. Methods The application was developed to integrate data from wrist-worn Ametris wGT3X-BT devices, ActiLife epoch and non-wear sensor exports, the Sadeh sleep-wake algorithm, Choi non-wear algorithm, onset/offset scoring rules, and sleep diaries, all originally used for the manual method. Ten-day actigraphy data from thirty 3–5-year-old children in free-living conditions with minimal non-wear time were scored by three raters using both the manual (M) method and application (App). Scoring time was recorded using a separate application, and IDs were randomized. Inter-rater reliability for scorers’ onset/offset ranges and inter-method agreement for sleep-wake metric/algorithm implementations were evaluated with intraclass correlations assuming representative random sampling for raters and data (ICC(2,1)). Results The application improved scoring speed by 3.3×, reducing mean scoring time by 14.9 minutes/participant (n=88; M: 21.5±8.9 min; App: 6.6±1.8 min, p< 0.001, d=1.72). For matched sleep periods including naps (n=391), both methods showed excellent interrater reliability ICCs (App_onset=0.99, App_offset=0.99; M_onset=0.99, M_offset=0.98). Excluding naps (n=295), manual was significantly less reliable for offset (App_onset=0.95, App_offset= 0.99; M_onset=0.96, M_offset=0.82. Inter-method agreement for sleep metrics from pooled, matched sleep periods from all raters (n=1240) yielded ICCs of 0.99 (Total Sleep Time), 0.90 (Wake After Sleep Onset), 0.89 (Sleep Efficiency), 0.98 (Time in Bed). However, all variance was explained by scorers’ different onset/offsets between methods (Lin’s CCC=1.00), confirming algorithmic and metric equivalence. Conclusion The application demonstrates significantly faster scoring speed, maintains inter-rater reliability for naps and improves/maintains it for main sleep periods, while preserving algorithmic and metric equivalence. Its open-source nature and modular architecture support integration of numerous features. Future work will compare against consensus validation and incorporate additional algorithms. Support (if any) 1P01HD109876

SLEEPVol. 49(Supplement_1)
Baylor College of Medicine (US), Rice University (US)
Openalex Percentile: Top 5%
Sleep and related disorders
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.