Reproducibility and class-level audit of wellbeing classification in the DigitalExposome dataset

BackgroundRepeated observations and missing participant and time metadata can complicate interpretation of wellbeing classification results from public sensor datasets.ObjectiveTo assess reproducibility and split sensitivity of wellbeing classification on the released DigitalExposome CSV.MethodsWe reconstructed an initially submitted 30-sample, 15-sample-stride windowed Random Forest (RF) analysis and compared matched 70/30 file-order and unstratified random row splits. Ten random seeds quantified partition variability. We recalculated class-level metrics and ran a deduplicated, 30-row positional-embargo sensitivity analysis. The CSV contains no participant identifiers or timestamps.ResultsThe file-order RF holdout gave Macro F1 = 0.8515; random splits yielded mean Macro F1 = 0.9772 (SD = 0.0014). Reconstructed windows yielded accuracy = 0.7887, Macro F1 = 0.7632, and weighted F1 = 0.7549. Recalculated recall was 0.205 for wellbeing level 2. The deduplicated sensitivity analysis produced Macro F1 values of 0.128-0.162 across examined split fractions and leaf settings.ConclusionScores were sensitive to split procedure and repeated feature vectors. Because row chronology and participant membership cannot be recovered, these results do not estimate future-time or participant-independent performance and do not establish clinical utility.

Authors

Institutions

Publication Details

Journal
Technology and Health Care
Published
2026-11-17
DOI
https://doi.org/10.1177/09287329261509125
Primary Topic
Emotion and Mood Recognition
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

Reproducibility and class-level audit of wellbeing classification in the DigitalExposome dataset

Özel Sebetçi
5 links
Technology and Health Care
Emotion and Mood Recognition
article

Reproducibility and class-level audit of wellbeing classification in the DigitalExposome dataset

Özel Sebetçi
article en

Abstract

BackgroundRepeated observations and missing participant and time metadata can complicate interpretation of wellbeing classification results from public sensor datasets.ObjectiveTo assess reproducibility and split sensitivity of wellbeing classification on the released DigitalExposome CSV.MethodsWe reconstructed an initially submitted 30-sample, 15-sample-stride windowed Random Forest (RF) analysis and compared matched 70/30 file-order and unstratified random row splits. Ten random seeds quantified partition variability. We recalculated class-level metrics and ran a deduplicated, 30-row positional-embargo sensitivity analysis. The CSV contains no participant identifiers or timestamps.ResultsThe file-order RF holdout gave Macro F1 = 0.8515; random splits yielded mean Macro F1 = 0.9772 (SD = 0.0014). Reconstructed windows yielded accuracy = 0.7887, Macro F1 = 0.7632, and weighted F1 = 0.7549. Recalculated recall was 0.205 for wellbeing level 2. The deduplicated sensitivity analysis produced Macro F1 values of 0.128-0.162 across examined split fractions and leaf settings.ConclusionScores were sensitive to split procedure and repeated feature vectors. Because row chronology and participant membership cannot be recovered, these results do not estimate future-time or participant-independent performance and do not establish clinical utility.

Technology and Health Care
Adnan Menderes University (TR)
Good health and well-being
Emotion and Mood Recognition
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon