Reproducibility and class-level audit of wellbeing classification in the DigitalExposome dataset
BackgroundRepeated observations and missing participant and time metadata can complicate interpretation of wellbeing classification results from public sensor datasets.ObjectiveTo assess reproducibility and split sensitivity of wellbeing classification on the released DigitalExposome CSV.MethodsWe reconstructed an initially submitted 30-sample, 15-sample-stride windowed Random Forest (RF) analysis and compared matched 70/30 file-order and unstratified random row splits. Ten random seeds quantified partition variability. We recalculated class-level metrics and ran a deduplicated, 30-row positional-embargo sensitivity analysis. The CSV contains no participant identifiers or timestamps.ResultsThe file-order RF holdout gave Macro F1 = 0.8515; random splits yielded mean Macro F1 = 0.9772 (SD = 0.0014). Reconstructed windows yielded accuracy = 0.7887, Macro F1 = 0.7632, and weighted F1 = 0.7549. Recalculated recall was 0.205 for wellbeing level 2. The deduplicated sensitivity analysis produced Macro F1 values of 0.128-0.162 across examined split fractions and leaf settings.ConclusionScores were sensitive to split procedure and repeated feature vectors. Because row chronology and participant membership cannot be recovered, these results do not estimate future-time or participant-independent performance and do not establish clinical utility.
Authors
- Özel Sebetçi (ORCID: https://orcid.org/0000-0002-2996-0270)
Institutions
- Adnan Menderes University (TR)
Publication Details
- Journal
- Technology and Health Care
- Published
- 2026-11-17
- DOI
- https://doi.org/10.1177/09287329261509125
- Primary Topic
- Emotion and Mood Recognition
- Type
- article
- Field-Weighted Citation Impact
- 0.00