Towards Wearable Opportunistic Crowdsensing for Open-Vocabulary Activity Data Collection Through User-Scheduled Trigger-Action Routines
Collecting richly labeled wearable activity data in everyday settings remains difficult because retrospective annotation is costly and often imprecise. Prior data collection apps rely on a labor-intensive self-reporting strategy and primarily treat participants as crowd labelers. We present Pebbl, a feasibility-stage system that incentivizes in-situ labeling through opportunistic crowdsensing. Pebbl lets users author trigger-action recipes on a smartphone and receive just-in-time reminders for beneficial actions when a trigger is detected. In the prototype, triggers are a limited set with four common audio cues, while actions are described in open-vocabulary natural language. Each confirmed execution yields a short sensor window with explicit start/end boundaries and a user-authored action label. We evaluate Pebbl through an expert workshop with wearable Human Activity Recognition (HAR) researchers ( N = 6), a within-subject in-lab study ( N = 21), and a pilot deployment ( N = 8). Experts viewed the approach as lower burden and more ecologically valid than common labeling workflows. In the lab, Pebbl produced reliable execution logs under controlled conditions (recall = 97.30%, precision = 97.15%) and was preferred over comparison workflows on perceived burden and confidence. The pilot deployment shows that the interaction and sensing pipeline can function in free-living use, while surfacing practical constraints such as false triggers and context dependence. Overall, Pebbl represents a step toward a low-burden, distributable collection approach of user-contributed wearable activity data.
Authors
- Mingze Gao (ORCID: https://orcid.org/0000-0003-2064-3452)
- Yingke Ding (ORCID: https://orcid.org/0009-0006-3618-9492)
- Yuanchun Shi
- Yuntao Wang
- Alex Mariakakis
- Zhuolun Ren
- Zeyu Wang
Institutions
- Qinghai University (CN)
- University of Toronto (CA)
- Qinghai University for Nationalities (CN)
- Beijing National Research Center for Information Science and Technology (CN)
- Renmin University of China (CN)
- Tsinghua University (CN)
Publication Details
- Journal
- Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies
- Published
- 2026-09-30
- DOI
- https://doi.org/10.1145/3831976
- Primary Topic
- Mobile Crowdsensing and Crowdsourcing
- Type
- article
- Field-Weighted Citation Impact
- 0.00