Demo Abstract: An LLM-Powered Multimodal Mobile Sensing System for Personalized and Interactive Health Behavior Analysis
Characterizing human behaviors using mobile devices is crucial for the longitudinal monitoring of chronic diseases, such as mental health conditions and Alzheimer's Disease. Current solutions often either focus on detecting basic human activities (e.g., sitting, walking) or lack comprehensive analysis and interactive guidance based on sensor data. We present MobiBox, a lightweight mobile app for long-term behavior data collection and interactive health analysis. MobiBox captures multimodal data including high-resolution 9-axis IMU data and contextual information such as APP usage and network activities, and integrates Large Language Models (LLMs) to generate personalized guidances like interventions and daily summaries. Moreover, MobiBox features a closed-loop design that allows users rate these guidances, building a high-quality dataset to enhance performance of LLMs on mobile health applications. The demo video is available at https://youtube.com/shorts/XgOXFoRaFIw?feature=share.
Authors
- Wenjie Du (ORCID: https://orcid.org/0009-0004-4359-9217)
- Yizhen Wang
- Liyu Zhang
- Xiaomin Ouyang
- Kun Liu (ORCID: https://orcid.org/0009-0005-9720-6818)
Institutions
- Hong Kong University of Science and Technology (HK)
- Zhejiang University (CN)
- University of Hong Kong (HK)
Publication Details
- Published
- 2025-05-04
- DOI
- https://doi.org/10.1145/3715014.3724376
- Primary Topic
- Context-Aware Activity Recognition Systems
- Type
- article
- Field-Weighted Citation Impact
- 0.00