Demo Abstract: An LLM-Powered Multimodal Mobile Sensing System for Personalized and Interactive Health Behavior Analysis

Characterizing human behaviors using mobile devices is crucial for the longitudinal monitoring of chronic diseases, such as mental health conditions and Alzheimer's Disease. Current solutions often either focus on detecting basic human activities (e.g., sitting, walking) or lack comprehensive analysis and interactive guidance based on sensor data. We present MobiBox, a lightweight mobile app for long-term behavior data collection and interactive health analysis. MobiBox captures multimodal data including high-resolution 9-axis IMU data and contextual information such as APP usage and network activities, and integrates Large Language Models (LLMs) to generate personalized guidances like interventions and daily summaries. Moreover, MobiBox features a closed-loop design that allows users rate these guidances, building a high-quality dataset to enhance performance of LLMs on mobile health applications. The demo video is available at https://youtube.com/shorts/XgOXFoRaFIw?feature=share.

Authors

Institutions

Publication Details

Published
2025-05-04
DOI
https://doi.org/10.1145/3715014.3724376
Primary Topic
Context-Aware Activity Recognition Systems
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Demo Abstract: An LLM-Powered Multimodal Mobile Sensing System for Personalized and Interactive Health Behavior Analysis

Wenjie Du, Yizhen Wang, Liyu Zhang, Xiaomin Ouyang et al.
Context-Aware Activity Recognition Systems
article

Demo Abstract: An LLM-Powered Multimodal Mobile Sensing System for Personalized and Interactive Health Behavior Analysis

Wenjie Du, Yizhen Wang, Liyu Zhang, Xiaomin Ouyang, Kun Liu
article en

Abstract

Characterizing human behaviors using mobile devices is crucial for the longitudinal monitoring of chronic diseases, such as mental health conditions and Alzheimer's Disease. Current solutions often either focus on detecting basic human activities (e.g., sitting, walking) or lack comprehensive analysis and interactive guidance based on sensor data. We present MobiBox, a lightweight mobile app for long-term behavior data collection and interactive health analysis. MobiBox captures multimodal data including high-resolution 9-axis IMU data and contextual information such as APP usage and network activities, and integrates Large Language Models (LLMs) to generate personalized guidances like interventions and daily summaries. Moreover, MobiBox features a closed-loop design that allows users rate these guidances, building a high-quality dataset to enhance performance of LLMs on mobile health applications. The demo video is available at https://youtube.com/shorts/XgOXFoRaFIw?feature=share.

Hong Kong University of Science and Technology (HK), Zhejiang University (CN), University of Hong Kong (HK)
Openalex Percentile: Top 92%
Context-Aware Activity Recognition Systems
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Demo Abstract: An LLM-Powered Multimodal Mobile Sensing System for Personalized and Interactive Health Behavior Analysis — Wenjie Du, Yizhen Wang, et al. · (2025) | TGRS Research Map | TGRS