A Personalized Exercise Assistant Using Reinforcement Learning: Results From a Large-Scale Mobile Health Randomized-Controlled Trial

Abstract Background Consistent physical inactivity among adults and adolescents poses a major global health challenge. Mobile health (mHealth) interventions, particularly just-in-time adaptive interventions (JITAIs), offer a promising avenue for scalable and personalized physical activity promotion. However, developing and evaluating such adaptive interventions at scale, while integrating robust behavioral science, presents methodological hurdles. Objective The Personalized Exercise Assistant Using Reinforcement Learning (PEARL) study aimed to assess the feasibility and effectiveness of a reinforcement learning (RL) algorithm, informed by health behavior change theory (capability, opportunity, and motivation–behavior [COM-B]), to personalize the content and timing of physical activity nudges via the Fitbit app (Google LLC) compared to fixed and random nudging strategies, and to a control group with no nudges. Methods We conducted a large-scale, 4-arm randomized controlled trial (RCT) enrolling 13,463 Fitbit users. Participants were randomized to: (1) control (no nudges), (2) random (random content/timing), (3) fixed (logic based on baseline COM-B survey), and (4) RL (adaptive algorithm). The primary outcome was the change in average daily step count from baseline to 2 months. Secondary outcomes included user engagement and survey responses regarding capability, opportunity, and motivation. Results A total of 7711 participants were included in the primary analysis (mean age 42.1, SD 9.0 years; 6657/7711, 86.3% female). At 1 month, the RL group showed a significant increase in daily steps compared to control (+296 steps; P <.001), random (+218 steps; P =.005), and fixed (+238 steps; P =.002) groups. For the prespecified primary analyses at 2 months, the RL group sustained a significant increase against the control (+210 steps; P =.01), but pairwise differences comparing the RL group against the random and fixed groups were not statistically significant. Generalized estimating equation (GEE) models confirmed a sustained significant increase in the RL group (+208 steps; P =.002). In exit surveys, the RL group reported higher favorable responses regarding nudge customization (224 of 605, 37%) compared to other groups. Conclusions This study demonstrates the feasibility and early efficacy of using RL to personalize digital health nudges at scale. To our knowledge, this represents one of the largest, nonincentivized randomized trials of this duration to evaluate RL for physical activity. While the magnitude of the observed step increase is modest, a sustained daily improvement of 200‐300 steps can contribute to broader public health goals by reducing sedentary behavior in large populations. The adaptive approach outperformed static behavioral rules, showcasing the promise of dynamic personalization in a real-world mHealth setting. Notably, participants receiving nudges based on fixed, theory-informed rules did not show a significant advantage over the random group, underscoring the challenge of using static baseline assessments to address nonstationary, day-to-day behavioral contexts. However, several limitations warrant consideration: the findings are specific to a 2-month follow-up, the study population was predominantly female (6657/7711, 86.3%) self-selected Fitbit users, and the observed step gains were modest in magnitude.

Authors

Institutions

Publication Details

Journal
Journal of Medical Internet Research
Published
2026-11-17
DOI
https://doi.org/10.2196/91156
Citations
1
Primary Topic
Mobile Health and mHealth Applications
Type
article
Field-Weighted Citation Impact
3.67
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
article

A Personalized Exercise Assistant Using Reinforcement Learning: Results From a Large-Scale Mobile Health Randomized-Controlled Trial

Amy Armento Lee, Sofía S. Villar, Sriram Lakshminarasimhan, Hulya Emir-Farinas et al.
1 citations
Journal of Medical Internet Research
Mobile Health and mHealth Applications
3.67
article

A Personalized Exercise Assistant Using Reinforcement Learning: Results From a Large-Scale Mobile Health Randomized-Controlled Trial

Amy Armento Lee, Sofía S. Villar, Sriram Lakshminarasimhan, Hulya Emir-Farinas, John Hernandez, Martin G. Seneviratne, Nina Deliu, Arun Sai Suggala, Aravindan Raghuveer, Pradnesh Kalkar, Jatin Alla, My Nguyen, Hariharan Manoharan, Qian He, Rahul Singh, Abhimanyu Singh, James Taylor, Karthikeyan Shanmugam, Emily Rosenzweig
article en
1 citations

Abstract

Abstract Background Consistent physical inactivity among adults and adolescents poses a major global health challenge. Mobile health (mHealth) interventions, particularly just-in-time adaptive interventions (JITAIs), offer a promising avenue for scalable and personalized physical activity promotion. However, developing and evaluating such adaptive interventions at scale, while integrating robust behavioral science, presents methodological hurdles. Objective The Personalized Exercise Assistant Using Reinforcement Learning (PEARL) study aimed to assess the feasibility and effectiveness of a reinforcement learning (RL) algorithm, informed by health behavior change theory (capability, opportunity, and motivation–behavior [COM-B]), to personalize the content and timing of physical activity nudges via the Fitbit app (Google LLC) compared to fixed and random nudging strategies, and to a control group with no nudges. Methods We conducted a large-scale, 4-arm randomized controlled trial (RCT) enrolling 13,463 Fitbit users. Participants were randomized to: (1) control (no nudges), (2) random (random content/timing), (3) fixed (logic based on baseline COM-B survey), and (4) RL (adaptive algorithm). The primary outcome was the change in average daily step count from baseline to 2 months. Secondary outcomes included user engagement and survey responses regarding capability, opportunity, and motivation. Results A total of 7711 participants were included in the primary analysis (mean age 42.1, SD 9.0 years; 6657/7711, 86.3% female). At 1 month, the RL group showed a significant increase in daily steps compared to control (+296 steps; P <.001), random (+218 steps; P =.005), and fixed (+238 steps; P =.002) groups. For the prespecified primary analyses at 2 months, the RL group sustained a significant increase against the control (+210 steps; P =.01), but pairwise differences comparing the RL group against the random and fixed groups were not statistically significant. Generalized estimating equation (GEE) models confirmed a sustained significant increase in the RL group (+208 steps; P =.002). In exit surveys, the RL group reported higher favorable responses regarding nudge customization (224 of 605, 37%) compared to other groups. Conclusions This study demonstrates the feasibility and early efficacy of using RL to personalize digital health nudges at scale. To our knowledge, this represents one of the largest, nonincentivized randomized trials of this duration to evaluate RL for physical activity. While the magnitude of the observed step increase is modest, a sustained daily improvement of 200‐300 steps can contribute to broader public health goals by reducing sedentary behavior in large populations. The adaptive approach outperformed static behavioral rules, showcasing the promise of dynamic personalization in a real-world mHealth setting. Notably, participants receiving nudges based on fixed, theory-informed rules did not show a significant advantage over the random group, underscoring the challenge of using static baseline assessments to address nonstationary, day-to-day behavioral contexts. However, several limitations warrant consideration: the findings are specific to a 2-month follow-up, the study population was predominantly female (6657/7711, 86.3%) self-selected Fitbit users, and the observed step gains were modest in magnitude.

Journal of Medical Internet ResearchVol. 28
Google (United States) (US), MRC Biostatistics Unit (GB), Sapienza University of Rome (IT)
Good health and well-being
Openalex Percentile: Top 15%
Mobile Health and mHealth Applications
3.67
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon