Advancing Behavioral Intervention and Theory Development for Mobile Health: The HeartSteps II Protocol

Modeling engagement with a digital behavior change intervention (HeartSteps II): An exploratory system identification approach

OBJECTIVE

Digital behavior change interventions (DBCIs) are feasibly effective tools for addressing physical activity. However, in-depth understanding of participants' long-term engagement with DBCIs remains sparse. Since the effectiveness of DBCIs to impact behavior change depends, in part, upon participant engagement, there is a need to better understand engagement as a dynamic process in response to an individual's ever-changing biological, psychological, social, and environmental context.

METHODS

The year-long micro-randomized trial (MRT) HeartSteps II provides an unprecedented opportunity to investigate DBCI engagement among ethnically diverse participants. We combined data streams from wearable sensors (Fitbit Versa, i.e., walking behavior), the HeartSteps II app (i.e. page views), and ecological momentary assessments (EMAs, i.e. perceived intrinsic and extrinsic motivation) to build the idiographic models. A system identification approach and a fluid analogy model were used to conduct autoregressive with exogenous input (ARX) analyses that tested hypothesized relationships between these variables inspired by Self-Determination Theory (SDT) with DBCI engagement through time.

RESULTS

Data from 11 HeartSteps II participants was used to test aspects of the hypothesized SDT dynamic model. The average age was 46.33 (SD=7.4) years, and the average steps per day at baseline was 5,507 steps (SD=6,239). The hypothesized 5-input SDT-inspired ARX model for app engagement resulted in a 31.75 % weighted RMSEA (31.50 % on validation and 31.91 % on estimation), indicating that the model predicted app page views almost 32 % better relative to the mean of the data. Among Hispanic/Latino participants, the average overall model fit across inventories of the SDT fluid analogy was 34.22 % (SD=10.53) compared to 22.39 % (SD=6.36) among non-Hispanic/Latino Whites, a difference of 11.83 %. Across individuals, the number of daily notification prompts received by the participant was positively associated with increased app page views. The weekend/weekday indicator and perceived daily busyness were also found to be key predictors of the number of daily application page views.

CONCLUSIONS

This novel approach has significant implications for both personalized and adaptive DBCIs by identifying factors that foster or undermine engagement in an individual's respective context. Once identified, these factors can be tailored to promote engagement and support sustained behavior change over time.

Systematic literature review on reinforcement learning in non-communicable disease interventions

There is evidence that reducing modifiable risk factors and strengthening medical and health interventions can reduce early mortality and economic losses from non-communicable diseases (NCDs). Machine learning (ML) algorithms have been successfully applied to preventing and controlling NCDs. Reinforcement learning (RL) is the most promising of these approaches because of its ability to dynamically adapt interventions to NCD disease progression and its commitment to achieving long-term intervention goals. This paper reviews the preferred algorithms, data sources, design details, and obstacles to clinical application in existing studies to facilitate the early application of RL algorithms in clinical practice research for NCD interventions. We screened 40 relevant papers for quantitative and qualitative analysis using the PRISMA review flow diagram. The results show that researchers tend to use Deep Q-Network (DQN) and Actor-Critic as well as their improved or hybrid algorithms to train and validate RL models on retrospective datasets. Often, the patient's physical condition is the main defining parameter of the state space, while interventions are the main defining parameter of the action space. Mostly, changes in the patient's physical condition are used as a basis for immediate rewards to the agent. Various attempts have been made to address the challenges to clinical application, and several approaches have been proposed from existing research. However, as there is currently no universally accepted solution, the use of RL algorithms in clinical practice for NCD interventions necessitates more comprehensive responses to the issues addressed in this paper, which are safety, interpretability, training efficiency, and the technical aspect of exploitation and exploration in RL algorithms.

Temporally Multi-Scale Sparse Self-Attention for Physical Activity Data Imputation

Wearable sensors enable health researchers to continuously collect data pertaining to the physiological state of individuals in real-world settings. However, such data can be subject to extensive missingness due to a complex combination of factors. In this work, we study the problem of imputation of missing step count data, one of the most ubiquitous forms of wearable sensor data. We construct a novel and large scale data set consisting of a training set with over 3 million hourly step count observations and a test set with over 2.5 million hourly step count observations. We propose a domain knowledge-informed sparse self-attention model for this task that captures the temporal multi-scale nature of step-count data. We assess the performance of the model relative to baselines and conduct ablation studies to verify our specific model designs.

A Physical Activity and Diet Just-in-Time Adaptive Intervention to Reduce Blood Pressure: The myBPmyLife Study Rationale and Design

BACKGROUND

Smartphone applications and wearable devices are promising mobile health interventions for hypertension self-management. However, most mobile health interventions fail to use contextual data, potentially diminishing their impact. The myBPmyLife Study is a just-in-time adaptive intervention designed to promote personalized self-management for patients with hypertension.

METHODS AND RESULTS

The study is a 6-month prospective, randomized-controlled, remotely administered trial. Participants were recruited from the University of Michigan Health in Ann Arbor, Michigan or the Hamilton Community Health Network, a federally qualified health center network in Flint, Michigan. Participants were randomized to a mobile application with a just-in-time adaptive intervention promoting physical activity and lower-sodium food choices as well as weekly goal setting or usual care. The mobile study application encourages goal attainment through a central visualization displaying participants' progress toward their goals for physical activity and lower-sodium food choices. Participants in both groups are followed for up for 6 months with a primary end point of change in systolic blood pressure. Exploratory analyses will examine the impact of notifications on step count and self-reported lower-sodium food choices. The study launched on December 9, 2021, with 484 participants enrolled as of March 31, 2023. Enrollment of participants was completed on July 3, 2023. After 6 months of follow-up, it is expected that results will be available in the spring of 2024.

CONCLUSIONS

The myBPmyLife study is an innovative mobile health trial designed to evaluate the effects of a just-in-time adaptive intervention focused on improving physical activity and dietary sodium intake on blood pressure in diverse patients with hypertension.

REGISTRATION

URL: https://www.clinicaltrials.gov; Unique identifier: NCT05154929.

Optimization of a Transdiagnostic Mobile Emotion Regulation Intervention for University Students: Protocol for a Microrandomized Trial

BACKGROUND

Many university students experience mental health problems such as anxiety and depression. To support their mental health, a transdiagnostic mobile app intervention has been developed. The intervention provides short exercises rooted in various approaches (eg, positive psychology, mindfulness, self-compassion, and acceptance and commitment therapy) that aim to facilitate adaptive emotion regulation (ER) to help students cope with the various stressors they encounter during their time at university.

OBJECTIVE

The goals of this study are to investigate whether the intervention and its components function as intended and how participants engage with them. In addition, this study aims to monitor changes in distress symptoms and ER skills and identify relevant contextual factors that may moderate the intervention's impact.

METHODS

A sequential explanatory mixed methods design combining a microrandomized trial and semistructured interviews will be used. During the microrandomized trial, students (N=200) will be prompted via the mobile app twice a day for 3 weeks to evaluate their emotional states and complete a randomly assigned intervention (ie, an exercise supporting ER) or a control intervention (ie, a health information snippet). A subsample of participants (21/200, 10.5%) will participate in interviews exploring their user experience with the app and the completed exercises. The primary outcomes will be changes in emotional states and engagement with the intervention (ie, objective and subjective engagement). Objective engagement will be evaluated through log data (eg, exercise completion time). Subjective engagement will be evaluated through exercise likability and helpfulness ratings as well as user experience interviews. The secondary outcomes will include the distal outcomes of the intervention (ie, ER skills and distress symptoms). Finally, the contextual moderators of intervention effectiveness will be explored (eg, the time of day and momentary emotional states).

RESULTS

The study commenced on February 9, 2023, and the data collection was concluded on June 13, 2023. Of the 172 eligible participants, 161 (93.6%) decided to participate. Of these 161 participants, 137 (85.1%) completed the first phase of the study. A subsample of participants (18/172, 10.5%) participated in the user experience interviews. Currently, the data processing and analyses are being conducted.

CONCLUSIONS

This study will provide insight into the functioning of the intervention and identify areas for improvement. Furthermore, the findings will shed light on potential changes in the distal outcomes of the intervention (ie, ER skills and distress symptoms), which will be considered when designing a follow-up randomized controlled trial evaluating the full-scale effectiveness of this intervention. Finally, the results and data gathered will be used to design and train a recommendation algorithm that will be integrated into the app linking students to relevant content.

TRIAL REGISTRATION

ClinicalTrials.gov NCT05576883; https://www.clinicaltrials.gov/study/NCT05576883.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

DERR1-10.2196/46603.

Advancing Understanding of Just-in-Time States for Supporting Physical Activity (Project JustWalk JITAI): Protocol for a System ID Study of Just-in-Time Adaptive Interventions

BACKGROUND

Just-in-time adaptive interventions (JITAIs) are designed to provide support when individuals are receptive and can respond beneficially to the prompt. The notion of a just-in-time (JIT) state is critical for JITAIs. To date, JIT states have been formulated either in a largely data-driven way or based on theory alone. There is a need for an approach that enables rigorous theory testing and optimization of the JIT state concept.

OBJECTIVE

The purpose of this system ID experiment was to investigate JIT states empirically and enable the empirical optimization of a JITAI intended to increase physical activity (steps/d).

METHODS

We recruited physically inactive English-speaking adults aged ≥25 years who owned smartphones. Participants wore a Fitbit Versa 3 and used the study app for 270 days. The JustWalk JITAI project uses system ID methods to study JIT states. Specifically, provision of support systematically varied across different theoretically plausible operationalizations of JIT states to enable a more rigorous and systematic study of the concept. We experimentally varied 2 intervention components: notifications delivered up to 4 times per day designed to increase a person's steps within the next 3 hours and suggested daily step goals. Notifications to walk were experimentally provided across varied operationalizations of JIT states accounting for need (ie, whether daily step goals were previously met or not), opportunity (ie, whether the next 3 h were a time window during which a person had previously walked), and receptivity (ie, a person previously walked after receiving notifications). Suggested daily step goals varied systematically within a range related to a person's baseline level of steps per day (eg, 4000) until they met clinically meaningful targets (eg, averaging 8000 steps/d as the lower threshold across a cycle). A series of system ID estimation approaches will be used to analyze the data and obtain control-oriented dynamical models to study JIT states. The estimated models from all approaches will be contrasted, with the ultimate goal of guiding rigorous, replicable, empirical formulation and study of JIT states to inform a future JITAI.

RESULTS

As is common in system ID, we conducted a series of simulation studies to formulate the experiment. The results of our simulation studies illustrated the plausibility of this approach for generating informative and unique data for studying JIT states. The study began enrolling participants in June 2022, with a final enrollment of 48 participants. Data collection concluded in April 2023. Upon completion of the analyses, the results of this study are expected to be submitted for publication in the fourth quarter of 2023.

CONCLUSIONS

This study will be the first empirical investigation of JIT states that uses system ID methods to inform the optimization of a scalable JITAI for physical activity.

TRIAL REGISTRATION

ClinicalTrials.gov NCT05273437; https://clinicaltrials.gov/ct2/show/NCT05273437.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

DERR1-10.2196/52161.

Assessing the Impact of Context Inference Error and Partial Observability on RL Methods for Just-In-Time Adaptive Interventions

Just-in-Time Adaptive Interventions (JITAIs) are a class of personalized health interventions developed within the behavioral science community. JITAIs aim to provide the right type and amount of support by iteratively selecting a sequence of intervention options from a pre-defined set of components in response to each individual's time varying state. In this work, we explore the application of reinforcement learning methods to the problem of learning intervention option selection policies. We study the effect of context inference error and partial observability on the ability to learn effective policies. Our results show that the propagation of uncertainty from context inferences is critical to improving intervention efficacy as context uncertainty increases, while policy gradient algorithms can provide remarkable robustness to partially observed behavioral state information.

Microrandomized Trials: Developing Just-in-Time Adaptive Interventions for Better Public Health

Just-in-time adaptive interventions (JITAIs) represent an intervention design that adapts the provision and type of support over time to an individual's changing status and contexts, intending to deliver the right support on the right occasion. As a novel strategy for delivering mobile health interventions, JITAIs have the potential to improve access to quality care in underserved communities and, thus, alleviate health disparities, a significant public health concern. Valid experimental designs and analysis methods are required to inform the development of JITAIs. Here, we briefly review the cutting-edge design of microrandomized trials (MRTs), covering both the classical MRT design and its outcome-adaptive counterpart. Associated statistical challenges related to the design and analysis of MRTs are also discussed. Two case studies are provided to illustrate the aforementioned concepts and designs throughout the article. We hope our work leads to better design and application of JITAIs, advancing public health research and practice. (Am J Public Health. 2023;113(1):60-69. https://doi.org/10.2105/AJPH.2022.307150).

Broadened assessments, health education and cognitive aids in the remote memory clinic

The prevalence of dementia is increasing and poses a health challenge for individuals and society. Despite the desire to know their risks and the importance of initiating early therapeutic options, large parts of the population do not get access to memory clinic-based assessments. Remote memory clinics facilitate low-level access to cognitive assessments by eschewing the need for face-to-face meetings. At the same time, patients with detected impairment or increased risk can receive non-pharmacological treatment remotely. Sensor technology can evaluate the efficiency of this remote treatment and identify cognitive decline. With remote and (partly) automatized technology the process of cognitive decline can be monitored but more importantly also modified by guiding early interventions and a dementia preventative lifestyle. We highlight how sensor technology aids the expansion of assessments beyond cognition and to other domains, e.g., depression. We also illustrate applications for aiding remote treatment and describe how remote tools can facilitate health education which is the cornerstone for long-lasting lifestyle changes. Tools such as transcranial electric stimulation or sleep-based interventions have currently mostly been used in a face-to-face context but have the potential of remote deployment-a step already taken with memory training apps. Many of the presented methods are readily scalable and of low costs and there is a range of target populations, from the worried well to late-stage dementia.

BayesLDM: A Domain-specific Modeling Language for Probabilistic Modeling of Longitudinal Data

In this paper we present BayesLDM, a library for Bayesian longitudinal data modeling consisting of a high-level modeling language with specific features for modeling complex multivariate time series data coupled with a compiler that can produce optimized probabilistic program code for performing inference in the specified model. BayesLDM supports modeling of Bayesian network models with a specific focus on the efficient, declarative specification of dynamic Bayesian Networks (DBNs). The BayesLDM compiler combines a model specification with inspection of available data and outputs code for performing Bayesian inference for unknown model parameters while simultaneously handling missing data. These capabilities have the potential to significantly accelerate iterative modeling workflows in domains that involve the analysis of complex longitudinal data by abstracting away the process of producing computationally efficient probabilistic inference code. We describe the BayesLDM system components, evaluate the efficiency of representation and inference optimizations and provide an illustrative example of the application of the system to analyzing heterogeneous and partially observed mobile health data.