Compliance with ecological momentary assessment protocols in substance users: a meta-analysis

Compliance Trends in a 14-Week Ecological Momentary Assessment Study of Undergraduate Alcohol Drinkers

High compliance is a priority for successful ecological momentary assessment (EMA) research, but meta-analyses of between-study differences show that reasons for missed prompts remain unclear. We examined compliance data from a 14-week, 182-survey EMA study of undergraduate alcohol use to test differences over time and across survey types between participants with better and worse compliance rates, and to evaluate the impact of incentives on ongoing participation. Participants were N = 196 students (65.8% female; Mage = 20.6). Overall compliance was 76.5%, declining gradually from 88.9% to 70% over 14 weeks. Declines were faster in participants with lower overall compliance, but we found no demographic, personality, mental health, or substance use differences between participants with better versus worse compliance rates. Compliance varied by survey type, and unannounced bonus incentives did not impact compliance rates. Participants completed fewer surveys the week after winning a gift card. We offer recommendations for designing future EMA studies.

Self-regulatory control processes in youths: A temporal network analysis approach

Objective

This study aimed to better understand the temporal interrelationships among self-control, response inhibition, and anger (i.e., momentary state and rumination) on both the within- and between-person levels in male adolescents.

Method

We applied temporal network analyses among 62 male adolescents with a wide range of behavioral difficulties. Self-control, momentary anger, and anger rumination were mapped by self-report measures, whereas we measured response inhibition through an ambulatory Go/No-go task (two measures a day-morning and afternoon-over a 9-day period).

Results

Temporal network analysis, at the within-person level, revealed that morning measures of response inhibition, anger rumination, and self-control were related to the corresponding measure in the afternoon. More efficient response inhibition in the morning was associated with higher self-control in the afternoon. Higher anger rumination in the morning led to higher momentary anger in the afternoon. In a concurrent within-person network, higher momentary anger was reciprocally associated with lower self-control. At the between-person level, higher momentary anger was correlated to higher anger rumination, lower response inhibition, and lower self-control.

Discussion

This study provides insight into the dynamic interactions among self-control, response inhibition, and anger (momentary state and rumination) in male adolescents, advancing the understanding of self-regulatory control functioning.

Investigating Receptivity and Affect Using Machine Learning: Ecological Momentary Assessment and Wearable Sensing Study

BACKGROUND

As mobile health (mHealth) studies become increasingly productive owing to the advancements in wearable and mobile sensor technology, our ability to monitor and model human behavior will be constrained by participant receptivity. Many health constructs are dependent on subjective responses, and without such responses, researchers are left with little to no ground truth to accompany our ever-growing biobehavioral data. This issue can significantly impact the quality of a study, particularly for populations known to exhibit lower compliance rates. To address this challenge, researchers have proposed innovative approaches that use machine learning (ML) and sensor data to modify the timing and delivery of surveys. However, an overarching concern is the potential introduction of biases or unintended influences on participants' responses when implementing new survey delivery methods.

OBJECTIVE

This study aims to demonstrate the potential impact of an ML-based ecological momentary assessment (EMA) delivery system (using receptivity as the predictor variable) on the participants' reported emotional state. We examine the factors that affect participants' receptivity to EMAs in a 10-day wearable and EMA-based emotional state-sensing mHealth study. We study the physiological relationships indicative of receptivity and affect while also analyzing the interaction between the 2 constructs.

METHODS

We collected data from 45 healthy participants wearing 2 devices measuring electrodermal activity, accelerometer, electrocardiography, and skin temperature while answering 10 EMAs daily, containing questions about perceived mood. Owing to the nature of our constructs, we can only obtain ground truth measures for both affect and receptivity during responses. Therefore, we used unsupervised and supervised ML methods to infer affect when a participant did not respond. Our unsupervised method used k-means clustering to determine the relationship between physiology and receptivity and then inferred the emotional state during nonresponses. For the supervised learning method, we primarily used random forest and neural networks to predict the affect of unlabeled data points as well as receptivity.

RESULTS

Our findings showed that using a receptivity model to trigger EMAs decreased the reported negative affect by >3 points or 0.29 SDs in our self-reported affect measure, scored between 13 and 91. The findings also showed a bimodal distribution of our predicted affect during nonresponses. This indicates that this system initiates EMAs more commonly during states of higher positive emotions.

CONCLUSIONS

Our results showed a clear relationship between affect and receptivity. This relationship can affect the efficacy of an mHealth study, particularly those that use an ML algorithm to trigger EMAs. Therefore, we propose that future work should focus on a smart trigger that promotes EMA receptivity without influencing affect during sampled time points.

Event-level risk for negative alcohol consequences in emerging adults: The role of affect, motivation, and context

OBJECTIVE

Decades of research has found support for the motivational model of alcohol use, such that positive/negative affect are indirectly associated with drinking behavior through drinking motives. However, research on event-level drinking motives is in its nascent stage, and studies have yet to consider how drinking context plays a role in the motivational pathway to both event- and person-level drinking behavior. Therefore, the present study seeks to test whether drinking context mediates the effect of affect and motivation on drinking outcomes at both the event- and person-level.

METHOD

Data for this Stage 1 Registered Report will come from a recently completed ecological momentary assessment (EMA) study in emerging adults. The study collected data on 131 emerging adults, of whom 107 reported event-level social and solitary drinking during the EMA period. Multilevel structural equation modeling will be used to test whether predrinking affect is associated with predrinking motives, and whether drinking context (social vs. solitary drinking) mediates the effect of drinking motives on drinking outcomes. Models will parse within-/between-person variance, allowing the present study to test whether drinking context serves as a mechanism of risk in the motivational model at the event-level, or solely at the between-person level. Findings will inform personalized interventions and motivational models of drinking behavior. (PsycInfo Database Record (c) 2024 APA, all rights reserved).

Temporal associations linking alcohol and cannabis use to cigarette smoking in young adults engaged in a tobacco cessation and relapse monitoring study

Young adulthood remains a developmental period in which cigarette smoking initiation and progression to dependence and regular use is common. Moreover, co-use of alcohol and/or cannabis with tobacco is common in this age group and may have detrimental effects on tobacco use rates and cessation outcomes. Although young adults are interested in quitting smoking, achieving abstinence remains difficult, even with evidence-based treatment strategies. Understanding proximal associations between other substance use (e.g., alcohol and cannabis) and smoking may have important treatment implications. This exploratory analysis investigated the role of alcohol and/or cannabis use in contributing to smoking events on the same day or next day among young adults engaged in a smoking cessation and relapse monitoring study. We used ecological momentary assessment (EMA) data from 43 young adults (ages 18-25; 932 observations) who smoked cigarettes daily and agreed to participate in a 5-week study that included a 2-day smoking quit attempt and provision of tobacco treatment in the form of nicotine replacement therapy, brief cessation counseling, and financial incentives for abstinence (incentives were provided only during the 2-day quit attempt). We tested multilevel time-series models of daily associations between alcohol use, cannabis use, and smoking. Consistent with hypotheses, days on which participants were more likely to drink alcohol predicted increased likelihood of smoking the next day (OR = 2.27, p =.003). This effect was significant after controlling for both the one-day lagged effect of smoking (i.e., autoregression) and the concurrent (i.e., same day) effects of drinking and cannabis use. Although there was a positive concurrent effect of cannabis use on smoking (OR = 12.86, p =.003), the one-day lagged effect of cannabis use and the concurrent effect of drinking was not significant, contrary to hypotheses. Results indicate that alcohol use presents a potential threat to successful smoking cessation that extends to the following day. This suggests a risk-window in which treatment could be supplemented with just-in-time interventions and extending the focus on co-use to include this lagged impact on cessation outcomes.

Experience sampling methodology study of anxiety and depression in adolescents with epilepsy: The role of metacognitive beliefs and perseverative thinking

Emotional distress is common in young people with epilepsy (YPwE). According to the Self-Regulatory Executive Function (S-REF) model, maladaptive metacognitive beliefs and perseverative thinking are fundamental in the development and maintenance of emotional distress. As emotional distress and perseverative thinking can highly fluctuate over short intervals in YPwE, it is important to account for this variability when testing the utility of psychological models. Experience sampling methodology (ESM) was therefore used to explore the momentary relationship between metacognitive beliefs, perseverative thinking, and emotional distress in YPwE. Eighteen participants diagnosed with epilepsy (aged 12-17 years) completed the 10-day ESM period. Participants were prompted to complete the ESM assessment five times daily. The ESM assessment assessed participant's momentary levels of metacognitive beliefs, perseverative thinking (i.e., worry and rumination), and emotional distress (i.e., anxiety and depression). A series of multilevel regression analyses indicated that metacognitive beliefs were significantly positively associated with worry, rumination, anxiety and depression. After controlling for worry and rumination, respectively, metacognitive beliefs did not account for additional variance in anxiety or depression. Findings provide preliminary support for the utility of the S-REF model for emotional distress in YPwE. Metacognitive therapy, which is underpinned by the S-REF model, may be an appropriate intervention for emotional distress in YPwE. Future studies should assess the mediational relationship between metacognitive beliefs, perseverative thinking, and emotional distress using time-lagged models.

Trial Participants' Perceptions of the Impact of Ecological Momentary Assessment on Smoking Behaviors: Qualitative Analysis

Background

Ecological momentary assessment (EMA) is an increasingly used tool for data collection in behavioral research, including smoking cessation studies. As previous addiction research suggests, EMA has the potential to elicit cue reactivity by triggering craving and increasing behavioral awareness. However, there has been limited evaluation of its potential influence on behavior.

Objective

By examining the perspectives of research participants enrolled in a tobacco treatment intervention trial, this qualitative analysis aims to understand the potential impact that EMA use may have had on smoking behaviors that may not have otherwise been captured through other study measures.

Methods

We performed a qualitative analysis of in-depth interviews with participants enrolled in a pilot randomized controlled trial of a tobacco treatment intervention that used SMS text messaging to collect EMA data on smoking behaviors. In the pilot randomized controlled trial, combustible cigarette and e-cigarette use and smoking-related cravings were measured as part of an EMA protocol, in which SMS text messaging served as a smoking diary. SMS text messaging was intended for data collection only and not designed to serve as part of the intervention. After a baseline assessment, participants were asked to record daily nicotine use for 12 weeks by responding to text message prompts that they received 4 times per day. Participants were prompted to share their experiences with the EMA text messaging component of the trial but were not directly asked about the influence of EMA on their behaviors. Transcripts were coded according to the principles of the framework for applied research. The codes were then examined, summarized, and grouped into themes based on the principles of grounded theory.

Results

Interviews were analyzed for 26 participants. The themes developed from the analysis suggested the potential for EMA, in the form of an SMS text messaging smoking diary, to influence participants' smoking behaviors. The perceived impacts of EMA text messaging on smoking behaviors were polarized; some participants emphasized the positive impacts of text messages on their efforts to reduce smoking, while others stressed the ways that text messaging negatively impacted their smoking reduction efforts. These contrasting experiences were captured by themes reflecting the positive impacts on smoking behaviors, including increased awareness of smoking behaviors and a sense of accountability, and the negative impacts on emotions and smoking behaviors, including provoking a sense of guilt and triggering smoking behaviors.

Conclusions

The collection of EMA smoking behavior data via SMS text messaging may influence the behaviors and perceptions of participants in tobacco treatment interventions. More research is needed to determine the magnitude of impact and mechanisms, to account for the potential effects of EMA. A broader discussion of the unintended effects introduced by EMA use is warranted among the research community.

A Tutorial on Analyzing Ecological Momentary Assessment Data in Psychological Research With Bayesian (Generalized) Mixed-Effects Models

In this tutorial, we introduce the reader to analyzing ecological momentary assessment (EMA) data as applied in psychological sciences with the use of Bayesian (generalized) linear mixed-effects models. We discuss practical advantages of the Bayesian approach over frequentist methods and conceptual differences. We demonstrate how Bayesian statistics can help EMA researchers to (a) incorporate prior knowledge and beliefs in analyses, (b) fit models with a large variety of outcome distributions that reflect likely data-generating processes, (c) quantify the uncertainty of effect-size estimates, and (d) quantify the evidence for or against an informative hypothesis. We present a workflow for Bayesian analyses and provide illustrative examples based on EMA data, which we analyze using (generalized) linear mixed-effects models to test whether daily self-control demands predict three different alcohol outcomes. All examples are reproducible, and data and code are available at https://osf.io/rh2sw/. Having worked through this tutorial, readers should be able to adopt a Bayesian workflow to their own analysis of EMA data.

Respondent characteristics associated with adherence in a general population ecological momentary assessment study

OBJECTIVES

Ecological momentary assessment (EMA) has seen an explosion in popularity in recent years; however, an improved understanding of how to minimise (selective) non-adherence is needed.

METHODS

We examined a range of respondent characteristics predictors of adherence (defined as the number of EMA surveys completed) in the D2M EMA study. Participants were a sample of n = 255 individuals drawn from the longitudinal z-proso cohort who completed up to 4 EMA surveys per day for a period of 2 weeks.

RESULTS

In unadjusted analyses, lower moral shame, lower self-control, lower levels of self-injury, and higher levels of aggression, tobacco use, psychopathy, and delinquency were associated with lower adherence. In fully adjusted analyses with predictors selected using lasso, only alcohol use was related to adherence: beer and alcopops to higher adherence and spirits to lower adherence.

CONCLUSIONS

These findings provide potential insights into some of the psychological mechanisms that may underlie adherence in EMA. They also point to respondent characteristics for which additional or tailored efforts may be needed to promote adherence.

Understanding the relationship between time spent outdoors, mental well-being and health-related behaviours in a Spanish sample: A real time smartphone-based study

INTRODUCTION

COVID-19 pandemic has affected our lifestyle and physical and mental well-being. We aimed to study the effect of being outdoors and mental well-being after the COVID-19 pandemic.

MATERIAL AND METHODS

We used smartphone based ecological momentary assessments (EMA) (Urban Mind app) to study the mental well-being of the Spanish general population. We collected socio-demographic data, past and current physical and mental health, and social and physical environment. Participants were recruited during 5 months (February to June 2021). Longitudinal associations between EMA and anxiety, depression, loneliness, tiredness, and happiness during the assessments were investigated using random intercept ordinal logistic regression models.

RESULTS

274 subjects downloaded the app and completed the baseline assessment. 66 participants completed at least 50 % of the assessments. Being outdoors was related to a lower likelihood of anxiety (OR: 0.48, 95 %CI 0.34-0.66), depression (OR: 0.40, 95 %CI 0.28-0.56), tiredness (OR: 0.47, 95 %CI 0.35-0.63), and loneliness (OR: 0.59, 95 %CI 0.42-0.84), and a higher likelihood of happiness (OR: 2.14, 95 %CI 1.57-2.93).

CONCLUSIONS

Being outdoors is related to better mental health in the general population independently of other factors (baseline mental well-being or socio-demographic characteristics). Public policies should include measurements to promote outdoor spaces in urban settings.

Disaggregating within- and between-person effects of affect on drinking behavior in a clinical sample with alcohol use disorder

OBJECTIVE

The goal of the current study was to better understand affect-drinking relations among those diagnosed with an alcohol use disorder (AUD), as recent meta-analytic work suggests that daily negative affect may not universally predict subsequent alcohol consumption in those nondependent on alcohol. Specifically, we investigated the between- and within-person effects of positive and negative affects on drinking.

METHOD

Participants (n = 92) who met AUD diagnostic criteria completed a 90-day daily assessment of drinking behavior and positive and negative affects.

RESULTS

Time-lagged multilevel modeling revealed that within-person elevations in negative affect predicted increased odds and quantity of drinking later in the day. Relations between positive affect and drinking were nonsignificant.

CONCLUSIONS

These findings are in contrast to recent meta-analytic findings and highlight the complexity of affect-drinking relations among those diagnosed with AUD. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Effects of a health versus hedonic mindset on daily-life snacking behaviour

BACKGROUND

In today's obesogenic environment high-caloric palatable foods are omnipresent, making it hard for many to reach and maintain a healthy body weight. This study investigates the effects of a health versus hedonic mindset on daily-life snacking behaviour. The hypothesis is that a health mindset leads to reduced snacking behaviour compared to a hedonic mindset. This effect is expected to be most pronounced with high dietary restraint and least pronounced with high trait self-control.

METHODS

For 3 weeks, degree of craving and amount of snacks that were craved and consumed were assessed four times a day, using smartphone Ecological Momentary Assessment (EMA). A total of 111 female participants (body mass index range: 20-23.5) were randomly assigned to a 1-week health (n = 53) or hedonic (n = 58) mindset, occurring in week 2 of the EMA protocol. The mindset manipulations consisted of text messages, focusing either on the enjoyment of tasty food (hedonic) or on healthy living and eating (health).

RESULTS

contrary to our hypotheses, mindset did not affect snacking behaviour. Instead, degree of craving and intake of snacks reduced significantly over time, not moderated by mindset, dietary restraint (Restraint Scale) or trait self-control (Brief Self-Control Scale). Importantly, this was not due to reduced compliance. Possibly, the reduced craving and snacking behaviour were due to monitoring and/or socially desirable answering tendencies. Additional time point analyses showed that craving was strongest in the late afternoon (3:30-5:00 PM), and-across mindset conditions-degree of craving correlated negatively with trait self-control.

CONCLUSIONS

future studies could manipulate degree of monitoring and design individually tailored manipulations.

Associations of daily alcohol, cannabis, combustible tobacco, and e-cigarette use with same-day co-use and poly-use of the other substances

BACKGROUND

Young adults frequently use alcohol, cannabis, and tobacco together. Given the increased prevalence of e-cigarette use and recreational cannabis use, we investigated daily patterns of alcohol, cannabis, and tobacco use and distinguished combustible tobacco from e-cigarettes.

METHODS

Young adult college students (N=341) reporting past-month alcohol and cannabis use "at the same time so that their effects overlapped" completed two 28-day bursts of repeated daily surveys. Exposures were day- and person-level use of each substance. Outcomes were (1) same-day co-use of each remaining substance or (2) poly-use of the other substances.

RESULTS

Daily use of alcohol, cannabis, combustible cigarettes, and e-cigarettes increased the odds of same-day co-use of the other substances (except combustible tobacco with e-cigarettes) and each poly-use outcome. The influence of person-level substance use on daily substance use was less consistent. Only e-cigarette use increased the odds of daily alcohol use. Use of either tobacco product but not alcohol increased the odds of daily cannabis use. Person-level alcohol and cannabis use increased the odds of daily use of either tobacco product but use of one tobacco product was not associated with daily use of the other product.

CONCLUSIONS

These findings increase our understanding of emerging daily patterns of alcohol, cannabis, and tobacco co-use, and the impact of different tobacco products. Future work is needed to extend this research into non-college samples and people who use tobacco but do not use alcohol and cannabis simultaneously, and examine daily chronologies of multiple substances that could serve as dynamic markers of risk.

Decision Trade-Offs in Ecological Momentary Assessments and Digital Wearables Uptake: Protocol for a Discrete Choice Experiment

BACKGROUND

Ecological momentary assessments (EMAs) and digital wearables (DW) are commonly used remote monitoring technologies that capture real-time data in people's natural environments. Real-time data are core to personalized medical care and intensively adaptive health interventions. The utility of such personalized care is contingent on user uptake and continued use of EMA and DW. Consequently, it is critical to understand user preferences that may increase the uptake of EMA and DW.

OBJECTIVE

The study aims to quantify users' preferences of EMA and DW, examine variations in users' preferences across demographic and behavioral subgroups, and assess the association between users' preferences and intentions to use EMA and DW.

METHODS

We will administer 2 discrete choice experiments (DCEs) paired with self-report surveys on the internet to a total of 3260 US adults through Qualtrics. The first DCE will assess participants' EMA preferences using a choice-based conjoint design that will ask participants to compare the relative importance of prompt frequency, number of questions per prompt, prompt type, health topic, and assessment duration. The second DCE will measure participants' DW preferences using a maximum difference scaling design that will quantify the relative importance of device characteristics, effort expectancy, social influence, and facilitating technical, health care, and market factors. Hierarchical Bayesian multinomial logistic regression models will be used to generate subject-specific preference utilities. Preference utilities will be compared across demographic (ie, sex, age, race, and ethnicity) and behavioral (ie, substance use, physical activity, dietary behavior, and sleep duration) subgroups. Regression models will determine whether specific utilities are associated with attitudes toward or intentions to use EMA and DW. Mixture models will determine the associations of attitudes toward and intentions to use EMA and DW with latent profiles of user preferences.

RESULTS

The institutional review board approved the study on December 19, 2022. Data collection started on January 20, 2023, and concluded on May 4, 2023. Data analysis is currently underway.

CONCLUSIONS

The study will provide evidence on users' preferences of EMA and DW features that can improve initial uptake and potentially continued use of these remote monitoring tools. The sample size and composition allow for subgroup analysis by demographics and health behaviors and will provide evidence on associations between users' preferences and intentions to uptake EMA and DW. Limitations include the cross-sectional nature of the study, which limits our ability to measure direct behavior. Rather, we capture behavioral intentions for EMA and DW uptake. The nonprobability sample limits the generalizability of the results and introduces self-selection bias related to the demographic and behavioral characteristics of participants who belong to web-based survey panels.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

DERR1-10.2196/47567.

Understanding polysubstance use at the daily and event levels: protocol for a mixed-methods qualitative and ecological momentary assessment study in a community-based sample of people who use illicit drugs in Oakland, California, USA

INTRODUCTION

Polysubstance use is extremely common among people who use illicit opioids in the USA. It is associated with poor substance use treatment outcomes, infectious disease risk and alarming rates of drug overdose. Nearly all extant literature examines polysubstance use over broad time frames, such as 30 days or 6 months. However, both substance use and overdose risk are episodic. To build a stronger understanding of polysubstance use and overdose risk, we need to expand the knowledge base to include daily-level and event-level data that examine how substances are used together, in which combinations and in which contexts. The study described in this protocol will use qualitative and ecological momentary assessment (EMA) methods to examine polysubstance use and overdose risk on a daily and event level.

METHODS AND ANALYSIS

This is a mixed-methods observational study with three phases. The first phase is formative, consisting of qualitative interviews with people who use multiple substances (N=20), to inform the development of items for the EMA component. The second phase is EMA data collection with people who use multiple substances (N=120), three times daily for 28 days. The third phase consists of mixed-methods inquiries with a subset of participants (N=20), using participant-level EMA data and qualitative techniques to build a nuanced understanding of the motivations and contexts of polysubstance use in everyday life. Analytical induction methods will be used to interpret qualitative data. Hierarchical linear modelling methods will be used to analyse EMA data.

ETHICS AND DISSEMINATION

This research has been reviewed and approved by the Institutional Review Board at RTI International (#MOD00001782 for EMA procedures and #MOD00001241 for qualitative procedures). Participants engage in an informed consent procedure for each component of the study. Data will be managed and shared per the National Institutes of Health extramural data sharing policy.

Sex differences in the relationship between cannabis use motives and cannabis craving in daily life in emerging adults

OBJECTIVE

Cannabis use motives and craving are associated with increased risk for cannabis-related problems and are ideal targets for prevention and early intervention. Patterns of motives and craving reactivity to cannabis cues differ by sex; however, few studies closely examine the relationship between motives and craving and how it may differ by valence (±) across men and women.

METHOD

The present study used Cue Reactivity Ecological Momentary Assessment to assess reward (+) and relief (-) craving four semirandom times per day for 2 weeks in a sample of 63 emerging adults (age 18-21; 54% cisgender women; 85.7% White) who frequently use cannabis (≥ 3 times per week). We assessed craving before and after exposure to brief neutral or cannabis image cues and examined within- and between-participant effects of cue type, motives, sex/gender, and their interactions, on postcue cannabis craving.

RESULTS

Regardless of cue type, women with high coping motives (-) reported less postcue relief (-) craving, and men with high enhancement motives (+) reported more postcue reward (+) craving. High enhancement motives (+), regardless of sex/gender, were associated with elevated relief (-) craving reactivity to cannabis cues, and women with high coping motives (-) reported elevated reward (+) craving reactivity to cannabis cues.

CONCLUSIONS

Sex/gender differences in the relationships between cannabis motives and craving reactivity indicate the value of a more targeted examination of valence (±) of craving experiences in addition to motives for use. Higher levels of precision may better inform interventions for emerging adults at risk for experiencing cannabis-related problems. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

A systematic review of ecological momentary assessment studies of appetite and affect in the experience of temptations and lapses during weight loss dieting

Dietary temptations and lapses challenge control over eating and act as barriers toward successful weight loss. These are difficult to assess in laboratory settings or with retrospective measures as they occur momentarily and driven by the current environment. A better understanding of how these experiences unfold within real-world dieting attempts could help inform strategies to increase the capacity to cope with the changes in appetitive and affective factors that surround these experiences. We performed a narrative synthesis on the empirical evidence of appetitive and affective outcomes measured using ecological momentary assessment (EMA) during dieting in individuals with obesity and their association with dietary temptations and lapses. A search of three databases (Scopus, Medline, and PsycInfo) identified 10 studies. Within-person changes in appetite and affect accompany temptations and lapses and are observable in the moments precipitating a lapse. Lapsing in response to these may be mediated through the strength of a temptation. Negative abstinence-violation effects occur following a lapse, which negatively impact self-attitudes. Engagement in coping strategies during temptations is effective for preventing lapses. These findings indicate that monitoring changes in sensations during dieting could help identify the crucial moments when coping strategies are most effective for aiding with dietary adherence.

Acceptability of Personal Sensing Among People With Alcohol Use Disorder: Observational Study

BACKGROUND

Personal sensing may improve digital therapeutics for mental health care by facilitating early screening, symptom monitoring, risk prediction, and personalized adaptive interventions. However, further development and the use of personal sensing requires a better understanding of its acceptability to people targeted for these applications.

OBJECTIVE

We aimed to assess the acceptability of active and passive personal sensing methods in a sample of people with moderate to severe alcohol use disorder using both behavioral and self-report measures. This sample was recruited as part of a larger grant-funded project to develop a machine learning algorithm to predict lapses.

METHODS

Participants (N=154; n=77, 50% female; mean age 41, SD 11.9 years; n=134, 87% White and n=150, 97% non-Hispanic) in early recovery (1-8 weeks of abstinence) were recruited to participate in a 3-month longitudinal study. Participants were modestly compensated for engaging with active (eg, ecological momentary assessment [EMA], audio check-in, and sleep quality) and passive (eg, geolocation, cellular communication logs, and SMS text message content) sensing methods that were selected to tap into constructs from the Relapse Prevention model by Marlatt. We assessed 3 behavioral indicators of acceptability: participants' choices about their participation in the study at various stages in the procedure, their choice to opt in to provide data for each sensing method, and their adherence to a subset of the active methods (EMA and audio check-in). We also assessed 3 self-report measures of acceptability (interference, dislike, and willingness to use for 1 year) for each method.

RESULTS

Of the 192 eligible individuals screened, 191 consented to personal sensing. Most of these individuals (169/191, 88.5%) also returned 1 week later to formally enroll, and 154 participated through the first month follow-up visit. All participants in our analysis sample opted in to provide data for EMA, sleep quality, geolocation, and cellular communication logs. Out of 154 participants, 1 (0.6%) did not provide SMS text message content and 3 (1.9%) did not provide any audio check-ins. The average adherence rate for the 4 times daily EMA was .80. The adherence rate for the daily audio check-in was .54. Aggregate participant ratings indicated that all personal sensing methods were significantly more acceptable (all P<.001) compared with neutral across subjective measures of interference, dislike, and willingness to use for 1 year. Participants did not significantly differ in their dislike of active methods compared with passive methods (P=.23). However, participants reported a higher willingness to use passive (vs active) methods for 1 year (P=.04).

CONCLUSIONS

These results suggest that active and passive sensing methods are acceptable for people with alcohol use disorder over a longer period than has previously been assessed. Important individual differences were observed across people and methods, indicating opportunities for future improvement.

Assessing Mood With the Identifying Depression Early in Adolescence Chatbot (IDEABot): Development and Implementation Study

BACKGROUND

Mental health status assessment is mostly limited to clinical or research settings, but recent technological advances provide new opportunities for measurement using more ecological approaches. Leveraging apps already in use by individuals on their smartphones, such as chatbots, could be a useful approach to capture subjective reports of mood in the moment.

OBJECTIVE

This study aimed to describe the development and implementation of the Identifying Depression Early in Adolescence Chatbot (IDEABot), a WhatsApp-based tool designed for collecting intensive longitudinal data on adolescents' mood.

METHODS

The IDEABot was developed to collect data from Brazilian adolescents via WhatsApp as part of the Identifying Depression Early in Adolescence Risk Stratified Cohort (IDEA-RiSCo) study. It supports the administration and collection of self-reported structured items or questionnaires and audio responses. The development explored WhatsApp's default features, such as emojis and recorded audio messages, and focused on scripting relevant and acceptable conversations. The IDEABot supports 5 types of interactions: textual and audio questions, administration of a version of the Short Mood and Feelings Questionnaire, unprompted interactions, and a snooze function. Six adolescents (n=4, 67% male participants and n=2, 33% female participants) aged 16 to 18 years tested the initial version of the IDEABot and were engaged to codevelop the final version of the app. The IDEABot was subsequently used for data collection in the second- and third-year follow-ups of the IDEA-RiSCo study.

RESULTS

The adolescents assessed the initial version of the IDEABot as enjoyable and made suggestions for improvements that were subsequently implemented. The IDEABot's final version follows a structured script with the choice of answer based on exact text matches throughout 15 days. The implementation of the IDEABot in 2 waves of the IDEA-RiSCo sample (140 and 132 eligible adolescents in the second- and third-year follow-ups, respectively) evidenced adequate engagement indicators, with good acceptance for using the tool (113/140, 80.7% and 122/132, 92.4% for second- and third-year follow-up use, respectively), low attrition (only 1/113, 0.9% and 1/122, 0.8%, respectively, failed to engage in the protocol after initial interaction), and high compliance in terms of the proportion of responses in relation to the total number of elicited prompts (12.8, SD 3.5; 91% out of 14 possible interactions and 10.57, SD 3.4; 76% out of 14 possible interactions, respectively).

CONCLUSIONS

The IDEABot is a frugal app that leverages an existing app already in daily use by our target population. It follows a simple rule-based approach that can be easily tested and implemented in diverse settings and possibly diminishes the burden of intensive data collection for participants by repurposing WhatsApp. In this context, the IDEABot appears as an acceptable and potentially scalable tool for gathering momentary information that can enhance our understanding of mood fluctuations and development.

Predicting Participation Willingness in Ecological Momentary Assessment of General Population Health and Behavior: Machine Learning Study

BACKGROUND

Ecological momentary assessment (EMA) is widely used in health research to capture individuals' experiences in the flow of daily life. The majority of EMA studies, however, rely on nonprobability sampling approaches, leaving open the possibility of nonrandom participation concerning the individual characteristics of interest in EMA research. Knowledge of the factors that predict participation in EMA research is required to evaluate this possibility and can also inform optimal recruitment strategies.

OBJECTIVE

This study aimed to examine the extent to which being willing to participate in EMA research is related to respondent characteristics and to identify the most critical predictors of participation.

METHODS

We leveraged the availability of comprehensive data on a general young adult population pool of potential EMA participants and used and compared logistic regression, classification and regression trees, and random forest approaches to evaluate respondents' characteristic predictors of willingness to participate in the Decades-to-Minutes EMA study.

RESULTS

In unadjusted logistic regression models, gender, migration background, anxiety, attention deficit hyperactivity disorder symptoms, stress, and prosociality were significant predictors of participation willingness; in logistic regression models, mutually adjusting for all predictors, migration background, tobacco use, and social exclusion were significant predictors. Tree-based approaches also identified migration status, tobacco use, and prosociality as prominent predictors. However, overall, willingness to participate in the Decades-to-Minutes EMA study was only weakly predictable from respondent characteristics. Cross-validation areas under the curve for the best models were only in the range of 0.56 to 0.57.

CONCLUSIONS

Results suggest that migration background is the single most promising target for improving EMA participation and sample representativeness; however, more research is needed to improve prediction of participation in EMA studies in health.

Effectiveness of personalized smoking cessation intervention based on ecological momentary assessment for smokers who prefer unaided quitting: protocol for a randomized controlled trial

Introduction

Ecological momentary assessment (EMA)-based smoking cessation intervention may help personalize intervention for smokers who prefer to quit smoking unaided. This study aims to evaluate the effectiveness of EMA-based phone counseling and instant messaging for smoking cessation.

Methods/design

This is a two-arm, accessor-blinded, simple individual randomized controlled trial (allocation ratio 1:1). Participants will be recruited from community sites and online platforms in Hong Kong. Interventions will be delivered via a phone call and instant messaging. Current adult smokers who (1) self-report no intention to use smoking cessation services and medication in the coming month and (2) have not used smoking cessation services or nicotine replacement therapy in the past 7 days will be recruited. Recruited participants will be randomized to intervention or control groups via an online randomizer. All participants will be required to complete EMAs (five times per day for 7 consecutive days). The intervention group (n = 220) will receive a nurse-led brief phone counseling immediately after the 1-week EMAs and 10-week EMA-based advice via instant messaging applications (e.g., WhatsApp, WeChat). The 10-week EMA-based advice covers a summary of the 1-week EMAs, and tailored cessation support focused on personalized smoking triggers. The control group (n = 220) will not receive any intervention during the same period. The primary outcomes are participants' progression toward smoking cessation assessed by the Incremental Behavior Change toward Smoking Cessation (IBC-S) and biochemically validated abstinence at the 3-month follow-up. Secondary outcomes include self-reported and biochemically validated tobacco abstinence at the 6-month follow-up.

Discussion

The findings will provide evidence that the EMA-based tailored smoking cessation intervention can be adapted as a new health promotion strategy for current smokers who are unwilling to use smoking cessation aids.

Clinical trial registration

https://classic.clinicaltrials.gov/ct2/show/NCT05212220, identifier: NCT05212220.

Monitoring Cigarette Smoking and Relapse in Young Adults With and Without Remote Biochemical Verification: Randomized Brief Cessation Study

BACKGROUND

Technological advancements to study young adult smoking, relapse, and to deliver interventions remotely offer conceptual appeal, but the incorporation of technological enhancement must demonstrate benefit over traditional methods without adversely affecting outcomes. Further, integrating remote biochemical verification of smoking and abstinence may yield value in the confirmation of self-reported smoking, in addition to ecologically valid, real-time assessments.

OBJECTIVE

The goal of this study was to evaluate the impact of remote biochemical verification on 24-hour self-reported smoking and biochemical verification agreement, retention, compliance with remote sessions, and abstinence during a brief, 5-week cessation attempt and relapse monitoring phase.

METHODS

Participants (N=39; aged 18-25 years; mean age 21.6, SD 2.1 years; n=22, 56% male; n=29, 74% White) who smoked cigarettes daily engaged in a 5-week cessation and monitoring study (including a 48-hour quit attempt and provision of tobacco treatment in the form of nicotine replacement therapy, brief cessation counseling, and financial incentives for abstinence during the 2-day quit attempt only). Smoking (cigarettes per day) was self-reported through ecological momentary assessment (EMA) procedures, and participants were randomized to either (1) the inclusion of remote biochemical verification (EMA + remote carbon monoxide [rCO]) 2× per day or (2) in-person, weekly CO (wCO). Groups were compared on the following outcomes: (1) agreement in self-reported smoking and breath carbon monoxide (CO) at common study time points, (2) EMA session compliance, (3) retention in study procedures, and (4) abstinence from smoking during the 2-day quit attempt and at the end of the 5-week study.

RESULTS

No significant differences were demonstrated between the rCO group and the wCO (weekly in-person study visit) group on agreement between 24-hour self-reported smoking and breath CO (moderate to poor), compliance with remote sessions, or retention, though these outcomes numerically favored the wCO group. Abstinence was numerically higher in the wCO group after the 2-day quit attempt and significantly different at the end of treatment (day 35), favoring the wCO group.

CONCLUSIONS

Though study results should be interpreted with caution given the small sample size, findings suggest that the inclusion of rCO breath added to EMA compared to EMA with weekly, in-person CO collection in young adults did not yield benefit and may have even adversely affected outcomes. Our results suggest that technological advancements may improve data accuracy through objective measurement but may also introduce barriers and burdens and could result in higher rates of missing data. The inclusion of technology to inform smoking cessation research and intervention delivery among young adults should consider (1) the research question and necessity of biochemical verification and then (2) how to seamlessly incorporate monitoring into personalized and dynamic systems to avoid the added burden and detrimental effects to compliance and honesty in self-report.

Compliance with ecological momentary assessment programmes in the elderly: a systematic review and meta-analysis

OBJECTIVE

Ecological momentary assessment (EMA) refers to the repeated sampling of information about an individual's symptoms and behaviours, enabling the capture of ecologically meaningful real-time information in a timely manner. Compliance with EMA is critical in determining the validity of an assessment. However, there is limited evidence related to how the elderly comply with EMA programmes or the factors that are associated with compliance.

DESIGN

Systematic review and meta-analysis.

DATA SOURCES

PubMed, Embase, the Cochrane Library and Web of Science were searched up to 17 July 2022.

ELIGIBILITY CRITERIA

We included observational studies on EMA in the elderly reported in English.

DATA EXTRACTION AND SYNTHESIS

Two investigators independently performed screening and data extraction. Discrepancies were resolved by discussion or a third investigator. A systematic review was carried out to characterise the basic characteristics of the participants and EMA programmes. Random-effects meta-analysis was conducted to assess overall compliance and to explore factors associated with differences in compliance among the elderly.

RESULTS

A total of 20 studies with 2047 participants were included in the systematic review and meta-analysis. Meta-analysis showed that the combined compliance rate was 86.41% (95% CI: 77.38% to 92.20%; I²=96.4%; p<0.001). Subgroup analysis revealed high levels of heterogeneity in terms of the methods used to assess population classification, assessment method and assessment frequency, although these may not be the sources of heterogeneity. Meta-regression analysis showed that population classification and assessment period might have a significant impact on heterogeneity (p<0.05). Egger's test indicated significant publication bias (p<0.001).

CONCLUSIONS

Compliance with EMA programmes is high in the elderly. It is recommended that scholars design reasonable EMA programmes according to the health status of the elderly in the future.

Parameters of EMA Compliance and Self-Reported Reactivity in a Longitudinal Study of Young Adult Cannabis and Tobacco Co-Users

Background

Co-use of cannabis and tobacco has become increasingly popular among young adults. Interactive voice response (IVR) based ecological momentary assessment (EMA) allows for measurement of behavior in or near real-time, but has limitations including non-compliance, missing data, and potential for reactivity (e.g., behavior change) from frequent assessments.

Methods

This study examined tobacco and cannabis use characteristics and factors associated with IVR compliance and self-reported reactivity in 97 young adults who reported cannabis and tobacco co-use at baseline and completed daily IVR surveys of co-use behavior at three random times per day for 28 days.

Results

Overall IVR compliance was 55%, with a modal compliance of 60%. Compliance rates did not differ across morning, midday, and evening surveys, but significantly declined over time. The sample was divided into high frequency responders (>70% calls completed, n=35) and low frequency responders (<70%, calls completed n=62). There were no differences between high and low frequency responders on any baseline demographic, tobacco use (nicotine dependence severity), alcohol, or cannabis use characteristics (past 30-day frequency of use). Participants were receptive to IVR-based EMA monitoring and, 16.5% reported purposely decreasing nicotine/tobacco use due to monitoring, while 19.6% reported purposely decreasing cannabis use, which predicted lower cannabis use post-EMA monitoring.

Conclusions

Real-time assessment of co-use behavior among young adults does not appear to be impacted by specific demographics or substance use severity (nicotine dependence, heavy drinking). Data suggest some predictive utility of IVR-based EMA monitoring on short-term behavior change. More intensive approaches are needed to improve compliance among young adult cannabis and tobacco co-users.

"I Know Myself Again, Which Makes Me Motivated for Life": Feasibility and Acceptability of Using Experience Sampling Methods With Trauma-Exposed Sexual Minority Women

Intensive longitudinal designs (e.g., experience sampling methods [ESMs]) hold promise for examining the dynamic interplay between daily adversity, coping strategies, and behavioral and mental health issues among marginalized populations. However, few studies have used intensive longitudinal designs with sexual minority women (SMW), an understudied and at-risk population. We assessed feasibility and acceptability of using once-daily, interval-contingent ESM with 161 trauma-exposed SMW (Mage = 29.1, SD = 7.57); 20.5% nonbinary; 32.3% queer; 52.2% people of color; 14.3% with annual incomes ≤$9,999; and 30.4% in Southern United States (U.S.). SMW completed one comprehensive online baseline assessment and once-daily brief online assessments for 14 days. Daily surveys assessed past-24-hour stressors, stress responses, and behavioral and mental health symptoms. At the end of the 14-day ESM period, SMW answered three open-ended questions about participating in this study and about research with SMW. Regarding feasibility, 151 participants (94.0%) initiated the post-baseline ESM study portion and 72 (45.0%) completed all 14 daily surveys. An average of 11.70 (median = 13, SD = 3.31) daily surveys (83.5%) were completed by those who initiated the ESM. ESM completion level varied by race/ethnicity and U.S. region. Qualitative acceptability data revealed several themes, namely that SMW (1) enjoyed participating and felt positively about the ESM experience, (2) felt supported to reflect on impacts of early and ongoing stressors, (3) appreciated the chance to self-reflect and challenge existing thought patterns and coping behaviors, (4) recognized their capacity to tolerate trauma-related distress, (5) recommended that researchers focus on SMW's diverse stressors and daily experiences, (6) wanted a rationale for providing sensitive information and more space to narrate their experiences, and (7) recognized the need for affirmative treatment and policies. Findings could inform modifications to ESM protocols to improve their feasibility and acceptability among trauma-exposed SMW and promote ongoing utility of this valuable method.

Within-person associations between psychological and contextual factors and lapse incidence in smokers attempting to quit: A systematic review and meta-analysis of ecological momentary assessment studies

AIMS

When attempting to stop smoking, discrete smoking events ('lapses') are strongly associated with a return to regular smoking ('relapse'). No study has yet pooled the psychological and contextual antecedents of lapse incidence, captured in ecological momentary assessment (EMA) studies. This systematic review and meta-analysis aimed to synthesize within-person psychological and contextual predictor-lapse associations in smokers attempting to quit.

METHODS

We searched Ovid MEDLINE, Embase, PsycINFO and Web of Science. A narrative synthesis and multi-level, random-effects meta-analyses were conducted, focusing on studies of adult, non-clinical populations attempting to stop smoking, with no restrictions on setting. Outcomes were the association between a psychological (e.g. stress, cravings) or contextual (e.g. cigarette availability) antecedent and smoking lapse incidence; definitions of 'lapse' and 'relapse'; the theoretical underpinning of EMA study designs; and the proportion of studies with pre-registered study protocols/analysis plans and open data.

RESULTS

We included 61 studies, with 19 studies contributing ≥ 1 effect size(s) to the meta-analyses. We found positive relationships between lapse incidence and 'environmental and social cues' [k = 12, odds ratio (OR) = 4.53, 95% confidence interval (CI) = 2.02, 10.16, P = 0.001] and 'cravings' (k = 10, OR = 1.71, 95% CI = 1.34, 2.18, P < 0.001). 'Negative feeling states' was not significantly associated with lapse incidence (k = 16, OR = 1.10, 95% CI = 0.98, 1.24, P = 0.12). In the narrative synthesis, negative relationships with lapse incidence were found for 'behavioural regulation', 'motivation not to smoke' and 'beliefs about capabilities'; positive relationships with lapse incidence were found for 'positive feeling states' and 'positive outcome expectancies'. Although lapse definitions were comparable, relapse definitions varied widely across studies. Few studies explicitly drew upon psychological theory to inform EMA study designs. One of the included studies drew upon Open Science principles.

CONCLUSIONS

In smokers attempting to stop, environmental and social cues and cravings appear to be key within-person antecedents of smoking lapse incidence. Due to low study quality, the confidence in these estimates is reduced.

A Pilot Open Trial of a Digital Mindfulness-Based Intervention for Anorexia Nervosa

Anorexia nervosa (AN) is a chronic and debilitating psychiatric disorder. Unfortunately, current treatments are lacking, with only 30-50% of individuals with AN recovering after treatment. We developed a beta-version of a digital mindfulness-based intervention for AN called Mindful Courage-Beta, which includes: (a) one foundational multimedia module; (b) 10 daily meditation mini-modules; (c) emphasis on a core skill set called the BOAT (Breathe, Observe, Accept, Take a Moment); and (d) brief phone coaching for both technical and motivational support. In this open trial, we aimed to evaluate (1) acceptability and feasibility; (2) intervention skill use and its association with state mindfulness in daily life; and (3) pre-to-post changes in target mechanisms and outcomes. Eighteen individuals with past-year AN or past-year atypical AN completed Mindful Courage-Beta over 2 weeks. Participants completed measures of acceptability, trait mindfulness, emotion regulation, eating disorder symptoms, and body dissatisfaction. Participants also completed ecological momentary assessment of skill use and state mindfulness. Acceptability ratings were good (ease-of-use: 8.2/10, helpfulness: 7.6/10). Adherence was excellent (100% completion for foundational module and 96% for mini-modules). Use of the BOAT in daily life was high (1.8 times/day) and was significantly associated with higher state mindfulness at the within-person level. We also found significant, large improvements in the target mechanisms of trait mindfulness (d = .96) and emotion regulation (d = .76), as well as significant, small-medium to medium-large reductions in eating disorder symptoms (ds = .36-.67) and body dissatisfaction (d = .60). Changes in trait mindfulness and emotion regulation had medium-large size correlations with changes in global ED symptoms and body dissatisfaction (rs = .43 - .56). Mindful Courage-Beta appears to be promising and further research on a longer, refined version is warranted.

Evaluating Declines in Compliance With Ecological Momentary Assessment in Longitudinal Health Behavior Research: Analyses From a Clinical Trial

BACKGROUND

Ecological momentary assessment (EMA) is increasingly used to evaluate behavioral health processes over extended time periods. The validity of EMA for providing representative, real-world data with high temporal precision is threatened to the extent that EMA compliance drops over time.

OBJECTIVE

This research builds on prior short-term studies by evaluating the time course of EMA compliance over 9 weeks and examines predictors of weekly compliance rates among cigarette-using adults.

METHODS

A total of 257 daily cigarette-using adults participating in a randomized controlled trial for smoking cessation completed daily smartphone EMA assessments, including 1 scheduled morning assessment and 4 random assessments per day. Weekly EMA compliance was calculated and multilevel modeling assessed the rate of change in compliance over the 9-week assessment period. Participant and study characteristics were examined as predictors of overall compliance and changes in compliance rates over time.

RESULTS

Compliance was higher for scheduled morning assessments (86%) than for random assessments (58%) at the beginning of the EMA period (P<.001). EMA compliance declined linearly across weeks, and the rate of decline was greater for morning assessments (2% per week) than for random assessments (1% per week; P<.001). Declines in compliance were stronger for younger participants (P<.001), participants who were employed full-time (P=.03), and participants who subsequently dropped out of the study (P<.001). Overall compliance was higher among White participants compared to Black or African American participants (P=.001).

CONCLUSIONS

This study suggests that EMA compliance declines linearly but modestly across lengthy EMA protocols. In general, these data support the validity of EMA for tracking health behavior and hypothesized treatment mechanisms over the course of several months. Future work should target improving compliance among subgroups of participants and investigate the extent to which rapid declines in EMA compliance might prove useful for triggering interventions to prevent study dropout.

TRIAL REGISTRATION

ClinicalTrials.gov NCT03262662; https://clinicaltrials.gov/ct2/show/NCT03262662.

An intensive longitudinal examination of topiramate treatment for alcohol use disorder: a secondary analysis of data from a randomized controlled trial

BACKGROUND AND AIMS

Previous findings have been equivocal as to whether a single-nucleotide polymorphism (rs2832407) in GRIK1, which encodes a glutamate receptor subunit, moderates the effects of topiramate treatment for drinking reduction. We leveraged intensive longitudinal data to provide greater precision and allow an examination of intermediate outcomes addressing this question. We used data from a randomized controlled trial (RCT) to test the hypotheses that topiramate treatment reduces daily heavy drinking, desire to drink and positive alcohol expectancies and that these effects are stronger in rs2832407*C-allele homozygotes.

DESIGN

Secondary data analysis of a randomized controlled trial.

SETTING

University of Pennsylvania Treatment Research Center in the United States.

PARTICIPANTS/CASES

Participants were 164 individuals (70.1% male, mean age = 51.42, 36.0% rs2832407*C-allele homozygotes) who sought to reduce or stop drinking.

INTERVENTION AND COMPARATOR

Participants were assigned to medication (topiramate or placebo), with stratification by genotype group (CC versus AA/AC) and treatment goal (reduce versus abstain).

MEASUREMENTS

During the 12-week treatment period, participants completed daily interactive voice response (IVR) surveys.

FINDINGS

On any given day during treatment, participants who received topiramate had lower odds of IVR-reported heavy drinking [odds ratio (OR) = 0.259, b (standard error, SE) = -1.351 (0.334), P < 0.001] and lower levels of desire to drink [b (SE) = -0.323 (0.122), P = 0.009] and positive alcohol expectancies [b (SE) = -0.347 (0.138), P = 0.013] than those who received placebo. Participants who received topiramate also reported greater reductions in positive alcohol expectancies during the first 2 weeks of treatment than those who received placebo [b (SE) = -0.028 (0.008), P = 0.001], but topiramate did not impact the daily rate of change in heavy drinking or desire to drink. Genotype did not moderate the effects of topiramate on any outcomes examined (P > 0.05).

CONCLUSIONS

Topiramate is an effective medication for individuals seeking to reduce heavy drinking. The effects are not moderated by the single-nucleotide polymorphism rs2832407.

Evaluation of Pressing Issues in Ecological Momentary Assessment

The use of repeated, momentary, real-world assessment methods known as the Experience Sampling Method and Ecological Momentary Assessment (EMA) has been broadly embraced over the last few decades. These methods have extended our assessment reach beyond lengthy retrospective self-reports as they can capture everyday experiences in their immediate context, including affect, behavior, symptoms, and cognitions. In this review we evaluate nine conceptual, methodological, and psychometric issues about EMA with the goal of stimulating conversation and guiding future research on these matters: the extent to which participants are actually reporting momentary experiences, respondents' interpretation of momentary questions, the use of comparison standards in responding, efforts to increase the EMA reporting period beyond the moment to longer periods within a day, training of EMA study participants, concerns about selection bias of respondents, the impact of missing EMA assessments, the reliability of momentary data, and for which purposes EMA might be considered a gold standard for assessment. Resolution of these issues should have far-reaching implications for advancing the field.

Evaluation of a smartphone-based methodology that integrates long-term tracking of mobility, place experiences, heart rate variability, and subjective well-being

This study presents MyGävle, a smartphone application that merge long-term tracking of mobility data, heart rate variability and subjective and objective well-being records. Developed to address the challenges faced in researching healthy and sustainable lifestyles, this app serves as a pioneering implementation of Real-life Long-term Methodology (ReaLM). After eight months' use by 257 participants from Gävle (Sweden), we evaluate the completeness, accuracy, validity, and consistency of all data collected. MyGävle produced remarkable results as a ReaLM method. On average, it precisely tracked participants daily locations for approximately 8 h and accurately collected heart-rate variability values throughout the day (12 h) and night (6 h). Participants reported 5115 subjective place experiences (ranging from 160 to 120 per week) and seasonal participation, although declining, is accurate. Our findings indicate that the amount of data collected through smartphone sensors, fitness wristbands and in-app questionnaires is consistent enough to be leveraged for integrated assessments of habits, environmental exposure, and subjective and physiological well-being. Yet, considerable variation exists across individuals; thus diagnostic analysis must precede use of these datasets in any particular research endeavors. By doing so we can maximise the potential of ReaLM research to delve into real life conditions conducive to healthy living habits while also considering broader sustainability goals.

Introducing a Real-Time Method for Identifying the Predictors of Noncompliance with Event-Based Reporting of Tobacco Use in Ecological Momentary Assessment

BACKGROUND

Little is known about the factors that bias event-based (i.e., self-initiated) reporting of health behaviors in ecological momentary assessment (EMA) due to the difficulty inherent to tracking failures to self-initiate reports.

PURPOSE

To introduce a real-time method for identifying the predictors of noncompliance with event-based reporting.

METHODS

N = 410 adults who used both cigarettes and e-cigarettes completed a 1-week EMA protocol that combined random reporting of current contexts with event-based reporting of tobacco use. Each random assessment first asked if participants were currently using tobacco and, if so, the assessment converted into a "randomly captured" event report-indicating failure to self-initiate that report. Multilevel modeling tested predictors of failing to complete random reports and failing to self-initiate event reports.

RESULTS

On the person level, male sex, higher average cigarette rate, and higher average cigarette urge each predicted missing random reports. The person-level predictors of failing to self-initiate event reports were older age, higher average cigarette and e-cigarette rates, higher average cigarette urge, and being alone more on average; the moment-level predictors were lower cigarette urge, lower positive affect, alcohol use, and cannabis use. Strikingly, the randomly captured events comprised more of the total EMA reports (28%) than did the self-initiated event reports (24%). These report types were similar across most variables, with some exceptions, such as momentary cannabis use predicting the random capture of tobacco events.

CONCLUSIONS

This study demonstrated a method of identifying predictors of noncompliance with event-based reporting of tobacco use and enhancing the real-time capture of events.

Time-varying model of engagement with digital self reporting: Evidence from smoking cessation longitudinal studies

Objective

Insufficient engagement is a critical barrier impacting the utility of digital interventions and mobile health assessments. As a result, engagement itself is increasingly becoming a target of studies and interventions. The purpose of this study is to investigate the dynamics of engagement in mobile health data collection by exploring whether, how, and why response to digital self-report prompts change over time in smoking cessation studies.

Method

Data from two ecological momentary assessment (EMA) studies of smoking cessation among diverse smokers attempting to quit (N = 573) with a total of 65,974 digital self-report prompts. We operationalize engagement with self-reporting in term of prompts delivered and prompt response to capture both broad and more granular engagement in self-reporting, respectively. The data were analyzed to describe trends in prompt delivered and prompt response over time. Time-varying effect modeling (TVEM) was employed to investigate the time-varying effects of response to previous prompt and the average response rate on the likelihood of current prompt response.

Results

Although prompt response rates were relatively stable over days in both studies, the proportion of participants with prompts delivered declined steadily over time in one of the studies, indicating that over time, fewer participants charged the device and kept it turned on (necessary to receive at least one prompt per day). Among those who did receive prompts, response rates were relatively stable. In both studies, there is a significant, positive and stable relationship between response to previous prompt and the likelihood of response to current prompt throughout all days of the study. The relationship between the average response rate prior to current prompt and the likelihood of responding to the current prompt was also positive, and increasing with time.

Conclusion

Our study highlights the importance of integrating various indicators to measure engagement in digital self-reporting. Both average response rate and response to previous prompt were highly predictive of response to the next prompt across days in the study. Dynamic patterns of engagement in digital self-reporting can inform the design of new strategies to promote and optimize engagement in digital interventions and mobile health studies.

Disentangling Medicinal and Recreational cannabis Use Among People Living with HIV: An Ecological Momentary Assessment Study

This study examined the feasibility of using ecological momentary assessment (EMA) to disentangle medicinal cannabis use (MCU) from recreational cannabis use (RCU) among people living HIV (PLWH). Over a 14-day period, PLWH (N = 29) who engaged in both MCU and RCU completed a smartphone-based survey before and after every cannabis use event assessing general motivation for cannabis use (MCU-only, RCU-only, or mixed MCU/RCU), cannabis use behavior, and several antecedents and outcomes of cannabis use. A total of 739 pre-cannabis surveys were completed; 590 (80%) of the prompted post-cannabis surveys were completed. Motives for cannabis use were reported as MCU-only on 24%, RCU-only on 30%, and mixed MCU/RCU on 46% of pre-cannabis surveys. Mixed effects models examined within-person differences across MCU-only, RCU-only, and mixed MCU/RCU events. Results showed that relative to RCU-only events, MCU-only events were more likely to involve symptom management and drug substitution motives, physical and sleep-related symptoms, solitary cannabis use, and use of cannabis oils and sprays; MCU-only events were less likely to involve relaxation, happiness, and wellness motives, cannabis flower use, and positive cannabis consequences. Differences between mixed MCU/RCU and RCU-only events were similar, except that mixed MCU/RCU events were additionally associated with stress reduction motives and symptoms of anxiety and depression. Findings support the feasibility of partially disentangling MCU and RCU behavior among PLWH who engage in concurrent MCU and RCU. This study highlights the need for more EMA studies isolating MCU from RCU to inform ongoing changes to cannabis policies.

Ecological Momentary Assessment: A Meta-Analysis on Designs, Samples, and Compliance Across Research Fields

Ecological Momentary Assessments (i.e., EMA, repeated assessments in daily life) are widespread in many fields of psychology and related disciplines. Yet, little knowledge exists on how differences in study designs and samples predict study compliance and dropout-two central parameters of data quality in (micro-)longitudinal research. The current meta-analysis included k = 477 articles (496 samples, total N = 677,536). For each article, we coded the design, sample characteristics, compliance, and dropout rate. The results showed that on average EMA studies scheduled six assessments per day, lasted for 7 days, and obtained a compliance of 79%. Studies with more assessments per day scheduled fewer assessment days, yet, the number of assessments did not predict compliance or dropout rates. Compliance was significantly higher in studies providing financial incentives. Otherwise, design or sample characteristics had little effects. We discuss the implications of the findings for planning, reporting, and reviewing EMA studies.

Concurrent and proximal associations among PTSD symptoms, prescription opioid use, and co-use of other substances: Results from a daily monitoring study

OBJECTIVE

Posttraumatic stress disorder (PTSD) and nonmedical prescription opioid use (NMPOU) are linked. Much of the research documenting this association uses cross-sectional or longitudinal designs that describe patterns of use over extended intervals. The present study used a daily monitoring design to examine how daily fluctuations in PTSD symptoms predicted patterns of prescription opioid use (both medical and nonmedical) and co-use of other substances. This approach has distinct advantages for understanding proximal temporal relations between PTSD symptom variation and substance use patterns.

METHOD

Forty adults with clinical or subclinical PTSD and past-month NMPOU completed daily measures of PTSD symptoms, physical pain, prescription opioid use, and other substance use for 28 days using a smartphone application.

RESULTS

Same day co-use of prescription opioids and at least one other substance was common. Higher-than-typical PTSD symptoms on a given day (within-person) was associated with an increased likelihood of reporting NMPOU (overall and with co-use of one or more additional substances) on the same day. This association was specific to PTSD alterations in arousal and reactivity symptoms (Criteria E). Neither total PTSD symptoms nor individual PTSD symptom clusters prospectively predicted next-day prescription opioid use (overall or with co-use). Use of prescription opioids also did not predict next-day PTSD symptom severity.

CONCLUSION

This is the first study to demonstrate positive associations between day-to-day fluctuations in PTSD symptoms and NMPOU. Results from the current study also highlight the importance of examining polysubstance use patterns among individuals with PTSD who use prescription opioids. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Ecological momentary assessment of mind-wandering: meta-analysis and systematic review

Mind-wandering (MW) is a universal human phenomenon and revealing its nature contributes to understanding consciousness. The ecological momentary assessment (EMA), in which subjects report a momentary mental state, is a suitable method to investigate MW in a natural environment. Previous studies employed EMA to study MW and attempted to answer the most fundamental question: How often do we let our minds wander? However, reported MW occupancies vary widely among studies. Further, while some experimental settings may induce bias in MW reports, these designs have not been explored. Therefore, we searched PubMed and Web of Science for articles published until the end of 2020 and systematically reviewed 25 articles, and performed meta-analyses on 17 of them. Our meta-analysis found that people spend 34.504% of daily life in mind-wandering, and meta-regression revealed that using subject smartphones for EMA, frequent sampling, and long experimental duration significantly affect MW reports. This result indicates that EMA using subject smartphones may tend to collect sampling under habitual smartphone use. Furthermore, these results indicate the existence of reactivity, even in MW research. We provide fundamental knowledge of MW and discuss rough standards for EMA settings in future MW studies.

The association between history of prenatal loss and maternal psychological state in a subsequent pregnancy: an ecological momentary assessment (EMA) study

BACKGROUND

Prenatal loss which occurs in approximately 20% of pregnancies represents a well-established risk factor for anxiety and affective disorders. In the current study, we examined whether a history of prenatal loss is associated with a subsequent pregnancy with maternal psychological state using ecological momentary assessment (EMA)-based measures of pregnancy-specific distress and mood in everyday life.

METHOD

This study was conducted in a cohort of N = 155 healthy pregnant women, of which N = 40 had a history of prenatal loss. An EMA protocol was used in early and late pregnancy to collect repeated measures of maternal stress and mood, on average eight times per day over a consecutive 4-day period. The association between a history of prenatal loss and psychological state was estimated using linear mixed models.

RESULTS

Compared to women who had not experienced a prior prenatal loss, women with a history of prenatal loss reported higher levels of pregnancy-specific distress in early as well as late pregnancy and also were more nervous and tired. Furthermore, in the comparison group pregnancy-specific distress decreased and mood improved from early to late pregnancy, whereas these changes across pregnancy were not evident in women in the prenatal loss group.

CONCLUSION

Our findings suggest that prenatal loss in a prior pregnancy is associated with a subsequent pregnancy with significantly higher stress and impaired mood levels in everyday life across gestation. These findings have important implications for designing EMA-based ambulatory, personalized interventions to reduce stress during pregnancy in this high-risk group.

Interactive associations between abstinence plans and romantic partner conflict and support with cigarette smoking

BACKGROUND

While most individuals who smoke cigarettes desire to quit, quit motivation can change daily and sustained abstinence is rarely achieved in quit attempts. Assessment of psychosocial factors that moderate associations between daily abstinence intentions and smoking behavior is necessary to inform effective cessation efforts.

METHODS

A secondary analysis was conducted using data from a 28-day ecological momentary assessment study among individuals who smoke and who were not actively planning a long-term quit attempt (N = 81 individuals; N = 1585 days). We examined main effect and interaction associations between primary predictors (daily abstinence plans and within- and between-person estimates of perceived romantic relationship conflict and support) and daily number of cigarettes smoked, as well as baseline emotion regulation difficulties as a moderator of these associations.

RESULTS

Smoking was reduced on days with an abstinence plan (β=-0.57,p<.001), especially among individuals with lower average levels of conflict (plan × between-person conflict interaction: β=0.98, p < .001), and higher average levels of support (plan × between-person support interaction: β=0.26, p < .001). Additionally, smoking was increased on days when participants had higher levels of conflict than usual (β=0.07, p < .01), but only on days when participants did not have a plan (plan × within-person conflict interaction:β=-0.10, p < .05). Emotion regulation difficulties did not moderate any associations.

CONCLUSION

This study adds to the literature on the influence of negative aspects of social experience on smoking behavior. Further, the present study underlines the importance of assessing the influence of both positive and negative aspects of - and within- and between-person differences in - social experiences.

In the Presence of Parents: Parental Heterosexism and Momentary Negative Affect and Substance Craving Among Sexual Minority Youth

PURPOSE

We examined the influence of parental heterosexism on in vivo negative affect and substance craving among sexual minority youth (SMY) who use nicotine and other substances, and if that relation was strengthened when in the presence of their parent(s).

METHODS

SMY (n = 42, ages 15-19) completed baseline assessments, including experiences of parental heterosexism (PH), and a 30-day ecological momentary assessment. Ecological momentary assessment reports included affective states (i.e., anger, anxiety, depression), substance craving (i.e., nicotine, cannabis, alcohol), and other contextual factors (e.g., presence of parents). Multilevel logistic regression models evaluated the study hypotheses.

RESULTS

PH was associated with greater odds of reporting in-the-moment anger, depression, cannabis craving, and alcohol craving. Parental presence was associated with lower odds of reporting anxiety or depression, and greater odds of reporting nicotine craving. There was a significant interaction when predicting the odds of reporting anxiety. For SMY low in PH, parental presence was related to lower odds of reporting anxiety. As PH increased, parental presence had diminishing associations with the odds of reporting anxiety.

DISCUSSION

Parenting behaviors can serve as protective and risk factors for negative affect and substance craving among SMY. Improving family-based interventions for SMY may be integral for enhancing healthy development and reducing health disparities.

Prompt-level predictors of compliance in an ecological momentary assessment study of young adults' mental health

BACKGROUND

Ecological momentary assessment (EMA) has become a popular method of gathering information about participants as they go about their daily lives. However, participant non-compliance, especially non-random compliance, in EMA is a concern. Better knowledge of the moment-to-moment factors that predict prompt non-response can inform the design of strategies to mitigate it.

METHOD

We used data from a general population young adult (n = 260) EMA study, 'decades-to-minutes' (D2M) and fitted dynamic structural equation models (DSEMs) to explore a range of candidate momentary predictors of missing the next prompt.

RESULTS

We found that higher levels of stress, overall negative affect, and the specific negative affective state of 'upset' at a given prompt predicted a greater likelihood of missing the next prompt. However, no other specific affective states, alcohol use, experiencing social provocations nor aggressive behaviour predicted missing the next prompt.

LIMITATIONS

The primary limitation of the present study was a lack of information on predictors concurrent with missed prompts.

CONCLUSIONS

Findings point to the potential value of gathering information on momentary negative affect (especially feeling upset) and stress to help inform strategies that intervene to prevent application disengagement at optimal moments and to feed into strategies to mitigate bias due to non-random non-response in EMA studies.

Alcohol consumption and pregnancy in American Indian and Alaska Native women: A scoping review of the literature

American Indian and Alaska Native communities have diverse cultures, histories, and contemporary experiences. Grouping them together masks the differences in health and lifestyle behaviors, chronic disease rates, and health outcomes among them. This is particularly true for data on drinking during pregnancy among American Indian and Alaska Native women. The goal of this article is to describe how generalizing findings from data gathered from often small, geographically specific samples, combined with inferior research methodologies, has led to misunderstandings about drinking among preconceptual and pregnant American Indian and Alaska Native women. We conducted a scoping review using PubMed and the "PCC mnemonic" (population, concept, and context) as our guide. Our search terms included the population (American Indian and Alaska Native women), concept (alcohol), and context (immediately before or during pregnancy) and focused on PubMed articles in the United States. Using these search terms, we uncovered a total of 38 publications and eliminated 19, leaving 19 for review. Methodologically (i.e. how data were collected), we found most previous research on prenatal or preconceptual alcohol use with American Indian and Alaska Native women used retrospective data collection. We also assessed who data were collected from and noted two groups: studies that sampled higher-risk women and those that focused on American Indian and Alaska Native women in specific geographic areas. Restricting data collection to higher-risk American Indian and Alaska Native women or conducting small studies in specific geographic areas has generated an incomplete and inaccurate picture of American Indian and Alaska Native women as a whole as well as those who consume alcohol. Data from select groups of American Indian and Alaska Native women may overestimate the true prevalence of drinking during pregnancy among this population. Updated and accurate data on drinking during pregnancy are urgently needed to inform the development of interventions and prevention efforts.

Understanding health behaviours in context: A systematic review and meta-analysis of ecological momentary assessment studies of five key health behaviours

Ecological Momentary Assessment (EMA) involves repeated, real-time sampling of health behaviours in context. We present the state-of-knowledge in EMA research focused on five key health behaviours (physical activity and sedentary behaviour, dietary behaviour, alcohol consumption, tobacco smoking, sexual health), summarising theoretical (e.g., psychological and contextual predictors) and methodological aspects (e.g., study characteristics, EMA adherence). We searched Ovid MEDLINE, Embase, PsycINFO and Web of Science until February 2021. We included studies focused on any of the aforementioned health behaviours in adult, non-clinical populations that assessed ≥1 psychological/contextual predictor and reported a predictor-behaviour association. A narrative synthesis and random-effects meta-analyses of EMA adherence were conducted. We included 633 studies. The median study duration was 14 days. The most frequently assessed predictors were 'negative feeling states' (21%) and 'motivation and goals' (16.5%). The pooled percentage of EMA adherence was high at 81.4% (95% CI = 80.0%, 82.8%, k = 348) and did not differ by target behaviour but was somewhat higher in student (vs. general population) samples, when EMAs were delivered via mobile phones/smartphones (vs. handheld devices), and when event contingent (vs. fixed) sampling was used. This review showcases how the EMA method has been applied to improve understanding and prediction of health behaviours in context.

Real-time momentary mood as a predictor of college students' prescription drug misuse in daily life: Direct links and the moderating role of background mental health

The present study addressed calls for research to identify real-time predictors of prescription drug misuse (Schepis et al., 2020) by testing young adults' momentary reports of their negative mood and positive mood as predictors of event-level misuse in daily life. We implemented a 28-day ecological momentary assessment (EMA) procedure that collected individuals' mood and other contextual experiences in moments preceding prescription drug misuse. Consistent with models of problematic substance use as a means to reduce negativity (Khantzian, 1997), results from hierarchical generalized linear modeling (HGLM) indicated within-person links between higher than usual negative mood and greater likelihood of prescription misuse in daily life. Contrary to the hypothesis, misuse was also more likely when preceded by elevated positive mood. We found consistent support for the hypothesized between-person effects, with prescription misuse in daily life associated with higher average levels of negative mood, and lower average levels of positive mood, across the reporting period. We further predicted that individuals reporting greater levels of social anxiety, depression, and externalizing symptoms would evidence stronger links between their momentary negative mood and prescription misuse. Partial support for this moderation hypothesis was found, with the positive within-person link between negative mood and prescription misuse significantly stronger among individuals higher (vs. lower) on social anxiety and depression. Results provide support for intricate connections between young adults' momentary mood, mental health symptoms, and prescription drug misuse. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

Identification of careless responding in ecological momentary assessment research: From posthoc analyses to real-time data monitoring

With the emerging ubiquity of cell phones, ecological momentary assessment (EMA) as a set of methods enable researchers to study momentary social, psychological, and affective responses to everyday life. Additionally, EMA enables researchers to acquire longitudinal data without the need for multiple lab visits. As the use of EMA in research increases, so too does the necessity of determining what constitutes valid or careless individual EMA responses to ensure validity and replicability of findings. Currently, EMA studies solely consider the response rate of a participant for exclusion. Yet, other features of an assessment can help to determine whether a response is careless or implausible. Here, we examined over 18,000 EMA text message responses of individual affect items to derive a data-driven model of what constitutes a "careless response." Results from this study indicate that an overly fast time to complete items (≤ 1 s), an overly narrow within assessment response variance (SD ≤ 5), and the percentage of items that fall at the mode (≥ 60%) are independent and reliable indicators of a careless response. Excluding careless responses such as these remove implausible positive correlations among psychometric antonyms (e.g., relaxed and anxious). Further, by identifying and removing careless responses, we also identify careless responders, participants who could be removed from group analyses. We use these results to develop and introduce an R package, EMAeval, so EMA researchers may similarly identify careless responses and responders either online during data collection or posthoc, after data collection has completed. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Wearable Sensor and Mobile App-based mHealth Approach for Investigating Substance Use and Related Factors in Daily Life: Protocol for an Ecological Momentary Assessment Study (Preprint)

BACKGROUND

Digital health technologies using mobile apps and wearable devices are a promising approach to the investigation of substance use in the real world and for the analysis of predictive factors or harms from substance use. Moreover, consecutive repeated data collection enables the development of predictive algorithms for substance use by machine learning methods.

OBJECTIVE

We developed a new self-monitoring mobile app to record daily substance use, triggers, and cravings. Additionally, a wearable activity tracker (Fitbit) was used to collect objective biological and behavioral data before, during, and after substance use. This study aims to describe a model using machine learning methods to determine substance use.

METHODS

This study is an ongoing observational study using a Fitbit and a self-monitoring app. Participants of this study were people with health risks due to alcohol or methamphetamine use. They were required to record their daily substance use and related factors on the self-monitoring app and to always wear a Fitbit for 8 weeks, which collected the following data: (1) heart rate per minute, (2) sleep duration per day, (3) sleep stages per day, (4) the number of steps per day, and (5) the amount of physical activity per day. Fitbit data will first be visualized for data analysis to confirm typical Fitbit data patterns for individual users. Next, machine learning and statistical analysis methods will be performed to create a detection model for substance use based on the combined Fitbit and self-monitoring data. The model will be tested based on 5-fold cross-validation, and further preprocessing and machine learning methods will be conducted based on the preliminary results. The usability and feasibility of this approach will also be evaluated.

RESULTS

Enrollment for the trial began in September 2020, and the data collection finished in April 2021. In total, 13 people with methamphetamine use disorder and 36 with alcohol problems participated in this study. The severity of methamphetamine or alcohol use disorder assessed by the Drug Abuse Screening Test-10 or the Alcohol Use Disorders Identification Test-10 was moderate to severe. The anticipated results of this study include understanding the physiological and behavioral data before, during, and after alcohol or methamphetamine use and identifying individual patterns of behavior.

CONCLUSIONS

Real-time data on daily life among people with substance use problems were collected in this study. This new approach to data collection might be helpful because of its high confidentiality and convenience. The findings of this study will provide data to support the development of interventions to reduce alcohol and methamphetamine use and associated negative consequences.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

DERR1-10.2196/44275.

Data Completeness and Concordance in the FeverApp Registry: Comparative Study

BACKGROUND

The FeverApp registry uses ecological momentary assessment (EMA) to collect parental data on pediatric fever for scientific research. The mobile app FeverApp educates parents on safe fever management and serves as a fever diary.

OBJECTIVE

The focus of this study was to evaluate the completeness and concordance of the EMA-based FeverApp registry with regard to its data quality from a multilevel perspective.

METHODS

Structured descriptions of fever episodes by health care professionals from an office were used as reference. The number of children, their sociodemographic data, and agreement of fever episodes, with maximum temperature, intake of antipyretics and antibiotics, and physician visits, were compared with the entries in the corresponding physician's reference records. The data quality indicators for completeness, meaning the extent to which the necessary data for the registry has actually been submitted, and concordance, which is the correspondence of the value of a data element with a reference source, were chosen to analyze whether EMA may be a suitable method for this kind of registry.

RESULTS

In both data sources, 1012 children were available for comparison over 16 months. The completeness of gender (1012/1012, 100%) and date of birth (1004/1012, 99.2%) information was high, and the mismatches were 0.69% (7/1012) and 1.19% (12/1012), respectively, between the sources. Of these 1012 children, 668 (66%) registered fever episodes in FeverApp. They relate to 534 families with 953 fever episodes in the reference records and 1452 episodes in the FeverApp registry. Of the 534 families, 183 (34.3%) refrained from visiting the office during fever episodes but nevertheless documented them in FeverApp. Largest part (766/1452, 52.75%) episodes were recorded exclusively in the FeverApp registry by 371 (371/534, 69.5%) families. The remaining 686 (47.2%) episodes of 391 (58.5%) children from 351 (65.7%) families were comparable with the reference data source in terms of physician visits, medication, and temperature. The completeness ranged, depending on the kind of variable, from 11.5% to 65% in the registry and from 7.6% to 42.6% in the office. The 953 fever episodes reported by the reference office consisted of 681 (71.5%) acute and 272 (28.5%) past episodes. In FeverApp, most past (262/272, 96.3%) but less acute (424/681, 62.3%) episodes have been entered. The concordance rates were varied: 90.2% for antibiotic use, 66.6% for antipyretic use, 61.7% for physician visits, and 16% for the highest temperature during the fever episode.

CONCLUSIONS

Both sources delivered only partial data, and the rates of completeness and concordance depended on the kind of variable. However, the FeverApp registry showed higher documentation and precision rates than professional records for all considered variables. Therefore, EMA may play a unique supplement for research in ambulatory care. FeverApp could support pediatric offices, especially during the pandemic.

Design decisions and data completeness for experience sampling methods used in psychosis: systematic review

BACKGROUND

The experience sampling method (ESM) is an intensive longitudinal research method.  Participants complete questionnaires at multiple times about their current or very recent state. The design of ESM studies is complex. People with psychosis have been shown to be less adherent to ESM study protocols than the general population. It is not known how to design studies that increase adherence to study protocols. A lack of typology makes it is hard for researchers to decide how to collect data in a way that allows for methodological rigour, quality of reporting, and the ability to synthesise findings. The aims of this systematic review were to characterise the design choices made in ESM studies monitoring the daily lives of people with psychosis, and to synthesise evidence relating the data completeness to different design choices.

METHODS

A systematic review was conducted of published literature on studies using ESM with people with psychosis. Studies were included if they used digital technology for data collection and reported the completeness of the data set. The constant comparative method was used to identify design decisions, using inductive identification of design decisions with simultaneous comparison of design decisions observed. Weighted regression was used to identify design decisions that predicted data completeness. The review was pre-registered (PROSPERO CRD42019125545).

RESULTS

Thirty-eight studies were included. A typology of design choices used in ESM studies was developed, which comprised three superordinate categories of design choice: Study context, ESM approach and ESM implementation. Design decisions that predict data completeness include type of ESM protocol used, length of time participants are enrolled in the study, and if there is contact with the research team during data collection.

CONCLUSIONS

This review identified a range of design decisions used in studies using ESM in the context of psychosis. Design decisions that influence data completeness were identified. Findings will help the design and reporting of future ESM studies. Results are presented with the focus on psychosis, but the findings can be applied across different mental health populations.