Never miss a beep: Using mobile sensing to investigate (non-)compliance in experience sampling studies

Given the increasing number of studies in various disciplines using experience sampling methods, it is important to examine compliance biases because related patterns of missing data could affect the validity of research findings. In the present study, a sample of 592 participants and more than 25,000 observations were used to examine whether participants responded to each specific questionnaire within an experience sampling framework. More than 400 variables from the three categories of person, behavior, and context, collected multi-methodologically via traditional surveys, experience sampling, and mobile sensing, served as predictors. When comparing different linear (logistic and elastic net regression) and non-linear (random forest) machine learning models, we found indication for compliance bias: response behavior was successfully predicted. Follow-up analyses revealed that study-related past behavior, such as previous average experience sampling questionnaire response rate, was most informative for predicting compliance, followed by physical context variables, such as being at home or at work. Based on our findings, we discuss implications for the design of experience sampling studies in applied research and future directions in methodological research addressing experience sampling methodology and missing data.

Emotion regulation in daily life in early psychosis: The role of contextual appraisals

BACKGROUND

Little is known about whether and how contextual appraisals relate to emotion regulation (ER) strategy use across the ultra-high risk and first episode stages of psychosis. The present study extends previous research by investigating the extent to which different appraisal dimensions of the most negative and positive events of the day are associated with ER strategy use in individuals with ultra-high risk (UHR) and first-episode psychosis (FEP).

METHOD

Sixty-eight UHR individuals and fifty-five FEP individuals filled out an experience sampling evening questionnaire for six consecutive days, in which their appraisal of intensity, importance and perceived control concerning the most negative or positive event of the day, and the ER strategies they deploy in response to these events were measured.

RESULTS

Multilevel mixed effect models showed that intensity appraisal was most closely associated with ER strategy use, as opposed to importance and controllability appraisals. Higher intense negative events were associated with more rumination and social sharing, while less intense negative events were associated with more reappraisal. Higher intense positive events were associated with a greater number of deployed strategies and more efforts in using savoring, expression and social sharing. The UHR and FEP individuals did not significantly differ regarding effects of above-mentioned appraisal dimensions on ER.

CONCLUSIONS

These results provide evidence supporting ER flexibility in early psychosis, and event intensity emerged as the dimension most strongly associated with ER. Future research should better account for other situational factors (such as social context) that might affect ER use in psychosis.

Acceptability, usability and feasibility of experienced sampling method in chronic secondary pain syndromes

Background

In chronic pain syndromes, symptoms can fluctuate and change over time. Standard questionnaires cannot register these fluctuations. Nonetheless, the experience sampling method (ESM) is developed to collect momentary measurements of everyday complaints, tracing fluctuations in symptoms and disabling factors over time. Although valuable information can be collected in this way, assessment may also be a burden. This study aimed to investigate the acceptability, usability, and feasibility of ESM in chronic secondary pain syndromes, in a single-center study in the Netherlands.

Methods

A prospective observational study with repeated measurements was conducted in patients with chronic secondary neuropathic and musculoskeletal pain syndromes, including small fiber neuropathy, spinal cord injury, and rheumatoid disorder.

Results

Thirty-four participants were included and filled in the ESM, of whom 19 were diagnosed with small fiber neuropathy, 11 with spinal cord injury, and 4 with a rheumatoid disorder. The mean age was 54.7 ± 13.9 years (range: 23-77) of whom 52.9% were female. In total, 19 participants filled in the general and user-friendliness evaluation about the acceptability and usability of the ESM. The general evaluation showed no influence of ESM on participants' social contacts (mean 1.47, SD 1.12), activities (mean 1.74, SD 1.44), and mood (mean 1.89, SD 1.59). The answers options of ESM were a good representation of the experiences of participants (mean 4.58, SD 1.77). Regarding feasibility, the overall response rate for answering the beep signals of ESM was 44.5% in total. The missing rate per person varied from 13% to 97% with a median of 54.1%.

Conclusion

The general evaluation and the user-friendliness revealed sufficient outcomes in favor of the ESM application. ESM seems a promising measurement tool to use in secondary chronic pain syndromes.

The stability of transient relationships

In contrast to long-term relationships, far less is known about the temporal evolution of transient relationships, although these constitute a substantial fraction of people's communication networks. Previous literature suggests that ratings of relationship emotional intensity decay gradually until the relationship ends. Using mobile phone data from three countries (US, UK, and Italy), we demonstrate that the volume of communication between ego and its transient alters does not display such a systematic decay, instead showing a lack of any dominant trends. This means that the communication volume of egos to groups of similar transient alters is stable. We show that alters with longer lifetimes in ego's network receive more calls, with the lifetime of the relationship being predictable from call volume within the first few weeks of first contact. This is observed across all three countries, which include samples of egos at different life stages. The relation between early call volume and lifetime is consistent with the suggestion that individuals initially engage with a new alter so as to evaluate their potential as a tie in terms of homophily.

Episodic future thinking and compassion reduce non-compliance urges regarding public health guidelines: a randomised controlled trial

BACKGROUND

People often feel urges to engage in activities that violate pandemic public health guidelines. Research on these urges has been reliant on measures of typical behaviour, which fail to capture these urges as they unfold. Guideline adherence could be improved through interventions, but few methods allow for ecologically valid observation of the range of behaviours that pandemic guidelines prescribe.

METHODS

In this preregistered parallel randomised trial, 95 participants aged 18-65 from the UK were assigned to three groups using blinded block randomisation, and engaged in episodic future thinking (n = 33), compassion exercises (n = 31), or a control procedure (n = 31). Following an ecological momentary assessment procedure, participants report on the intensity of their occurrent urges (min. 1, max. 10) and their ability to control them. The study further investigates whether, and through which mechanism, state impulsivity and vaccine attitudes affect guideline adherence.

RESULTS

Episodic future thinking (b = -1.80) and compassion exercises (b = -1.45) reduced the intensity of urges. State impulsivity is associated with stronger urges, but we found no evidence that vaccine hesitancy predicts lesser self-control.

CONCLUSIONS

We conclude that episodic future thinking exercises and compassion training may be used to decrease non-compliance urges of individuals who are an acute public health risk for the community, such as those in voluntary isolation.

Design decisions and data completeness for experience sampling methods used in psychosis: systematic review

BACKGROUND

The experience sampling method (ESM) is an intensive longitudinal research method.  Participants complete questionnaires at multiple times about their current or very recent state. The design of ESM studies is complex. People with psychosis have been shown to be less adherent to ESM study protocols than the general population. It is not known how to design studies that increase adherence to study protocols. A lack of typology makes it is hard for researchers to decide how to collect data in a way that allows for methodological rigour, quality of reporting, and the ability to synthesise findings. The aims of this systematic review were to characterise the design choices made in ESM studies monitoring the daily lives of people with psychosis, and to synthesise evidence relating the data completeness to different design choices.

METHODS

A systematic review was conducted of published literature on studies using ESM with people with psychosis. Studies were included if they used digital technology for data collection and reported the completeness of the data set. The constant comparative method was used to identify design decisions, using inductive identification of design decisions with simultaneous comparison of design decisions observed. Weighted regression was used to identify design decisions that predicted data completeness. The review was pre-registered (PROSPERO CRD42019125545).

RESULTS

Thirty-eight studies were included. A typology of design choices used in ESM studies was developed, which comprised three superordinate categories of design choice: Study context, ESM approach and ESM implementation. Design decisions that predict data completeness include type of ESM protocol used, length of time participants are enrolled in the study, and if there is contact with the research team during data collection.

CONCLUSIONS

This review identified a range of design decisions used in studies using ESM in the context of psychosis. Design decisions that influence data completeness were identified. Findings will help the design and reporting of future ESM studies. Results are presented with the focus on psychosis, but the findings can be applied across different mental health populations.

Momentary predictors of compliance in studies using the experience sampling method

The influence of momentary experiences on compliance has not yet been studied extensively in diary methods such as the experience sampling method (ESM). This study investigated to what extent momentary experiences at the moment of responding (hereafter 'beep') can predict compliance in high frequency ESM protocols. Lagged-analyses were conducted using a pooled dataset of seven studies including 1,318 healthy volunteers and individuals with different mental health conditions. All studies used an ESM design of 10 beeps per day over 4 to 6 days. Overall compliance was 86% (to beeps where a subject was compliant at the previous beep). Results indicated that participants who reported higher positive affect overall were more compliant. Feeling disturbed by a beep, being outside the home, medication use, or longer inter-prompt interval decreased the chances of compliance to the subsequent beep. While participants with depression tended to be more compliant, chances to be compliant decreased in the evenings and over the course of the study days. When more beeps were missed consecutively, the chances to miss the subsequent beep increased. Findings suggest that disturbance of the beep, being outside the home, medication use, and inter-prompt interval might decrease the chances of compliance to the subsequent beep.

What Affects the Completion of Ecological Momentary Assessments in Chronic Pain Research? An Individual Patient Data Meta-Analysis

Background

Ecological momentary assessment (EMA) involves repeated sampling of people’s current experiences in real time in their natural environments, which offers a granular perspective on patients’ experience of pain and other symptoms. However, EMA can be burdensome to patients, and its benefits depend upon patients’ engagement in the assessments.

Objective

The goal of this study was to investigate factors affecting EMA-completion rates among patients with chronic pain.

Methods

This individual patient data meta-analysis was based on 12 EMA datasets that examined patients with chronic noncancer-related pain (n=701). The EMA-completion rates were calculated on a daily basis for each patient. Multilevel models were used to test the following predictors of completion rates at different levels: within-patient factors (days into the study and daily pain level), between-patient factors (age, sex, pain diagnosis, and average pain level per person), and between-study EMA design factors (study duration, sampling density, and survey length).

Results

Across datasets, an EMA-completion rate of 85% was observed. The strongest results were found for the between-patient factor age: Younger respondents reported lower completion rates than older respondents (P=.002). One within-patient factor, study day, was associated with completion rates (P<.001): over the course of the studies, the completion rates declined. The two abovementioned factors interacted with each other (P=.02) in that younger participants showed a more rapid decline in EMA completion over time. In addition, none of the other hypothesized factors including gender, chronic pain diagnoses, pain intensity levels, or measures of study burden showed any significant effects.

Conclusion

Many factors thought to influence the EMA-completion rates in chronic pain studies were not confirmed. However, future EMA research in chronic pain should note that study length and young age can impact the quality of the momentary data and devise strategies to maximize completion rates across different age groups and study days.