For whom, and for what, is experience sampling more accurate than retrospective report?

Attention in hindsight: Using stimulated recall to capture dynamic fluctuations in attentional engagement

Attentional engagement is known to vary on a moment-to-moment basis. However, few self-report methods can effectively capture dynamic fluctuations in attentional engagement over time. In the current paper, we evaluated the utility of stimulated recall, a method wherein individuals are asked to remember their subjective states while using a mnemonic cue, for the measurement of temporal changes in attentional engagement. Participants were asked to watch a video lecture, during which we assessed their in-the-moment levels of attentional engagement using intermittent thought probes. Then, we used stimulated recall by cueing participants with short video clips from the lecture to retrospectively assess the levels of attentional engagement they had experienced when they first watched those clips within the lecture. Experiment 1 assessed the statistical overlap between in-the-moment and video-stimulated ratings. Experiment 2 assessed the generalizability of video-stimulated recall across different types of lectures. Experiment 3 assessed the impact of presenting video-stimulated probe clips in non-chronological order. Experiment 4 assessed the effect of video-stimulated recall on its own. Across all experiments, we found statistically robust correspondence between in-the-moment and video-stimulated ratings of attentional engagement, illustrating a strong convergence between these two methods of assessment. Taken together, our findings indicate that stimulated recall provides a new and practical methodological approach that can accurately capture dynamic fluctuations in subjective attentional states over time.

On Personality Measures and Their Data: A Classification of Measurement Approaches and Their Recommended Uses

We employ a new approach for classifying methods of personality measurement such as self-judgment, mental ability, and lifespace measures and the data they produce. We divide these measures into two fundamental groups: personal-source data, which arise from the target person's own reports, and external-source data, which derive from the areas surrounding the person. These two broad classes are then further divided according to what they target and the response processes that produce them. We use the model to organize roughly a dozen kinds of data currently employed in the field. With this classification system in hand, we describe how much we might expect two types of measures of the same attribute to converge-and explain why methods often yield somewhat different results. Given that each measurement method has its own strengths and weaknesses, we examine the pros and cons of selecting a given type of measure to assess a specific area of personality.

The effect of a prosocial environment on health and well-being during the first COVID-19 lockdown and a year later

The outset of the COVID-19 pandemic was characterized by prolonged periods of chronic stress and social isolation. While studies have investigated the changes to well-being (WB) during this period, the impact of the social environment on long-term physical and mental health requires further study. This study aimed to assess the factors influencing WB and health outcomes, with the hypothesis that a positive social environment would play a significant immediate and long-term role in improving WB and preventing the effects of anxiety associated with the pandemic. At time point 1 (April 2020), an Israeli sample of 206 participants (84% female, mean age 31.5) responded to traditional questionnaires assessing mental health and social support. Factors affecting WB were assessed within subjects during the first COVID-19 lockdown for 6 weeks using a daily survey (Beiwe phone application). A year later, in May 2021, at time point 2, the initial questionnaires were readministered to a subset of the same participants (N = 94). We found that anxiety during the first lockdown adversely affected WB and predicted health and WB deterioration a year later. In contrast, a high quality of social relationships was associated with better short- and long-term WB, and mitigated the adverse effects of anxiety. Daily activities, including physical activity, meditation, and romantic relations, were also positively associated with WB during the first lockdown but did not have long-term effects. In summary, our study underscores the enduring health advantages of a positive social environment, particularly during stressful periods. These results have implications for health policymakers: programs which support individuals with high anxiety and low support, by integrating them into community-based interventions, promise to enhance well-being (WB) and health, as well as to fortify the community as a whole.

Usability of the Experience Sampling Method in Specialized Mental Health Care: Pilot Evaluation Study

BACKGROUND

Mental health problems occur in interactions in daily life. Yet, it is challenging to bring contextual information into the therapy room. The experience sampling method (ESM) may facilitate this by assessing clients' thoughts, feelings, symptoms, and behaviors as they are experienced in everyday life. However, the ESM is still primarily used in research settings, with little uptake in clinical practice. One aspect that may facilitate clinical implementation concerns the use of ESM protocols, which involves providing practitioners with ready-to-use ESM questionnaires, sampling schemes, visualizations, and training.

OBJECTIVE

This pilot study's objective was to evaluate the usability of an ESM protocol for using the ESM in a specialized mental health care setting.

METHODS

We created the ESM protocol using the m-Path software platform and tested its usability in clinical practice. The ESM protocol consists of a dashboard for practitioners (ie, including the setup of the template and data visualizations) and an app for clients (ie, for completing the ESM questionnaires). A total of 8 practitioners and 17 clients used the ESM in practice between December 1, 2020, and July 31, 2021. Usability was assessed using questionnaires, ESM compliance rates, and semistructured interviews.

RESULTS

The usability was overall rated reasonable to good by practitioners (mean scores of usability items ranging from 5.33, SD 0.91, to 6.06, SD 0.73, on a scale ranging from 1 to 7). However, practitioners expressed difficulty in personalizing the template and reported insufficient guidelines on how to use the ESM in clinical practice. On average, clients completed 55% (SD 25%) of the ESM questionnaires. They rated the usability as reasonable to good, but their scores were slightly lower and more variable than those of the practitioners (mean scores of usability items ranging from 4.18, SD 1.70, to 5.94, SD 1.50 on a scale ranging from 1 to 7). Clients also voiced several concerns over the piloted ESM template, with some indicating no interest in the continued use of the ESM.

CONCLUSIONS

The findings suggest that using an ESM protocol may facilitate the implementation of the ESM as a mobile health assessment tool in psychiatry. However, additional adaptions should be made before further implementation. Adaptions include providing training on personalizing questionnaires, adding additional sampling scheme formats as well as an open-text field, and creating a dynamic data visualization interface. Future studies should also identify factors determining the suitability of the ESM for specific treatment goals among different client populations.

Maladaptive task-unrelated thoughts: Self-control failure or avoidant behavior? Preliminary evidence from an experience sampling study

Introduction

Task-unrelated thoughts (TUT) play an important role in everyday life functioning (e.g., anticipating the future, or providing a mental break). However, TUT might also be maladaptive, impairing cognitive performance emotion regulation, and increasing the risk of psychological disorders. In the present study, we aimed to test how self-reported control over TUT and task valence moderate the link between task difficulty and TUT intensity, testing the context regulation and avoidant alternative hypotheses of TUT occurrence.

Method

Forty-nine participants took part in an experience sampling study. They were asked to answer five times a day for 5 days a series of questions assessing the intensity, valence, control over TUT, and their momentary affect along with characteristics of the task they were currently performing. They also filled in trait questionnaires assessing their tendency to daydream, ruminate, and their beliefs on emotions' usefulness and controllability.

Results

The results showed that both task difficulty and one's lower control over thoughts along with their interaction significantly increased TUT intensity. Task negative valence significantly predicted TUT intensity and moderated the link between task difficulty and TUT intensity. In addition, the tendency to daydream and beliefs in the controllability of negative emotions affect the relations in this model.

Discussion

To the best of our knowledge, this study is the first to provide quantitative evidence from an experience sampling study on the role of the valence of currently performed tasks and beliefs on emotions on TUT intensity. It might be an important indication for research and clinical practice that maladaptive TUT might not be only linked to self-control failure but also to emotion regulation strategies one is using.

Tracking perceived stress, anxiety, and depression in daily life: a double-downward spiral process

Introduction

Previous studies using retrospective questionnaires have suggested a complex relationship between perceived stress and related negative emotions and emphasized their importance in mental health. However, how daily perceived stress, anxiety, and depression interact dynamically in a natural context remains largely unexplored.

Methods

This study conducted a longitudinal survey that applied experience sampling methodology to data from 141 Chinese college students (58% women, mean age = 20.1 ± 1.63 years).

Results

The hierarchical linear models confirmed that daily perceived stress and negative emotions (i.e., perceived depression and anxiety) could reciprocally reinforce one another with the characteristic dynamics of a cognitive-emotional downward spiral. Additionally, anxiety and depression could further circularly aggravate each other imminently. These two intertwined downward-spiral processes constitute a double-downward-spiral model.

Discussion

The findings contribute to a better understanding of the interactive mechanisms underlying perceived stress and its related negative emotions in everyday life and highlight the significance of early emotion regulation and stress relief in healthy people.

Measuring affect dynamics: An empirical framework

A fast-growing body of evidence from experience sampling studies suggests that affect dynamics are associated with well-being and health. But heterogeneity in experience sampling approaches impedes reproducibility and scientific progress. Leveraging a large dataset of 7016 individuals, each providing over 50 affect reports, we introduce an empirically derived framework to help researchers design well-powered and efficient experience sampling studies. Our research reveals three general principles. First, a sample of 200 participants and 20 observations per person yields sufficient power to detect medium-sized associations for most affect dynamic measures. Second, for trait- and time-independent variability measures of affect (e.g., SD), distant sampling study designs (i.e., a few daily measurements spread out over several weeks) lead to more accurate estimates than close sampling study designs (i.e., many daily measurements concentrated over a few days), although differences in accuracy across sampling methods were inconsistent and of little practical significance for temporally dependent affect dynamic measures (i.e., RMSSD, autocorrelation coefficient, TKEO, and PAC). Third, across all affect dynamics measures, sampling exclusively on specific days or time windows leads to little to no improvement over sampling at random times. Because the ideal sampling approach varies for each affect dynamics measure, we provide a companion R package, an online calculator ( https://sergiopirla.shinyapps.io/powerADapp ), and a series of benchmark effect sizes to help researchers address three fundamental hows of experience sampling: How many participants to recruit? How often to solicit them? And for how long?

Symptoms of complicated grief and depression following job loss: Can engagement in non-work activities bring relief?

The present study aimed to examine whether day-level engagement in non-work activities can mitigate the adverse outcomes of job loss. Based on Jahoda's latent deprivation model, we hypothesized that engaging in such activities (e.g., meeting others) can fulfil five basic needs (e.g., need for time structure) and that fulfilment of these needs mitigates the negative consequences of job loss. A diary study was conducted on five consecutive days among 236 participants who had involuntarily lost their job, yielding 1046 daily measures of the time spent on activities, the evaluation of these activities, and emotional distress. Multilevel regression analyses showed that time spent on daily activities was associated with the degree of fulfilment of the basic needs and emotional distress, yet the effect sizes were small. Perceived utility of these daily activities showed more solid effect sizes with the basic needs and emotional distress. However, the mediation effect of the basic needs regarding the association between activities and emotional distress could not be confirmed. The present results suggest that, in addition to stimulating individuals who experience job loss-related emotional distress to undertake certain activities, the evaluation of these activities should also be taken into account in tailor-made interventions and preventive measures.

Do We Know Whether We're Happier? Corroborating Perceived Retrospective Assessments of Improvements in Well-Being

To what extent do our beliefs about how our well-being has improved over time correspond to observed changes? Participants (N = 1,247 from Qualtrics Panels) completed questionnaires measuring dispositional well-being and ill-being (depressive symptoms) at three time points over the course of one year, as well as 44 weekly assessments of state well-being and ill-being over 52 weeks. They additionally completed measures of perceived improvements in well-being and ill-being at Weeks 45 and 52 as well as a measure of broad personality traits. We estimated latent change scores and latent growth curves, which allowed us to obtain more accurate estimates of the convergence between retrospective improvements and veridical change compared to past methods utilized. Stability in both global and state well-being and ill-being were observed. People who agreed more strongly that their well-being had improved (or their ill-being had increased) tended to show greater increases in actual well-being (or ill-being) across the past year. Additionally, we observed meaningful relationships between personality traits and perceived improvements. On average, people have some insight in assessing whether they became happier (or unhappier) over one year.

Examining the Theoretical Framework of Behavioral Activation for Major Depressive Disorder: Smartphone-Based Ecological Momentary Assessment Study

BACKGROUND

Behavioral activation (BA), either as a stand-alone treatment or as part of cognitive behavioral therapy, has been shown to be effective for treating depression. The theoretical underpinnings of BA derive from Lewinsohn et al's theory of depression. The central premise of BA is that having patients engage in more pleasant activities leads to them experiencing more pleasure and elevates their mood, which, in turn, leads to further (behavioral) activation. However, there is a dearth of empirical evidence about the theoretical framework of BA.

OBJECTIVE

This study aims to examine the assumed (temporal) associations of the 3 constructs in the theoretical framework of BA.

METHODS

Data were collected as part of the "European Comparative Effectiveness Research on Internet-based Depression Treatment versus treatment-as-usual" trial among patients who were randomly assigned to receive blended cognitive behavioral therapy (bCBT). As part of bCBT, patients completed weekly assessments of their level of engagement in pleasant activities, the pleasure they experienced as a result of these activities, and their mood over the course of the treatment using a smartphone-based ecological momentary assessment (EMA) application. Longitudinal cross-lagged and cross-sectional associations of 240 patients were examined using random intercept cross-lagged panel models.

RESULTS

The analyses did not reveal any statistically significant cross-lagged coefficients (all P>.05). Statistically significant cross-sectional positive associations between activities, pleasure, and mood levels were identified. Moreover, the levels of engagement in activities, pleasure, and mood slightly increased over the duration of the treatment. In addition, mood seemed to carry over, over time, while both levels of engagement in activities and pleasurable experiences did not.

CONCLUSIONS

The results were partially in accordance with the theoretical framework of BA, insofar as the analyses revealed cross-sectional relationships between levels of engagement in activities, pleasurable experiences deriving from these activities, and enhanced mood. However, given that no statistically significant temporal relationships were revealed, no conclusions could be drawn about potential causality. A shorter measurement interval (eg, daily rather than weekly EMA reports) might be more attuned to detecting potential underlying temporal pathways. Future research should use an EMA methodology to further investigate temporal associations, based on theory and how treatments are presented to patients.

TRIAL REGISTRATION

ClinicalTrials.gov, NCT02542891, https://clinicaltrials.gov/ct2/show/NCT02542891; German Clinical Trials Register, DRKS00006866, https://tinyurl.com/ybja3xz7; Netherlands Trials Register, NTR4962, https://www.trialregister.nl/trial/4838; ClinicalTrials.Gov, NCT02389660, https://clinicaltrials.gov/ct2/show/NCT02389660; ClinicalTrials.gov, NCT02361684, https://clinicaltrials.gov/ct2/show/NCT02361684; ClinicalTrials.gov, NCT02449447, https://clinicaltrials.gov/ct2/show/NCT02449447; ClinicalTrials.gov, NCT02410616, https://clinicaltrials.gov/ct2/show/NCT02410616; ISRCTN registry, ISRCTN12388725, https://www.isrctn.com/ISRCTN12388725.

Go Greener, Less Risk: Access to Nature Is Associated with Lower Risk Taking in Different Domains during the COVID-19 Lockdown

Specific risk attitude and risky behavior had an important boost during the coronavirus disease 2019 (COVID-19) pandemic. In this contribution, we hypothesize that access to nature during home confinement will decrease both the tendency to passive risk taking and alcohol intake. To do so, we interviewed through an online survey two samples of Italian residents during the strict lockdown due to the first wave of the COVID-19 pandemic. Specifically, in Study 1, participants were 1519 Italian residents coming from different Italian regions, whilst in Study 2, participants were 182 students at a university of southern Italy who were monitored for one week. In Study 1, the hierarchical regression analysis attested that access to nature during the lockdown mitigated the tendency to passive risk taking, over and beyond the effect of socio-demographic variables and the psychological construct of impulsiveness, an important personality correlate of risk taking. In Study 2, the hierarchical regression showed that access to green was associated with fewer glasses of alcohol drunk in a week of lockdown. This effect held over and above the effect of socio-demographic variables and the drinking behavior before the outbreak of the COVID-19 pandemic. In both studies, findings confirmed the beneficial effect of access to nature in specific risk-taking domains. Theoretical future directions, as well as practical implications for the management of the COVID-19 emergency by policymakers, are discussed.

Momentary versus retrospective reports of alcohol or cannabis use, sexual activity, and their co-occurrence

OBJECTIVE

Comparing people's momentary and retrospective reports of substance use and sexual activity can illuminate discrepant recall biases across these behaviors. Extant research suggests that people tend to underreport alcohol use on retrospective surveys and overreport sexual activity. We provided an updated account of these biases, extending previous work by looking at alcohol- and cannabis-involved sexual activity as well as potential gender differences in recall biases.

METHOD

Using a sample of adults (n = 110; 58.2% women), we administered surveys three times a day for 28 days to measure momentary alcohol and cannabis use, sexual activity, and substance-involved sexual activity. At the end of this momentary assessment, participants completed a retrospective survey assessing how frequently they engaged in these behaviors during the 28-day period.

RESULTS

We compared participants' momentary reports-which were scaled to account for compliance rates-and retrospective surveys. While there were no significant differences in momentary and retrospective reports of alcohol or cannabis use, participants reported higher rates of sexual activity and alcohol-involved sexual activity on the retrospective surveys than the momentary reports. Effect sizes for significant differences were medium to large (Cohen's d: 0.26-0.67).

CONCLUSIONS

Alcohol- and cannabis-involved sexual activity tend to be overreported on retrospective surveys, and preliminary findings suggest that these recall biases may vary by gender. Researchers interested in the co-occurrence of substance use and sexual activity should be aware of this potential random error and consider how to reduce recall biases based on method of data collection.

Brief daily self-care reflection for undergraduate well-being: a randomized control trial of an online intervention

There is a limited research on the effects of self-care, specifically the importance of taking time to reflect on one's self-care habits. Healthy undergraduate students (N = 95) were assigned to either a self-care intervention or passive control condition. The intervention group (N = 52) was prompted daily via email with questions about self-care habits and plans over three weeks, whereas the control group (N = 43) only completed baseline and post-assessments. Primary outcome variables included subjective happiness, positive and negative affect, and stress. Explanatory variables included mindfulness, self-compassion, and active coping tendency. Stress and negative affect decreased in the intervention group relative to the control group, but no interaction was observed for happiness and positive affect. There was no evidence that these effects were moderated by participant mindfulness, coping tendency, or self-compassion. These results suggest that even a very brief daily reflection on self-care can have powerful effects in promoting resilience against the accumulation of negative affect and stress over the term.

Emotional Well-Being Under Conditions of Lockdown: An Experience Sampling Study in Austria During the COVID-19 Pandemic

The coronavirus (COVID-19) pandemic and attendant lockdown measures present serious threats to emotional well-being worldwide. Here, we examined the extent to which being outdoors (vs. indoors), the experience of loneliness, and screen-time are associated with emotional well-being during the COVID-19 pandemic using an experiencing sampling method. In April 2020, Austrian adults (N = 286, age M = 31.0 years) completed a 21-day experience sampling phase in which they reported their emotional well-being (i.e., happiness), whether they were indoors or outdoors, and loneliness at three random time-points each day, as well as their daily screen-time. Results indicated that being outdoors was associated with higher emotional well-being, whereas greater loneliness and greater daily screen-time were associated with poorer well-being. Additionally, the impact of loneliness on well-being was weaker when participants were outdoors than indoors. These results have health policy implications for the promotion of population well-being during pandemics.

Emotional Well-Being Under Conditions of Lockdown: An Experience Sampling Study in Austria During the COVID-19 Pandemic

The coronavirus (COVID-19) pandemic and attendant lockdown measures present serious threats to emotional well-being worldwide. Here, we examined the extent to which being outdoors (vs. indoors), the experience of loneliness, and screen-time are associated with emotional well-being during the COVID-19 pandemic using an experiencing sampling method. In April 2020, Austrian adults (N = 286, age M = 31.0 years) completed a 21-day experience sampling phase in which they reported their emotional well-being (i.e., happiness), whether they were indoors or outdoors, and loneliness at three random time-points each day, as well as their daily screen-time. Results indicated that being outdoors was associated with higher emotional well-being, whereas greater loneliness and greater daily screen-time were associated with poorer well-being. Additionally, the impact of loneliness on well-being was weaker when participants were outdoors than indoors. These results have health policy implications for the promotion of population well-being during pandemics.

An Initial Study of Practicing Psychologists' Views of the Utility of Ecological Momentary Assessment for Difficult Psychotherapy Cases

Ecological momentary assessment (EMA) is a burgeoning area of research, and several clinical applications of the resulting data have been identified by researchers, suggesting potential benefit to psychotherapy practice. However, practitioners often do not use traditional empirically-supported tools for diagnosis and outcome monitoring (e.g., validated interview measures and questionnaires). Thus, it is not clear how readily practitioners will take up newer technology-enhanced assessment methods, despite current enthusiasm among researchers. The current study aimed to explore the perceived usefulness of EMA-based tools for clinical assessment and outcome monitoring of difficult psychotherapy cases, as well as to identify correlates of attitudes about the usefulness of these tools. Clinical psychologists in active therapy practice with adults (n = 375) completed an internet survey including the Attitudes toward Standardized Assessment scale and the Attitudes toward Standardized Assessment Scales-Monitoring and Feedback. Respondents characterized their current diagnostic and outcome monitoring practices and rated how helpful they would find several assessment and outcome monitoring resources for a difficult case, including both traditional instruments and EMA-based methods. EMA-based tools had lower perceived usefulness than existing instruments. Attitudes toward standardized assessment and outcome monitoring predicted the perceived utility of these methods, as did several professional variables. Practicing psychologists may not adopt EMA for clinical assessment more readily than traditional assessment tools. Recommendations for facilitating the uptake of new technologies by psychotherapists are offered.