A Review of Explicit and Implicit Assumptions When Providing Personalized Feedback Based on Self-Report EMA Data

Introducing FRED: Software for Generating Feedback Reports for Ecological Momentary Assessment Data

Ecological Momentary Assessment (EMA) is a data collection approach utilizing smartphone applications or wearable devices to gather insights into daily life. EMA has advantages over traditional surveys, such as increasing ecological validity. However, especially prolonged data collection can burden participants by disrupting their everyday activities. Consequently, EMA studies can have comparably high rates of missing data and face problems of compliance. Giving participants access to their data via accessible feedback reports, as seen in citizen science initiatives, may increase participant motivation. Existing frameworks to generate such reports focus on single individuals in clinical settings and do not scale well to large datasets. Here, we introduce FRED (Feedback Reports on EMA Data) to tackle the challenge of providing personalized reports to many participants. FRED is an interactive online tool in which participants can explore their own personalized data reports. We showcase FRED using data from the WARN-D study, where 867 participants were queried for 85 consecutive days with four daily and one weekly survey, resulting in up to 352 observations per participant. FRED includes descriptive statistics, time-series visualizations, and network analyses on selected EMA variables. Participants can access the reports online as part of a Shiny app, developed via the R programming language. We make the code and infrastructure of FRED available in the hope that it will be useful for both research and clinical settings, given that it can be flexibly adapted to the needs of other projects with the goal of generating personalized data reports.

The associations of sexual desire, daily stress, and intimacy in gay men in long-term relationships

We investigated the associations between daily stress, sexual desire and intimacy in gay men in long-term relationships. A daily diary method of data collection was used. Twenty-two adult participants completed brief questionnaires ten times per day during seven consecutive days. Multilevel regression analyses revealed significant negative associations of daily stress with sexual desire (p = 0.003); higher stress came with lower levels of sexual desire, and vice versa. The hypothesized moderation effect of the associations of stress with sexual desire by intimacy was found significant (p = 0.003). However, the effect was not as predicted: at higher levels of intimacy the negative effect of stress on sexual desire was shown to be stronger than at lower levels. Most temporal associations of stress and intimacy with sexual desire were not significant. Nevertheless, the present findings implicate that daily stress and intimacy are important factors in sexual functioning of gay men in long-term relationships.

Considering the 'With Whom': Differences Between Event- and Signal-Contingent ESM Data of Person-Specific Social Interactions

Experience sampling studies often aim to capture social interactions. A central methodological question in such studies is whether to use event- or signal-contingent sampling. The little existing research on this issue has not taken into account that social interactions occur with unique interaction partners (e.g., Anna or Tom). We analyze one week of social interaction data of 286 students from the University of Pittsburgh (60.8% male, mean age 19.2 years), taking into account the unique interaction partners of each student. Specifically, we investigate the differences between event- and signal contingent sampling in (1) the total number of unique interaction partners captured, as well as (2) the kinds of relationships, and (3) the quality of social interactions with these captured interaction partners. Apart from a larger quantity of interactions and unique interaction partners in the event-contingent sampling design, our analyses indicate subtle differences between the two designs when aiming to assess social interactions with more distant interaction partners, such as coworkers or strangers. Most importantly, in our analyses, specific interaction partners and social roles explained a considerable amount of variance in the quality of social interactions (up to 20.5%), suggesting that future research would benefit greatly from considering "with whom" individuals interact.

Applications of the experience sampling method (ESM) in paediatric healthcare: a systematic review

BACKGROUND

With the Experience Sampling Method (ESM) participants are asked to provide self-reports of their symptoms, feelings, thoughts and behaviours in daily life. This preregistered systematic review assessed how ESM is being used to monitor emotional well-being, somatic health, fatigue and pain in children and adolescents with a chronic somatic illness.

METHODS

Databases were searched from inception. Studies were selected if they included children or adolescents aged 0-25 years with a chronic somatic illness and used ESM focussing on mental health or psychosocial wellbeing, biopsychosocial factors and/or somatic health. Two reviewers extracted data of the final 47 papers, describing 48 studies.

RESULTS

Most studies evaluated what factors influence medical or psychological symptoms and how symptoms influence each other. Another common purpose was to study the feasibility of ESM or ESM as part of an app or intervention. Study methods were heterogeneous and most studies lack adequate reporting of ESM applications and results.

CONCLUSIONS

While ESM holds great potential for providing results and feedback to patients and caregivers, little use is being made of this option. Future studies should consider what they report in their studies, conduct a priori power analyses and how ESM can be embedded in clinical practice.

IMPACT

While ESM has many clinical applications, it is currently mostly used for research purposes. Current studies using ESM are heterogeneous and lack consistent, high-quality reporting. There is great potential in ESM for providing patients and parents with personalised feedback.

Real-time personalized feedback in mHealth for adolescents

Mobile Health (mHealth) interventions have the potential to improve early identification, prevention, and treatment of mental health problems. Grow It! is a multiplayer smartphone app designed for youth aged 12-25, allowing them to monitor their emotions and engage in daily challenges based on Cognitive Behavioral Therapy (CBT) principles. Recently, a personalized mood profile was added to improve the app. We investigated whether real-time personalized feedback on mood enhances app engagement, user experience, and the effects on affective and cognitive well-being. Sample A (N = 1269, age = 18.60 SD = 3.39, 80.6% girls, 95.4% Dutch) played the original app without feedback on their mood, and an independent Sample B (N = 386, age = 16.04 SD = 3.21, 67.6% girls, 82.9% Dutch) received the renewed version with personalized real-time feedback on their mood. Participants who received personal feedback did not have higher app engagement (t(1750,400) = 1.39, P = .206, d = 0.07; t(692,905) = 0.36, P = .971, d = 0.0) nor higher user experience (t(177,596) = 0.21, P = .831, d = 0.02; (t(794) = 1.28, P = .202, d = 0.12; χ2 (659,141) = 2.83, P = .091). Players of the renewed version (Sample B) experienced significant improvements in affective (t(175) = 3.01, P = .003, d = 0.23) and cognitive well-being (t(175) = 3.48, P = <.001, d = 0.26) over the course of three weeks. The renewed version Grow It! has the potential to enhance youths' affective and cognitive well-being. However, adding real-time insights did not seem to affect app engagement nor user experience.

Recall bias of students' affective experiences in adolescence: The role of personality and internalizing behavior

INTRODUCTION

Adolescence is characterized by multiple biopsychosocial changes, associated with a high intraindividual variability of emotional experiences. Previous findings suggest that this intraindividual variability is reflected in a recall bias of adolescents' emotion reports. However, corresponding findings are scarce and inconclusive. Studies on predictors of recall bias in adulthood indicate that personality traits, especially neuroticism and extraversion, as well as specific internalizing disorders might affect recall bias of emotion reports.

METHODS

The sample consists of 118 Swiss adolescent students in grade 8 and 9 (M_age  = 15.15, SD_age  = 0.89). The students' momentary affective experience was recorded using smartphones over seven consecutive days in situ at 42 randomly generated occasions (six per day), with a total of 1059 protocols on current events. At the end of the experience-sampling phase, students filled out an online questionnaire, providing information about their personality and typical behavior as well as their retrospective affective experience. In addition, the students' behavior was evaluated by their teachers. We applied two-level structural equation modeling with latent difference variables.

RESULTS

Adolescents high in extraversion showed retrospective overestimation of positive affective experiences and underestimation of negative affective experiences. Adolescents with high neuroticism tended to overestimate negative affect retrospectively, showing no significant effects for positive affect. However, internalizing behavior did not predict a negative recall bias in adolescents' affective experience.

CONCLUSIONS

Retrospective self-reports about adolescents' affective experience are biased by relatively stable individual factors, whereas less stable individual factors did not seem to have any influence.

Three Quarks for Hypersexuality Research

In some areas of sex research, we note room for methodological improvement of research practices. In particular, in the field of hypersexuality research, where societal norms have been influential, methodological improvement might advance goals of objectivity in research. We propose that hypersexuality research should: firstly, take into account relevant subpopulations; secondly, use Item Response Theory (IRT) to construct item banks for measurement instruments; and, thirdly, measure sexual desire and related important constructs where and how they play out—in daily life, changing from moment to moment. We show that comparing relevant subpopulations can lead to depathologizing normative, but highly frequent, sexual behavior. Using IRT can lead to more precise measurement instruments by assessment of characteristics of individual items. Measuring sexual desire as an inherently fluctuating process in everyday life, and as part of emotion regulation processes, can direct research towards relevant associations other research methods might miss. Bringing into practice our three proposals for improvement can procure a number of advantages. We illustrate these advantages mainly for the field of hypersexuality research, but our suggestions might also be beneficial for sex research in general.

Are Retrospective Assessments Means of People's Experiences?: Accounting for Interpersonal and Intrapersonal Variability when Comparing Retrospective Assessment Data to Ecological Momentary Assessment Data

Retrospective Assessment (RA) scores are often found to be higher than the mean of Ecological Momentary Assessment (EMA) scores about a concurrent period. This difference is generally interpreted as bias towards salient experiences in RA. During RA participants are often asked to summarize their experiences in unspecific terms, leaving room for personal interpretation. As a result, participants may use various strategies to summarize their experiences. In this study, we reanalyzed an existing dataset (N = 92) using a repeated N = 1 approach. We assessed for each participant whether it was likely that their RA score was an approximation of the mean of their experiences as captured by their EMA scores. We found considerable interpersonal differences in the difference between EMA scores and RA scores, as well as some extreme cases. Furthermore, for a considerable part of the sample (n = 46 for positive affect, n = 56 for negative affect), we did not reject the null hypothesis that their RA score represented the mean of their experiences as captured by their EMA scores. We conclude that in its current unspecific form RA may facilitate bias, although not for everyone. Future studies may determine whether differences between RA and EMA are mitigated using more specific forms of RA, while acknowledging interindividual differences.