A Review of Current Ambulatory Assessment Studies in Adolescent Samples and Practical Recommendations

Burden and Inattentive Responding in a 12-Month Intensive Longitudinal Study: Interview Study Among Young Adults

BACKGROUND

Intensive longitudinal data (ILD) collection methods have gained popularity in social and behavioral research as a tool to better understand behavior and experiences over time with reduced recall bias. Engaging participants in these studies over multiple months and ensuring high data quality are crucial but challenging due to the potential burden of repeated measurements. It is suspected that participants may engage in inattentive responding (IR) behavior to combat burden, but the processes underlying this behavior are unclear as previous studies have focused on the barriers to compliance rather than the barriers to providing high-quality data.

OBJECTIVE

This study aims to broaden researchers' knowledge about IR during ILD studies using qualitative analysis and uncover the underlying IR processes to aid future hypothesis generation.

METHODS

We explored the process of IR by conducting semistructured qualitative exit interviews with 31 young adult participants (aged 18-29 years) who completed a 12-month ILD health behavior study with daily evening smartphone-based ecological momentary assessment (EMA) surveys and 4-day waves of hourly EMA surveys. The interviews assessed participants' motivations, the impact of time-varying contexts, changes in motivation and response patterns over time, and perceptions of attention check questions (ACQs) to understand participants' response patterns and potential factors leading to IR.

RESULTS

Thematic analysis revealed 5 overarching themes on factors that influence participant engagement: (1) friends and family also had to tolerate the frequent surveys, (2) participants tried to respond to surveys quickly, (3) the repetitive nature of surveys led to neutral responses, (4) ACQs within the surveys helped to combat overly consistent response patterns, and (5) different motivations for answering the surveys may have led to different levels of data quality.

CONCLUSIONS

This study aimed to examine participants' perceptions of the quality of data provided in an ILD study to contribute to the field's understanding of engagement. These findings provide insights into the complex process of IR and participant engagement in ILD studies with EMA. The study identified 5 factors influencing IR that could guide future research to improve EMA survey design. The identified themes offer practical implications for researchers and study designers, including the importance of considering social context, the consideration of dynamic motivations, and the potential benefit of including ACQs as a technique to reduce IR and leveraging the intrinsic motivators of participants. By incorporating these insights, researchers might maximize the scientific value of their multimonth ILD studies through better data collection protocols.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

RR2-10.2196/36666.

Loneliness in daily life: A comparison between youths with autism spectrum disorders and 22q11.2 deletion syndrome (22q11DS)

Loneliness is a negative emotional experience that can stem from a gap between desires and the reality of social relationships. It is also a predictor of mental health. Loneliness is therefore important to investigate in neurodevelopmental populations known for having difficulties in the social sphere. This co-registered study involved 48 youths with autism spectrum disorders (ASD), 54 youths with 22q11.2 deletion syndrome (22q11DS) and 65 typically developing youths (TD) aged 12-30. State loneliness was assessed with an ecological momentary assessment. Paper-pencil questionnaires assessing attitude toward aloneness, trait loneliness, and mental health, were completed by the youths and their caregivers. A comparable level of state loneliness between clinical groups and TD were found, with greater loneliness when alone than in a social context. Clinical groups showed a greater intra-individual variability. Both individuals with ASD and 22q11DS revealed a greater affinity toward being alone than TD, but only individuals with ASD reported greater trait loneliness. However, no significant association was found between attitude toward aloneness, trait and state loneliness. Emotional reactivity to loneliness was different between the clinical groups. Self-reported mental health only was associated with loneliness in the clinical groups. These results provide new insights into the understanding of loneliness in these clinical populations and have an impact on clinical care by highlighting the need to remain vigilant when encountering youths who report feeling lonely, and that these youths need to be supported in developing their social network, which appears to be a protective factor against loneliness.

Better, for worse, or both? Testing environmental sensitivity models with parenting at the level of individual families

According to environmental sensitivity models, children vary in responsivity to parenting. However, different models propose different patterns, with responsivity to primarily: (1) adverse parenting (adverse sensitive); or (2) supportive parenting (vantage sensitive); or (3) to both (differentially susceptible). This preregistered study tested whether these three responsivity patterns coexist. We used intensive longitudinal data of Dutch adolescents (N = 256, Mage = 14.8, 72% female) who bi-weekly reported on adverse and supportive parenting and their psychological functioning (tmean = 17.7, tmax = 26). Dynamic Structural Equation Models (DSEM) indeed revealed differential parenting effects. As hypothesized, we found that all three responsivity patterns coexisted in our sample: 5% were adverse sensitive, 3% vantage sensitive, and 26% differentially susceptible. No adolescent appeared unsusceptible, however. Instead, we labeled 28% as unperceptive, because they did not perceive any changes in parenting and scored lower on trait environmental sensitivity than others. Furthermore, unexpected patterns emerged, with 37% responding contrary to parenting theories (e.g., decreased psychological functioning after more parental support). Sensitivity analyses with concurrent effects and parent-reported parenting were performed. Overall, findings indicate that theorized responsivity-to-parenting patterns might coexist in the population, and that there are other, previously undetected patterns that go beyond environmental sensitivity models.

Changes in adolescents' daily-life solitary experiences during the COVID-19 pandemic: an experience sampling study

BACKGROUND

Adolescent solitude was drastically impacted by the COVID-19 pandemic. As solitude is crucial for adolescent development through its association with both positive and negative developmental outcomes, it is critical to understand how adolescents' daily-life solitary experiences changed as a result of the pandemic.

METHODS

Using three waves of Experience Sampling Method data from a longitudinal study, we compared adolescents' daily-life solitary experiences in the early (nT1=100; MAge=16.1; SDAge=1.9; 93% girls) and mid-pandemic (nT2=204; MAge=16.5; SDAge=2.0; 79% girls) to their pre-pandemic experiences.

RESULTS

We found that adolescents with lower levels of pre-pandemic social support and social skills reported wanting to be alone less and feeling like an outsider more at both time points during the pandemic. In the mid-pandemic wave, adolescents with higher levels of pre-pandemic social support and social skills reported decreases in positive affect compared to the pre-pandemic wave.

CONCLUSION

This study shows that adolescents' daily-life solitary experiences worsened throughout the COVID-19 pandemic. There should be continued concern for the wellbeing of all adolescents, not only those already at risk, as effects of the pandemic on mental health might only manifest later.

Applications of the experience sampling method (ESM) in paediatric healthcare: a systematic review

BACKGROUND

With the Experience Sampling Method (ESM) participants are asked to provide self-reports of their symptoms, feelings, thoughts and behaviours in daily life. This preregistered systematic review assessed how ESM is being used to monitor emotional well-being, somatic health, fatigue and pain in children and adolescents with a chronic somatic illness.

METHODS

Databases were searched from inception. Studies were selected if they included children or adolescents aged 0-25 years with a chronic somatic illness and used ESM focussing on mental health or psychosocial wellbeing, biopsychosocial factors and/or somatic health. Two reviewers extracted data of the final 47 papers, describing 48 studies.

RESULTS

Most studies evaluated what factors influence medical or psychological symptoms and how symptoms influence each other. Another common purpose was to study the feasibility of ESM or ESM as part of an app or intervention. Study methods were heterogeneous and most studies lack adequate reporting of ESM applications and results.

CONCLUSIONS

While ESM holds great potential for providing results and feedback to patients and caregivers, little use is being made of this option. Future studies should consider what they report in their studies, conduct a priori power analyses and how ESM can be embedded in clinical practice.

IMPACT

While ESM has many clinical applications, it is currently mostly used for research purposes. Current studies using ESM are heterogeneous and lack consistent, high-quality reporting. There is great potential in ESM for providing patients and parents with personalised feedback.

Self-regulatory control processes in youths: A temporal network analysis approach

Objective

This study aimed to better understand the temporal interrelationships among self-control, response inhibition, and anger (i.e., momentary state and rumination) on both the within- and between-person levels in male adolescents.

Method

We applied temporal network analyses among 62 male adolescents with a wide range of behavioral difficulties. Self-control, momentary anger, and anger rumination were mapped by self-report measures, whereas we measured response inhibition through an ambulatory Go/No-go task (two measures a day-morning and afternoon-over a 9-day period).

Results

Temporal network analysis, at the within-person level, revealed that morning measures of response inhibition, anger rumination, and self-control were related to the corresponding measure in the afternoon. More efficient response inhibition in the morning was associated with higher self-control in the afternoon. Higher anger rumination in the morning led to higher momentary anger in the afternoon. In a concurrent within-person network, higher momentary anger was reciprocally associated with lower self-control. At the between-person level, higher momentary anger was correlated to higher anger rumination, lower response inhibition, and lower self-control.

Discussion

This study provides insight into the dynamic interactions among self-control, response inhibition, and anger (momentary state and rumination) in male adolescents, advancing the understanding of self-regulatory control functioning.

Using ecological momentary assessment and machine learning techniques to predict depressive symptoms in emerging adults

The objective of this study was to predict the level of depressive symptoms in emerging adults by analyzing sociodemographic variables, affect, and emotion regulation strategies. Participants were 33 emerging adults (M = 24.43; SD = 2.80; 56.3 % women). They were asked to assess their current emotional state (positive or negative affect), recent events that may relate to that state, and emotion regulation strategies through ecological momentary assessment. Participants were prompted randomly by an app 6 times per day between 10 am and 10 pm for a seven-day period. They answered 1233 of the 2058 surveys (beeps), collectively. The analysis of observations, using Machine Learning (ML) techniques, showed that the Random Forest algorithm yields significantly better predictions than other models. The algorithm used 13 out of the 36 variables adopted in the study. Furthermore, the study revealed that age, emotion of worried and a specific emotion regulation strategy related to social exchange were the most accurate predictors of severe depressive symptoms. By carefully selecting predictors and utilizing appropriate sorting techniques, these findings may provide valuable supplementary information to traditional diagnostic methods and psychological assessments.

Real-time personalized feedback in mHealth for adolescents

Mobile Health (mHealth) interventions have the potential to improve early identification, prevention, and treatment of mental health problems. Grow It! is a multiplayer smartphone app designed for youth aged 12-25, allowing them to monitor their emotions and engage in daily challenges based on Cognitive Behavioral Therapy (CBT) principles. Recently, a personalized mood profile was added to improve the app. We investigated whether real-time personalized feedback on mood enhances app engagement, user experience, and the effects on affective and cognitive well-being. Sample A (N = 1269, age = 18.60 SD = 3.39, 80.6% girls, 95.4% Dutch) played the original app without feedback on their mood, and an independent Sample B (N = 386, age = 16.04 SD = 3.21, 67.6% girls, 82.9% Dutch) received the renewed version with personalized real-time feedback on their mood. Participants who received personal feedback did not have higher app engagement (t(1750,400) = 1.39, P = .206, d = 0.07; t(692,905) = 0.36, P = .971, d = 0.0) nor higher user experience (t(177,596) = 0.21, P = .831, d = 0.02; (t(794) = 1.28, P = .202, d = 0.12; χ2 (659,141) = 2.83, P = .091). Players of the renewed version (Sample B) experienced significant improvements in affective (t(175) = 3.01, P = .003, d = 0.23) and cognitive well-being (t(175) = 3.48, P = <.001, d = 0.26) over the course of three weeks. The renewed version Grow It! has the potential to enhance youths' affective and cognitive well-being. However, adding real-time insights did not seem to affect app engagement nor user experience.

State-level working memory and dysregulated eating in children and adolescents: An exploratory ecological momentary assessment study

BACKGROUND

Children with loss of control (LOC) eating and overweight/obesity have relative deficiencies in trait-level working memory (WM), which may limit adaptive responding to intra- and extra-personal cues related to eating. Understanding of how WM performance relates to eating behavior in real-time is currently limited.

METHODS

We studied 32 youth (ages 10-17 years) with LOC eating and overweight/obesity (LOC-OW; n = 9), overweight/obesity only (OW; n = 16), and non-overweight status (NW; n = 7). Youth completed spatial and numerical WM tasks requiring varying degrees of cognitive effort and reported on their eating behavior daily for 14 days via smartphone-based ecological momentary assessment. Linear mixed effects models estimated group-level differences in WM performance, as well as associations between contemporaneously completed measures of WM and dysregulated eating.

RESULTS

LOC-OW were less accurate on numerical WM tasks compared to OW and NW (ps < .01); groups did not differ on spatial task accuracy (p = .41). Adjusting for between-subject effects (reflecting differences between individuals in their mean WM performance and its association with eating behavior), within-subject effects (reflecting variations in moment-to-moment associations) revealed that more accurate responding on the less demanding numerical WM task, compared to one's own average, was associated with greater overeating severity across the full sample (p = .013). There were no associations between WM performance and LOC eating severity (ps > .05).

CONCLUSIONS

Youth with LOC eating and overweight/obesity demonstrated difficulties mentally retaining and manipulating numerical information in daily life, replicating prior laboratory-based research. Overeating may be related to improved WM, regardless of LOC status, but temporality and causality should be further explored.

PUBLIC SIGNIFICANCE STATEMENT

Our findings suggest that youth with loss of control eating and overweight/obesity may experience difficulties mentally retaining and manipulating numerical information in daily life relative to their peers with overweight/obesity and normal-weight status, which may contribute to the maintenance of dysregulated eating and/or elevated body weight. However, it is unclear whether these individual differences are related to eating behavior on a moment-to-moment basis.

A smartphone-based intervention for young people who self-harm ('PRIMARY'): study protocol for a multicenter randomized controlled trial

BACKGROUND

Self-harm in young people is a public health concern connected with severe mental health problems, such as personality pathology. Currently, there are no specific evidence-based interventions available for young people who self-harm. Therefore, we developed PRe-Intervention Monitoring of Affect and Relationships in Youth (PRIMARY), a smartphone-based intervention, co-designed by clinicians and young people with lived experience of mental ill-health. PRIMARY combines the Experience Sampling Method (ESM) with weekly report sessions. The study aims to examine the effectiveness of PRIMARY with regard to reducing self-harm, and improving emotion regulation and quality of relationships.

METHODS

This study is a multicenter, parallel groups, randomized controlled trial (RCT) comparing the PRIMARY intervention to a waiting list control group. PRIMARY comprises 28 consecutive days of questionnaires five times each day (i.e., ESM) and four weekly report sessions. Participants will comprise 180 young people referred for treatment to the participating Dutch mental healthcare institutions and (1) are aged 12 to 25 years, and (2) engaged in ≥ 1 act of self-harm in the past year. Participants are randomly allocated to a study group after screening in a 1:1 ratio by an independent researcher using computer-generated randomization sequences with stratified block randomization by age (12 to 15 years / 16 to 25 years). Staff will conduct assessments with all participants at baseline (Wave 1), after 28 days (Wave 2), and in a subsample after 10 weeks of subsequent specialized treatment (Wave 3). The primary outcomes are self-harm, emotion regulation, and quality of relationships. Secondary outcomes include patient and clinician satisfaction. Exploratory analyses of ESM data will examine the relationship between emotions, social relationships, and self-harm.

DISCUSSION

The results of this trial will clarify whether an innovative smartphone-based intervention is effective for reducing self harm and improving emotion regulation and the quality of social relationships. It has the potential to fill a treatment gap of interventions specifically targeting self-harm. If proven effective, it would provide an accessible, easy-to-implement, low-cost intervention for young people. Furthermore, the ESM-data will allow detailed analyses into the processes underlying self-harm, which will contribute to theoretical knowledge regarding the behavior.

TRIAL REGISTRATION

ISRCTN42088538 ( https://doi.org/10.1186/ISRCTN42088538 ), retrospectively registered on the 26th of October 2022.

A moment of autonomy support brightens adolescents' mood: Autonomy support, psychological control and adolescent affect in everyday life

This experience sampling study examined whether autonomy-supportive and psychologically controlling interactions with parents are intertwined with adolescents' momentary affect. For 7 days (in 2020), 143 adolescents (Mage  = 15.82; SDage  = 1.75; 64% girls; 95% European, 1% African, 3% unknown) reported 5 or 6 times a day how they felt and how interactions with parents were experienced. Preregistered dynamic structural equation models on 1439 (including 532 adjacent) parent-adolescent interactions revealed significant within-family associations: Adolescents experienced more positive affect during and following autonomy-supportive interactions, and vice versa. Adolescents felt more negative affect during and 3 h before psychologically controlling interactions. Between-family associations showed significant linkages between parenting and affect. These findings show that a moment of autonomy support can alter adolescents' everyday well-being.

The effect of universal school-based mindfulness on anhedonia and emotional distress and its underlying mechanisms: A cluster randomised controlled trial via experience sampling in secondary schools

This cluster randomised controlled trial examined the effectiveness of universal school-based mindfulness training (MT; vs. passive control) to lower anhedonia and emotional distress among mid-adolescents (15-18 years). It further examined three potential mechanisms: dampening of positive emotions, non-acceptance/suppression of negative emotions, and perceived social pressure not to experience/express negative emotions. Adolescents (ncontrol = 136, nintervention = 95) participated in three assessment points (before, after and two/three months after the in-class MT), consisting of Experience Sampling (ES) assessments and self-report questionnaires (SRQs) to corroborate the ES assessments. Analyses were based on general linear modelling and multilevel modelling. Overall, no evidence was found for a significant beneficial and long-lasting impact of the MT on adolescents' mental health. Importantly, some barriers inherently linked to universal MT approaches (low engagement in and mixed attitudes towards the MT) may have tempered the effectiveness of the MT in the current trial. Further research should prioritise overcoming these barriers to optimise programme implementation. Additionally, given the potential complex interplay of moderators at micro- (home practice), meso- (school climate), and macro-level (broader context), research should simultaneously focus on alternative ways of delivering MT at schools to strengthen adolescents' mental health.

How to explore within-person and between-person measurement model differences in intensive longitudinal data with the R package lmfa

Intensive longitudinal data (ILD) have become popular for studying within-person dynamics in psychological constructs (or between-person differences therein). Before investigating the dynamics, it is crucial to examine whether the measurement model (MM) is the same across subjects and time and, thus, whether the measured constructs have the same meaning. If the MM differs (e.g., because of changes in item interpretation or response styles), observations cannot be validly compared. Exploring differences in the MM for ILD can be done with latent Markov factor analysis (LMFA), which classifies observations based on the underlying MM (for many subjects and time points simultaneously) and thus shows which observations are comparable. However, the complexity of the method or the fact that no open-source software for LMFA existed until now may have hindered researchers from applying the method in practice. In this article, we provide a step-by-step tutorial for the new user-friendly software package lmfa, which allows researchers to easily perform the analysis LMFA in the freely available software R to investigate MM differences in their own ILD.

Ecological and Convergent Validity of Experimentally and Dynamically Assessed Capacity for Social Contingency Detection Using the Perceptual Crossing Experiment in Adolescence

The Perceptual Crossing Experiment (PCE) captures the capacity for social contingency detection using real-time social interaction dynamics but has not been externally validated. We tested ecological and convergent validity of the PCE in a sample of 208 adolescents from the general population, aged 11 to 19 years. We expected associations between PCE performance and (a) quantity and quality of social interaction in daily life, using Experience Sampling Methodology (ESM; ecological validity) and (b) self-reported social skills using a questionnaire (convergent validity). We also expected PCE performance to better explain variance in ESM social measures than self-reported social skills. Multilevel analyses showed that only self-reported social skills were positively associated with social experience of company in daily life. These initial results do not support ecological and convergent validity of the PCE. However, fueled by novel insights regarding the complexity of capturing social dynamics, we identified promising methodological advances for future validation efforts.

Ecological Momentary Assessment: A Meta-Analysis on Designs, Samples, and Compliance Across Research Fields

Ecological Momentary Assessments (i.e., EMA, repeated assessments in daily life) are widespread in many fields of psychology and related disciplines. Yet, little knowledge exists on how differences in study designs and samples predict study compliance and dropout-two central parameters of data quality in (micro-)longitudinal research. The current meta-analysis included k = 477 articles (496 samples, total N = 677,536). For each article, we coded the design, sample characteristics, compliance, and dropout rate. The results showed that on average EMA studies scheduled six assessments per day, lasted for 7 days, and obtained a compliance of 79%. Studies with more assessments per day scheduled fewer assessment days, yet, the number of assessments did not predict compliance or dropout rates. Compliance was significantly higher in studies providing financial incentives. Otherwise, design or sample characteristics had little effects. We discuss the implications of the findings for planning, reporting, and reviewing EMA studies.

Smartphone-Tracked Digital Markers of Momentary Subjective Stress in College Students: Idiographic Machine Learning Analysis

BACKGROUND

Stress is an important predictor of mental health problems such as burnout and depression. Acute stress is considered adaptive, whereas chronic stress is viewed as detrimental to well-being. To aid in the early detection of chronic stress, machine learning models are increasingly trained to learn the quantitative relation from digital footprints to self-reported stress. Prior studies have investigated general principles in population-wide studies, but the extent to which the findings apply to individuals is understudied.

OBJECTIVE

We aimed to explore to what extent machine learning models can leverage features of smartphone app use log data to recognize momentary subjective stress in individuals, which of these features are most important for predicting stress and represent potential digital markers of stress, the nature of the relations between these digital markers and stress, and the degree to which these relations differ across people.

METHODS

Student participants (N=224) self-reported momentary subjective stress 5 times per day up to 60 days in total (44,381 observations); in parallel, dedicated smartphone software continuously logged their smartphone app use. We extracted features from the log data (eg, time spent on app categories such as messenger apps and proxies for sleep duration and onset) and trained machine learning models to predict momentary subjective stress from these features using 2 approaches: modeling general relations at the group level (nomothetic approach) and modeling relations for each person separately (idiographic approach). To identify potential digital markers of momentary subjective stress, we applied explainable artificial intelligence methodology (ie, Shapley additive explanations). We evaluated model accuracy on a person-to-person basis in out-of-sample observations.

RESULTS

We identified prolonged use of messenger and social network site apps and proxies for sleep duration and onset as the most important features across modeling approaches (nomothetic vs idiographic). The relations of these digital markers with momentary subjective stress differed from person to person, as did model accuracy. Sleep proxies, messenger, and social network use were heterogeneously related to stress (ie, negative in some and positive or zero in others). Model predictions correlated positively and statistically significantly with self-reported stress in most individuals (median person-specific correlation=0.15-0.19 for nomothetic models and median person-specific correlation=0.00-0.09 for idiographic models).

CONCLUSIONS

Our findings indicate that smartphone log data can be used for identifying digital markers of stress and also show that the relation between specific digital markers and stress differs from person to person. These findings warrant follow-up studies in other populations (eg, professionals and clinical populations) and pave the way for similar research using physiological measures of stress.

Common Elements Approaches to Implementation Research and Practice: Methods and Integration with Intervention Science

We propose that common elements approaches can advance implementation research and practice and facilitate pragmatic use of intervention and implementation evidence. Common elements are practices or processes frequently shared by interventions or implementations. Traditional common elements methodologies use synthesis, distillation, and statistics to describe and evaluate the merit of common ingredients in effective interventions. Recent developments include identifying and testing common configurations of elements, processes, and context variables across the literature of effective interventions and implementations. While common elements thinking has grown popular in intervention science, it has rarely been utilized in implementation science, and specifically, combined with the intervention literature. The goals of this conceptual methodology paper are to (1) provide an overview of the common elements concept and how it may advance implementation research and usability for practice, (2) give a step-by-step guide to systematic common elements reviews that synthesizes and distills the intervention and implementation literature together, and (3) offer recommendations for advancing element-level evidence in implementation science. A narrative review of the common elements literature was conducted with attention to applications to implementation research. A six-step guide to using an advanced common elements methodology was provided. Examples of potential results are presented, along with a review of the implications for implementation research and practice. Finally, we reviewed methodological limitations in current common elements approaches, and identified steps towards realizing their potential. Common elements methodologies can (a) synthesize and distill the implementation science literature into practical applications, (b) generate evidence-informed hypotheses about key elements and determinants in implementation and intervention processes and mechanisms, and (c) promote evidence-informed precision tailoring of intervention and implementation to context. To realize this potential, common elements approaches need improved reporting of details from both successful and unsuccessful intervention and implementation research, more data availability, and more testing and investigation of causal processes and mechanisms of change from diverse theories.

Supplementary Information

The online version contains supplementary material available at 10.1007/s43477-023-00077-4.

Evaluating Covariate Effects on ESM Measurement Model Changes with Latent Markov Factor Analysis: A Three-Step Approach

Invariance of the measurement model (MM) between subjects and within subjects over time is a prerequisite for drawing valid inferences when studying dynamics of psychological factors in intensive longitudinal data. To conveniently evaluate this invariance, latent Markov factor analysis (LMFA) was proposed. LMFA combines a latent Markov model with mixture factor analysis: The Markov model captures changes in MMs over time by clustering subjects' observations into a few states and state-specific factor analyses reveal what the MMs look like. However, to estimate the model, Vogelsmeier, Vermunt, van Roekel, and De Roover (2019) introduced a one-step (full information maximum likelihood; FIML) approach that is counterintuitive for applied researchers and entails cumbersome model selection procedures in the presence of many covariates. In this paper, we simplify the complex LMFA estimation and facilitate the exploration of covariate effects on state memberships by splitting the estimation in three intuitive steps: (1) obtain states with mixture factor analysis while treating repeated measures as independent, (2) assign observations to the states, and (3) use these states in a discrete- or continuous-time latent Markov model taking into account classification errors. A real data example demonstrates the empirical value.

Unraveling the Bidirectional Associations between Parental Knowledge and Children's Externalizing Behavior

Although within- and between-family bidirectional associations between parental knowledge and children's externalizing behavior have been theoretically proposed, studies that unravel these associations simultaneously remain scarce. This study examined these bidirectional associations within and between German families. 3611 families participated across one-year intervals between children ages 8 to 15 (50.6% boys, 34.5% fathers, 89.0% German-born, M_waves = 3.63, SD_waves = 2.00). Random intercept cross-lagged panel models (RI-CLPM) with linear slopes revealed negative between-family associations between parental knowledge and children's externalizing behavior, and a negative association between the random linear slopes. Generally, no within-family cross-lagged effects were found, but there were some correlated slopes across families. When teasing apart paternal and maternal knowledge, father-driven but not mother-driven lagged effects of increased knowledge predicting decreased externalizing behavior were found. The findings illustrate the importance of fathers' knowledge and new directions for within-family studies of parent-child interactions.

Promoting Daily Well-being in Adolescents using mHealth

Adolescents are at increased risk for developing mental health problems. The Grow It! app is an mHealth intervention aimed at preventing mental health problems through improving coping by cognitive behavioral therapy (CBT)-inspired challenges as well as self-monitoring of emotions through Experience Sampling Methods (ESM). Yet, little is known about daily changes in well-being and coping during a stressful period, like the COVID-19 pandemic. The current study aimed to elucidate daily changes in positive and negative affect, and adaptive coping, and to better understand the within-person's mechanisms of the Grow It! app. The sample consisted of 12-25-year old Dutch adolescents in two independent cohorts (cohort 1: N = 476, Mage = 16.24, 76.1% female, 88.7% Dutch; cohort 2: N = 814, Mage = 18.45, 82.8% female, 97.2% Dutch). ESM were used to measure daily positive and negative affect and coping (cohort 1: 42 days, 210 assessments per person; cohort 2: 21 days, 105 assessments). The results showed that, on average, adolescents decreased in daily positive affect and adaptive coping, and increased in their experienced negative affect. A positive relation between adaptive coping and positive affect was found, although independent of the CBT-based challenges. Latent class analysis identified two heterogeneous trajectories for both positive and negative affect, indicating that the majority of participants with low to moderate-risk on developing mental health problems were likely to benefit from the Grow It! app.

Digitale Phänotypisierung in der Psychologie – ein Quantensprung in der psychologischen Forschung?

Zusammenfassung. Digitale Phänotypisierung stellt einen neuen, leistungsstarken Ansatz zur Realisierung psychodiagnostischer Aufgaben in vielen Bereichen der Psychologie und Medizin dar. Die Grundidee besteht aus der Nutzung digitaler Spuren aus dem Alltag, um deren Vorhersagekraft für verschiedenste Anwendungsmöglichkeiten zu überprüfen und zu nutzen. Voraussetzungen für eine erfolgreiche Umsetzung sind elaborierte Smart Sensing Ansätze sowie Big Data-basierte Extraktions- (Data Mining) und Machine Learning-basierte Analyseverfahren. Erste empirische Studien verdeutlichen das hohe Potential, aber auch die forschungsmethodischen sowie ethischen und rechtlichen Herausforderungen, um über korrelative Zufallsbefunde hinaus belastbare Befunde zu gewinnen. Hierbei müssen rechtliche und ethische Richtlinien sicherstellen, dass die Erkenntnisse in einer für Einzelne und die Gesellschaft als Ganzes wünschenswerten Weise genutzt werden. Für die Psychologie als Lehr- und Forschungsdomäne bieten sich durch Digitale Phänotypisierung vielfältige Möglichkeiten, die zum einen eine gelebte Zusammenarbeit verschiedener Fachbereiche und zum anderen auch curriculare Erweiterungen erfordern. Die vorliegende narrative Übersicht bietet eine theoretische, nicht-technische Einführung in das Forschungsfeld der Digitalen Phänotypisierung, mit ersten empirischen Befunden sowie einer Diskussion der Möglichkeiten und Grenzen sowie notwendigen Handlungsfeldern.

A Web-Based Application for Personalized Ecological Momentary Assessment in Psychiatric Care: User-Centered Development of the PETRA Application

BACKGROUND

Smartphone self-monitoring of mood, symptoms, and contextual factors through ecological momentary assessment (EMA) provides insights into the daily lives of people undergoing psychiatric treatment. Therefore, EMA has the potential to improve their care. To integrate EMA into treatment, a clinical tool that helps clients and clinicians create personalized EMA diaries and interpret the gathered data is needed.

OBJECTIVE

This study aimed to develop a web-based application for personalized EMA in specialized psychiatric care in close collaboration with all stakeholders (ie, clients, clinicians, researchers, and software developers).

METHODS

The participants were 52 clients with mood, anxiety, and psychotic disorders and 45 clinicians (psychiatrists, psychologists, and psychiatric nurses). We engaged them in interviews, focus groups, and usability sessions to determine the requirements for an EMA web application and repeatedly obtained feedback on iteratively improved high-fidelity EMA web application prototypes. We used human-centered design principles to determine important requirements for the web application and designed high-fidelity prototypes that were continuously re-evaluated and adapted.

RESULTS

The iterative development process resulted in Personalized Treatment by Real-time Assessment (PETRA), which is a scientifically grounded web application for the integration of personalized EMA in Dutch clinical care. PETRA includes a decision aid to support clients and clinicians with constructing personalized EMA diaries, an EMA diary item repository, an SMS text message-based diary delivery system, and a feedback module for visualizing the gathered EMA data. PETRA is integrated into electronic health record systems to ensure ease of use and sustainable integration in clinical care and adheres to privacy regulations.

CONCLUSIONS

PETRA was built to fulfill the needs of clients and clinicians for a user-friendly and personalized EMA tool embedded in routine psychiatric care. PETRA is unique in this codevelopment process, its extensive but user-friendly personalization options, its integration into electronic health record systems, its transdiagnostic focus, and its strong scientific foundation in the design of EMA diaries and feedback. The clinical effectiveness of integrating personalized diaries via PETRA into care requires further research. As such, PETRA paves the way for a systematic investigation of the utility of personalized EMA for routine mental health care.

Examining food intake similarities in adolescent best friend dyads using longitudinal Actor-Partner Interdependence Models

Little is known about how adolescent best friends may affect each other's food intake. This study explored whether friendship selection and socialization mechanisms explained potential food intake similarities in adolescent reciprocated best friend dyads. We also tested whether socialization processes were moderated by dyad member's relative zBMI. Members of 145 same-gender best friendship dyads (56% female; Mage = 12.79; SDage = 0.61) reported on their intake of food obtained from home and from outside the home at the beginning and the end of the school year through food frequency questionnaires. Longitudinal Actor-Partner Interdependence Models results showed no indication of selection or socialization, and very limited evidence for the moderation of socialization processes by relative zBMI. These findings indicate that focusing on adolescent reciprocated best friends in dietary interventions may not be valuable.

The Grow It! app-longitudinal changes in adolescent well-being during the COVID-19 pandemic: a proof-of-concept study

Adolescent mental health and well-being have been adversely impacted by the COVID-19 pandemic. In this preregistered longitudinal study, we evaluated whether adolescents' well-being improved after playing the multiplayer serious game app Grow It! During the first lockdown (May-June 2020), 1282 Dutch adolescents played the Grow It! app (age = 16.67, SD = 3.07, 68% girls). During the second lockdown (December-May 2020 onwards), an independent cohort of 1871 adolescents participated (age = 18.66, SD = 3.70, 81% girls). Adolescents answered online questionnaires regarding affective and cognitive well-being, depressive symptoms, anxiety, and impact of COVID-19 at baseline. Three to six weeks later, the baseline questionnaire was repeated and user experience questions were asked (N = 462 and N = 733 for the first and second cohort). In both cohorts, affective and cognitive well-being increased after playing the Grow It! app (t = - 6.806, p < 0.001; t = - 6.77, p < 0.001; t = - 6.12, p < 0.001; t = - 5.93, p < 0.001; Cohen's d range 0.20-0.32). At the individual level, 41-53% of the adolescents increased in their affective or cognitive well-being. Adolescents with higher risk profiles (i.e., more depressive symptoms, lower atmosphere at home, and more COVID-19 impact) improved more strongly in their well-being. Positive user evaluations and app engagement were unrelated to changes in affective and cognitive well-being. This proof-of-concept study tentatively suggests that Grow It! supported adolescents during the pandemic.

The Experience Sampling Method in Monitoring Social Interactions Among Children and Adolescents in School: A Systematic Literature Review

Background

The experience sampling method (ESM) is an increasingly popular data collection method to assess interpersonal dynamics in everyday life and emotions contextualized in real-world settings. As primary advantages of ESM sampling strategies include minimization of memory biases, maximization of ecological validity, and hypothesis testing at the between- and within-person levels, ESM is suggested to be appropriate for studying the daily lives of educational actors. However, ESM appears to be underutilized in education research. We, thus, aimed to systematically evaluate the methodological characteristics and quality of published ESM studies of social interactions among children and adolescents in school settings, as well as to explore how much variance in social interaction variables could be attributed to the within-person level.

Method

Using Academic Search Complete, APA PsycINFO, APA PsycArticles, ProQuest, Web of Science, Wiley Online Library, and SAGE Journals, and in accordance with PRISMA guidelines and pre-defined eligibility criteria, we conducted a systematic literature search of experience sampling studies up to November 2020. To assess methodological quality, we used a modified checklist for reporting of ESM studies.

Results

Of the originally 2 413 identified studies, a final 52 experience sampling studies were included in the present review. Findings on sample and study design characteristics generally revealed wide variability. Even if high-quality studies were associated with higher scores on the training of participants in using the ESM procedure, and use of incentives, these design strategies did not reveal a statistically significant impact on compliance. The intraclass correlation coefficient was reported in nine studies and on average 58% of the variance in social interaction variables could be attributed to within-person fluctuation between timepoints.

Conclusion

The current study is the first to systematically review ESM-based studies on social interactions among children and adolescents in the school context. These observations suggest that ESM is a potentially favorable technique for extracting complex social phenomena in real-world settings. We hope that this review will contribute to improving the quality assessment of ESM studies as well as to inform and guide future experience sampling studies, particularly regarding social phenomena with children and adolescents in educational settings.

Child development in real time: The power of ambulatory assessment for investigating dynamic developmental processes and behavior longitudinally

Ambulatory assessment methods used to capture "real-world" microprocesses through self-report or passive data collection are used to assess child and adolescent behavior in context. This chapter begins by introducing the researcher to ambulatory assessment methods and describes these methods for use in child and adolescent developmental and behavioral research. Next, the importance of attention to timing is discussed. We then suggest appropriate analytic methods for putting ambulatory assessment data to best use to answer developmental research questions. We end with comments on the ethics of ambulatory assessment data and some concluding remarks for researchers wanting to use these methods in their own work.

Measuring Adolescents' Self-injurious Thoughts and Behaviors: Comparing Ecological Momentary Assessment to a Traditional Interview

The purpose of this study was to compare adolescents' reports of self-injurious thoughts and behaviors (SITBs) between ecological momentary assessment (EMA) and a traditional, retrospective interview. Adolescents were recruited following recent discharge from acute psychiatric care for a suicidal crisis (as part of a larger study). Participants completed: (1) EMA surveys assessing SITBs multiple times daily over a 28-day follow-up period, and (2) a follow-up phone interview to evaluate SITBs retrospectively at the end of the same 28-day follow-up period. Forty-one adolescents completed the final follow-up interview (M_age = 14.9 years; 78.0% White; 61.0% female). Adolescents' reports of SITB presence (vs. absence) and frequency, collected via EMA and retrospective interview over follow-up, were compared. Preliminary differences in SITB endorsement (presence/absence) were observed between reporting methods with more adolescents endorsing suicide ideation (SI; n = 30) and nonsuicidal self-injury (NSSI; n = 15) in EMA compared to retrospective interview (SI: n = 17; NSSI: n = 10). Reasons for withholding SITBs from EMA reports (gathered during a final qualitative interview) included not wanting to answer additional EMA questions and concerns about EMA-reporting consequences. There were no statistically significant differences in SITB frequency by report method. Further investigation is warranted in a larger sample to elucidate frequency patterns. Given the growing research using this method, these findings are important to help clarify the utility of EMA methods for studying SITBs in youth.

A Smartphone Serious Game for Adolescents (Grow It! App): Development, Feasibility, and Acceptance Study

BACKGROUND

Anxiety and mood problems in adolescents often go unnoticed and may therefore remain untreated. Identifying and preventing the development of emotional problems requires monitoring and effective tools to strengthen adolescents' resilience, for example, by enhancing coping skills.

OBJECTIVE

This study describes the developmental process, feasibility, and acceptance of Grow It!, a multiplayer serious game app for adolescents aged 12-25 years. The app consists of the experience sampling method (ESM) to monitor thoughts, behaviors, and emotions in daily life to enhance self-insight and daily cognitive behavioral therapy-based challenges to promote adaptive coping.

METHODS

Our approach entails an iterative game design process combined with an agile method to develop the smartphone app. The incorporated game features (ie, challenges, chat functionality, and visual representation) in the Grow It! app were co-designed with adolescent end users to increase participant engagement and adherence.

RESULTS

The Grow It! app was delivered for Android and iOS in May 2020. Grow It! was offered to adolescents during the COVID-19 crisis between May and December 2020. Participants of the Grow It! COVID-19 study (sample 1: N=685; mean age 16.19, SD 3.11 years; 193/685, 28.2% boys; sample 2: N=1035; mean age 18.78, SD 3.51 years; 193/1035, 18.64% boys) completed 31.5% (13.2/42) to 49.5% (10.4/21) of challenges. Compliance of ESM was suboptimal (35.1/210, 16.7% to 32.5/105, 30.9%). Follow-up questionnaires indicated an overall score of the app of 7.1 out of 10. Moreover, 72.6% (278/383) to 75.6% (487/644) would recommend the app to friends.

CONCLUSIONS

To our knowledge, Grow It! is the first gamified ESM app that both measures individual differences in emotional dynamics and offers an integrated cognitive behavioral therapy-based intervention. Our findings support the feasibility and acceptance, and therefore applicability, of the Grow It! app in adolescents. Further iterations of this serious game app will focus on the increase of compliance and on providing participants feedback through their personal mood profiles.

Sustained threat and phasic fear in the laboratory and cognitive-emotional processes of anxiety in everyday life - An ambulatory assessment study

Fear is a phasic state of apprehension to an imminent threat, whereas anxiety is a more sustained state of expecting a potential threat leading to tension and worry. The NPU-threat test is a laboratory startle paradigm allowing a reliable and valid assessment of both, fear- and anxiety-potentiated reactions. It is suggested to differentiate between anxiety disorders, but little is known on associations with everyday life experiences of cognitive-emotional processes regarding anxiety in non-clinical samples. In the present project, the NPU-threat test was applied in three studies with (1) unselected healthy individuals, (2) participants with extreme manifestations of trait anxiety (low vs. high) and (3) individuals preparing for a high-stakes exam. Self-reported states of emotionality and worry were assessed during a four-day ambulatory assessment (AA). Overall, NPU-threat test measures did not significantly differ between studies, while the AA dependent measures were sufficiently sensitive to capture differences between groups. However, there was no significant association between psychophysiological measures of the NPU-threat test and AA state measures across participants. In participants recruited for low vs. high trait anxiety we found an association with AA worry and emotionality, but no interaction with potentiated startle. The present findings do not support the idea of a link between our laboratory biomarker and adaptive regulation of cognitive-emotional states in everyday life in healthy individuals. We speculate that an association between laboratory physiological measures and everyday experience of anxious states may be detectable in clinical samples.

Incorporating ecological momentary assessment into multimethod investigations of cognitive aging: Promise and practical considerations

Ecological momentary assessment (EMA) represents a promising approach to study cognitive aging. In contrast to laboratory-based studies, EMA involves the repeated sampling of experiences in daily life contexts, enabling investigators to gain access to dynamic processes (e.g., situational contexts, intraindividual variability) that are likely to strongly contribute to aging and age-related change across the adult life-span. As such, EMA approaches complement the prevailing research methods in the field of cognitive aging (e.g., laboratory-based paradigms, neuroimaging), while also providing the opportunity to replicate and extend findings from the laboratory in more naturalistic contexts. Following an overview of the methodological and conceptual strengths of EMA approaches in cognitive aging research, we discuss best practices for researchers interested in implementing EMA studies. A key goal is to highlight the tremendous potential for combining EMA methods with other laboratory-based approaches, in order to increase the robustness, replicability, and real-world implications of research findings in the field of cognitive aging. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

Parent-adolescent interaction quality and adolescent affect-An experience sampling study on effect heterogeneity

Person–environment interactions might ultimately drive longer term development. This experience sampling study (Data collection: 2019/20 the Netherlands) assessed short‐term linkages between parent–adolescent interaction quality and affect during 2281 interactions of 124 adolescents (M_age = 15.80, SD_age = 1.69, 59% girls, 92% Dutch, Education: 25% low, 31% middle, 35% high, 9% other). Adolescents reported on parent–adolescent interaction quality (i.e., warmth and conflict) and momentary positive and negative affect five to six times a day, for 14 days. Preregistered dynamic structural equation models (DSEM) revealed within‐family associations between parent–adolescent interaction quality and adolescent affect (concurrently: r = −.22 to .39; lagged effects: ß = −.17 to .15). These effects varied significantly between families. These findings stress the need for more person‐specific research on parenting processes.

Dynamics of adolescents' smartphone use and well-being are positive but ephemeral

Well-being and smartphone use are thought to influence each other. However, previous studies mainly focused on one direction (looking at the effects of smartphone use on well-being) and considered between-person effects, with self-reported measures of smartphone use. By using 2548 assessments of well-being and trace data of smartphone use collected for 45 consecutive days in 82 adolescent participants (Mage = 13.47, SDage = 1.62, 54% females), the present study disentangled the reciprocal and individual dynamics of well-being and smartphone use. Hierarchical Bayesian Continuous Time Dynamic Models were used to estimate how a change in frequency and duration of smartphone use predicted a later change in well-being, and vice versa. Results revealed that (i) when participants used the smartphone frequently and for a longer period, they also reported higher levels of well-being; (ii) well-being positively predicted subsequent duration of smartphone use; (iii) usage patterns and system dynamics showed heterogeneity, with many subjects showing reciprocal effects close to zero; finally, (iv) changes in well-being tend to persist longer than changes in the frequency and duration of smartphone use.

Identifying Clusters of Adolescents Based on Their Daily-Life Social Withdrawal Experience

Social withdrawal is often presented as overall negative, with a focus on loneliness and peer exclusion. However, social withdrawal is also a part of normative adolescent development, which indicates that groups of adolescents potentially experience social withdrawal differently from one another. This study investigated whether different groups of adolescents experienced social withdrawal in daily life as positive versus negative, using experience sampling data from a large-scale study on mental health in general population adolescents aged 11 to 20 (n = 1913, M_Age = 13.8, SD_Age = 1.9, 63% female) from the Flemish region in Belgium. Two social withdrawal clusters were identified using model-based cluster analysis: one cluster characterized by high levels of positive affect and one cluster characterized by high levels of negative affect, loneliness and exclusion. Logistic regression showed that boys had 66% decreased odds of belonging to the negative cluster. These results show that daily-life social withdrawal experiences are heterogeneous in adolescence, which strengthens the view that, both in research and clinical practice, social withdrawal should not be seen as necessarily maladaptive.

Creation and validation of the pictorial ecological momentary well-being instrument (EMOWI) for adolescents

PURPOSE

Adolescence is characterized by the ongoing maturation of emotion-regulation skills and increased emotional reactivity. There is a need for a measurement tool suitable to the Ecological Momentary Assessment methodology, to better capture within-day variations in well-being, and provide fine-grained data that can help understand how environments, behaviors, and health intersect. This paper presents the development and evaluation of the Ecological MOmentary Well-Being Instrument for adolescents, designed for use in EMA.

METHODS

A mixed-methods study was conducted, using both qualitative and quantitative approaches, to develop and assess the EMOWI. A literature review, pictorial production by graphic designers, and qualitative interviews with French and Canadian professionals and adolescents helped design and evaluate the scale face validity. Quantitative evaluation of dimensionality, reliability, and validity was conducted in two samples of French 8th graders.

RESULTS

The resulting 8-item EMOWI showed excellent face validity. Confirmatory factor analysis supported a single factor hypothesis (RMSEA = 0.072). Internal consistency (Cronbach's alpha = 0.85) and intraday test-retest reliability (ICC = 0.83) were high. Correlations with existing scales were consistent with preset hypotheses. Ceiling effects were evidenced for all items, yet not on the global score. Quantitative estimations were similar for the verbal and pictorial versions, but qualitative findings argued in favor of the pictorial version.

CONCLUSION

The 8-item pictorial EMOWI is a short and innovative instrument to measure momentary well-being in adolescents aged 12 to 17 years. Its strong psychometric properties and its acceptability among adolescents make it an excellent candidate instrument for the Ecological Momentary Assessment of well-being in this population.

Stay Home, Drink at Home? A Daily Diary Study on College Students' Alcohol and Social Media Use during the COVID-19 Pandemic

BACKGROUND

COVID-19 and measures to contain it may have impacted college students' behavior, including their drinking behavior. Students' drinking may have decreased-for example, due to the closure of bars-but problematic drinking may have increased-for example, due to (solitary) drinking at home. Another behavior that has increased due to COVID-19 and the accompanying social isolation is students' social networking site (SNS) use. This is worrisome because students' SNS use has been shown to increase their alcohol use. Nevertheless, little research has investigated these behaviors and the possible link between them during a lockdown. Therefore, this study aimed to examine (1) whether students engaged in drinking during a lockdown, (2) whether they displayed their drinking behavior on SNSs, and (3) whether exposure to and posting of alcohol-related content was linked to their daily alcohol use.

METHODS

337 college students (M_age = 20.63 years, SD_age = 1.55 years; 50.3% male) participated in a two-week daily diary study. Descriptive statistical analyses and generalized linear mixed modeling (GLMM) were deployed.

RESULTS

Descriptive analysis results showed that during the week, students' drinking occurred with friends in dormitories, while in the weekend, this behavior shifted to drinking with friends and parents at home. Moreover, students mostly saw visual and posted textual posts of this drinking on SNSs. Furthermore, GLMM revealed associations between exposure to alcohol postings, sharing of alcohol postings, and students' probability of drinking on the same day.

CONCLUSION

This study provides important insights into students' alcohol use and its underlying mechanisms during health crises.

The role of self-regulatory control processes in understanding aggressive ideations and behaviors: An experience sampling method study

INTRODUCTION

In this study, we aimed to examine the association between aggressive ideations and aggressive behaviors in everyday life, as well as the role of processes related to self-regulatory control (i.e., self-control, ego depletion, and emotional states), using experience sampling methods (ESM).

METHODS

A total of 62 male adolescents performed a baseline measure of aggression, violent ideations (trait level), and ESM assessments, including four measures per day during nine consecutive days.

RESULTS

At a state level, aggressive ideations were associated with higher negative emotions during the previous day as well as with lower self-control and stronger anger rumination at the moment. Aggressive behaviors were related to higher anger rumination at the moment and to the manifestation of higher intensity of aggressive ideations derived in the previous measure. Higher self-control was related to a lower probability of aggressive behavior.

DISCUSSION

This study highlights the temporal link between aggressive ideations and behaviors in everyday life as well as the role of self-control in understanding aggressivity in the lap of time. Furthermore, we observed that expressions of anger (i.e., reactivity, as well as rumination) were central in the understanding of aggressive ideations and behaviors in the everyday life (i.e., at within-person variability at the state level).

Researching the Links between Smartphone Behavior and Adolescent Wellbeing: The Study Protocol for the FUTURE (WP4) Ecological Momentary Assessment Study (Preprint)

Background

Smartphone ownership has increased among teens within the last decade, with up to 89% of adolescents owning a smartphone and engaging daily with the online world through it. Although the results of recent meta-analyses suggest that engaging digital technology plays only a small role in adolescent well-being, parents, professionals, and policymakers remain concerned about the impact that the instant connectivity of smartphones has on adolescent well-being.

Objective

Herein, we introduce the protocol of a research study investigating the associations between adolescent smartphone use and different facets of well-being (social, physical, and psychological), with the aim to apply innovative methods to address the limitations of existing empirical studies.

Methods

This 12-month prospective study of adolescents uses a repeated measurement-burst design with the ecological momentary assessment methodology. Adolescents (N=203; age range 13-17 years) complete baseline assessments through online questionnaires, four 14-day intensive data collection bursts, and an online questionnaire at the end of the study. As part of the 4 measurement bursts, adolescent smartphone behavior is assessed objectively by passive data collection of smartphone data logs and through self-reports in short questionnaires administered via a custom-built Android app.

Results

The protocol describes the study objectives, research tools (including the development of the Android app and specialized software), and process (including pilot studies, the main study, and targets for machine learning approaches). Two of the 203 enrolled participants provided no data during the first data collection burst of the main study. Preliminary analyses of the data from the first data collection burst indicated an acceptable level of compliance (72.25%) with the daily questionnaires. The design of the study will allow for the assessment of both within- and between-person variabilities in smartphone behavior, as well as short-term variation and long-term change in smartphone behavior and how it impacts the indicators of social, physical, and psychological well-being.

Conclusions

The innovative methods applied in this study (objective smartphone logs, ecological momentary assessment, and machine learning) will allow for a more nuanced assessment of the links between smartphone use and well-being, informing strategies to help adolescents navigate the online world more constructively in terms of the development of their physical, social, and psychological well-being.

International Registered Report Identifier (IRRID)

DERR1-10.2196/35984

Tracking Infant Development With a Smartphone: A Practical Guide to the Experience Sampling Method

The COVID-19 pandemic has forced developmental researchers to rethink their traditional research practices. The growing need to study infant development at a distance has shifted our research paradigm to online and digital monitoring of infants and families, using electronic devices, such as smartphones. In this practical guide, we introduce the Experience Sampling Method (ESM) – a research method to collect data, in the moment, on multiple occasions over time – for examining infant development at a distance. ESM is highly suited for assessing dynamic processes of infant development and family dynamics, such as parent-infant interactions and parenting practices. It can also be used to track highly fluctuating family dynamics (e.g., infant and parental mood or behavior) and routines (e.g., activity levels and feeding practices). The aim of the current paper was to provide an overview by explaining what ESM is and for what types of research ESM is best suited. Next, we provide a brief step-by-step guide on how to start and run an ESM study, including preregistration, development of a questionnaire, using wearables and other hardware, planning and design considerations, and examples of possible analysis techniques. Finally, we discuss common pitfalls of ESM research and how to avoid them.

Psychotic experiences in daily-life in adolescents and young adults with 22q11.2 deletion syndrome: An Ecological Momentary Assessment study

22q11.2 deletion syndrome (22q11DS) is a genetic condition associated with a markedly increased risk for psychosis. Psychotic experiences are classically evaluated by clinical interviews that give little information about these symptoms' fluctuation in daily-life. The current study aims to investigate these phenomena using the Ecological Momentary Assessment (EMA), a structured diary technique that collects real-life measures in the everyday-life context, and to examine how these manifestations relate to a gold standard semi-structured assessment of psychotic experiences. Eighty-six individuals with 22q11DS as well as healthy controls (HC) aged 11-27 years were recruited. They completed a 6-day EMA protocol assessing momentary psychotic experiences as well as positive and negative affect. The presence of (attenuated) psychotic symptoms was assessed in 22q11DS participants with the SIPS interview. Participants with 22q11DS reported more intense (p = .005) and more frequent (p = .006) momentary psychotic experiences than HC. Significant associations between negative affect and momentary psychotic experiences were observed in both groups (p = .001). In participants with 22q11DS, more intense (p = <.001) and more frequent (p = <.001) momentary psychotic experiences measured by EMA were associated with the severity of SIPS positive symptoms. Participants with 22q11DS reporting at least attenuated positive symptoms of psychosis on the SIPS had more intense (p = .027) and more frequent (p = .023) momentary psychotic experiences than participants with 22q11DS without psychotic symptoms. This study highlights the validity of EMA to assess psychotic experiences in the context of daily-life and sets correspondence between EMA and the SIPS. Furthermore, it expands our current understanding of the associations between mood and psychotic experiences.

Opening the Black Box of Daily Life in Nonsuicidal Self-injury Research: With Great Opportunity Comes Great Responsibility

Although nonsuicidal self-injury (NSSI)-deliberate damaging of body tissue without suicidal intent-is a behavior that occurs in interaction with real-world contexts, studying NSSI in the natural environment has historically been impossible. Recent advances in real-time monitoring technologies have revolutionized our ability to do exactly that, providing myriad research and clinical practice opportunities. In this viewpoint paper, we review new research pathways to improve our ability to understand, predict, and prevent NSSI, and provide critical perspectives on the responsibilities inherent to conducting real-time monitoring studies on NSSI. Real-time monitoring brings unique opportunities to advance scientific understanding about (1) the dynamic course of NSSI, (2) the real-time predictors thereof and ability to detect acute risk, (3) the ecological validity of theoretical models, (4) the functional mechanisms and outcomes of NSSI, and (5) the promotion of person-centered care and novel technology-based interventions. By considering the opportunities of real-time monitoring research in the context of the accompanying responsibilities (eg, inclusive recruitment, sound and transparent research practices, participant safety and engagement, measurement reactivity, researcher well-being and training), we provide novel insights and resources to open the black box of daily life in the next decade(s) of NSSI research.

Measuring parent-adolescent interactions in natural habitats. The potential, status, and challenges of ecological momentary assessment

Few people are as important for an adolescent's development as their parents. However, most research on parent-adolescent relationships describes long-term population-wide effects. Therefore, little is known about everyday interactions between adolescents and parents in individual families. Ecological momentary assessment (EMA) measures families several times a day as they go through daily life. This approach provides ecologically valid insights into which interactions took place and how they were experienced. State-of-the-art EMA studies suggest that within-family fluctuations in parenting may trigger changes in an adolescent's well-being and behaviors. In practice, moreover, EMA may strengthen family support and intervention research. This article reviews recent empirical work, highlights the (un)used theoretical and practical promise of EMA and identifies key-challenges to unlock this full potential.

A year in the social life of a teenager: Within-person fluctuations in stress, phone communication, and anxiety and depression

Stressful life events (SLEs) are strongly associated with the emergence of adolescent anxiety and depression, but the underlying mechanisms remain poorly understood, especially at the within-person level. We investigated how adolescent social communication (i.e., frequency of calls and texts) following SLEs relates to changes in internalizing symptoms in a multi-timescale intensive year-long study (N=30; n=355 monthly observations; n=~5,000 experience-sampling observations). Within-person increases in SLEs were associated with receiving more calls than usual at both monthly- and momentary-levels, and making more calls at the monthly-level. Increased calls were prospectively associated with worsening internalizing symptoms at the monthly-level only, suggesting that SLEs rapidly influences phone communication patterns, but these communication changes may have a more protracted, cumulative influence on internalizing symptoms. Finally, increased incoming calls prospectively mediated the association between SLEs and anxiety at the monthly-level. We identify adolescent social communication fluctuations as a potential mechanism conferring risk for stress-related internalizing psychopathology.

Daily fluctuations in occupation with and worry about COVID-19

In the first week after the first COVID-19 patient was reported in the Netherlands, we conducted a pre-registered momentary assessment study (7 surveys per day, 50 participants, 7 days) to study the dynamic relationship between individuals' occupation with and worries about COVID-19 in daily life, and the moderating role of neuroticism in this relationship. At the group level, higher scores on occupation and worry co-occurred, and occupation predicted worry 1 h later, but not vice versa. There were substantial individual differences in the magnitudes and directions of the effects. For instance, occupation with COVID-19 was related to increases in worry for some but decreases in worry for others. Neuroticism did not predict any of these individual differences in the links between worry and occupation. This study suggests that it is important to go beyond group-level analyses and to account for individual differences in responses to COVID-19.

Internet and smartphone-based ecological momentary assessment and personalized advice (PROfeel) in adolescents with chronic conditions: A feasibility study

OBJECTIVE

Growing up with a chronic disease comes with challenges, such as coping with fatigue. Many adolescents are severely fatigued, though its associated factors exhibit considerable interpersonal and longitudinal variation. We assessed whether PROfeel, a combination of a smartphone-based ecological momentary assessment (EMA) method using the internet, followed by a face-to-face dialogue and personalized advice for improvement of symptoms or tailor treatment based on a dynamic network analysis report, was feasible and useful.

STUDY DESIGN

Feasibility study in fatigued outpatient adolescents 12-18 years of age with cystic fibrosis, autoimmune disease, post-cancer treatment, or with medically unexplained fatigue. Participants were assessed at baseline to personalize EMA questions. EMA was conducted via smartphone notifications five times per day for approximately six weeks. Hereby, data was collected via the internet. The EMA results were translated into a personalized report, discussed with the participant, and subsequently translated into a personalized advice. Afterwards, semi-structured interviews on feasibility and usefulness were held.

RESULTS

Fifty-seven adolescents were assessed (mean age 16.2 y ± 1.6, 16% male). Adolescents deemed the smartphone-based EMA feasible, with the app being used for an average of 49 days. Forty-two percent of the notifications were answered and 85% of the participants would recommend the app to other adolescents. The personalized report was deemed useful and comprehensible and 95% recognized themselves in the personalized report, with 64% rating improved insight in their symptoms and subsequent steps towards an approach to reduce one's fatigue as good or very good.

CONCLUSIONS

PROfeel was found to be highly feasible and useful for fatigued adolescents with a chronic condition. This innovative method has clinical relevance through bringing a patient's daily life into the clinical conversation.

Perceived Impacts, Acceptability, and Recommendations for Ecological Momentary Assessment Among Youth Experiencing Homelessness: Qualitative Study

BACKGROUND

The use of ecological momentary assessment (EMA) to study youth experiencing homelessness (YEH) behaviors is an emerging area of research. Despite high rates of participation and potential clinical utility, few studies have investigated the acceptability and recommendations for EMA from the YEH perspective.

OBJECTIVE

This study aimed to describe the perceived benefits, usability, acceptability, and barriers to the use of EMA from the homeless youth perspective.

METHODS

YEH were recruited from a larger EMA study. Semistructured exit interviews were performed using an interview guide that focused on the YEH experience with the EMA app, and included perceived barriers and recommendations for future studies. Data analyses used an inductive approach with thematic analysis to identify major themes and subthemes.

RESULTS

A total of 18 YEH aged 19-24 years participated in individual and group exit interviews. The EMA was highly acceptable to YEH and they found the app and EMA surveys easy to navigate. Perceived benefits included increased behavioral and emotional awareness with some YEH reporting a decrease in their high-risk behaviors as a result of participation. Another significant perceived benefit was the ability to use the phones for social support and make connections to family, friends, and potential employers. Barriers were primarily survey and technology related. Survey-related barriers included the redundancy of questions, the lack of customizable responses, and the timing of survey prompts. Technology-related barriers included the "freezing" of the app, battery charge, and connectivity issues. Recommendations for future studies included the need to provide real-time mental health support for symptomatic youth, to create individually customized questions, and to test the use of personalized motivational messages that respond to the EMA data in real time.

CONCLUSIONS

YEH are highly receptive to the use of EMA in studies. Further studies are warranted to understand the impact of EMA on YEH behaviors. Incorporating the YEH perspective into the design and implementation of EMA studies may help minimize barriers, increase acceptability, and improve participation rates in this hard-to-reach, disconnected population.

Latent Markov Latent Trait Analysis for Exploring Measurement Model Changes in Intensive Longitudinal Data

Drawing inferences about dynamics of psychological constructs from intensive longitudinal data requires the measurement model (MM)-indicating how items relate to constructs-to be invariant across subjects and time-points. When assessing subjects in their daily life, however, there may be multiple MMs, for instance, because subjects differ in their item interpretation or because the response style of (some) subjects changes over time. The recently proposed "latent Markov factor analysis" (LMFA) evaluates (violations of) measurement invariance by classifying observations into latent "states" according to the MM underlying these observations such that MMs differ between states but are invariant within one state. However, LMFA is limited to normally distributed continuous data and estimates may be inaccurate when applying the method to ordinal data (e.g., from Likert items) with skewed responses or few response categories. To enable researchers and health professionals with ordinal data to evaluate measurement invariance, we present "latent Markov latent trait analysis" (LMLTA), which builds upon LMFA but treats responses as ordinal. Our application shows differences in MMs of adolescents' affective well-being in different social contexts, highlighting the importance of studying measurement invariance for drawing accurate inferences for psychological science and practice and for further understanding dynamics of psychological constructs.

Grumpy or depressed? Disentangling typically developing adolescent mood from prodromal depression using experience sampling methods

INTRODUCTION

This study aimed at differentiating normative developmental turmoil from prodromal depressive symptoms in adolescence.

METHOD

Negative and positive mood (daily) in different contexts (friends, home, school), and (subsequent) depressive symptoms were assessed in Dutch adolescents.

RESULTS & CONCLUSION

Mixture modeling on one cross-sectional study, using a newly developed questionnaire (CSEQ; subsample 1a; n = 571; girls 55.9%; Mage = 14.17) and two longitudinal datasets with Experience Sampling Methods data (subsample 1b: n = 241; Mage = 13.81; 62.2% girls, sample 2: n = 286; 59.7% girls; Mage = 14.19) revealed three mood profiles: 18-24% "happy", 43-53% "typically developing", and 27-38% "at-risk". Of the "at-risk" profile between 12.5% and 25% of the adolescents scored above the clinical cut-off for depression. These mood profiles predicted later depressive symptoms, while controlling for earlier symptoms. In subsample 1b, parents were not always aware of the mental health status of their adolescent.