The experience of traumatic events disrupts the measurement invariance of a posttraumatic stress scale

Fear learning and extinction predicts anxiety in daily life: a study of Pavlovian conditioning and ecological momentary assessment

BACKGROUND

The association between anxious mood and aberrant fear learning mechanisms has not been fully elucidated. Studying how fear conditioning and extinction constructs relate to anxiety symptoms and reactivity to stressful and benign moments in everyday life provides a powerful addition to experimental paradigms.

METHOD

Fifty-one young adults completed laboratory-based differential conditioning and extinction tasks with (CS + ) and without (CS-) an aversive unconditional stimulus (US). Electrodermal skin conductance responses were measured during each phase, followed by ecological momentary assessment (EMA) tapping anxiety and stressors six times daily for seven days (2, 142 moments).

RESULTS

Conditioned electrodermal reactivity to the CS + and overgeneralisation to the CS- were associated with greater change in anxiety (measured via EMA), across non-stressful situations, remaining the same across stressful situations. Likewise, during extinction when the CS + is now safe, more electrodermal reactivity to the CS + was associated with more anxiety change across non-stressful situations and remained the same across stressful situations. Also, during extinction when threat is absent, more electrodermal reactivity at the late stage of the CS- was associated with less momentary anxiety change in response to stressful situations; more electrodermal activity at the late stage of the CS + was associated with more anxiety change across non-stressful situations and remained the same across stressful situations.

CONCLUSIONS

Sampling 'in vivo' emotion and stress experiences, study findings revealed links between conditioned electrodermal reactivity and overgeneralisation to safe stimuli and heightened anxious reactivity during non-stressful (i.e. safe) moments in daily life, coupled with less change in response to actual stressors.

Do State and Trait Affect Measures Retain Their Measurement Properties during a Disaster? An Investigation of Measurement Invariance during the COVID-19 Pandemic

Psychologists have begun to study the impact of the COVID-19 pandemic on emotionality, though such investigations assume that the measurement properties of affect scales have not changed as a function of the pandemic. To our knowledge, no prior study has tested measurement invariance (MI) of an affect scale during a disaster, and very few studies have explored MI of scales administered through ecological momentary assessment (EMA). The current study tested invariance of trait and state affect measures across homogenous groups of 18-year-olds assessed prior to and during the first acute phase of the COVID-19 pandemic in Long Island, New York. Trait affect was measured with a single administration of the Schedule for Nonadaptive and Adaptive Personality-Youth Version. State affect was assessed with items developed for the EMA portion of this study, which were administered 5 times daily for 14 consecutive days using a smartphone application. A baseline correlated 2-factor (positive and negative affect) model was fit for both measures. Invariances tests established up to strict MI across pre-/COVID-19 groups for both affect measures. These findings suggest that valid comparisons of observed score means and variances can be made between groups assessed before and during the COVID-19 pandemic.

Adjusting for Measurement Noninvariance with Alignment in Growth Modeling

Longitudinal measurement invariance-the consistency of measurement in data collected over time-is a prerequisite for any meaningful inferences of growth patterns. When one or more items measuring the construct of interest show noninvariant measurement properties over time, it leads to biased parameter estimates and inferences on the growth parameters. In this paper, I extend the recently developed alignment-within-confirmatory factor analysis (AwC) technique to adjust for measurement biases for growth models. The proposed AwC method does not require a priori knowledge of noninvariant items and the iterative searching of noninvariant items in typical longitudinal measurement invariance research. Results of a Monte Carlo simulation study comparing AwC with the partial invariance modeling method show that AwC largely reduces biases in growth parameter estimates and gives good control of Type I error rates, especially when the sample size is at least 1,000. It also outperforms the partial invariance method in conditions when all items are noninvariant. However, all methods give biased growth parameter estimates when the proportion of noninvariant parameters is over 25%. Based on the simulation results, I conclude that AO is a viable alternative to the partial invariance method in growth modeling when it is not clear whether longitudinal measurement invariance holds. The current paper also demonstrates AwC in an example modeling neuroticism over three time points using a public data set, which shows how researchers can compute effect size indices for noninvariance in AwC to assess to what degree invariance holds and whether AwC results are trustworthy.

Testing Invariance of Measures of Internalizing Symptoms Before and After a Major Life Stressor: The Impact of COVID-19 in an Adolescent and Young Adult Sample

There are reports of increases in levels of internalizing psychopathology during the COVID-19 pandemic. However, these studies presume that measurement properties of these constructs remained unchanged from before the pandemic. In this study, we examined longitudinal measurement invariance of assessments of depression, anxiety, and intolerance of uncertainty (IU) in adolescents and young adults from ongoing longitudinal studies. We found consistent support for configural and metric invariance across all constructs, but scalar invariance was unsupported for depression and IU. Thus, it is necessary to interpret pandemic-associated mean-level changes in depression and IU cautiously. In contrast, mean-level comparisons of panic, generalized, and social anxiety symptoms were not compromised. These findings are limited to the specific measures examined and the developmental period of the sample. We acknowledge that there is tremendous distress accompanying disruptions due to the COVID-19 outbreak. However, for some instruments, comparisons of symptom levels before and during the pandemic may be limited.

Approximate Measurement Invariance of Willingness to Sacrifice for the Environment Across 30 Countries: The Importance of Prior Distributions and Their Visualization

Nationwide opinions and international attitudes toward climate and environmental change are receiving increasing attention in both scientific and political communities. An often used way to measure these attitudes is by large-scale social surveys. However, the assumption for a valid country comparison, measurement invariance, is often not met, especially when a large number of countries are being compared. This makes a ranking of countries by the mean of a latent variable potentially unstable, and may lead to untrustworthy conclusions. Recently, more liberal approaches to assessing measurement invariance have been proposed, such as the alignment method in combination with Bayesian approximate measurement invariance. However, the effect of prior variances on the assessment procedure and substantive conclusions is often not well understood. In this article, we tested for measurement invariance of the latent variable "willingness to sacrifice for the environment" using Maximum Likelihood Multigroup Confirmatory Factor Analysis and Bayesian approximate measurement invariance, both with and without alignment optimization. For the Bayesian models, we used multiple priors to assess the impact on the rank order stability of countries. The results are visualized in such a way that the effect of different prior variances and models on group means and rankings becomes clear. We show that even when models appear to be a good fit to the data, there might still be an unwanted impact on the rank ordering of countries. From the results, we can conclude that people in Switzerland and South Korea are most motivated to sacrifice for the environment, while people in Latvia are less motivated to sacrifice for the environment.

Illuminating the complexities of conflict with evolution: validation of the scales of evolutionary conflict measure (SECM)

BACKGROUND

Although personal, familial, and community conflict with evolution have been documented in the literature, these scales require conceptualization as a construct and operationalization as a measure. The Scales of Conflict with Evolution Measure (SECM) instrument was developed in response to these needs. Using a construct validity framework, the content, internal structure, convergent, and substantive validity of the SECM were evaluated using Rasch analysis, Structural Equation Modeling (SEM), and follow up questioning. The conceptual utility of the instrument was explored by examining whether it added explanatory insights into evolution acceptance above and beyond religiosity, evolution knowledge, and background variables.

RESULTS

A literature review and expert consultation indicated that construct of evolutionary conflict perception should (i) encompass the hierarchical nature of human social structures (personal, family, community) and (ii) probe conflict as it relates to human values, cultures, and beliefs. A three-dimensional construct was operationalized as a nine-item rating scale measure. Using Rasch analyses of SECM responses from a diverse sample of > 1000 students studying evolution, the instrument met criteria of robust measurement, including: fit to model expectations; three-dimensional structure; high reliability; good rating scale function; measurement invariance with time; and convergence with a similar construct. SEM showed that: (i) family and community conflict had unique causal contributions to personal conflict, with family showing a stronger and modest impact, and (ii) personal conflict had a significant and modest causal impact on evolution acceptance above and beyond the contributions of religiosity, evolution knowledge, and background variables.

CONCLUSION

The SECM is an easy-to-administer instrument to measure conflict with evolution and is supported by several forms of validity evidence. The SECM has potential for facilitating measurement of evolutionary conflict in educational settings, thereby raising instructor awareness of conflict levels in students, promoting rigorous evaluations of educational interventions designed to reduce conflict, and fostering conceptual advances in the field of evolution education. Future work is needed to gather additional forms of validity evidence and to test current validity claims in additional participant samples. SECM measures should also be incorporated into more complex SEM models that treat evolution knowledge and religiosity as part of the structural paths to evolution acceptance. Such models could provide insights into the most worthwhile targets for the development of educational interventions to mitigate conflict at multiple scales.

Accounting for Differential Item Functioning Using Bayesian Approximate Measurement Invariance

The main thesis of the present study is to use the Bayesian structural equation modeling (BSEM) methodology of establishing approximate measurement invariance (A-MI) using data from a national examination in Saudi Arabia as an alternative to not meeting strong invariance criteria. Instead, we illustrate how to account for the absence of measurement invariance using relative compared to exact criteria. A secondary goal was to compare latent means across groups using invariant parameters only and through utilizing exact and relative evaluative-MI protocol suggested equivalence of the thresholds using prior variances equal to 0.10. Subsequent differences between groups were evaluated using effect size criteria and the prior-posterior predictive p-value (PPPP), which proved to be invaluable in attesting for differences that are beyond zero, some meaningless nonzero estimate, and the three commonly used indices of effect sizes described by Cohen in 1988 (i.e., .20, .50, and .80). Results substantiated the use of the PPPP for evaluating mean differences across groups when utilizing nonexact evaluative criteria.

Structure and longitudinal invariance of the Short Alcohol and Alcohol Problems Perception Questionnaire

Many studies have employed the Short Alcohol Attitudes Problem Perception Questionnaire (SAAPPQ) to measure professionals' attitudes toward working with people experiencing alcohol problems. However, research has not confirmed the internal structure of the SAAPPQ, leaving open the possibility that scale scores are not valid empirical proxies for underlying attitudes. It is also unclear if measurement invariance holds over time or across groups. This is an important gap in light of evidence that (a) experiences can change the structure of scales and (b) structures of some popular scales differ dramatically between groups. Thus, measurement bias may confound comparisons of composite SAAPPQ scores between measurement occasions or groups. To address these gaps in the literature, we conducted a longitudinal examination of the psychometrics of the SAAPPQ using data from 241 human services professionals-in-training. We found a four-factor structure, rather than the previously reported five factors. Configural, metric, and a strong degree of scalar invariance held longitudinally. Few factor intercorrelations were significant at time one and they strengthened over time, suggesting that the SAAPPQ should not be aggregated at higher-order levels (i.e., global scores should not be used). Findings suggest four SAAPPQ subscale scores may be used as valid proxies for attitudes toward alcohol users; however, additional confirmatory studies are needed to ensure that measurement bias does not compromise inferences based on SAAPPQ scores.

Mothers' emotions after pediatric burn injury: Longitudinal associations with posttraumatic stress and depressive symptoms 18 months postburn

BACKGROUND

Various emotions are implicated in posttraumatic stress disorder (PTSD). Longitudinal studies examining temporal associations between emotions and posttraumatic stress may reveal who is at risk of chronic psychological problems. This study examined the longitudinal relationships of mothers' trauma-related emotions with posttraumatic stress and depressive symptoms after pediatric burn injury.

METHODS

Data from two cohort studies were used (n = 296). Mothers reported the intensity of burn-related emotions within the first month (T1) and 12 months postburn (T2). The Impact of Event Scale (IES) and the Hospital and Anxiety Depression Scale (HADS-D; depression subscale) were administered at T1 and 18 months postburn (T3).

RESULTS

Based on two exploratory factor analyses, emotion variables were combined into acute and long-term basic emotions (fear, sadness, horror, anger) and self-conscious emotions (guilt, shame). The path model showed a positive relationship between acute and long-term basic emotions. Higher long-term basic emotions were related to persistence of posttraumatic stress and depressive symptoms. Acute self-conscious emotions showed associations with posttraumatic stress and depressive symptoms at T1 and were longitudinally related to depressive, but not posttraumatic stress, symptoms.

LIMITATIONS

The posttraumatic stress measure was not based on DSM-5 PTSD criteria and results require replication using these criteria.

CONCLUSIONS

This study suggests that mothers' acute self-conscious and long-term basic emotions in relation to their child's burn injury are involved in the development of posttraumatic stress and depressive symptoms. Clinically, assessing and monitoring parents' early posttraumatic stress, depressive symptoms and burn-related emotions may be useful to identify parents at risk.

Longitudinal Measurement Invariance of Posttraumatic Stress Disorder in Deployed Marines

The meaningful interpretation of longitudinal study findings requires temporal stability of the constructs assessed (i.e., measurement invariance). We sought to examine measurement invariance of the construct of posttraumatic stress disorder (PTSD) as based on the Diagnostic and Statistical Manual of Mental Disorders indexed by the PTSD Checklist (PCL) and the Clinician-Administered PTSD Scale (CAPS) in a sample of 834 Marines with significant combat experience. PTSD was assessed 1-month predeployment (T0), and again at 1-month (T1), 5-months (T2), and 8-months postdeployment (T3). We tested configural (pattern of item/parcel loadings), metric (item/parcel loadings on latent factors), and scalar (item/parcel-level severity) invariance and explored sources of measurement instability (partial invariance testing). The T0 best-fitting emotional numbing model factor structure informed the conceptualization of PTSD's latent factors and parcel formations. We found (1) scalar noninvariance for the construct of PTSD as measured by the PCL and the CAPS, and for PTSD symptom clusters as assessed by the CAPS; and (2) metric noninvariance for PTSD symptom clusters as measured by the PCL. Exploratory analyses revealed factor-loading and intercept differences from pre- to postdeployment for avoidance symptoms, numbing symptoms (mainly psychogenic amnesia and foreshortened future), and the item assessing startle, each of which reduced construct stability. Implications of these findings for longitudinal studies of PTSD are discussed.

A virtual reality paradigm as an analogue to real-life trauma: its effectiveness compared with the trauma film paradigm

Background: The trauma film paradigm (TFP) is a well-established method to study the effects of analogue psychological trauma under controlled laboratory settings. It has been used to examine pre-, peri-, and post-trauma processes, and to create and test interventions. A possible drawback is that watching films is a somewhat passive endeavour that lacks active behavioural engagement. Virtual reality (VR) may provide a better alternative. Like the TFP, VR allows for experimental control. In addition, it can induce a greater 'feeling of presence' and allows interaction with the environment, enabling research on action-reaction associations. Objective: We aimed to validate the utility of a VR paradigm as an experimental model to study psychological trauma by comparing its effectiveness with the TFP. Method: One group of participants (N = 25) was shown an aversive film, and another group (N = 25) moved through a VR scene. Main outcome measures were intrusion frequency assessed with a 7-day diary and self-rated vividness and emotionality of recalled memories related to the film or VR scene. Results: The results indicate that the film and VR scene were equally effective in inducing vivid and intrusive memories. However, self-reported emotional intensity appeared to be higher for memories related to the film than for memories related to the VR scene. Conclusions: Perhaps the film was more effective in inducing emotional memories than the VR scene due to its more aversive content. However, the VR scene seemed equally effective in inducing vivid and intrusive memories, and merits further exploration in light of ethical considerations (less aversive content) and other presumably beneficial qualities (e.g. inducing a greater feeling of presence and allowing interaction with the environment).

The class-dimensional structure of PTSD before and after deployment to Iraq: Evidence from direct comparison of dimensional, categorical, and hybrid models

The assumption of specific etiology in posttraumatic stress disorder (PTSD) differentiates the disorder from most other psychiatric conditions. A 'risky test' of the assumption of specific etiology and resultant trauma-related symptom dimensions was conducted through structural modeling of PTSD symptoms in soldiers before (N=522) and after (n=423) a combat deployment to Iraq. If PTSD represents a discrete diagnostic entity that emerges after trauma exposure, we hypothesized either the number of latent classes should increase from pre- to post-deployment or symptom dimensions should qualitatively distinguish affected from unaffected classes following trauma exposure. Comparison of latent structural models revealed best fitting hybrid models for PTSD and depression with strong invariance of symptom dimensions across classes both before and after deployment and only quantitative (i.e., severity) differences between classes. These findings suggest PTSD is generally well-conceptualized as a dimensional syndrome worsened but not necessarily elicited by trauma exposure.

Some Behaviorial Science Measurement Concerns and Proposals

Primarily from a measurement standpoint, we question some basic beliefs and procedures characterizing the scientific study of human behavior. The relations between observed and unobserved variables are key to an empirical approach to building explanatory theories and we are especially concerned about how the former are used as proxies for the latter. We believe that behavioral science can profitably reconsider the prevailing version of this arrangement because of its vulnerability to limiting idiosyncratic aspects of observed/unobserved variable relations. We describe a general measurement approach that takes into account idiosyncrasies that should be irrelevant to the measurement process but can intrude and may invalidate it in ways that distort and weaken relations among theoretically important variables. To clarify further our major concerns, we briefly describe one version of the measurement approach that fundamentally supports the individual as the primary unit of analysis orientation that we believe should be preeminent in the scientific study of human behavior.