The Acceptance and Action Questionnaire – II: an Item Response Theory Analysis

Psychometric evidence of the Acceptance and Action Questionnaire-II (AAQ-II): an item response theory analysis in university students from Chile

BACKGROUND

Experiential avoidance (EA) is a psychological mechanism associated with several mental health disorders and is regarded as a relevant target by third-generation cognitive behavioral therapies. It has been mainly assessed through self-report questionnaires, and the AAQ-II is the most used tool. Its psychometric evidence has been mostly tested through the classical test theory (CTT) and very scarcely assessed through Item Response Theory (IRT).

METHODS

We used the Graded Response Model to examine its psychometric properties in Spanish-speaking university students (n = 1503; women = 995 (66.2%), mean age = 19.29, SD = 2.45). We tested whether the empirical data fit the model's predictions and estimated the dispersion of persons and items along the experiential avoidance continuum. Moreover, we examined category probability curves to identify the response probability of each answer. Likewise, an item-person map was made where the measurement of persons and items, both on the same scale and along the experiential avoidance continuum, could be observed jointly. Finally, we tested the gender invariance of the scale.

RESULTS

We found that the values of the individuals and the items were in the established range to be considered an adequate measure of EA. Additionally, we observed high discrimination indices for all items. The current version with seven answer options could not be optimal and should be tested in future studies. Finally, we found evidence of differential functioning by gender in one of the seven items of the instrument.

CONCLUSIONS

Our results indicate that the AAQ-II is a suitable tool for measuring EA and accurately classifying and differentiating EA levels in university students.

The Relationship Between Psychological Inflexibility and Well-Being in Adults: A Meta-Analysis of the Acceptance and Action Questionnaire

Psychological inflexibility is defined as the rigid responding to stimuli (e.g., unpleasant thoughts and feelings) that interferes with well-being and valued actions. It is the treatment target in acceptance and commitment therapy (ACT). Despite the centrality of the link between inflexibility and well-being to ACT theory, an empirical review clarifying the nature of this relationship has not been conducted. As such, the current meta-analysis examined the meta-correlation between psychological inflexibility, measured by the Acceptance and Action Questionnaire (AAQ) and its variants, and well-being. A systematic review yielded 151 studies, including 25 versions of the AAQ and 43 well-being measures. Consistent with ACT theory, higher psychological inflexibility was associated with worse well-being (r = -.47, 95% CI[-.49, -.45]). In addition, sample diagnosis, type of AAQ, and type of well-being measure significantly moderated this relationship. Overall, our findings support the hypothesized link between psychological inflexibility and worse well-being. Limitations include reliance on cross-sectional data, precluding causal interpretation.

Acceptance and Commitment Therapy Processes and Mediation: Challenges and How to Address Them

Acceptance and commitment therapy (ACT) emphasizes a focus on theory-driven processes and mediating variables, a laudable approach. The implementation of this approach would be advanced by addressing five challenges, including (a) distinguishing ACT processes in measurement contexts, (b) developing and rigorously validating measures of ACT processes, (c) the wide use of psychometrically weaker ACT process measures and the more limited use of stronger measures in earlier work, (d) the inconsistency of past evidence that ACT processes are sensitive or specific to ACT or mediate ACT outcomes specifically, and (e) improving statistical power and transparency. Drawing on the existing literature, we characterize and provide evidence for each of these challenges. We then offer detailed recommendations for how to address each challenge in ongoing and future work. Given ACT's core focus on theorized processes, improving the measurement and evaluation of these processes would significantly advance the field's understanding of ACT.

Measurement of psychological inflexibility: an examination of the psychometric properties of the AAQ-3 compared to AAQ-II

Due to the limitations of the existing measurements of experiential avoidance, we would like to check the validity of the improved version of Acceptance and Action Questionnaire-II (AAQ-II), i.e., Acceptance and Action Questionnaire-3 (AAQ-3), in Chinese content. The present study was aim to examine the construct and validity of the Chinese version of AAQ-3 in college students and provide an initial validation of this instrument to promote future cross-cultural examination of the psychological flexibility. Totally 1,572 college students were invited to complete the Chinese AAQ-3 and the related questionnaires at the same time. After one month, 380 participates were assessed with same questionnaires to examine the test-retest reliability. The results indicated a similar one-factor solution in the Chinese AAQ-3 to the original version by exploratory factor analysis, parallel analysis and confirmatory factor analysis. Internal consistency and test-retest reliability were good. According to the testing of the measurement invariance, the one-factor model was acceptable across gender (Man = 875, Girl = 697). Additionally, Chinese AAQ-3 was significantly negatively correlated with positive mental health (life satisfaction, mindful attention awareness), significantly positively correlated with negative emotions (depression, anxiety, stress), and significantly positively correlated with AAQ-II and Brief Experiential Avoidance Questionnaire (BEAQ). Besides, Chinese AAQ-3 was the strongest predictor of depression, anxiety, stress and life satisfaction compared to the AAQ-II and BEAQ. However, according to the exploratory structural equation model, the Chinese AAQ-3 demonstrated excellent discriminate validity from negative emotions. Overall, the AAQ-3 modified the limitations of the existing measurements of experiential avoidance (i.e., AAQ-II and BEAQ) as it showed better convergent validity with positive mental health indicators, better discriminant validity with negative emotions, and higher incremental validity. Therefore, the Chinese AAQ-3 is a valid measurement tool for assessing the level of experiential avoidance or psychological flexibility in Chinese college students.

Cognitive and psychological factors associated with severe insomnia in Brazilian women: a cross-sectional study

Insomnia is the most prevalent sleep disorder in women. Sociodemographic, cognitive, and psychological factors may contribute to its severity. This study evaluated factors associated with severe insomnia in women with insomnia complaints. We evaluated 530 women aged 18-59 (mean = 40.5, SD = 10.2), who experienced insomnia complaints, using self-report instruments. Severe insomnia was defined as a score above 21 on the Insomnia Severity Index. Age, marital status, educational level, depression and anxiety, psychological inflexibility, and beliefs about sleep were assessed as potential factors associated with severe insomnia. Simple and multivariate analyses were conducted using binary logistic regression. Low education level (odds ratio; OR = 1.85 [1.27-2.69]), depression (OR = 2.17 [1.27-3.81]), psychological inflexibility (OR = 1.05 [1.02-1.08]), and dysfunctional beliefs about sleep (OR = 1.04 [1.02-1.06]) were factors associated with severe insomnia scores in the multiple logistic regression model. These findings are important from a public health perspective, because behavioral strategies designed to treat insomnia with a focus on cognitive and psychological factors are low-cost treatments and may help improve sleep quality in women, which also influences mental health.

Validity Evidence of the eHealth Literacy Questionnaire (eHLQ) Part 2: Mixed Methods Approach to Evaluate Test Content, Response Process, and Internal Structure in the Australian Community Health Setting

Background

Digital technologies have changed how we manage our health, and eHealth literacy is needed to engage with health technologies. Any eHealth strategy would be ineffective if users’ eHealth literacy needs are not addressed. A robust measure of eHealth literacy is essential for understanding these needs. On the basis of the eHealth Literacy Framework, which identified 7 dimensions of eHealth literacy, the eHealth Literacy Questionnaire (eHLQ) was developed. The tool has demonstrated robust psychometric properties in the Danish setting, but validity testing should be an ongoing and accumulative process.

Objective

This study aims to evaluate validity evidence based on test content, response process, and internal structure of the eHLQ in the Australian community health setting.

Methods

A mixed methods approach was used with cognitive interviewing conducted to examine evidence on test content and response process, whereas a cross-sectional survey was undertaken for evidence on internal structure. Data were collected at 3 diverse community health sites in Victoria, Australia. Psychometric testing included both the classical test theory and item response theory approaches. Methods included Bayesian structural equation modeling for confirmatory factor analysis, internal consistency and test-retest for reliability, and the Bayesian multiple-indicators, multiple-causes model for testing of differential item functioning.

Results

Cognitive interviewing identified only 1 confusing term, which was clarified. All items were easy to read and understood as intended. A total of 525 questionnaires were included for psychometric analysis. All scales were homogenous with composite scale reliability ranging from 0.73 to 0.90. The intraclass correlation coefficient for test-retest reliability for the 7 scales ranged from 0.72 to 0.95. A 7-factor Bayesian structural equation modeling using small variance priors for cross-loadings and residual covariances was fitted to the data, and the model of interest produced a satisfactory fit (posterior productive P=.49, 95% CI for the difference between observed and replicated chi-square values −101.40 to 108.83, prior-posterior productive P=.92). All items loaded on the relevant factor, with loadings ranging from 0.36 to 0.94. No significant cross-loading was found. There was no evidence of differential item functioning for administration format, site area, and health setting. However, discriminant validity was not well established for scales 1, 3, 5, 6, and 7. Item response theory analysis found that all items provided precise information at different trait levels, except for 1 item. All items demonstrated different sensitivity to different trait levels and represented a range of difficulty levels.

Conclusions

The evidence suggests that the eHLQ is a tool with robust psychometric properties and further investigation of discriminant validity is recommended. It is ready to be used to identify eHealth literacy strengths and challenges and assist the development of digital health interventions to ensure that people with limited digital access and skills are not left behind.

Alcohol, Trait Anger, and Psychological Flexibility: A Laboratory Investigation of Intimate Partner Violence Perpetration

The I³ Model is a meta-theoretical framework that posits intimate partner violence (IPV) perpetration is the product of three interactive factors: instigators, impellors, and inhibitors. The present study examined the effects of trait anger (an impellor), psychological flexibility (a disimpellor), and alcohol intoxication (a disinhibitor) on IPV perpetration. Participants were 249 heavy drinkers (41% female) who had perpetrated IPV toward their current partner in the past year. Participants completed self-report measures of trait anger and psychological flexibility, were randomly assigned to consume an alcoholic or non-alcoholic beverage, and then engaged in the Taylor Aggression Paradigm (Taylor, 1967) ostensibly against their current partner. Analyses detected a small-to-medium effect for two separate two-way interactions. First, a significant Beverage x Psychological Flexibility interaction was detected. Consistent with the I³ Model, explication analyses revealed that alcohol intoxication predicted higher levels of IPV perpetration in those who reported low, but not high, psychological flexibility (i.e., low disimpellance). Second, although the Beverage x Trait Anger interaction was non-significant, explication analyses revealed that alcohol intoxication predicted higher levels of IPV perpetration among those who reported low, but not high, trait anger (i.e., low impellance). These results have several potential treatment implications among alcohol-consuming clients.

Psychological inflexibility and intolerance of uncertainty moderate the relationship between social isolation and mental health outcomes during COVID-19

The COVID-19 pandemic has had an enormous impact on human activity worldwide, in part due to many governments issuing stay-at-home orders and limiting the types of social interactions in which citizens can engage. Previous research has shown that social isolation can contribute to psychological distress. The impact of increased social isolation on mental health functioning during the COVID-19 crisis, as well as potential mechanisms to buffer this impact, have yet to be investigated. The current study explored the moderating role of psychological flexibility and related constructs on the relationships between social isolation and mental health outcomes during the COVID-19 pandemic. Cross-sectional data from 278 participants, the majority residing in the United States, were collected during a 3-week period from mid-April to early May 2020 via online survey. A series of hierarchical linear regression analyses indicated statistically significant relationships between social isolation and psychological distress (depression, anxiety, and stress), well-being, and valued living. Psychological inflexibility, intolerance of uncertainty, and emotional suppression significantly moderated these relationships in a number of instances. Greater psychological flexibility and acceptance of difficult experiences appeared to act as a buffer against the negative effects of increased social isolation, while amplifying the benefits of social connectedness. Implications for promoting mental health and buffering against the harmful effects of social isolation during the COVID-19 pandemic and beyond are discussed.

•

Social isolation predicts negative psychological distress during COVID-19.

•

Psychological flexibility buffers negative impacts of isolation on distress.

•

Tolerance of uncertainty buffers negative impacts of social isolation on distress.

•

Psychological flexibility enhances beneficial effects of connectedness.

•

Psychological flexibility is a promising treatment target during COVID-19.