The Implicit Relational Assessment Procedure: Emerging reliability and validity data

Implicit aggressive self-concept in patients with obsessive-compulsive disorder: Results from an approach-avoidance task

BACKGROUND AND OBJECTIVES

Patients with obsessive-compulsive disorder (OCD) have reported higher anger and aggression than healthy individuals in previous studies using explicit measures. However, studies using implicit measures have demonstrated mixed results. The aim of the present study was to investigate implicit aggressiveness in OCD using an approach-avoidance task (AAT).

METHODS

Seventy-eight patients with OCD and 37 healthy controls underwent structured clinical interviews and measures of anger, OCD, and depressive symptoms as well as a computerized AAT that included aggressive, peaceful, negative, and positive stimuli.

RESULTS

In line with previous studies, patients with OCD reported higher scores on explicit anger. With respect to the implicit measure, repeated measures ANOVAs did not show any differences in mean reaction times for pushing compared to pulling aggressive versus peaceful and negative versus positive words. However, analyses of specific OCD symptom dimensions demonstrated significantly faster reaction times for pulling compared to pushing aggressive words for patients with high scores in the OCD symptom dimensions obsessing and hoarding.

LIMITATIONS

Eighty percent of patients with OCD showed psychiatric comorbidities and all were seeking treatment.

CONCLUSION

The present study supports previous studies reporting the absence of higher aggressiveness in patients with OCD compared to healthy controls using implicit measures. However, in contrast to previous studies, we found an implicit approach bias towards aggressive self-statements for OCD patients scoring high in the symptom dimensions obsessing and hoarding compared to healthy controls. Future studies should further elucidate putative functional relationships between different OCD symptom dimensions and implicit aggressiveness.

Assessing Psychological Inflexibility Pertaining to Self in Patients With Posttraumatic Stress Disorder Using an Indirect Measure of (Nonassociative) Propositions

Relational frame theory (RFT) is a modern behavioral account of human language and cognition, which focuses on relations or propositions, rather than associations, as core explanatory constructs. In an attempt to measure such propositions, RFT researchers have developed the implicit relational assessment procedure (IRAP). It has been argued that the size of an IRAP effect may provide a metric for psychological inflexibility. The current study aimed to determine whether psychological inflexibility, as measured by the self-focused Natural Language-IRAP (NL-IRAP), would be higher in a clinical sample of individuals with a diagnosis of PTSD (N = 29) when compared to a nonclinical sample. Subsequently, the study investigated whether the self-focused NL-IRAP could be used to predict the presence of a clinical diagnosis, using a ROC analysis. As predicted, higher levels of psychological inflexibility were observed for the clinical group. The self-focused NL-IRAP also correctly classified the presence of PTSD (AUC = 76%) with a sensitivity level of 79.3% and a specificity level of 59.2%. Overall, the use of the IRAP as a nonassociative clinical measure appears promising.

How Implicit Attitudes toward Vaccination Affect Vaccine Hesitancy and Behaviour: Developing and Validating the V-IRAP

Vaccination is one of the most important ways of fighting infectious diseases, such as COVID-19. However, vaccine hesitancy and refusal can reduce adherence to vaccination campaigns, and therefore undermine their effectiveness. Although the scientific community has made great efforts to understand the psychological causes of vaccine hesitancy, studies on vaccine intention have usually relied on traditional detection techniques, such as questionnaires. Probing these constructs explicitly could be problematic due to defense mechanisms or social desirability. Thus, a measure capable of detecting implicit attitudes towards vaccination is needed. To achieve this aim, we designed and validated a new test called the Vaccine-IRAP, or V-IRAP, which is a modified version of the original Implicit Relational Assessment Procedure, or IRAP, task. The V-IRAP allows the unspoken reasons behind vaccine hesitancy to be investigated, and is able to distinguish between positive and negative beliefs on vaccination. The test was assessed in a sample of 151 participants. The V-IRAP showed good internal reliability and convergent validity, with meaningful correlational patterns with explicit measures. Moreover, it revealed incremental validity over such explicit measures. Lastly, the V-IRAP was able to shed light on the implicit attitudes involved in vaccine refusal, revealing negative attitudes relative to vaccine-related risks in non-vaccinated participants. Overall, these results support V-IRAP as a sensitive and reliable tool that could be used in future studies on implicit attitudes toward vaccination.

On the quality of quantitative instruments to measure digital competence in higher education: A systematic mapping study

In this study, we report on a Systematic Mapping Study (SMS) on how the quality of the quantitative instruments used to measure digital competencies in higher education is assured. 73 primary studies were selected from the published literature in the last 10 years in order to 1) characterize the literature, 2) evaluate the reporting practice of quality assessments, and 3) analyze which variables explain such reporting practices. The results indicate that most of the studies focused on medium to large samples of European university students, who attended social science programs. Ad hoc, self-reported questionnaires measuring various digital competence areas were the most commonly used method for data collection. The studies were mostly published in low tier journals. 36% of the studies did not report any quality assessment, while less than 50% covered both groups of reliability and validity assessments at the same time. In general, the studies had a moderate to high depth of evidence on the assessments performed. We found that studies in which several areas of digital competence were measured were more likely to report quality assessments. In addition, we estimate that the probability of finding studies with acceptable or good reporting practices increases over time.

Testing the discrepancy between actual and ideal body image with the Implicit Relational Assessment Procedure (IRAP)

BACKGROUND

The discrepancy between actual and ideal body image is considered an index of body dissatisfaction and a risk factor for eating disorders. While discrepancy has been traditionally tested with figural drawing rating scales, in recent times the use of implicit measures has been explored.

METHODS

This study employs the Implicit Relational Assessment Procedure (IRAP) to examine actual-ideal body-size discrepancy in a sample of 130 Spanish college students, as well as its utility to predict symptoms of eating disorders and other body-image relevant measures. Participants completed the Contour Drawing Rating Scale (CDRS). The three smallest and the three largest contour drawings of the CDRS were used as target stimuli in two different IRAP tasks: one in combination with the sample phrases "I am" and "I am not" (that assessed implicit actual body image), another in combination with the phrases "I want to be" and "I don't want to be" (that assessed implicit ideal body image). After completing both IRAP tasks, participants completed explicit measures of body-image psychological inflexibility, body dissatisfaction, and symptoms of eating disorders.

RESULTS

Results showed a small implicit bias towards thinness. Participants were faster in affirming than denying that they are thin and that they desire to be thin. They were also faster in affirming than denying that they are fat and that they want to be fat, but to a smaller extent than with thinness. Specifically, the implicit desire to be (or not be) fat emerged as an independent predictor of eating disorder symptoms, psychological inflexibility, and body dissatisfaction that significantly increased the predictive power of CDRS scores.

CONCLUSIONS

These findings underscore the need for further research on specific body image implicit beliefs towards fatness, both in subclinical and clinical populations, in order to examine whether willingness to accept the idea that one can have a larger body size can be a suitable target for prevention and intervention in eating disorders.

Development and Validation of an Implicit Relational Assessment Procedure (IRAP) to Measure Implicit Dysfunctional Beliefs about Caregiving in Dementia Family Caregivers

Caregivers of people with dementia who endorse dysfunctional beliefs about caregiving are at high risk of experiencing higher levels of distress. These dysfunctional beliefs are presented in the form of rules, verbal statements that specify what responsibilities one should expect in order to be a “good caregiver,” and are characterized as rigid, unrealistic, or highly demanding. Previous studies relied exclusively on self-report measures when assessing such dysfunctional beliefs about caregiving. The objectives of this study were: 1) to develop and validate an Implicit Relational Assessment Procedure (IRAP) to measure implicit dysfunctional beliefs about caregiving (CARE-IRAP), and 2) considering the relatively high age of the sample, to analyze the adaptation of the IRAP for older adults, comparing the IRAP performance between older adult caregivers and middle-aged caregivers. Participants were 123 dementia family caregivers with a mean age of 62.24 ± 12.89. Adaptations were made to the IRAP by adjusting the accuracy and response time criteria. The sample was split into middle-aged caregivers (below 60 years) and older adult caregivers (60 or older). The CARE-IRAP scores presented significant positive correlations with explicit measures of dysfunctional beliefs about caregiving and experiential avoidance in caregiving. A similar pattern of results was observed across the two age groups. The results revealed that caregivers endorse implicit dysfunctional beliefs about caregiving and offer preliminary support for the use of the IRAP as a valid measure of implicit caregiving beliefs. This exploratory study is the first to adapt the IRAP criteria to older adults, and future studies should further explore criteria suitable for this population.

Examining the effectiveness of brief interventions to strengthen a positive implicit relation between women and STEM across two timepoints

The current study assessed the impact of three brief interventions aimed at influencing implicit gender bias in Science, Technology, Engineering and Math (STEM) fields. The reduction of this bias is a key consideration as it remains a major barrier to gender equality in STEM. The interventions (psychoeducation, exposure to positive counter-stereotypical exemplars and perspective-taking) were compared to a control group at two timepoints. Gender-STEM bias was assessed at the implicit level (via the Implicit Relational Assessment Procedure; IRAP) and the explicit level (via rating scales). Two hundred and ten adults (58.1% women) completed one of the four study conditions. Results indicated that implicit gender-STEM bias is malleable, at least in the short term. At Time 1, intervention groups showed higher levels of implicit pro-Women-STEM bias and lower levels of pro-Men-STEM bias than the Control group. Psychoeducation appeared most effective, followed by exposure to positive counter-stereotypical exemplars. Results from Time 2 presented a more complex picture of implicit bias change, as the control group exhibited an increased pro-Women-STEM bias that was unexpected. The implications of these findings are discussed in relation to refining the interventions, the malleability of gender-STEM bias and the measurement of implicit bias across contexts.

Can Behavior Analysis Help Us Understand and Reduce Racism? A review of the Current Literature

Despite ongoing efforts to eradicate racism, it persists globally, negatively affecting education, mental health, community relations, and economic development. Every behavior analyst can, and should, contribute to the reduction of racism in some way. Unfortunately, little behavior-analytic research exists to guide us. This article proposes ways that members of our scientific community can learn about racism from a behavioral perspective, extend experimental analyses of prejudice, and intervene to reduce racism in varied settings. It describes both traditional behavior-analytic and functional-contextualist accounts of racism and summarizes the small amount of related empirical and applied research. The review suggests that combining traditional behavior-analytic methods with acceptance and commitment training techniques may attenuate racism more effectively. The article ends with a call to collaborate around this globally important issue-and to do more to reduce racism.

Do Implicit and Explicit Racial Biases Influence Autism Identification and Stigma? An Implicit Association Test Study

Are implicit and explicit biases related to ASD identification and/or stigma? College students (N = 493) completed two IATs assessing implicit stigma and racial biases. They evaluated vignettes depicting a child with ASD or conduct disorder (CD) paired with a photo of a Black or White child. CD was more implicitly and explicitly stigmatized than ASD. Accurately identifying ASD was associated with reduced explicit stigma; identifying CD led to more stigma. Participants who identified as White implicitly associated the White child with ASD and the Black child with CD. A trend in the reverse direction was observed among Black participants. Implicit and explicit biases were unrelated. Findings highlight a need for trainings to ameliorate biases favoring one's in-group.

Models of Cognition and Their Applications in Behavioral Economics: A Conceptual Framework for Nudging Derived From Behavior Analysis and Relational Frame Theory

This paper puts forward a rounder conceptual model for interpreting short- and long-term effects of choice behavior. As a further development of dual-process theory, Kahneman (2003) distinguished between intuition and reasoning, which served as the respective precursors of the cognitive processing systems 1 and 2. We maintain that they reflect the more rigorous distinction between brief and immediate and extended and elaborated relational responding, which may be reinterpreted through an analysis of their functional properties. Repertoires of relational responding are offered by the multi-dimensional multi-level model. Specifically, we provide a conceptual account of how nudging, or the manipulation of environmental contingencies, works on the creation and modification of relational framing. Educative nudges, or boosts, are a subset of nudges that may more easily maintain target choice behavior in the future. The central role of verbal behavior is essential toward formulating rules, which inform and guide choice behavior over time. Although nudges are traditionally regarded as System 1-steered aspects, they are herein regarded as cues for responding to relational frames, which may induce System 2-steered aspects. We suggest adopting the implicit relational assessment procedure (IRAP) to inform how coherent and immediate responding to novel relational responding may occur in the presence of choice behavior. Several examples are included to support the claim of encompassing relational responding and choice behavior. We address the instances of consumer behavior, stereotypy and prejudices, eating behavior, and overcoming cognitive biases. The conclusions depict a promising way forward for the study of choice: an improved model for interpreting and overcoming human errors, due to changes in the contingencies of behavior.

Assessing implicit and explicit dementia stigma in young adults and care-workers

This aim of this study was to assess implicit and self-reported stigma towards people with dementia in young adults with no contact or experience ( n = 23), and in care-workers ( n = 17 professional dementia care-workers). Data were analysed to determine whether stigma was related to self-reported levels of depression, anxiety, stress and professional burnout. Forty participants completed the Implicit Relational Assessment Procedure and Dementia Attitudes Scale. The Depression Anxiety and Stress Scale and Maslach Burnout Inventory were used to measure depression, anxiety, stress and professional burnout. The young adult group showed statistically significant levels of dementia stigma (on the two “ dementia” trial-types, p = .027 and p = .030). Statistical analyses showed more dementia-positive attitudes in care-workers compared to young adults on the Implicit Relational Assessment Procedure and the Dementia Attitudes Scale (both p’s=.021). Spearman’s Rho correlations tests showed that for the care-givers, higher levels of burn-out were associated with more negative attitudes towards people with dementia on both of the Dementia Attitudes Scale subscales (social comfort p<.001 and dementia knowledge p=.005). The results support prior research showing that experience with a stigmatised group can lower stigma and demonstrate the importance of providing a supportive work environment to mitigate burnout.

Individuals with current suicidal ideation demonstrate implicit "fearlessness of death"

BACKGROUND AND OBJECTIVES

Suicidal behaviour has proved to be difficult to predict, due in part to the particular limitations of introspection within suicidality. In an effort to overcome this, recent research has demonstrated the utility of indirect measures of "implicit" attitudes within the study of suicidality. However, research to date has focused predominantly on implicit self-evaluations and self-death associations. No work has examined implicit evaluations of death, despite the theoretical importance of such evaluations; "fearlessness of death" is central to both the Interpersonal Theory of Suicide and the Integrated Motivational-Volitional model of suicide..

METHODS

Twenty-three psychiatric patients with current suicidal ideation and twenty-five normative university students completed two versions of the Implicit Relational Assessment Procedure (IRAP) that targeted evaluations of death. One task specified personal death (i.e., was self-focused) and the other targeted death in the abstract.

RESULTS

Self-focused evaluations of death reliably distinguished between the two groups, correctly classifying 74% of cases, but evaluations of death in the abstract did not. The suicidal group produced specific biases indicating a rejection of the negativity of death. Results are consistent with the definition of suicidality as involving a self-focused wish to die..

LIMITATIONS

For ethical reason, suicidal behaviours were not assessed in the normative group. Groups were therefore not mutually exclusive. This may have decreased the specificity of the IRAP.

CONCLUSIONS

Suicidal ideation is associated with an implicit "fearlessness of death". The utility of implicit death-evaluations should therefore be considered alongside self-evaluations and self-death associations in the future..

To be or want to be: disentangling the role of actual versus ideal self in implicit self-esteem

A growing body of work suggests that both depressed and non-depressed individuals display implicit positivity towards the self. In the current study, we examined whether this positivity can be underpinned by two qualitatively distinct propositions related to actual ('I am good') or ideal ('I want to be good') self-esteem. Dysphoric and non-dysphoric participants completed a self-esteem Implicit Association Test (IAT) as well an Implicit Relational Assessment Procedure (IRAP) targeting their actual self-esteem and an IRAP targeting ideal self-esteem. Both groups demonstrated similar and positive IAT effects. A more complex picture emerged with regard to the IRAP effects. Whereas non-dysphorics did not differ in their actual and ideal self-esteem, their dysphoric counterparts demonstrated lower actual than ideal self-esteem. Our results suggest that closer attention to the role of propositional processes in implicit measures may unlock novel insight into the relationship between implicit self-esteem and depression.

Anxiety and avoidance in psychogenic nonepileptic seizures: the role of implicit and explicit anxiety

This study examined implicit and explicit anxiety in individuals with epilepsy and psychogenic nonepileptic seizures (PNESs) and explored whether these constructs were related to experiential avoidance and seizure frequency. Based on recent psychological models of PNESs, it was hypothesized that nonepileptic seizures would be associated with implicit and explicit anxiety and experiential avoidance. Explicit anxiety was measured by the State-Trait Anxiety Inventory; implicit anxiety was measured by an Implicit Relational Assessment Procedure; and experiential avoidance was measured with the Multidimensional Experiential Avoidance Questionnaire. Although both groups with epilepsy and PNESs scored similarly on implicit measures of anxiety, significant implicit-explicit anxiety discrepancies were only identified in patients with PNESs (p<.001). In the group with PNESs (but not in the group with epilepsy), explicit anxiety correlated with experiential avoidance (r=.63, p<.01) and frequency of seizures (r=.67, p<.01); implicit anxiety correlated with frequency of seizures only (r=.56, p<.01). Our findings demonstrate the role of implicit anxiety in PNESs and provide additional support for the contribution of explicit anxiety and experiential avoidance to this disorder.

The promise of mobile technologies and single case designs for the study of individuals in their natural environment

Mobile technologies are growing rapidly around the world to broad demographics of society. These technologies hold great promise for their integration with Single Case Designs (SCDs) and the study of individuals in their natural environment. This paper discusses the theoretical, methodological and analytic implications of these tools for the advancement of the contextual behavioral etiology of behavioral disorders, and their remediation. We hope this paper will highlight the scientific advantages of combining mobile technologies and SCDs and encourage their adoption among CBS scientists.