Capturing Resilience in Context: Development and Validation of a Situational Judgment Test of Resilience

The protective role of resilience in the reporting of post-concussive symptoms within a non-clinical sample

Objective: Despite being common following a brain injury, post-concussive symptoms (PCS) are highly prevalent in healthy and non-concussed individuals. Psychosocial factors likely subserve the maintenance of symptoms, and numerous studies have identified prominent risk factors associated with post-concussive symptom reporting (e.g. history of depression). However, few studies have investigated protective factors in this context. The aim of the current study was to examine the relationship between resilience and PCS, and to identify the factors subserving resilience within this relationship. Method: Healthy and non-concussed participants (n = 283, Mage = 22.70 years) completed questionnaires examining PCS (Rivermead Post-Concussion Symptom Questionnaire) and resilience (Resilience Scale for Adults), together with a screener of background demographic/clinical factors. Results: Resilience negatively predicted PCS above and beyond the effect of demographic and clinical factors previously implicated in the reporting of PCS. Interestingly, heightened "perception of self" was the resilience factor uniquely associated with PCS symptoms. The final model accounted for 33% of the variance in PCS. Overall, female gender, a history of headaches, and diagnoses of ADHD and depression, and reduced "perception of self" were all predictive of greater PCS (ps < .05). Conclusion: Resilience, particularly perception of self, is a positive protective factor in the reporting of PCS. These findings highlight the importance of early identification of less resilient individuals following trauma-such as an mTBI and provide a potential rationale for the incorporation of resilience-based rehabilitation programs into the recovery process, particularly those that promote greater self-efficacy and self-competency.

Impact of patterns of language use and socio-economic status on a constructed response Situational Judgment Test (SJT)

The study explored the impacts of patterns of language use (PLU) and socio-economic status (SES) on Casper, a constructed-response situational judgment test (SJT). 10,266 applicants from two U.S. medical schools were grouped into self-reported balanced bilinguals, unbalanced bilinguals, English monolinguals, and English as a Second Language (ESL) students. A multicomponent SES composite was used to assess the degree of socioeconomic disadvantage (DSD). Results from a hierarchical regression analysis showed that after accounting for demographic variables, both PLU and DED were significant factors on applicants' Casper performance. Bilingualism was associated with better Casper performance compared to English monolinguals and ESL students. No significant effect of speaking English as a native language was found on applicants' Casper performance. English monolinguals and ESL students performed equivalently on Casper. Finally, high DSD was associated with better Casper performance than low DSD, and the impact of DSD on Casper held the same across all four language groups. These findings provide evidence that socio-cultural factors, such as PLU and DSD have important impacts on SJT performance. Further research is needed to understand the role of differences in language construction across socio-cultural factors on constructed-response SJT performance.

Psychometric validity and reliability of the 10- and 2-item Connor-Davidson resilience scales among a national sample of Americans responding to the Covid-19 pandemic: an item response theory analysis

Purpose

Psychometric validity/reliability of 10-item and 2-item abbreviations of the Connor–Davidson Resilience Scale (CD-RISC-10; CD-RISC-2) was investigated via item response theory and classic approaches.

Methods

We sampled 5023 adult American participants in a June/July 2020 survey on the COVID-19 pandemic’s psychological effects. Our questionnaire incorporated the CD-RISC-10 with other validated measures. CD-RISC-10 items were ranked on item-to-scale correlations, loadings on a one-factor confirmatory factor analysis model, and item slope/threshold parameters plus information curves from a unidimensional graded response model. Concurrent validity of the highest ranked item pair was evaluated vis-à-vis the CD-RISC-10 and CD-RISC−2. Internal consistency, based on average variance extracted (AVE) and multiple reliability coefficients, was also compared. Convergent/divergent validity was tested by correlating anxiety, depression, fear of COVID-19, anxiety sensitivity, coping, and personality measures with both scales and the highest ranked item pair. Binary agreement/classification indexes assessed inter-rater reliability.

Results

Items 2 and 9 from CD-RISC-10 ranked the highest. Reliability coefficients were > 0.93, > 0.72, and > 0.82 for the CD-RISC-10, CD-RISC-2, vs summation of items 2 and 9. AVEs were 0.66, 0.67, and 0.77. CD-RISC abbreviations and the summation of items 2 and 9 correlated negatively with anxiety (> − 0.43), depression (> − 0.42), and fear of COVID-19 (> − 0.34); positively with emotional stability (> 0.53) and conscientiousness (> 0.40). Compared to the CD-RISC-2, summative scores of items 2 and 9 more efficiently classified/discriminated high resilience on the CD-RISC-10.

Conclusion

We confirmed construct validity/reliability of copyrighted CD-RISC abbreviations. The CD-RISC-10’s items 2 and 9 were psychometrically more salient than the CD-RISC−2.

Supplementary Information

The online version contains supplementary material available at 10.1007/s11136-022-03125-y.

Applying Evidence-Centered Design to Measure Psychological Resilience: The Development and Preliminary Validation of a Novel Simulation-Based Assessment Methodology

Modern technologies have enabled the development of dynamic game- and simulation-based assessments to measure psychological constructs. This has highlighted their potential for supplementing other assessment modalities, such as self-report. This study describes the development, design, and preliminary validation of a simulation-based assessment methodology to measure psychological resilience-an important construct for multiple life domains. The design was guided by theories of resilience, and principles of evidence-centered design and stealth assessment. The system analyzed log files from a simulated task to derive individual trajectories in response to stressors. Using slope analyses, these trajectories were indicative of four types of responses to stressors: thriving, recovery, surviving, and succumbing. Using Machine Learning, the trajectories were predictive of self-reported resilience (Connor-Davidson Resilience Scale) with high accuracy, supporting construct validity of the simulation-based assessment. These findings add to the growing evidence supporting the utility of gamified assessment of psychological constructs. Importantly, these findings address theoretical debates about the construct of resilience, adding to its theory, supporting the combination of the "trait" and "process" approaches to its operationalization.

The selection gap in teacher education: Adverse effects of ethnicity, gender, and socio-economic status on situational judgement test performance

Background

Situational judgement tests (SJTs) measure non‐cognitive attributes and have recently drawn attention as a selection method for initial teacher education programmes. To date, very little is known about adverse impact in teacher selection SJT performance.

Aims

This study aimed to shed light on adverse effects of gender, ethnicity, and socio‐economic status (SES) on SJT scores, by exploring both main effects and interactions, and considering both overall SJT performance and separate SJT domain scores (mindset, emotion regulation, and conscientiousness).

Sample

A total of 2,808 prospective teachers from the United Kingdom completed the SJTs as part of the initial stage of selection into a teacher education programme.

Methods

In addition to SJT scores, the variables gender (female vs. male), ethnicity (majority group vs. minority group), and home SES background (higher SES status vs. lower SES status) were used in the analyses. Regression models and moderated regression models were employed.

Results and conclusions

Results from the regression models revealed that gender effects (females scoring higher than males) were restricted to emotion regulation, while ethnicity effects (ethnic majority group members scoring higher than ethnic minority group members) emerged for SJT overall scores and all three domains. Moderated regression modelling results furthermore showed significant interactions (gender and ethnicity) for SJT overall scores and two domains. Considering the importance of reducing subgroup differences in selection test scores to ensure equal access to teacher education, this study’s findings are a critical contribution. The partially differentiated results for overall vs. domain‐specific scores point towards the promise of applying a domain‐level perspective in research on teacher selection SJTs.