A Systematic Review of the Psychometric Properties of Trait Cognitive Self-Report Measures in Social Anxiety

Psychometric properties of self-report measures of eating disorder cognitions: a systematic review

BACKGROUND

Although eating disorder (ED) models display some differences in theory and treatment approach, cognitive-behavioural, schema-focused, and disorder-specific models all highlight the fundamental nature of cognitions as key factors in ED development and maintenance processes. As such, it is vital that ED cognitions continue to be assessed and monitored as therapeutic targets and treatment outcomes as well as being examined as constructs in empirical research. This review aimed to systematically identify and evaluate the psychometric properties of existing self-report measures of ED cognitions.

METHODS

A systematic review protocol was registered using the international prospective register of systematic reviews (PROSPERO; CRD42023440840). Included studies described the development, validation and/or the psychometric evaluation of a measure (or subscale) that was specifically developed to solely assess ED cognitions (that is thoughts, expectations, assumptions, or beliefs), in English-speaking, adult populations. The search was conducted using three electronic databases: PsycINFO, MedLine, and Embase. Two independent reviewers conducted screening, selection and evaluation of the psychometric properties of relevant measures using a standardised, well-established quality appraisal tool.

RESULTS

Of the initial search of 7581 potential studies, 59 met inclusion criteria and described the psychometric evaluation of 31 measures (or subscales) of ED cognitions. The findings from the current review indicate that of the included measures, none currently meet all nine criteria of adequate psychometric properties. The Eating Beliefs Questionnaire (EBQ; and EBQ-18), and the Eating Disorder Inventory Body Dissatisfaction subscale (EDI [BD]) currently possess the most evidence supporting their validity, reliability, and clinical utility.

CONCLUSIONS

The findings of the current systematic review provide guidance for future researchers to focus efforts on improving evidence for the validity, reliability and utility of self-report measures of ED cognitions. Overall, the present study has provided a detailed and systematic evaluation to support researchers and clinicians in future selection of measures of ED cognitions dependent on the specific aims of their research and treatment.

Psychometric properties of the state Probability and Consequences Questionnaire for social anxiety disorder

Cognitive models of social anxiety propose that overestimation of the probability and cost of negative evaluation plays a central role in maintaining the disorder. However, there are currently no self-report state-based measures of probability and cost appraisals. The current paper examines the psychometric properties of the Probability and Consequences Questionnaire for social anxiety (PCQ-SA), which measures probability and consequence appraisals both in anticipation of, and in response to, an impromptu speech task. A total of 532 participants were recruited for the present study, consisting of 409 participants with a principal diagnosis of Social Anxiety Disorder (SAD), and 123 non-clinical controls. Results of exploratory and confirmatory factor analyses supported a two-factor solution for the PCQ-SA. The PCQ-SA demonstrated excellent internal consistency, excellent test-retest reliability, good convergent validity at both time points (i.e., pre and post speech task), and sensitivity to treatment. Finally, using Receiver Operating Characteristic Curve Analysis, clinical cut-off scores were calculated for probability and consequences at both time points, with the PCQ-SA scales showing good sensitivity, specificity, and positive and negative predictive values. Overall, the results provide evidence that the PCQ-SA possesses excellent psychometric properties. The PCQ-SA is suitable for use in clinical and research settings to assess key cognitive maintaining factors for SAD.

Measures of Psychological Impacts of Stuttering in Young School-Age Children: A Systematic Review

Purpose Recent research has shown that some school-age children who stutter may have speech-related anxiety. Given this, speech-language pathologists require robust measures to assess the psychological effects of stuttering during the school-age years. Accordingly, this systematic review aimed to explore available measures for assessing the psychological impacts of stuttering in young school-age children and to examine their measurement properties. Method The systematic search protocol was registered with PROSPERO (ID: 163181). Seven online databases, in addition to manual searching and screening of reference lists, were used to identify appropriate measures for the population of children who stutter aged 7-12 years. The first two authors independently assessed the measures using the quality appraisal tool described by Terwee et al. (2007). Results Despite the comprehensive search strategy, only six measures were identified for quality appraisal. No assessment tool was found to possess adequate measurement properties for the eight assessed domains: content validity, internal consistency, construct validity, reproducibility, reliability, responsiveness, floor and ceiling effects, and interpretability. No measure had clear evidence of responsiveness to clinical change. Based on the criterion defined by the Terwee et al. (2007) appraisal tool, the Communication Attitude Test and the Overall Assessment of the Speaker's Experience of Stuttering for School-Age Children received the highest number of ratings in support of their measurement properties. Conclusions The results highlight a lack of available measures in this domain and poor practices in developing and testing measurement instruments. To ensure that clinicians and researchers are equipped with sound measures to meet the mental health needs of this vulnerable population, further research to establish resources is needed.

Cortisol reactivity in social anxiety disorder: A highly standardized and controlled study

In order to understand the psychopathology of the social anxiety disorder (SAD) at the neuroendocrine level, standardized experimental studies on endocrine and physiological markers are necessary, especially since empirical data are still ambiguous. Hence, differences in both, the autonomic nervous system (ANS) and the endocrine stress responses (ACTH, salivary and plasma cortisol) were investigated in a particularly homogenous sample after a standardized stressor (Trier Social Stress Test). The sample consisted of n  = 35 patients with SAD, age, and gender matched to n  = 35 healthy controls (HC). In terms of the heart rate, the response pattern was comparable in both groups. Concerning ACTH, no significant group differences in the response pattern nor in the total output (AUC_G) were exhibited. Significant differences were noticeable only in the plasma cortisol response pattern with less total output (AUC_G) in patients suggesting a blunted response. The salivary cortisol response indicated comparable patterns between groups. However, the patients' total output (AUC_G) was significantly smaller relative to the controls. In sum, evidence for a hypo-responsiveness of the HPA-axis in SAD by means of blood cortisol was observed, with no differences in ACTH between the two groups. This reduced reactivity of the HPA-axis might be associated with an inability to elicit an adequate hormone release, possibly accompanied by an enhanced perception of the stress stimulus. This might be explained by an adaptation of the adrenocortical system due to prolonged repeated stress exposure such as social evaluation.

A Systematic Review of the Psychometric Properties of Multidimensional Trait Perfectionism Self-Report Measures

Different and evolving conceptualisations of perfectionism have led to the development of numerous perfectionism measures in an attempt to capture the true representations of the construct. It is, therefore, important to ensure that these instruments are valid and reliable. The present systematic review examined the literature for the psychometric properties of the most commonly used general multidimensional trait perfectionism self-report measures. Relevant studies were identified by a systematic electronic search of academic databases. A total of 349 studies were identified, with 38 of these meeting inclusion criteria. The psychometric properties presented in each of these studies were subjected to assessment using a standardised protocol. All studies were evaluated by two reviewers independently. Results indicated that while none of the included measures demonstrated adequacy across all of the nine psychometric properties assessed, most were found to possess adequate internal consistency and construct validity. The absence of evidence to support adequate measurement properties over a number of domains for the measures included in this review may be attributed to the criteria of adequacy used, with some appearing overly strict and less relevant to perfectionism measures. Clinical and research relevance of the present findings and directions for future research are discussed.

A systematic review of the psychometric properties of death anxiety self-report measures

Recent research suggests that the transdiagnostic construct of death anxiety may be a basic fear underlying a range of anxiety disorders. Although the investigation of death anxiety in clinical populations is relatively recent, the death anxiety literature as a whole has a longer history evidenced by the number of instruments developed to measure this construct. This systematic review aimed to evaluate the evidence supporting the psychometric properties of self-report death anxiety measures. Relevant studies were identified via a systematic search of four electronic databases in addition to reference list searches. Two independent reviewers evaluated relevant studies using the established Terwee et al. quality appraisal tool. Of the 1831 studies identified, 89 met inclusion criteria. These studies investigated the psychometric properties of 21 self-report scales of death anxiety as well as six subscales. No measure was found to possess evidence of adequacy on all evaluated quality criteria. The Templer Death Anxiety Scale, Concerns about Dying Instrument and Death Concern Scale were found to possess the most evidence supporting their validity and reliability. Overall findings suggest that additional research is needed to establish the psychometric adequacy of death anxiety instruments, especially given increased utilization of these measures in both clinical and research settings.