The reading the mind in the eyes test short form (A & B): validation and outcomes in an amyotrophic lateral sclerosis cohort

Construct validity evidence reporting practices for the Reading the Mind in the Eyes Test: A systematic scoping review

The Reading the Mind in the Eyes Test (RMET) is one of the most influential measures of social cognitive ability, and it has been used extensively in clinical populations. However, questions have been raised about the validity of RMET scores. We conducted a systematic scoping review of the validity evidence reported in studies that administered the RMET (n = 1461; of which 804 included at least one clinical sample) with a focus on six key dimensions: internal consistency, test-retest reliability, factor structure, convergent validity, discriminant validity, and known group validity. Strikingly, 63% of these studies failed to provide validity evidence from any of these six categories. Moreover, when evidence was reported, it frequently failed to meet widely accepted validity standards. Overall, our results suggest a troubling conclusion: the validity of RMET scores (and the research findings based on them) are largely unsubstantiated and uninterpretable. More broadly, this project demonstrates how unaddressed measurement issues can undermine a voluminous psychological literature.

Psychometric Evaluation of the A-NKS: A Diagnostic Instrument to Assess Impairment of Activities of Daily Living in Mild and Major Neurocognitive Disorder According to DSM-5

BACKGROUND

Activities of daily living (ADL) functioning are important in the diagnosis of neurocognitive disorders (NCD), yet no standardized and validated instrument exist based on international classification systems.

OBJECTIVE

We aimed to psychometrically evaluate the differentiated assessment of ADL and instrumental ADL (IADL) impairments due to NCD according to DSM-5 criteria (Instrument für die Erfassung von Alltagsbeeinträchtigungen bei Neurokognitiven Störungen; A-NKS).

METHODS

We conducted a pilot study involving 92 participant-informant dyads of participants with mild or major NCDs, cognitively healthy individuals, and an informant, to test acceptability, internal consistency, and convergent validity with similar measures.

RESULTS

Both A-NKS versions demonstrated excellent internal consistency (α= 0.95 -0.99) and correlate with other instrumental ADL instruments (participant [informant]: Barthel Index: rs = -0.26, p≤0.05 [rs = -0.30, p≤0.01]; Amsterdam IADL: rs = 0.59, p≤0.01 [rs = 0.48, p≤0.01]; SIDAM ADL: rs = 0.46, p≤0.001 [rs = 0.47, p≤0.001]). Additionally, there are correlations with the scale autonomy of the WHOQOL-OLD (rs = -0.50, p≤0.001 [rs = -0.37, p≤0.001]) and physical, as well as cognitive activities (rs = -0.39, p≤0.001 [rs = -0.50, p≤0.001]). They were well-accepted by participants and informants.

CONCLUSIONS

The A-NKS is an instrument with acceptable psychometric properties to assess ADL due to neurodegenerative decline in healthy individuals, and those with mild or major NCD. Further research is needed to confirm reliability and validity and investigate the factor structure.

Neuropsychological impairment in amyotrophic lateral sclerosis-frontotemporal spectrum disorder

Amyotrophic lateral sclerosis (ALS) is a neurodegenerative disease with a rapid course, characterized by motor neuron dysfunction, leading to progressive disability and death. This Review, which is aimed at neurologists, psychologists and other health professionals who follow evidence-based practice relating to ALS and frontotemporal dementia (FTD), examines the neuropsychological evidence that has driven the reconceptualization of ALS as a spectrum disorder ranging from a pure motor phenotype to ALS-FTD. It focuses on changes in cognition and behaviour, which vary in severity across the spectrum: around 50% individuals with ALS are within the normal range, 15% meet the criteria for ALS-FTD, and the remaining 35% are in the mid-spectrum range with milder and more focal impairments. The cognitive impairments include deficits in verbal fluency, executive functions, social cognition and language, and apathy is the most prevalent behavioural change. The pattern and severity of cognitive and behavioural change predicts underlying regional cerebral dysfunction from brain imaging and post-mortem pathology. Our increased recognition of cognition and behaviour as part of the ALS phenotype has led to the development and standardization of assessment tools, which have been incorporated into research and clinical care. Measuring change over the course of the disease is vital for clinical trials, and neuropsychology is proving to be a biomarker for the earliest preclinical changes.

A 20-Year Systematic Review of the 'Reading the Mind in the Eyes' Test across Neurodegenerative Conditions

Social cognition has a broad theoretical definition, which includes the ability to mentalise, i.e., recognise and infer mental states to explain and predict another's behaviour. There is growing recognition of the clinical, diagnostic, and prognostic value of assessing a person's ability to perform social cognitive tasks, particularly aspects of theory of mind, such as mentalising. One such measure of mentalising is the 'Reading the Mind in the Eyes' test (RMET). This systematic review and meta-analysis consider performance on the RMET, applied to people with neurodegenerative conditions in matched control studies, since its publication in 2001. Overall, this review includes 22 papers with data from N = 800 participants with neurodegenerative conditions: Alzheimer's disease, n = 31; Parkinson's disease, n = 221; Lewy body dementia, n = 33; motor neuron disease, n = 218; Huntington's disease n = 80; multiple sclerosis, n = 217; and N = 601 matched typical controls. Our meta-analyses show that deficits in mentalising, as measured by the RMET, are consistently reported across neurodegenerative conditions, with participants in both early and late disease stages being affected. Social cognition is an emerging field of cognitive neuroscience requiring specific and sensitive measurement across each subdomain. Adult-based meta-normative data feature, for which future groups or individuals could be compared against, and hypotheses relating to the source of these mentalising deficits are further discussed. This review was registered with PROSPERO (CRD42020182874).

Validity and diagnostics of the Reading the Mind in the Eyes Test (RMET) in non-demented amyotrophic lateral sclerosis (ALS) patients

Background

The aim of this study was to explore the construct validity and diagnostic properties of the Reading the Mind in the Eyes Test (RMET) in non-demented patients with amyotrophic lateral sclerosis (ALS).

Materials

A total of 61 consecutive patients and 50 healthy controls (HCs) were administered the 36-item RMET. Additionally, patients underwent a comprehensive assessment of social cognition via the Story-Based Empathy Task (SET), which encompasses three subtests targeting Causal Inference, Emotion Attribution (SET-EA), and Intention Attribution (SET-IA), as well as global cognitive [the Edinburgh Cognitive and Behavioral ALS Screen (ECAS)] and behavioral screening [the Frontal Behavioral Inventory (FBI); the Dimensional Apathy Scale (DAS); the Beck Depression Inventory (BDI); and the State and Trait Anxiety Inventory-Y]. The construct validity of the RMET was tested by regressing it within a stepwise model that encompassed as predictors the abovementioned cognitive and behavioral measures, covarying for demographic and motor confounders. Receiver-operating characteristics (ROC) analyses allowed exploring intrinsic and post-test properties of the RMET both in discriminating patients from HCs and in identifying patients with a defective SET-EA performance.

Results

The RMET was solely predicted by the SET-EA (p = 0.003) and SET-IA (p = 0.005). RMET scores showed high accuracy both in discriminating patients from HCs (AUC = 0.81) and in identifying patients with a defective SET-EA score (AUC = 0.82), with adequate-to-optimal both intrinsic and post-test properties.

Discussion

The RMET is a convergently and divergently valid measure of affective social cognition in non-demented ALS patients, also featuring optimal intrinsic and post-test diagnostic properties in both case-control and case-finding scenarios.

'Feeling' or 'sensing' the future? Testing for anomalous cognitions in clinical versus healthy populations

In the study and treatment of psychosis, emotional intelligence (EI) and thinking styles are important patient characteristics for successful outcomes in clinical intervention. Anticipation of unpredictable stimuli (AUS) may be understood as an anomalous perception and anomalous cognition in which an individual supposedly senses and recognizes future stimuli in an unexpected way, also referred to as “hunches or premonitions.” This examined the roles of EI and thinking styles in AUSs in convenience samples of healthy participants (n = 237) versus patients diagnosed with psychosis (n = 118). We adjusted several quadratic and exponential regression models according to the obtained functions. Group means were also compared to examine differences in EI scores for participants with psychosis compared to healthy participants. In the healthy group, EI predicted AUSs with a weight between 42% and 58%. Thinking styles were not correlated with AUSs. However, EI was not correlated with AUSs in the clinical group. Patients with psychosis tended to score higher on AUSs and lower on EI and thinking styles compared to participants in the healthy group. We discuss EI as a variable that can contextualize some anomalous perceptions which are otherwise difficult to classify or measure within the classic psychosis continuum model.

Borderline personality disorder traits and mentalising ability: The self-other social cognition paradox

Objective

Borderline personality disorder (BPD) is a psychiatric condition characterised by a pervasive pattern of impulsivity, low self-image, and interpersonal conflicts. Previous findings indicate a mixed relationship between BPD and social cognition; little research as investigated whether BPD traits influence performance on specific elements of social cognitive tasks, i.e., positive/negative valence.

Method

Community-based typical controls (n = 151; 51% female) were recruited through an online survey. Participants completed aspects of the Personality Assessment Inventory pertaining to BPD traits, the Interpersonal Reactivity Index, and measures of both emotion recognition and mentalising.

Results

Following group stratification into high/low BPD traits, participants with high BPD traits were observed to perform significantly better when identifying negative valence stimuli. Furthermore, high levels of affect instability was found to significantly influence negative valence recognition.

Conclusion

This research highlights previous research which shows a paradox between higher performance on measures of social cognition, with a group of individuals who report significant interpersonal and relational difficulties. This research supports the assessment of social cognitive processes for people with BPD and/or high BPD traits to support clinical formulation of strengths and difficulties.

Correlates of Social Cognition and Psychopathic Traits in a Community-Based Sample of Males

Social cognition is the ability to identify, understand, and interpret mental states and emotions. Psychopathic traits are typically described in two ways; Primary: shallow affect, emotional detachment, and relationship difficulties, and Secondary Psychopathic Traits: antisocial traits, impulsiveness, and emotional dysregulation. People with high psychopathic traits tend to perform lower on measures of social cognition. This study investigated the relationship of social cognition (mentalising) to primary and secondary psychopathic traits in a non-clinical sample, and investigated the psychometric properties of the Reading the Mind in the Eyes Test (RMET) Short Forms (A and B). A community-based male sample (N = 1,000; age range 18-78) was recruited through an online platform. Psychopathic traits were measured using Levenson, Kiehl, and Fitzpatrick's Self-Report Psychopathy Scale, and stratified into Primary and Secondary Psychopathic traits. Secondary validation of the RMET Short Forms was completed investigating scale reliability, and validity. Findings suggest excellent psychometrics in a large community cohort for the RMET Short Forms (A and B), with significant negative correlations on social cognitive performance and high self-report psychopathy. The item valence within the social cognitive measure (positive, negative, and neutral affect stimuli) was also examined, and correlated significantly with both Primary and Secondary Psychopathic traits. This study provides further validation of the RMET Short Forms (A and B), and adds to the literature on the scale by investigating performance on short-form specific valence. This study further suggests that in a non-clinical community sample of males, that higher psychopathic traits correlated significantly, and negatively, with social cognitive performance.