New tests to measure individual differences in matching and labelling facial expressions of emotion, and their association with ability to recognise vocal emotions and facial identity

Multiracial Reading the Mind in the Eyes Test (MRMET): An inclusive version of an influential measure

Can an inclusive test of face cognition meet or exceed the psychometric properties of a prominent less inclusive test? Here, we norm and validate an updated version of the influential Reading the Mind in the Eyes Test (RMET), a clinically significant neuropsychiatric paradigm that has long been used to assess theory of mind and social cognition. Unlike the RMET, our Multiracial Reading the Mind in the Eyes Test (MRMET) incorporates racially inclusive stimuli, nongendered answer choices, ground-truth referenced answers, and more accessible vocabulary. We show, via a series of large datasets, that the MRMET meets or exceeds RMET across major psychometric indices. Moreover, the reliable signal captured by the two tests is statistically indistinguishable, evidence for full interchangeability. We thus present the MRMET as a high-quality, inclusive, normed and validated alternative to the RMET, and as a case in point that inclusivity in psychometric tests of face cognition is an achievable aim. The MRMET test and our normative and validation data sets are openly available under a CC-BY-SA 4.0 license at osf.io/ahq6n.

Dissociations between face identity and face expression processing in developmental prosopagnosia

Individuals with developmental prosopagnosia (DPs) experience severe and lifelong deficits recognising faces, but whether their deficits are selective to the processing of face identity or extend to the processing of face expression remains unclear. Clarifying this issue is important for understanding DP impairments and advancing theories of face processing. We compared identity and expression processing in a large sample of DPs (N = 124) using three different matching tasks that each assessed identity and expression processing with identical experimental formats. We ran each task in upright and inverted orientations and we measured inversion effects to assess the integrity of upright-specific face processes. We report three main results. First, DPs showed large deficits at discriminating identity but only subtle deficits at discriminating expression. Second, DPs showed a reduced inversion effect for identity but a normal inversion effect for expression. Third, DPs' performance on the expression tasks were linked to autism traits, but their performance on the identity tasks were not. These results constitute several dissociations between identity and expression processing in DP, and they are consistent with the view that the core impairment in DP is highly selective to identity.

Processing emotions from faces and words measured by event-related brain potentials

Affective aspects of a stimulus can be processed rapidly and before cognitive attribution, acting much earlier for verbal stimuli than previously considered. Aimed for specific mechanisms, event-related brain potentials (ERPs), expressed in facial expressions or word meaning and evoked by six basic emotions - anger, disgust, fear, happy, sad, and surprise - relative to emotionally neutral stimuli were analysed in a sample of 116 participants. Brain responses in the occipital and left temporal regions elicited by the sadness in facial expressions or words were indistinguishable from responses evoked by neutral faces or words. Confirming previous findings, facial fear elicited an early and strong posterior negativity. Instead of expected parietal positivity, both the happy faces and words produced significantly more negative responses compared to neutral. Surprise in facial expressions and words elicited a strong early response in the left temporal cortex, which could be a signature of appraisal. The results of this study are consistent with the view that both types of affective stimuli, facial emotions and word meaning, set off rapid processing and responses occur very early in the processing stage.

Ostracism modulates children's recognition of emotional facial expressions

Ostracism has been shown to induce considerable physiological, behavioral and cognitive changes in adults. Previous research demonstrated its effects on children's cognitive and behavioral abilities, but less is known about its impact on their capacity to recognize subtle variations in social cues. The present study aimed at investigating whether social manipulations of inclusion and ostracism modulate emotion recognition abilities in children, and whether this modulation varies across childhood. To do so, 5- and 10-year-old children participated in a computer-based ball tossing game called Cyberball during which they were either included or ostracized. Then, they completed a facial emotion recognition task in which they were required to identify neutral facial expressions, or varying levels of intensity of angry and fearful facial expressions. Results indicated lower misidentification rates for children who were previously ostracized as compared to children who were previously included, both at 5 and 10 years of age. Moreover, when looking at children's accuracy and sensitivity to facial expressions, 5-year-olds' decoding abilities were affected by the social manipulation, while no difference between included and ostracized participants was observed for 10-year-olds. In particular, included and ostracized 10-year-old children as well as ostracized 5-year-olds showed higher accuracy and sensitivity for expressions of fear as compared to anger, while no such difference was observed for included 5-year-olds. Overall, the current study presents evidence that Cyberball-induced inclusion and ostracism modulate children's recognition of emotional faces.

Monitoring the effect of oxytocin on the neural sensitivity to emotional faces via frequency-tagging EEG: A double-blind, cross-over study

The neuropeptide oxytocin (OXT) is suggested to exert an important role in human social behaviors by modulating the salience of social cues. To date, however, there is mixed evidence whether a single dose of OXT can improve the behavioral and neural sensitivity for emotional face processing. To overcome difficulties encountered with classic event-related potential studies assessing stimulus-saliency, we applied frequency-tagging EEG to implicitly assess the effect of a single dose of OXT (24 IU) on the neural sensitivity for positive and negative facial emotions. Neutral faces with different identities were presented at 6 Hz, periodically interleaved with an expressive face (angry, fearful, and happy, in separate sequences) every fifth image (i.e., 1.2 Hz oddball frequency). These distinctive frequency tags for neutral and expressive stimuli allowed direct and objective quantification of the neural expression-categorization responses. The study involved a double-blind, placebo-controlled, cross-over trial with 31 healthy adult men. Contrary to our expectations, we did not find an effect of OXT on facial emotion processing, neither at the neural, nor at the behavioral level. A single dose of OXT did not evoke social enhancement in general, nor did it affect social approach-avoidance tendencies. Possibly ceiling performances in facial emotion processing might have hampered further improvement.

Study development and protocol for a cohort study examining the impact of baseline social cognition on response to treatment for people living with post-traumatic stress disorder

Background: Social cognitive impairments, specifically in facial emotion processing and mental state attribution, are common in post-traumatic stress disorder. However few studies so far have examined whether social cognitive ability impacts on PTSD recovery. Objective: To examine whether baseline social cognitive abilities are associated with treatment outcomes following trauma-focused therapy for PTSD. Method: This is a cohort study that will relate treatment outcomes post-discharge to baseline measures of social cognition (five tasks: Emotion Odd-One-Out Task (Oddity), Reading the Mind in the Eyes Task (RMET), Social Shapes Test (SST), Spontaneous Theory of Mind Protocol (STOMP), and Reflective Functioning Questionnaire (RFQ-8)) in people starting a course of psychological therapy for PTSD (target N = 60). The primary outcome will be pre- to post-treatment change in PTSD symptom severity (assessed using the PTSD Checklist for DSM-5). Secondary outcomes include functional impairment (assessed using the Work and Social Adjustment Scale), drop-out rate, and analyses differentiating participants with DSM-5 PTSD and ICD-11 PTSD and CPTSD. Regression models will be used to examine associations between baseline social cognitive performance and outcome measures while adjusting for potential confounders. Two pilot studies informed the development of our study protocol. The first involved qualitative analysis of interviews with nine participants with lived experience of mental health problems to inform our research questions and study protocol. The second involved trialling social cognitive tasks on 20 non-clinical participants to refine our test battery. Discussion: This study will address a gap in the literature about whether abilities in social cognition in people living with PTSD are associated with treatment-related recovery.

HIGHLIGHTS

Impairments in social cognition are recognised in people with PTSD.Few studies have examined whether social cognitive ability is associated with recovery from PTSD.We present a study protocol, developed after pilot testing, to address this question.

Anodal tDCS effects over the left dorsolateral prefrontal cortex (L-DLPFC) on the rating of facial expression: evidence for a gender-specific effect

The accurate recognition of others' facial expressions is a core skill for social interactions. The left Dorsolateral Prefrontal Cortex (L-DLPFC) represents a key node in the network for facial emotion recognition. However, its specific role is still under debate. As such, the aim of the current neuromodulation study was to assess the causal role of the L-DLPFC in humans' rating of facial expressions of emotions and implicit attitudes toward other races. In this sham-controlled single-blind between-subject experiment, we offline administered L-DLPFC transcranial direct current stimulation (tDCS) to 69 healthy participants who were divided into three groups of 23 (each receiving anodal 1 mA tDCS, anodal 2 mA tDCS, or Sham), before completing an "Emotion Rating task and two Implicit Association Tests (IATs). The former required the intensity rating of 192 faces (half black and half white) displaying happiness, sadness, anger, or fear. The IATs were designed to assess participants' automatic associations of positive or negative attributes with racial contents. Results on the Emotion Rating task showed participants' gender-specific effect of tDCS. Specifically, a gender bias, with only males showing a tendency to underestimate negative emotions was found in Sham, and absent in the tDCS groups. When considering the race of the stimuli, females but not males in Sham exhibited a racial bias, that is, the tendency to overestimate negative emotions of other-race faces. Again, the bias disappeared in the tDCS groups. Concerning the IATs, no significant effects emerged. We conclude that the L-DLPFC plays a critical role in humans' rating of facial expressions, and for variability in other-race emotional judgements. These results shed light on the neural bases of the human emotional system and its gender-related differences, and have potential implications for interventional settings.

The role of stimulus-based cues and conceptual information in processing facial expressions of emotion

Face shape and surface textures are two important cues that aid in the perception of facial expressions of emotion. Additionally, this perception is also influenced by high-level emotion concepts. Across two studies, we use representational similarity analysis to investigate the relative roles of shape, surface, and conceptual information in the perception, categorisation, and neural representation of facial expressions. In Study 1, 50 participants completed a perceptual task designed to measure the perceptual similarity of expression pairs, and a categorical task designed to measure the confusability between expression pairs when assigning emotion labels to a face. We used representational similarity analysis and constructed three models of the similarities between emotions using distinct information. Two models were based on stimulus-based cues (face shapes and surface textures) and one model was based on emotion concepts. Using multiple linear regression, we found that behaviour during both tasks was related with the similarity of emotion concepts. The model based on face shapes was more related with behaviour in the perceptual task than in the categorical, and the model based on surface textures was more related with behaviour in the categorical than the perceptual task. In Study 2, 30 participants viewed facial expressions while undergoing fMRI, allowing for the measurement of brain representational geometries of facial expressions of emotion in three core face-responsive regions (the Fusiform Face Area, Occipital Face Area, and Superior Temporal Sulcus), and a region involved in theory of mind (Medial Prefrontal Cortex). Across all four regions, the representational distances between facial expression pairs were related to the similarities of emotion concepts, but not to either of the stimulus-based cues. Together, these results highlight the important top-down influence of high-level emotion concepts both in behavioural tasks and in the neural representation of facial expressions.

Investigating individual differences in emotion recognition ability using the ERAM test

Individuals vary in emotion recognition ability (ERA), but the causes and correlates of this variability are not well understood. Previous studies have largely focused on unimodal facial or vocal expressions and a small number of emotion categories, which may not reflect how emotions are expressed in everyday interactions. We investigated individual differences in ERA using a brief test containing dynamic multimodal (facial and vocal) expressions of 5 positive and 7 negative emotions (the ERAM test). Study 1 (N = 593) showed that ERA was positively correlated with emotional understanding, empathy, and openness, and negatively correlated with alexithymia. Women also had higher ERA than men. Study 2 was conducted online and replicated the recognition rates from Study 1 (which was conducted in lab) in a different sample (N = 106). Study 2 also showed that participants who had higher ERA were more accurate in their meta-cognitive judgments about their own accuracy. Recognition rates for visual, auditory, and audio-visual expressions were substantially correlated in both studies. Results provide further clues about the underlying structure of ERA and its links to broader affective processes. The ERAM test can be used for both lab and online research, and is freely available for academic research.

Facial Emotion Recognition and Executive Functions in Fibromyalgia

OBJECTIVE

The ability to accurately identify facial expressions of emotions is crucial in human interaction. Although a previous study suggested deficient emotional face recognition in patients with fibromyalgia, not much is known about the origin of this impairment. Against this background, the present study investigated the role of executive functions. Executive functions refer to cognitive control mechanisms enabling implementation and coordination of basic mental operations. Deficits in this domain are prevalent in fibromyalgia.

METHODS

Fifty-two fibromyalgia patients and thirty-two healthy individuals completed the Ekman-60 Faces Test, which requires classification of facial displays of happiness, sadness, anger, fear, surprise, and disgust. They also completed eight tasks assessing the executive function components of shifting, updating, and inhibition. Effects of comorbid depression and anxiety disorders, as well as medication use, were tested in stratified analyses of patient subgroups.

RESULTS

Patients made more errors overall than controls in classifying the emotional expressions. Moreover, their recognition accuracy correlated positively with performance on most of the executive function tasks. Emotion recognition did not vary as a function of comorbid psychiatric disorders or medication use.

CONCLUSIONS

The study supports impaired facial emotion recognition in fibromyalgia, which may contribute to the interaction problems and poor social functioning characterizing this condition. Facial emotion recognition is regarded as a complex process, which may be particularly reliant on efficient coordination of various basic operations by executive functions. As such, the correlations between cognitive task performance and recognition accuracy suggest that deficits in higher cognitive functions underlie impaired emotional communication in fibromyalgia.

It Works Without Words

Abstract. Emotion recognition ability of emotions expressed by other people (ERA-O) can be important for job performance, leadership, bargaining, and career success. Traditional personnel assessment tools of this ability, however, are contaminated by linguistic skills. In a time of global work migration, more and more people speak a language at work that is not their mother tongue. Consequently, we developed and validated the Face-Based Emotion Matching Test (FEMT), a nonlinguistic objective test of ERA-O in gainfully employed adults. We demonstrate the FEMT’s validity with psychological constructs (cognitive and emotional intelligence, Big Five personality traits) and its criterion validity and interethnic fit.

Neuropsychological Subgroups of Emotion Processing in Youths With Conduct Disorder

Background: At the group level, youths with conduct disorder (CD) show deficient emotion processing across various tasks compared to typically developing controls (TDC). But little is known about neuropsychological subgroups within the CD population, the clinical correlates of emotion processing deficits [for instance, with regard to the presence or absence of the DSM-5 Limited Prosocial Emotions (LPE) specifier], and associated risk factors. Methods: 542 children and adolescents with CD (317 girls) and 710 TDCs (479 girls), aged 9-18 years, were included from the FemNAT-CD multisite study. All participants completed three neuropsychological tasks assessing emotion recognition, emotion learning, and emotion regulation. We used a self-report measure of callous-unemotional traits to create a proxy for the LPE specifier. Results: Relative to TDCs, youths with CD as a group performed worse in all three emotion domains. But using clinically based cut-off scores, we found poor emotion recognition skills in only 23% of the participants with CD, followed by emotion regulation deficits in 18%, and emotion learning deficits in 13% of the CD group. Critically, the majority of youths with CD (~56%) did not demonstrate any meaningful neuropsychological deficit, and only a very small proportion showed pervasive deficits across all three domains (~1%). Further analyses indicate that established DSM-5 subtypes of CD are not tightly linked to neurocognitive deficits in one particular emotion domain over another (i.e., emotion recognition deficits in CD+LPE vs. emotion regulation deficits in CD-LPE). Conclusions: Findings from this large-scale data set suggest substantial neuropsychological diversity in emotion processing in the CD population and, consequently, only a subgroup of youths with CD are likely to benefit from additional behavioral interventions specifically targeting emotion processing mechanisms.

Consistent behavioral and electrophysiological evidence for rapid perceptual discrimination among the six human basic facial expressions

The extent to which the six basic human facial expressions perceptually differ from one another remains controversial. For instance, despite the importance of rapidly decoding fearful faces, this expression often is confused with other expressions, such as Surprise in explicit behavioral categorization tasks. We quantified implicit visual discrimination among rapidly presented facial expressions with an oddball periodic visual stimulation approach combined with electroencephalography (EEG), testing for the relationship with behavioral explicit measures of facial emotion discrimination. We report robust facial expression discrimination responses bilaterally over the occipito-temporal cortex for each pairwise expression change. While fearful faces presented as repeated stimuli led to the smallest deviant responses from all other basic expressions, deviant fearful faces were well discriminated overall and to a larger extent than expressions of Sadness and Anger. Expressions of Happiness did not differ quantitatively as much in EEG as for behavioral subjective judgments, suggesting that the clear dissociation between happy and other expressions, typically observed in behavioral studies, reflects higher-order processes. However, this expression differed from all others in terms of scalp topography, pointing to a qualitative rather than quantitative difference. Despite this difference, overall, we report for the first time a tight relationship of the similarity matrices across facial expressions obtained for implicit EEG responses and behavioral explicit measures collected under the same temporal constraints, paving the way for new approaches of understanding facial expression discrimination in developmental, intercultural, and clinical populations.

Are affective factors related to individual differences in facial expression recognition?

Evidence that affective factors (e.g. anxiety, depression, affect) are significantly related to individual differences in emotion recognition is mixed. Palermo et al. (Palermo et al. 2018 J. Exp. Psychol. Hum. Percept. Perform. 44, 503-517) reported that individuals who scored lower in anxiety performed significantly better on two measures of facial-expression recognition (emotion-matching and emotion-labelling tasks), but not a third measure (the multimodal emotion recognition test). By contrast, facial-expression recognition was not significantly correlated with measures of depression, positive or negative affect, empathy, or autistic-like traits. Because the range of affective factors considered in this study and its use of multiple expression-recognition tasks mean that it is a relatively comprehensive investigation of the role of affective factors in facial expression recognition, we carried out a direct replication. In common with Palermo et al. (Palermo et al. 2018 J. Exp. Psychol. Hum. Percept. Perform. 44, 503-517), scores on the DASS anxiety subscale negatively predicted performance on the emotion recognition tasks across multiple analyses, although these correlations were only consistently significant for performance on the emotion-labelling task. However, and by contrast with Palermo et al. (Palermo et al. 2018 J. Exp. Psychol. Hum. Percept. Perform. 44, 503-517), other affective factors (e.g. those related to empathy) often also significantly predicted emotion-recognition performance. Collectively, these results support the proposal that affective factors predict individual differences in emotion recognition, but that these correlations are not necessarily specific to measures of general anxiety, such as the DASS anxiety subscale.

Rapid neural categorization of angry and fearful faces is specifically impaired in boys with autism spectrum disorder

BACKGROUND

Difficulties with facial expression processing may be associated with the characteristic social impairments in individuals with autism spectrum disorder (ASD). Emotional face processing in ASD has been investigated in an abundance of behavioral and EEG studies, yielding, however, mixed and inconsistent results.

METHODS

We combined fast periodic visual stimulation (FPVS) with EEG to assess the neural sensitivity to implicitly detect briefly presented facial expressions among a stream of neutral faces, in 23 boys with ASD and 23 matched typically developing (TD) boys. Neutral faces with different identities were presented at 6 Hz, periodically interleaved with an expressive face (angry, fearful, happy, sad in separate sequences) every fifth image (i.e., 1.2 Hz oddball frequency). These distinguishable frequency tags for neutral and expressive stimuli allowed direct and objective quantification of the expression-categorization responses, needing only four sequences of 60 s of recording per condition.

RESULTS

Both groups show equal neural synchronization to the general face stimulation and similar neural responses to happy and sad faces. However, the ASD group displays significantly reduced responses to angry and fearful faces, compared to TD boys. At the individual subject level, these neural responses allow to predict membership of the ASD group with an accuracy of 87%. Whereas TD participants show a significantly lower sensitivity to sad faces than to the other expressions, ASD participants show an equally low sensitivity to all the expressions.

CONCLUSIONS

Our results indicate an emotion-specific processing deficit, instead of a general emotion-processing problem: Boys with ASD are less sensitive than TD boys to rapidly and implicitly detect angry and fearful faces. The implicit, fast, and straightforward nature of FPVS-EEG opens new perspectives for clinical diagnosis.

Diagnosing developmental prosopagnosia: repeat assessment using the Cambridge Face Memory Test

Developmental prosopagnosia (DP) is a cognitive condition characterized by a relatively selective impairment in face recognition. Currently, people are screened for DP via a single attempt at objective face-processing tests, usually all presented on the same day. However, several variables probably influence performance on these tests irrespective of actual ability, and the influence of repeat administration is also unknown. Here, we assess, for the first known time, the test-retest reliability of the Cambridge Face Memory Test (CFMT)-the leading task used worldwide to diagnose DP. This value was found to fall just below psychometric standards, and single-case analyses revealed further inconsistencies in performance that were not driven by testing location (online or in-person), nor the time-lapse between attempts. Later administration of an alternative version of the CFMT (the CFMT-Aus) was also found to be valuable in confirming borderline cases. Finally, we found that performance on the first 48 trials of the CFMT was equally as sensitive as the full 72-item score, suggesting that the instrument may be shortened for testing efficiency. We consider the implications of these findings for existing diagnostic protocols, concluding that two independent tasks of unfamiliar face memory should be completed on separate days.

Expression Recognition Difficulty Is Associated with Social But Not Attention-to-Detail Autistic Traits and Reflects Both Alexithymia and Perceptual Difficulty

Autistic people often show difficulty with facial expression recognition. However, the degree of difficulty varies widely, which might reflect varying symptom profiles. We examined three domains of autistic traits in the typical population and found that more autistic-like social skills were associated with greater difficulty labelling expressions, and more autistic-like communication was associated with greater difficulty labelling and perceptually discriminating between expressions. There were no associations with autistic-like attention to detail. We also found that labelling, but not perceptual, difficulty was mediated by alexithymia. We found no evidence that labelling or perceptual difficulty was mediated by weakened adaptive coding. Results suggest expression recognition varies between the sub-clinical expressions of autistic symptom domains and reflects both co-occurring alexithymia and perceptual difficulty.

Fast Periodic Visual Stimulation EEG Reveals Reduced Neural Sensitivity to Fearful Faces in Children with Autism

We objectively quantified the neural sensitivity of school-aged boys with and without autism spectrum disorder (ASD) to detect briefly presented fearful expressions by combining fast periodic visual stimulation with frequency-tagging electroencephalography. Images of neutral faces were presented at 6 Hz, periodically interleaved with fearful expressions at 1.2 Hz oddball rate. While both groups equally display the face inversion effect and mainly rely on information from the mouth to detect fearful expressions, boys with ASD generally show reduced neural responses to rapid changes in expression. At an individual level, fear discrimination responses predict clinical status with an 83% accuracy. This implicit and straightforward approach identifies subtle deficits that remain concealed in behavioral tasks, thereby opening new perspectives for clinical diagnosis.

The Musical Emotion Discrimination Task: A New Measure for Assessing the Ability to Discriminate Emotions in Music

Previous research has shown that levels of musical training and emotional engagement with music are associated with an individual's ability to decode the intended emotional expression from a music performance. The present study aimed to assess traits and abilities that might influence emotion recognition, and to create a new test of emotion discrimination ability. The first experiment investigated musical features that influenced the difficulty of the stimulus items (length, type of melody, instrument, target-/comparison emotion) to inform the creation of a short test of emotion discrimination. The second experiment assessed the contribution of individual differences measures of emotional and musical abilities as well as psychoacoustic abilities. Finally, the third experiment established the validity of the new test against other measures currently used to assess similar abilities. Performance on the Musical Emotion Discrimination Task (MEDT) was significantly associated with high levels of self-reported emotional engagement with music as well as with performance on a facial emotion recognition task. Results are discussed in the context of a process model for emotion discrimination in music and psychometric properties of the MEDT are provided. The MEDT is freely available for research use.

Functional neural correlates of facial affect recognition impairment following TBI

Facial affect recognition deficits following traumatic brain injury (TBI) have been well documented, as has their relationship with impairment in several other cognitive domains. However, little is known about the neurobiological mechanisms underlying affect recognition deficits, in particular mechanisms underlying different aspects of facial affect recognition (e.g., perceptual and interpretive processes). In the current study, 33 adults with moderate-to-severe TBI and 24 demographically matched healthy comparison (HC) participants completed an fMRI facial affect recognition study. While in the scanner, participants were asked to match the affect of a target face to either (a) one of two faces differing in affect (perceptual condition) or (b) one of two written affect labels (interpretative condition). In both groups we found activations in regions typically involved in affect recognition. Our results revealed that in the perceptual condition individuals with TBI tended to activate the left dorsolateral prefrontal cortex less than HCs, and within the HC group individuals with higher perceptual affect recognition scores showed higher levels of activation in the same brain region. Individuals with TBI who were specifically impaired at interpretative affect recognition showed less activation than HCs in the right fusiform gyrus. Moreover, in the labeling condition individuals with TBI tended to de-activate medial prefrontal regions less than HCs. A region of interest analysis revealed that individuals with TBI showed significantly less activation than HCs in the FFA for all the contrasts of interest. Our results suggest involvement of several brain regions in facial affect recognition impairment post TBI, and provide neurobiological support for the notion that distinct aspects of facial affect recognition can be differentially impaired following TBI.

A meta-analysis of the relationship between emotion recognition ability and intelligence

The ability to recognise others' emotions from nonverbal cues (emotion recognition ability, ERA) is measured with performance-based tests and has many positive correlates. Although researchers have long proposed that ERA is related to general mental ability or intelligence, a comprehensive analysis of this relationship is lacking. For instance, it remains unknown whether the magnitude of the association varies by intelligence type, ERA test features, as well as demographic variables. The present meta-analysis examined the relationship between ERA and intelligence based on 471 effect sizes from 133 samples and found a significant mean effect size (controlled for nesting within samples) of r = .19. Different intelligence types (crystallized, fluid, spatial, memory, information processing speed and efficiency) yielded similar effect sizes, whereas academic achievement measures (e.g. SAT scores) were unrelated to ERA. Effect sizes were higher for ERA tests that simultaneously present facial, vocal, and bodily cues (as compared to tests using static pictures) and for tests with higher reliability and more emotions. Results were unaffected by most study and sample characteristics, but effect size increased with higher mean age of the sample. These findings establish ERA as sensory-cognitive ability that is distinct from, yet related to, intelligence.

Acute Exercise and Emotion Recognition in Young Adolescents

While there is evidence that acute bouts of aerobic and coordinative exercise positively affect attention and executive functions, no study has focused on the impact of acute exercise on facial-emotion processing. A total of 106 adolescents (mean age 13.0 years) were randomly assigned to a group performing either an aerobic exercise session (AER), an aerobic exercise session with coordinative demands (AER+C), or stretching. Before and after the 35-min experimental session, participants completed computerized facial-emotion labeling and emotion-matching tasks. Facial-emotion labeling, but not emotion matching, increased over time, but more so in AER and AER+C conditions. When aerobic exercise is combined with coordinative demands, greater benefits seem to be elicited for some aspects of facial-emotion recognition. Results suggest a new direction for the influence of exercising on dimensions of psychological functioning, namely on emotion processing and social cognition.

Anodal tDCS and High-Frequency tRNS Targeting the Occipitotemporal Cortex Do Not Always Enhance Face Perception

There has been increasing interest in the utility of transcranial electrical stimulation as a tool to enhance cognitive abilities. In the domain of face perception, enhancements have been reported for both transcranial direct current stimulation (tDCS) and high-frequency transcranial random noise stimulation (tRNS) targeting the occipitotemporal cortex. In a series of two experiments, we attempted to replicate these findings for face identity perception, and extend on previous studies, to determine if similar enhancements are also observed for object and facial expression perception. In Experiment 1, using a single blind, between-subjects design in healthy volunteers (N = 53), we examined whether anodal tDCS over the occipitotemporal cortex enhanced performance on tasks involving perception of face identity, facial expression, and object stimuli, when compared to sham stimulation. We failed to replicate previous findings of enhanced performance on face and object perception, nor extend findings to facial expression perception. In Experiment 2, using a single blind, between-subjects design (N = 39), we examined the effect of high-frequency tRNS over the occipitotemporal cortex using the same three tasks employed in Experiment 1. We failed to replicate previous findings of enhanced face perception following high-frequency tRNS over the occipitotemporal cortex, relative to sham stimulation (although we used different stimulation parameters to that employed in a previous study). We also found no evidence of enhanced facial expression and object perception following high-frequency tRNS. The findings align with a growing body of studies that have failed to replicate previously reported enhancements following administration of tDCS and hint for different efficacy of, on first sight, related stimulation protocols. Future studies should explore the foundation of these differential effects in greater detail.

How generalizable is the inverse relationship between social class and emotion perception?

Compared to individuals in lower positions of power, higher-power individuals are theorized to be less motivated to attend to social cues. In support of this theory, previous research has consistently documented negative correlations between social class and emotion perception. Prior studies, however, were limited by the size and diversity of the participant samples as well as the systematicity with which social class and emotion perception were operationalized. Here, we examine the generalizability of prior research across 10,000+ total participants. In an initial modest sample, (n = 179), Study 1 partially replicated past results: emotion identification correlated negativity with subjective social class (β = -0.15, 95% CI = [-0.28,-0.02]) and one of two objective social class measures (participant education β = -0.15, 95% CI = [-0.03,-0.01]). Studies 2-4 followed up on Study 1's mixed results for objective social class in three much larger samples. These results diverged from past literature. In Study 2, complex emotion identification correlated non-significantly with participant education (β = 0.02, p = 0.25; 95% CI = [-0.01, 0.05], n = 2,726), positively with childhood family income (β = 0.03, 95% CI = [0.01,0.06], n = 4,312), and positively with parental education (β = 0.06, 95% CI = [0.04,0.09], n = 4,225). In Study 3, basic emotion identification correlated positively with participant education (β = 0.05, 95% CI = [0.02, 0.09]), n = 2,564). In Study 4, basic emotion discrimination correlated positively with participant education (β = 0.09, 95% CI = [0.05,0.13], n = 2,079), positively with parental education (β = 0.06, 95% CI = [0.02,0.09], n = 3,225), and non-significantly with childhood family income (β = 0.2, 95% CI = [0.01,0.07], n = 3,272). Results remained similar when restricting analyses to U.S.-based participants. Taken together, these findings suggest that previously reported negative correlations between emotion perception and social class may generalize poorly past select samples and/or subjective measures of social class. Data from the three large web-based samples used in Studies 2-4 are available at osf.io/jf7r3 as normative datasets and to support future investigations of these and other research questions.

White matter correlates of different aspects of facial affect recognition impairment following traumatic brain injury

Although facial affect recognition deficits are well documented in individuals with moderate-to-severe traumatic brain injury (TBI), little research has examined the neural mechanisms underlying these impairments. Here, we use diffusion tensor imaging (DTI), specifically the scalars fractional anisotropy (FA), mean diffusivity (MD), and radial diffusivity (RD), to examine relationships between regional white-matter integrity and two facial affect sub-skills: perceptual affect recognition abilities (measured by an affect matching task) and verbal categorization of facial affect (measured by an affect labeling task). Our results showed that, within the TBI group, higher levels of white-matter integrity in tracts involved in affect recognition (inferior fronto-occipital, inferior longitudinal, and uncinate fasciculi) were associated with better performance on both tasks. Verbal categorization skills were specifically and positively correlated with integrity of the left uncinate fasciculus. Moreover, we observed a striking lateralization effect, with perceptual abilities having an almost exclusive relationship with integrity of right hemisphere tracts, while verbal abilities were associated with both left and right hemisphere integrity. The findings advance our understanding of the neurobiological mechanisms that underlie subcomponents of facial affect recognition and lead to different patterns of facial affect recognition impairment in adults with TBI.

Different aspects of facial affect recognition impairment following traumatic brain injury: The role of perceptual and interpretative abilities

It is well established that many individuals with traumatic brain injury (TBI) are impaired at facial affect recognition, yet little is known about the mechanisms underlying such deficits. In particular, little work has examined whether the breakdown of facial affect recognition abilities occurs at the perceptual level (e.g., recognizing a smile) or at the verbal categorization stage (e.g., assigning the label "happy" to a smiling face). The aim of the current study was to investigate the integrity of these two distinct facial affect recognition subskills in a sample of 38 individuals with moderate-to-severe TBI and 24 demographically matched healthy individuals. Participants were administered an affect matching (perceptual skills) and an affect labeling (verbal categorization skills) task. Statistical analyses revealed that, while individuals with TBI showed significantly higher levels of impairment in the verbal categorization task than in the perceptual task, they performed less well than healthy comparison participants on both tasks. These findings indicate that facial affect recognition impairment can occur at different cognitive stages following TBI, suggesting the necessity of careful screening to offer targeted treatment. Moreover, they provide further neuropsychological evidence supporting the notion that distinct types of subskills are necessary to achieve successful recognition of facial affects.

The Two-Systems Account of Theory of Mind: Testing the Links to Social- Perceptual and Cognitive Abilities

According to the two-systems account of theory of mind (ToM), understanding mental states of others involves both fast social-perceptual processes, as well as slower, reflexive cognitive operations (Frith and Frith, 2008; Apperly and Butterfill, 2009). To test the respective roles of specific abilities in either of these processes we administered 15 experimental procedures to a large sample of 343 participants, testing ability in face recognition and holistic perception, language, and reasoning. ToM was measured by a set of tasks requiring ability to track and to infer complex emotional and mental states of others from faces, eyes, spoken language, and prosody. We used structural equation modeling to test the relative strengths of a social-perceptual (face processing related) and reflexive-cognitive (language and reasoning related) path in predicting ToM ability. The two paths accounted for 58% of ToM variance, thus validating a general two-systems framework. Testing specific predictor paths revealed language and face recognition as strong and significant predictors of ToM. For reasoning, there were neither direct nor mediated effects, albeit reasoning was strongly associated with language. Holistic face perception also failed to show a direct link with ToM ability, while there was a mediated effect via face recognition. These results highlight the respective roles of face recognition and language for the social brain, and contribute closer empirical specification of the general two-systems account.

Super-recognition in development: A case study of an adolescent with extraordinary face recognition skills

Face recognition abilities vary widely. While face recognition deficits have been reported in children, it is unclear whether superior face recognition skills can be encountered during development. This paper presents O.B., a 14-year-old female with extraordinary face recognition skills: a "super-recognizer" (SR). O.B. demonstrated exceptional face-processing skills across multiple tasks, with a level of performance that is comparable to adult SRs. Her superior abilities appear to be specific to face identity: She showed an exaggerated face inversion effect and her superior abilities did not extend to object processing or non-identity aspects of face recognition. Finally, an eye-movement task demonstrated that O.B. spent more time than controls examining the nose - a pattern previously reported in adult SRs. O.B. is therefore particularly skilled at extracting and using identity-specific facial cues, indicating that face and object recognition are dissociable during development, and that super recognition can be detected in adolescence.

Structural connections support emotional connections: Uncinate Fasciculus microstructure is related to the ability to decode facial emotion expressions

The Uncinate Fasciculus (UF) is an association fibre tract connecting regions in the frontal and anterior temporal lobes. UF disruption is seen in several disorders associated with impaired social behaviour, but its functional role is unclear. Here we set out to test the hypothesis that the UF is important for facial expression processing, an ability fundamental to adaptive social behaviour. In two separate experiments in healthy adults, we used high-angular resolution diffusion-weighted imaging (HARDI) and constrained spherical deconvolution (CSD) tractography to virtually dissect the UF, plus a control tract (the corticospinal tract (CST)), and quantify, via fractional anisotropy (FA), individual differences in tract microstructure. In Experiment 1, participants completed the Reading the Mind in the Eyes Task (RMET), a well-validated assay of facial expression decoding. In Experiment 2, a different set of participants completed the RMET, plus an odd-emotion-out task of facial emotion discrimination. In both experiments, participants also completed a control odd-identity-out facial identity discrimination task. In Experiment 1, FA of the right-, but not the left-hemisphere, UF was significantly correlated with performance on the RMET task, specifically for emotional, but not neutral expressions. UF FA was not significantly correlated with facial identity discrimination performance. In Experiment 2, FA of the right-, but not left-hemisphere, UF was again significantly correlated with performance on emotional items from the RMET, together with performance on the facial emotion discrimination task. Again, no significant association was found between UF FA and facial identity discrimination performance. Our findings highlight the contribution of right-hemisphere UF microstructure to inter-individual variability in the ability to decode facial emotion expressions, and may explain why disruption of this pathway affects social behaviour.

•

We studied white matter microstructure correlates of facial emotion decoding skills.

•

Focused on the role of a key limbic tract, the Uncinate Fasciculus (UF).

•

Right UF microstructure linked to facial expression decoding skills.

•

UF microstructure not related to facial identity discrimination skills.

•

Right UF has a distinct role in the processing of facial expressions of emotion.

Neural substrates of the ability to recognize facial expressions: a voxel-based morphometry study

The recognition of facial expressions of emotion is adaptive for human social interaction, but the ability to do this and the manner in which it is achieved differs among individuals. Previous functional neuroimaging studies have demonstrated that some brain regions, such as the inferior frontal gyrus (IFG), are active during the response to emotional facial expressions in healthy participants, and lesion studies have demonstrated that damage to these structures impairs the recognition of facial expressions. However, it remains to be established whether individual differences in the structure of these regions could be associated with differences in the ability to recognize facial expressions. We investigated this issue using acquired structural magnetic resonance imaging, and assessed the performance of healthy adults with respect to recognition of the facial expressions of six basic emotions. The gray matter volume of the right IFG positively correlated with the total accuracy of facial expression recognition. This suggests that individual differences in the ability to recognize facial expressions are associated with differences in the structure of the right IFG. Furthermore, the mirror neuron activity of the IFG may be important for establishing efficient facial mimicry to facilitate emotion recognition.

Facial emotion perception in patients with epilepsy: A systematic review with meta-analysis

Facial emotion perception is a fundamental social competency relying on a specialised, yet distributed, neural network. This review aimed to determine whether patients with epilepsy have facial emotion perception accuracy impairments overall, or for a subset of emotions (anger, disgust, happiness, sadness, fear, and surprise), and the relationship to epilepsy type, demographic/treatment variables, and brain organisation. Database searches used PRISMA guidelines with strict inclusion/exclusion criteria. Thirty included studies assessed patients with temporal lobe (TLE; n=709), frontocentral (FCE; n=22), and genetic generalised (GGE; n=48) epilepsy. Large deficits emerged in patients with epilepsy compared to controls (n=746; Hedges' g=0.908-1.076). Patients with TLE were significantly impaired on all emotions except surprise; patients with GGE were significantly impaired in anger, disgust, and fear perception. Meta-regression of patients with TLE revealed younger age at testing was associated with lower accuracy. This review provides evidence for marked global deficits of emotion perception in epilepsy, with differential emotion-specific impairment patterns in patients with TLE and GGE.

Social perception and aging: The relationship between aging and the perception of subtle changes in facial happiness and identity

Previous findings suggest that older adults show impairments in the social perception of faces, including the perception of emotion and facial identity. The majority of this work has tended to examine performance on tasks involving young adult faces and prototypical emotions. While useful, this can influence performance differences between groups due to perceptual biases and limitations on task performance. Here we sought to examine how typical aging is associated with the perception of subtle changes in facial happiness and facial identity in older adult faces. We developed novel tasks that permitted the ability to assess facial happiness, facial identity, and non-social perception (object perception) across similar task parameters. We observe that aging is linked with declines in the ability to make fine-grained judgements in the perception of facial happiness and facial identity (from older adult faces), but not for non-social (object) perception. This pattern of results is discussed in relation to mechanisms that may contribute to declines in facial perceptual processing in older adulthood.

The EU-AIMS Longitudinal European Autism Project (LEAP): design and methodologies to identify and validate stratification biomarkers for autism spectrum disorders

BACKGROUND

The tremendous clinical and aetiological diversity among individuals with autism spectrum disorder (ASD) has been a major obstacle to the development of new treatments, as many may only be effective in particular subgroups. Precision medicine approaches aim to overcome this challenge by combining pathophysiologically based treatments with stratification biomarkers that predict which treatment may be most beneficial for particular individuals. However, so far, we have no single validated stratification biomarker for ASD. This may be due to the fact that most research studies primarily have focused on the identification of mean case-control differences, rather than within-group variability, and included small samples that were underpowered for stratification approaches. The EU-AIMS Longitudinal European Autism Project (LEAP) is to date the largest multi-centre, multi-disciplinary observational study worldwide that aims to identify and validate stratification biomarkers for ASD.

METHODS

LEAP includes 437 children and adults with ASD and 300 individuals with typical development or mild intellectual disability. Using an accelerated longitudinal design, each participant is comprehensively characterised in terms of clinical symptoms, comorbidities, functional outcomes, neurocognitive profile, brain structure and function, biochemical markers and genomics. In addition, 51 twin-pairs (of which 36 had one sibling with ASD) are included to identify genetic and environmental factors in phenotypic variability.

RESULTS

Here, we describe the demographic characteristics of the cohort, planned analytic stratification approaches, criteria and steps to validate candidate stratification markers, pre-registration procedures to increase transparency, standardisation and data robustness across all analyses, and share some 'lessons learnt'. A clinical characterisation of the cohort is given in the companion paper (Charman et al., accepted).

CONCLUSION

We expect that LEAP will enable us to confirm, reject and refine current hypotheses of neurocognitive/neurobiological abnormalities, identify biologically and clinically meaningful ASD subgroups, and help us map phenotypic heterogeneity to different aetiologies.

Supporting the Self-Management of Chronic Pain Conditions with Tailored Momentary Self-Assessments

To better support the self-management of chronic pain, this paper investigates how those living with the condition prefer to self-assess their pain levels using smartphones. Our work consists of three stages: design ideation and review, an in-lab user study with 10 participants resulting in nine candidate interfaces, and a 3 week field trial of two further honed measures with 12 participants. This research firstly yields a better understanding of participants' strong and sometimes contrasting preferences regarding their self-assessment of pain intensity. We additionally contribute two novel interfaces that support accurate, quick, and repeated use along with other participant-valued interactions (e.g., familiar, relatable, and highly usable). In particular, we focus on designing tailored measures that both enhance respondent motivation as well as minimize the difficulty of meaningful self-assessment by supporting the cog-nitive effort in translating a subjective experience into a single numerical value.

Relationship between individual differences in functional connectivity and facial-emotion recognition abilities in adults with traumatic brain injury

Although several studies have demonstrated that facial-affect recognition impairment is common following moderate-severe traumatic brain injury (TBI), and that there are diffuse alterations in large-scale functional brain networks in TBI populations, little is known about the relationship between the two. Here, in a sample of 26 participants with TBI and 20 healthy comparison participants (HC) we measured facial-affect recognition abilities and resting-state functional connectivity (rs-FC) using fMRI. We then used network-based statistics to examine (A) the presence of rs-FC differences between individuals with TBI and HC within the facial-affect processing network, and (B) the association between inter-individual differences in emotion recognition skills and rs-FC within the facial-affect processing network. We found that participants with TBI showed significantly lower rs-FC in a component comprising homotopic and within-hemisphere, anterior-posterior connections within the facial-affect processing network. In addition, within the TBI group, participants with higher emotion-labeling skills showed stronger rs-FC within a network comprised of intra- and inter-hemispheric bilateral connections. Findings indicate that the ability to successfully recognize facial-affect after TBI is related to rs-FC within components of facial-affective networks, and provide new evidence that further our understanding of the mechanisms underlying emotion recognition impairment in TBI.

•

Emotion recognition deficits are common following severe TBI.

•

TBI patients show reduced rs-FC within affect processing network.

•

Affect processing network rs-FC correlates with emotion recognition skills.

•

Rs-FC disruption as possible mechanism of emotion recognition deficit

Decreased neural response for facial emotion processing in subjects with high genetic load for schizophrenia

BACKGROUND

Patients with schizophrenia show impairment in facial emotion processing which is essential for successful social cognition. Using a functional magnetic resonance imaging (fMRI), this study aimed to investigate the implicit facial emotion recognition processing in participants with high genetic load for schizophrenia (GHR) as a possible trait marker of developing schizophrenia.

METHODS

Block design fMRI of implicit facial emotion processing was used in 20 participants with GHR aged 16-35, and 17 age, sex, and education year-matched healthy controls (HC). During the facial emotional processing for fearful, happy, and neutral face stimuli, participants were asked to explicitly determine the gender per stimuli.

RESULTS

Occipito-temporo-limbic area in fearful face condition and involvement of broader region including prefrontal cortex in neutral face condition revealed significant attenuation of BOLD signal activation in GHR compared to HC. The GHR demonstrated less activity in right amygdala during fearful and neutral face condition.

CONCLUSION

The study presented that GHR displayed abnormal brain activity in occipito-temporo-limbic-frontal network implicated in facial emotion processing. It indicates that abnormal facial emotion processing may be influenced by a genetic factor and could be a trait marker in schizophrenia.

The relationship between face recognition ability and socioemotional functioning throughout adulthood

The relationship between face recognition ability and socioemotional functioning has been widely explored. However, how aging modulates this association regarding both objective performance and subjective-perception is still neglected. Participants, aged between 18 and 81 years, performed a face memory test and completed subjective face recognition and socioemotional questionnaires. General and social anxiety, and neuroticism traits account for the individual variation in face recognition abilities during adulthood. Aging modulates these relationships because as they age, individuals that present a higher level of these traits also show low-level face recognition ability. Intriguingly, the association between depression and face recognition abilities is evident with increasing age. Overall, the present results emphasize the importance of embedding face metacognition measurement into the context of these studies and suggest that aging is an important factor to be considered, which seems to contribute to the relationship between socioemotional and face-cognitive functioning.

The independence of expression and identity in face-processing: evidence from neuropsychological case studies

The processing of facial identity and facial expression have traditionally been seen as independent—a hypothesis that has largely been informed by a key double dissociation between neurological patients with a deficit in facial identity recognition but not facial expression recognition, and those with the reverse pattern of impairment. The independence hypothesis is also reflected in more recent anatomical models of face-processing, although these theories permit some interaction between the two processes. Given that much of the traditional patient-based evidence has been criticized, a review of more recent case reports that are accompanied by neuroimaging data is timely. Further, the performance of individuals with developmental face-processing deficits has recently been considered with regard to the independence debate. This paper reviews evidence from both acquired and developmental disorders, identifying methodological and theoretical strengths and caveats in these reports, and highlighting pertinent avenues for future research.

Face recognition: a model specific ability

In our everyday lives, we view it as a matter of course that different people are good at different things. It can be surprising, in this context, to learn that most of what is known about cognitive ability variation across individuals concerns the broadest of all cognitive abilities; an ability referred to as general intelligence, general mental ability, or just g. In contrast, our knowledge of specific abilities, those that correlate little with g, is severely constrained. Here, we draw upon our experience investigating an exceptionally specific ability, face recognition, to make the case that many specific abilities could easily have been missed. In making this case, we derive key insights from earlier false starts in the measurement of face recognition’s variation across individuals, and we highlight the convergence of factors that enabled the recent discovery that this variation is specific. We propose that the case of face recognition ability illustrates a set of tools and perspectives that could accelerate fruitful work on specific cognitive abilities. By revealing relatively independent dimensions of human ability, such work would enhance our capacity to understand the uniqueness of individual minds.