The distributed human neural system for face perception

Personal familiarity of faces, animals, objects, and scenes: Distinct perceptual and overlapping conceptual representations

While face, object, and scene recognition are often studied at a basic categorization level (e.g. "a face", "a car", "a kitchen"), we frequently recognise individual items of these categories as unique entities (e.g. "my mother", "my car", "my kitchen"). This recognition of individual identity is essential to appropriate behaviour in our world. However, relatively little is known about how we recognise individually familiar visual stimuli. Using event-related brain potentials, the present study examined whether and to what extent the underlying neural representations of personally familiar items are similar or different across different categories. In three experiments, we examined the recognition of personally highly familiar faces, animals, indoor scenes, and objects. We observed relatively distinct familiarity effects in an early time window (200-400 ms), with a clearly right-lateralized occipito-temporal scalp distribution for human faces and more bilateral and posterior distributions for other stimulus categories, presumably reflecting access to at least partly discrete visual long-term representations. In contrast, we found clearly overlapping familiarity effects in a later time window (starting 400 to 500 ms after stimulus onset), again with a mainly right occipito-temporal scalp distribution, for all stimulus categories. These later effects appear to reflect the sustained activation of conceptual properties relevant to any potential interaction. We conclude that familiarity for items from the various visual stimulus categories tested here is represented differently at the perceptual level, while relatively overlapping conceptual mechanisms allow for the preparation of impending potential interaction with the environment.

Independent measurement of face perception, face matching, and face memory reveals impairments in face perception and memory, but not matching, in autism

Multiple psychological processes are required in order for a face to be recognised from memory. However, when testing face memory using tasks such as the Cambridge Face Memory Task (CFMT), it is rare for studies to attempt to account for individual differences in face perception and face matching in order to isolate variance in face memory specifically. In Study 1, the Oxford Face Matching Test (OFMT) was used to assess face matching and face perception in a large sample of participants (N = 1,112). Results revealed independent contributions of face perception and matching to CFMT performance, and these results replicated with the Glasgow Face Matching Test. In Study 2, the same procedure was used to test face perception, face matching and face memory in a group of 57 autistic adults and a matched neurotypical control group. Results revealed impaired face perception and memory in the individuals with autism, but intact face matching. Face perception may therefore act as a potential intervention target for individuals with autism who exhibit face recognition impairments.

Decoding the temporal representation of facial expression in face-selective regions

The ability of humans to discern facial expressions in a timely manner typically relies on distributed face-selective regions for rapid neural computations. To study the time course in regions of interest for this process, we used magnetoencephalography (MEG) to measure neural responses participants viewed facial expressions depicting seven types of emotions (happiness, sadness, anger, disgust, fear, surprise, and neutral). Analysis of the time-resolved decoding of neural responses in face-selective sources within the inferior parietal cortex (IP-faces), lateral occipital cortex (LO-faces), fusiform gyrus (FG-faces), and posterior superior temporal sulcus (pSTS-faces) revealed that facial expressions were successfully classified starting from ∼100 to 150 ms after stimulus onset. Interestingly, the LO-faces and IP-faces showed greater accuracy than FG-faces and pSTS-faces. To examine the nature of the information processed in these face-selective regions, we entered with facial expression stimuli into a convolutional neural network (CNN) to perform similarity analyses against human neural responses. The results showed that neural responses in the LO-faces and IP-faces, starting ∼100 ms after the stimuli, were more strongly correlated with deep representations of emotional categories than with image level information from the input images. Additionally, we observed a relationship between the behavioral performance and the neural responses in the LO-faces and IP-faces, but not in the FG-faces and lpSTS-faces. Together, these results provided a comprehensive picture of the time course and nature of information involved in facial expression discrimination across multiple face-selective regions, which advances our understanding of how the human brain processes facial expressions.

Social cognition in hyperkinetic movement disorders: a systematic review

Numerous lines of research indicate that our social brain involves a network of cortical and subcortical brain regions that are responsible for sensing and controlling body movements. However, it remains unclear whether movement disorders have a systematic impact on social cognition. To address this question, we conducted a systematic review examining the influence of hyperkinetic movement disorders (including Huntington disease, Tourette syndrome, dystonia, and essential tremor) on social cognition. Following the PRISMA guidelines and registering the protocol in the PROSPERO database (CRD42022327459), we analyzed 50 published studies focusing on theory of mind (ToM), social perception, and empathy. The results from these studies provide evidence of impairments in ToM and social perception in all hyperkinetic movement disorders, particularly during the recognition of negative emotions. Additionally, individuals with Huntington's Disease and Tourette syndrome exhibit empathy disorders. These findings support the functional role of subcortical structures (such as the basal ganglia and cerebellum), which are primarily responsible for movement disorders, in deficits related to social cognition.

TMS disruption of the lateral prefrontal cortex increases neural activity in the default mode network when naming facial expressions

Recognizing facial expressions is dependent on multiple brain networks specialized for different cognitive functions. In the current study, participants (N = 20) were scanned using functional magnetic resonance imaging (fMRI), while they performed a covert facial expression naming task. Immediately prior to scanning thetaburst transcranial magnetic stimulation (TMS) was delivered over the right lateral prefrontal cortex (PFC), or the vertex control site. A group whole-brain analysis revealed that TMS induced opposite effects in the neural responses across different brain networks. Stimulation of the right PFC (compared to stimulation of the vertex) decreased neural activity in the left lateral PFC but increased neural activity in three nodes of the default mode network (DMN): the right superior frontal gyrus, right angular gyrus and the bilateral middle cingulate gyrus. A region of interest analysis showed that TMS delivered over the right PFC reduced neural activity across all functionally localised face areas (including in the PFC) compared to TMS delivered over the vertex. These results suggest that visually recognizing facial expressions is dependent on the dynamic interaction of the face-processing network and the DMN. Our study also demonstrates the utility of combined TMS/fMRI studies for revealing the dynamic interactions between different functional brain networks.

Functional connectivity of the human face network exhibits right hemispheric lateralization from infancy to adulthood

Adults typically exhibit right hemispheric dominance in the processing of faces. In this cross-sectional study, we investigated age-dependent changes in face processing lateralization from infancy to adulthood (1-48 years old; N = 194). We co-registered anatomical and resting state functional Magnetic Resonance Imaging (fMRI) scans of toddlers, children, adolescents, and adults into a common space and examined functional connectivity across the face, as well as place, and object-selective regions identified in adults. As expected, functional connectivity between core face-selective regions was stronger in the right compared to the left hemisphere in adults. Most importantly, the same lateralization was evident in all other age groups (infants, children, adolescents) and appeared only in face-selective regions, and not in place or object-selective regions. These findings suggest that the physiological development of face-selective brain areas may differ from that of object and place-selective areas. Specifically, the functional connectivity of the core-face selective regions exhibits rightward lateralization from infancy, years before these areas develop mature face-selective responses.

Sound-encoded faces activate the left fusiform face area in the early blind

Face perception in humans and nonhuman primates is accomplished by a patchwork of specialized cortical regions. How these regions develop has remained controversial. In sighted individuals, facial information is primarily conveyed via the visual modality. Early blind individuals, on the other hand, can recognize shapes using auditory and tactile cues. Here we demonstrate that such individuals can learn to distinguish faces from houses and other shapes by using a sensory substitution device (SSD) presenting schematic faces as sound-encoded stimuli in the auditory modality. Using functional MRI, we then asked whether a face-selective brain region like the fusiform face area (FFA) shows selectivity for faces in the same subjects, and indeed, we found evidence for preferential activation of the left FFA by sound-encoded faces. These results imply that FFA development does not depend on experience with visual faces per se but may instead depend on exposure to the geometry of facial configurations.

Neural tracking of social hierarchies in adolescents' real-world social networks

In the current study, we combined sociometric nominations and neuroimaging techniques to examine adolescents' neural tracking of peers from their real-world social network that varied in social preferences and popularity. Adolescent participants from an entire school district (N = 873) completed peer sociometric nominations of their grade at school, and a subset of participants (N = 117, Mage = 13.59 years) completed a neuroimaging task in which they viewed peer faces from their social networks. We revealed two neural processes by which adolescents track social preference: (1) the fusiform face area, an important region for early visual perception and social categorization, simultaneously represented both peers high in social preference and low in social preference; (2) the dorsolateral prefrontal cortex (DLPFC), which was differentially engaged in tracking peers high and low in social preference. No regions specifically tracked peers high in popularity and only the inferior parietal lobe, temporoparietal junction, midcingulate cortex and insula were involved in tracking unpopular peers. This is the first study to examine the neural circuits that support adolescents' perception of peer-based social networks. These findings identify the neural processes that allow youths to spontaneously keep track of peers' social value within their social network.

Novel approaches to functional lateralization: Assessing information in activity patterns across hemispheres and more accurately identifying structural homologues

Functional lateralization is typically measured by comparing activation levels across the right and left hemispheres of the brain. Significant additional information, however, exists within distributed multi-voxel patterns of activity - a format not detectable by traditional activation-based analysis of functional magnetic resonance imaging (fMRI) data. We introduce and test two methods -one anatomical, one functional- that allow hemispheric information asymmetries to be detected. We first introduce and apply a novel tool that draws on brain 'surface fingerprints' to pair every location in one hemisphere with its hemispheric homologue. We use anatomical data to show that this approach is more accurate than the common distance-from-midline method for comparing bilateral regions. Next, we introduce a complementary analysis method that quantifies multivariate laterality in functional data. This new 'multivariate Laterality Index' (mLI) reflects both quantitative and qualitative information-differences across homologous activity patterns. We apply the technique here to functional data collected as participants viewed faces and non-faces. Using the previously generated surface fingerprints to pair-up homologous searchlights in each hemisphere, we use the novel multivariate laterality technique to identify face-information asymmetries across right and left counterparts of the fusiform gyrus, inferior temporal gyrus, superior parietal lobule, and early visual areas. The typical location of the fusiform face area has greater information asymmetry for faces than for shapes. More generally, we argue that the field should consider an information-based approach to lateralization.

Neural basis of social attention: common and distinct mechanisms for social and nonsocial orienting stimuli

Social and nonsocial directional stimuli (such as gaze and arrows, respectively) share their ability to trigger attentional processes, although the issue of whether social stimuli generate other additional (and unique) attentional effects is still under debate. In this study, we used the spatial interference paradigm to explore, using functional magnetic resonance imaging, shared and dissociable brain activations produced by gaze and arrows. Results showed a common set of regions (right parieto-temporo-occipital) similarly involved in conflict resolution for gaze and arrows stimuli, which showed stronger co-activation for incongruent than congruent trials. The frontal eye field showed stronger functional connectivity with occipital regions for congruent as compared with incongruent trials, and this effect was enhanced for gaze as compared with arrow stimuli in the right hemisphere. Moreover, spatial interference produced by incongruent (as compared with congruent) arrows was associated with increased functional coupling between the right frontal eye field and a set of regions in the left hemisphere. This result was not observed for incongruent (as compared with congruent) gaze stimuli. The right frontal eye field also showed greater coupling with left temporo-occipital regions for those conditions in which larger conflict was observed (arrow incongruent vs. gaze incongruent trials, and gaze congruent vs. arrow congruent trials). These findings support the view that social and nonsocial stimuli share some attentional mechanisms, while at the same time highlighting other differential effects. Highlights Attentional orienting triggered by social (gaze) and nonsocial (arrow) cues is comparable. When social and nonsocial stimuli are used as targets, qualitatively different behavioral effects are observed. This study explores the neural bases of shared and dissociable neural mechanisms for social and nonsocial stimuli. Shared mechanisms were found in the functional coupling between right parieto-temporo-occipital regions. Dissociable mechanisms were found in the functional coupling between right frontal eye field and ipsilateral and contralateral occipito-temporal regions.

Distinct patterns of neural response to faces from different races in humans and deep networks

Social categories such as the race or ethnicity of an individual are typically conveyed by the visual appearance of the face. The aim of this study was to explore how these differences in facial appearance are represented in human and artificial neural networks. First, we compared the similarity of faces from different races using a neural network trained to discriminate identity. We found that the differences between races were most evident in the fully connected layers of the network. Although these layers were also able to predict behavioural judgements of face identity from human participants, performance was biased toward White faces. Next, we measured the neural response in face-selective regions of the human brain to faces from different races in Asian and White participants. We found distinct patterns of response to faces from different races in face-selective regions. We also found that the spatial pattern of response was more consistent across participants for own-race compared to other-race faces. Together, these findings show that faces from different races elicit different patterns of response in human and artificial neural networks. These differences may underlie the ability to make categorical judgements and explain the behavioural advantage for the recognition of own-race faces.

Modeling face recognition in the predictive coding framework: A combined computational modeling and functional imaging study

The learning of new facial identities and the recognition of familiar faces are crucial processes for social interactions. Recently, a combined computational modeling and functional magnetic resonance imaging (fMRI) study used predictive coding as a biologically plausible framework to model face identity learning and to relate specific model parameters with brain activity (Apps and Tsakiris, Nat Commun 4, 2698, 2013). On the one hand, it was shown that behavioral responses on a two-option face recognition task could be predicted by the level of contextual and facial familiarity in a computational model derived from predictive-coding principles. On the other hand, brain activity in specific brain regions was associated with these parameters. More specifically, brain activity in the superior temporal sulcus (STS) varied with contextual familiarity, whereas activity in the fusiform face area (FFA) covaried with the prediction error parameter that updated facial familiarity. Literature combining fMRI assessments and computational modeling in humans still needs to be expanded. Furthermore, prior results are largely not replicated. The present study was, therefore, specifically set up to replicate these previous findings. Our results support the original findings in two critical aspects. First, on a group level, the behavioral responses were modeled best by the same computational model reported by the original authors. Second, we showed that estimates of these model parameters covary with brain activity in specific, face-sensitive brain regions. Our results thus provide further evidence that the functional properties of the face perception network conform to central principles of predictive coding. However, our study yielded diverging findings on specific computational model parameters reflected in brain activity. On the one hand, we did not find any evidence of a computational involvement of the STS. On the other hand, our results showed that activity in the right FFA was associated with multiple computational model parameters. Our data do not provide evidence for functional segregation between particular face-sensitive brain regions, as previously proposed.

Functional connectivity between the amygdala and prefrontal cortex underlies processing of emotion ambiguity

Processing facial expressions of emotion draws on a distributed brain network. In particular, judging ambiguous facial emotions involves coordination between multiple brain areas. Here, we applied multimodal functional connectivity analysis to achieve network-level understanding of the neural mechanisms underlying perceptual ambiguity in facial expressions. We found directional effective connectivity between the amygdala, dorsomedial prefrontal cortex (dmPFC), and ventromedial PFC, supporting both bottom-up affective processes for ambiguity representation/perception and top-down cognitive processes for ambiguity resolution/decision. Direct recordings from the human neurosurgical patients showed that the responses of amygdala and dmPFC neurons were modulated by the level of emotion ambiguity, and amygdala neurons responded earlier than dmPFC neurons, reflecting the bottom-up process for ambiguity processing. We further found parietal-frontal coherence and delta-alpha cross-frequency coupling involved in encoding emotion ambiguity. We replicated the EEG coherence result using independent experiments and further showed modulation of the coherence. EEG source connectivity revealed that the dmPFC top-down regulated the activities in other brain regions. Lastly, we showed altered behavioral responses in neuropsychiatric patients who may have dysfunctions in amygdala-PFC functional connectivity. Together, using multimodal experimental and analytical approaches, we have delineated a neural network that underlies processing of emotion ambiguity.

Modeling naturalistic face processing in humans with deep convolutional neural networks

Deep convolutional neural networks (DCNNs) trained for face identification can rival and even exceed human-level performance. The ways in which the internal face representations in DCNNs relate to human cognitive representations and brain activity are not well understood. Nearly all previous studies focused on static face image processing with rapid display times and ignored the processing of naturalistic, dynamic information. To address this gap, we developed the largest naturalistic dynamic face stimulus set in human neuroimaging research (700+ naturalistic video clips of unfamiliar faces). We used this naturalistic dataset to compare representational geometries estimated from DCNNs, behavioral responses, and brain responses. We found that DCNN representational geometries were consistent across architectures, cognitive representational geometries were consistent across raters in a behavioral arrangement task, and neural representational geometries in face areas were consistent across brains. Representational geometries in late, fully connected DCNN layers, which are optimized for individuation, were much more weakly correlated with cognitive and neural geometries than were geometries in late-intermediate layers. The late-intermediate face-DCNN layers successfully matched cognitive representational geometries, as measured with a behavioral arrangement task that primarily reflected categorical attributes, and correlated with neural representational geometries in known face-selective topographies. Our study suggests that current DCNNs successfully capture neural cognitive processes for categorical attributes of faces but less accurately capture individuation and dynamic features.

Mediating effect of amygdala activity on response to fear vs. happiness in youth with significant levels of irritability and disruptive mood and behavior disorders

Introduction

Irritability, characterized by a tendency to exhibit increased anger, is a common clinical problem in youth. Irritability is a significant clinical issue in youth with various psychiatric diagnoses, especially disruptive behavior, and mood disorders (Attention-Deficit/Hyperactivity Disorder, Oppositional Defiant Disorder, Conduct Disorder, and Disruptive Mood Dysregulation Disorder). Although there have been previous studies focusing on functional alteration in the amygdala related to irritability, there is no comprehensive model between emotional, neuronal, and behavioral characteristics.

Methods

Using an functional magnetic resonance imaging (fMRI) procedure, we investigated the relationships between behavioral irritability, selective impairments in processing facial emotions and the amygdala neural response in youth with increased irritability. Fifty-nine youth with disruptive mood and behavior disorder completed a facial expression processing task with an event-related fMRI paradigm. The severity of irritability was evaluated using the Affective Reactivity Index.

Results

In the result of behavioral data, irritability, and reaction time (RT) differences between interpreting negative (fear) and positive (happiness) facial expressions were positively correlated. In the fMRI result, youth showed higher activation in the right cingulate gyrus, bilateral cerebellum, right amygdala, right precuneus, right superior frontal gyrus, right middle occipital gyrus, and middle temporal gyrus, during the happiness condition vs. fear condition. No brain region exhibited greater activation in the fear than in the happiness conditions. In the result of the mediator analysis, increased irritability was associated with a longer RT toward positive vs. negative facial expressions. Irritability was also positively associated with the difference in amygdala blood oxygen level-dependent responses between the two emotional conditions (happiness > fear). This difference in amygdala activity mediated the interaction between irritability and the RT difference between negative and positive facial expressions.

Discussion

We suggest that impairment in the implicit processing of facial emotional expressions with different valences causes distinct patterns of amygdala response, which correlate with the level of irritability. These results broaden our understanding of the biological mechanism of irritability at the neural level and provide information for the future direction of the study.

Investigating the role of the fusiform face area and occipital face area using multifocal transcranial direct current stimulation

The functional role of the occipital face area (OFA) and the fusiform face area (FFA) in face recognition is inconclusive to date. While some research has shown that the OFA and FFA are involved in early (i.e., featural processing) and late (i.e., holistic processing) stages of face recognition respectively, other research suggests that both regions are involved in both early and late stages of face recognition. Thus, the current study aims to further examine the role of the OFA and the FFA using multifocal transcranial direct current stimulation (tDCS). In Experiment 1, we used computer-generated faces. Thirty-five participants completed whole face and facial features (i.e., eyes, nose, mouth) recognition tasks after OFA and FFA stimulation in a within-subject design. No difference was found in recognition performance after either OFA or FFA stimulation. In Experiment 2 with 60 participants, we used real faces, provided stimulation following a between-subjects design and included a sham control group. Results showed that FFA stimulation led to enhanced efficiency of facial features recognition. Additionally, no effect of OFA stimulation was found for either facial feature or whole face recognition. These results suggest the involvement of FFA in the recognition of facial features.

Perceptual discrimination in the face perception of robots is attenuated compared to humans

When interacting with groups of robots, we tend to perceive them as a homogenous group where all group members have similar capabilities. This overgeneralization of capabilities is potentially due to a lack of perceptual experience with robots or a lack of motivation to see them as individuals (i.e., individuation). This can undermine trust and performance in human-robot teams. One way to overcome this issue is by designing robots that can be individuated such that each team member can be provided tasks based on its actual skills. In two experiments, we examine if humans can effectively individuate robots: Experiment 1 (n = 225) investigates how individuation performance of robot stimuli compares to that of human stimuli that either belong to a social ingroup or outgroup. Experiment 2 (n = 177) examines to what extent robots' physical human-likeness (high versus low) affects individuation performance. Results show that although humans are able to individuate robots, they seem to individuate them to a lesser extent than both ingroup and outgroup human stimuli (Experiment 1). Furthermore, robots that are physically more humanlike are initially individuated better compared to robots that are physically less humanlike; this effect, however, diminishes over the course of the experiment, suggesting that the individuation of robots can be learned quite quickly (Experiment 2). Whether differences in individuation performance with robot versus human stimuli is primarily due to a reduced perceptual experience with robot stimuli or due to motivational aspects (i.e., robots as potential social outgroup) should be examined in future studies.

Beyond facial expressions: A systematic review on effects of emotional relevance of faces on the N170

The N170 is the most prominent electrophysiological signature of face processing. While facial expressions reliably modulate the N170, there is considerable variance in N170 modulations by other sources of emotional relevance. Therefore, we systematically review and discuss this research area using different methods to manipulate the emotional relevance of inherently neutral faces. These methods were categorized into (1) existing pre-experimental affective person knowledge (e.g., negative attitudes towards outgroup faces), (2) experimentally instructed affective person knowledge (e.g., negative person information), (3) contingency-based affective learning (e.g., fear-conditioning), or (4) the immediate affective context (e.g., emotional information directly preceding the face presentation). For all categories except the immediate affective context category, the majority of studies reported significantly increased N170 amplitudes depending on the emotional relevance of faces. Furthermore, the potentiated N170 was observed across different attention conditions, supporting the role of the emotional relevance of faces on the early prioritized processing of configural facial information, regardless of low-level differences. However, we identified several open research questions and suggest venues for further research.

Modeling Biological Face Recognition with Deep Convolutional Neural Networks

Deep convolutional neural networks (DCNNs) have become the state-of-the-art computational models of biological object recognition. Their remarkable success has helped vision science break new ground, and recent efforts have started to transfer this achievement to research on biological face recognition. In this regard, face detection can be investigated by comparing face-selective biological neurons and brain areas to artificial neurons and model layers. Similarly, face identification can be examined by comparing in vivo and in silico multidimensional "face spaces." In this review, we summarize the first studies that use DCNNs to model biological face recognition. On the basis of a broad spectrum of behavioral and computational evidence, we conclude that DCNNs are useful models that closely resemble the general hierarchical organization of face recognition in the ventral visual pathway and the core face network. In two exemplary spotlights, we emphasize the unique scientific contributions of these models. First, studies on face detection in DCNNs indicate that elementary face selectivity emerges automatically through feedforward processing even in the absence of visual experience. Second, studies on face identification in DCNNs suggest that identity-specific experience and generative mechanisms facilitate this particular challenge. Taken together, as this novel modeling approach enables close control of predisposition (i.e., architecture) and experience (i.e., training data), it may be suited to inform long-standing debates on the substrates of biological face recognition.

Investigating the Face Inversion Effect in Autism Across Behavioral and Neural Measures of Face Processing: A Systematic Review and Bayesian Meta-Analysis

Importance

Face processing is foundational to human social cognition, is central to the hallmark features of autism spectrum disorder (ASD), and shapes neural systems and social behavior. Highly efficient and specialized, the face processing system is sensitive to inversion, demonstrated by reduced accuracy in recognition and altered neural response to inverted faces. Understanding at which mechanistic level the autistic face processing system may be particularly different, as measured by the face inversion effect, will improve overall understanding of brain functioning in autism.

Objective

To synthesize data from the extant literature to determine differences of the face processing system in ASD, as measured by the face inversion effect, across multiple mechanistic levels.

Data Sources

Systematic searches were conducted in the MEDLINE, Embase, Web of Science, and PubMed databases from inception to August 11, 2022.

Study Selection

Original research that reported performance-based measures of face recognition to upright and inverted faces in ASD and neurotypical samples were included for quantitative synthesis. All studies were screened by at least 2 reviewers.

Data Extraction and Synthesis

This systematic review and meta-analysis was conducted according to the 2020 Preferred Reporting Items for Systematic Reviews and Meta-analyses (PRISMA) reporting guideline. Multiple effect sizes were extracted from studies to maximize information gain and statistical precision and used a random-effects, multilevel modeling framework to account for statistical dependencies within study samples.

Main Outcomes and Measures

Effect sizes were calculated as a standardized mean change score between ASD and neurotypical samples (ie, Hedges g). The primary outcome measure was performance difference between upright and inverted faces during face recognition tasks. Measurement modality, psychological construct, recognition demand, sample age, sample sex distribution, and study quality assessment scores were assessed as moderators.

Results

Of 1768 screened articles, 122 effect sizes from 38 empirical articles representing data from 1764 individual participants (899 ASD individuals and 865 neurotypical individuals) were included in the meta-analysis. Overall, face recognition performance differences between upright and inverted faces were reduced in autistic individuals compared with neurotypical individuals (g = -0.41; SE = 0.11; 95% credible interval [CrI], -0.63 to -0.18). However, there was considerable heterogeneity among effect sizes, which were explored with moderator analysis. The attenuated face inversion effect in autistic individuals was more prominent in emotion compared with identity recognition (b = 0.46; SE = 0.26; 95% CrI, -0.08 to 0.95) and in behavioral compared with electrophysiological measures (b = 0.23; SE = 0.24; 95% CrI, -0.25 to 0.70).

Conclusions and Relevance

This study found that on average, face recognition in autism is less impacted by inversion. These findings suggest less specialization or expertise of the face processing system in autism, particularly in recognizing emotion from faces as measured in behavioral paradigms.

Strange-face-in-the-mirror illusions: specific effects on derealization, depersonalization, and dissociative identity

Anomalous strange-face illusions (SFIs) are produced when mirror gazing under a low level of face illumination. In contrast to past studies in which an observer's task was to pay attention to the reflected face and to perceive potential facial changes, the present research used a mirror gazing task (MGT) that instructed participants to fixate their gaze on a 4-mm hole in a glass mirror. The participants' eye-blink rates were thus measured without priming any facial changes. Twenty-one healthy young individuals participated in the MGT and a control panel-fixation task (staring at a hole in a gray non-reflective panel). The Revised Strange-Face Questionnaire (SFQ-R) indexed derealization (deformations of facial features; FD), depersonalization (bodily face detachment; BD), and dissociative identity (new or unknown identities; DI) scales. Mirror-fixation increased FD, BD, and DI scores compared to panel-fixation. In mirror-fixation, FD scores revealed fading specific to facial features, distinct from "classical" Troxler- and Brewster-fading. In mirror-fixation, eye-blink rates correlated negatively with FD scores. Panel-fixation produced low BD scores, and, in a few participants, face pareidolias as detected on FD scores. Females were more prone to early derealization and males to compartmentalization of a dissociative identity. SFQ-R may be a valuable instrument for measuring face-specific dissociation (FD, BD, DI) produced by MGT. Use of MGT and panel-fixation task for differential diagnoses between schizophrenia and dissociative identity disorder is discussed.

Detection of emotional faces: The role of spatial frequencies and local features

Models of emotion processing suggest that threat-related stimuli such as fearful faces can be detected based on the rapid extraction of low spatial frequencies. However, this remains debated as other models argue that the decoding of facial expressions occurs with a more flexible use of spatial frequencies. The purpose of this study was to clarify the role of spatial frequencies and differences in luminance contrast between spatial frequencies, on the detection of facial emotions. We used a saccadic choice task in which emotional-neutral face pairs were presented and participants were asked to make a saccade toward the neutral or the emotional (happy or fearful) face. Faces were displayed either in low, high, or broad spatial frequencies. Results showed that participants were better to saccade toward the emotional face. They were also better for high or broad than low spatial frequencies, and the accuracy was higher with a happy target. An analysis of the eye and mouth saliency ofour stimuli revealed that the mouth saliency of the target correlates with participants' performance. Overall, this study underlines the importance of local more than global information, and of the saliency of the mouth region in the detection of emotional and neutral faces.

Disgust Processing and Potential Relationships with Behaviors in Autism

PURPOSE OF REVIEW

While there are reports of differences in emotion processing in autism, it is less understood whether the emotion of disgust, in particular, plays a significant role in these effects. Here, we review literature on potential disgust processing differences in autism and its possible associations with autistic traits.

RECENT FINDINGS

In autism, there is evidence for differences in physical disgust processing, pica behaviors, attention away from other's disgust facial expressions, and differences in neural activity related to disgust processing. In typically developing individuals, disgust processing is related to moral processing, but modulated by individual differences in interoception and alexithymia. Autistic individuals may experience atypical disgust, which may lead to difficulty avoiding contaminants and affect socio-emotional processing. In autism, such outcomes may lead to increased occurrences of illness, contribute to gastrointestinal issues, diminish vicarious learning of disgust expression and behaviors, and potentially contribute to differences in processes related to moral reasoning, though further research is needed.

Alcohol cue reactivity in the brain: Age-related differences in the role of social processes in addiction in male drinkers

Social attunement (SA)-the tendency to harmonize behavior with the social environment-has been proposed to drive the escalation of alcohol use in adolescence, while reducing use in adulthood. Little is known about how heightened social sensitivity in adolescence may interact with neural alcohol cue reactivity-a marker of alcohol use disorder-and its relationship to alcohol use severity over time. The aims of this study were to test whether (1) adolescents and adults differ in social alcohol cue reactivity in the nucleus accumbens, anterior cingulate cortex, and right medial prefrontal cortex (mPFC), and (2) age moderates the relationship between social alcohol cue reactivity and social attunement, measures of drinking at baseline, and changes in drinking over time. A sample of male adolescents (16-18 years) and adults (29-35 years) completed an fMRI social alcohol cue-exposure task at baseline and an online follow-up two to three years later. No main effects of age or drinking measures were observed in social alcohol cue reactivity. However, age significantly moderated associations of social alcohol cue reactivity in the mPFC and additional regions from exploratory whole-brain analyses with SA, with a positive association in adolescents and negative association in adults. Significant age interactions emerged only for SA in predicting drinking over time. Adolescents with higher SA scores escalated drinking, while adults with higher SA scores reduced drinking. These findings warrant further research on SA as a risk and protective factor and suggest that social processes influence cue reactivity differentially in male adolescents and adults.

Explicit face memory abilities are positively related to the non-intentional encoding of faces: Behavioral and ERP evidence

Individual differences in face memory abilities have been shown to be related to individual differences in brain activity. The present study investigated brain-behavior relationships for the N250 component in event-related brain potentials, which is taken as a neural sign of face familiarity. We used a task in which a designated, typical target face and several (high- and low-distinctive) nontarget faces had to be distinguished during multiple presentations across a session. Separately, face memory/recognition abilities were measured with easy versus difficult tasks. We replicated an increase of the N250 amplitude to the target face across the session and observed a similar increase for the non-target faces, indicating the build-up of memory representations also for these faces. On the interindividual level, larger across-session N250 amplitude increases to low-distinctive non-target faces were related to faster face recognition as measured in an easy task. These findings indicate that non-intentional encoding of non-target faces into memory is associated with the swift recognition of explicitly learned faces; that is, there is shared variance of incidental and intentional face memory.

Diminished emotion recognition with reduced face gaze in complex situation in individuals with broad autism phenotype

Background/objective

Individuals with broad autism phenotype (BAP) showed a diminished ability to recognize emotion. This study aims to examine whether their decline in emotion recognition ability could be more clearly identified as task complexity increased and whether their decline could be influenced by their eye-gaze patterns.

Method

41 individuals with BAP and 40 healthy controls performed two types of emotion recognition tasks. After confirming conditions wherein the BAP group did not perform well compared to the control group, we compared gaze proportion on faces and context between groups when performing the conditions.

Results

The more difficult the task, the clearer the significant relationships between the level of autistic traits and emotion recognition ability. The BAP group showed lower accuracy compared to the control group when a face with mild emotional intensity was presented with context. In terms of gaze proportion, the BAP group looked less at faces when recognizing emotions compared to the control group.

Conclusion

These findings indicate that diminished emotion recognition ability in individuals with BAP may be influenced by face gaze.

Motivated attention and task relevance in the processing of cross-modally associated faces: Behavioral and electrophysiological evidence

It has repeatedly been shown that visually presented stimuli can gain additional relevance by their association with affective stimuli. Studies have shown effects of associated affect in event-related potentials (ERP) like the early posterior negativity (EPN), late positive complex (LPC), and even earlier components as the P1 or N170. However, findings are mixed as to the extent associated affect requires directed attention to the emotional quality of a stimulus and which ERP components are sensitive to task instructions during retrieval. In this preregistered study ( https://osf.io/ts4pb ), we tested cross-modal associations of vocal affect-bursts (positive, negative, neutral) to faces displaying neutral expressions in a flash-card-like learning task, in which participants studied face-voice pairs and learned to correctly assign them to each other. In the subsequent EEG test session, we applied both an implicit ("old-new") and explicit ("valence-classification") task to investigate whether the behavior at retrieval and neurophysiological activation of the affect-based associations were dependent on the type of motivated attention. We collected behavioral and neurophysiological data from 40 participants who reached the preregistered learning criterium. Results showed EPN effects of associated negative valence after learning and independent of the task. In contrast, modulations of later stages (LPC) by positive and negative associated valence were restricted to the explicit, i.e., valence-classification, task. These findings highlight the importance of the task at different processing stages and show that cross-modal affect can successfully be associated to faces.

The Neural Correlates of Developmental Prosopagnosia: Twenty-Five Years on

Faces play a crucial role in social interactions. Developmental prosopagnosia (DP) refers to the lifelong difficulty in recognizing faces despite the absence of obvious signs of brain lesions. In recent decades, the neural substrate of this condition has been extensively investigated. While early neuroimaging studies did not reveal significant functional and structural abnormalities in the brains of individuals with developmental prosopagnosia (DPs), recent evidence identifies abnormalities at multiple levels within DPs' face-processing networks. The current work aims to provide an overview of the convergent and contrasting findings by examining twenty-five years of neuroimaging literature on the anatomo-functional correlates of DP. We included 55 original papers, including 63 studies that compared the brain structure (MRI) and activity (fMRI, EEG, MEG) of healthy control participants and DPs. Despite variations in methods, procedures, outcomes, sample selection, and study design, this scoping review suggests that morphological, functional, and electrophysiological features characterize DPs' brains, primarily within the ventral visual stream. Particularly, the functional and anatomical connectivity between the Fusiform Face Area and the other face-sensitive regions seems strongly impaired. The cognitive and clinical implications as well as the limitations of these findings are discussed in light of the available knowledge and challenges in the context of DP.

Identifying the cortical face network with dynamic face stimuli: A large group fMRI study

Functional magnetic resonance imaging (fMRI) studies have identified a network of face-selective regions distributed across the human brain. In the present study, we analyzed data from a large group of gender-balanced participants to investigate how reliably these face-selective regions could be identified across both cerebral hemispheres. Participants ( N =52) were scanned with fMRI while viewing short videos of faces, bodies, and objects. Results revealed that five face-selective regions: the fusiform face area (FFA), posterior superior temporal sulcus (pSTS), anterior superior temporal sulcus (aSTS), inferior frontal gyrus (IFG) and the amygdala were all larger in the right than in the left hemisphere. The occipital face area (OFA) was larger in the right hemisphere as well, but the difference between the hemispheres was not significant. The neural response to moving faces was also greater in face-selective regions in the right than in the left hemisphere. An additional analysis revealed that the pSTS and IFG were significantly larger in the right hemisphere compared to other face-selective regions. This pattern of results demonstrates that moving faces are preferentially processed in the right hemisphere and that the pSTS and IFG appear to be the strongest drivers of this laterality. An analysis of gender revealed that face-selective regions were typically larger in females ( N =26) than males ( N =26), but this gender difference was not statistically significant.

Eye image effect in the context of pedestrian safety: a French questionnaire study

Human behavior is influenced by the presence of others, which scientists also call 'the audience effect'. The use of social control to produce more cooperative behaviors may positively influence road use and safety. This study uses an online questionnaire to test how eyes images affect the behavior of pedestrians when crossing a road. Different eyes images of men, women and a child with different facial expressions -neutral, friendly and angry- were presented to participants who were asked what they would feel by looking at these images before crossing a signalized road. Participants completed a questionnaire of 20 questions about pedestrian behaviors (PBQ). The questionnaire was received by 1,447 French participants, 610 of whom answered the entire questionnaire. Seventy-one percent of participants were women, and the mean age was 35 ± 14 years. Eye images give individuals the feeling they are being observed at 33%, feared at 5% and surprised at 26%, and thus seem to indicate mixed results about avoiding crossing at the red light. The expressions shown in the eyes are also an important factor: feelings of being observed increased by about 10-15% whilst feelings of being scared or inhibited increased by about 5% as the expression changed from neutral to friendly to angry. No link was found between the results of our questionnaire and those of the Pedestrian Behavior Questionnaire (PBQ). This study shows that the use of eye images could reduce illegal crossings by pedestrians, and is thus of key interest as a practical road safety tool. However, the effect is limited and how to increase this nudge effect needs further consideration.

Single neuron responses underlying face recognition in the human midfusiform face-selective cortex

Faces are critical for social interactions and their recognition constitutes one of the most important and challenging functions of the human brain. While neurons responding selectively to faces have been recorded for decades in the monkey brain, face-selective neural activations have been reported with neuroimaging primarily in the human midfusiform gyrus. Yet, the cellular mechanisms producing selective responses to faces in this hominoid neuroanatomical structure remain unknown. Here we report single neuron recordings performed in 5 human subjects (1 male, 4 females) implanted with intracerebral microelectrodes in the face-selective midfusiform gyrus, while they viewed pictures of familiar and unknown faces and places. We observed similar responses to faces and places at the single cell level, but a significantly higher number of neurons responding to faces, thus offering a mechanistic account for the face-selective activations observed in this region. Although individual neurons did not respond preferentially to familiar faces, a population level analysis could consistently determine whether or not the faces (but not the places) were familiar, only about 50 ms after the initial recognition of the stimuli as faces. These results provide insights into the neural mechanisms of face processing in the human brain.

A "Bandwidth" in cortical representations of multiple faces

The human ability to process multiple items simultaneously can be constrained by the extent to which those items are represented by distinct neural populations. In the current study, we used fMRI to investigate the cortical representation of multiple faces. We found that the addition of a second face to occupy both visual hemifields led to an increased response, whereas a further addition of faces within the same visual hemifield resulted in a decreased response. This pattern was widely observed in the occipital visual cortex, the intraparietal sulcus, and extended to the posterior inferotemporal cortex. A parallel trend was found in a behavioral change-detection task, revealing a perceptual "bandwidth" of multiface processing. The sensitivity to face clutter gradually decreased along the ventral pathway, supporting the notion of a buildup of clutter-tolerance representation. These cortical response patterns to face clutters suggest that adding signals with nonoverlapping cortical representation enhanced perception, while adding signals that competed for representation resources impaired perception.

The Sabancı University Dynamic Face Database (SUDFace): Development and validation of an audiovisual stimulus set of recited and free speeches with neutral facial expressions

Faces convey a wide range of information, including one's identity, and emotional and mental states. Face perception is a major research topic in many research fields, such as cognitive science, social psychology, and neuroscience. Frequently, stimuli are selected from a range of available face databases. However, even though faces are highly dynamic, most databases consist of static face stimuli. Here, we introduce the Sabancı University Dynamic Face (SUDFace) database. The SUDFace database consists of 150 high-resolution audiovisual videos acquired in a controlled lab environment and stored with a resolution of 1920 × 1080 pixels at a frame rate of 60 Hz. The multimodal database consists of three videos of each human model in frontal view in three different conditions: vocalizing two scripted texts (conditions 1 and 2) and one Free Speech (condition 3). The main focus of the SUDFace database is to provide a large set of dynamic faces with neutral facial expressions and natural speech articulation. Variables such as face orientation, illumination, and accessories (piercings, earrings, facial hair, etc.) were kept constant across all stimuli. We provide detailed stimulus information, including facial features (pixel-wise calculations of face length, eye width, etc.) and speeches (e.g., duration of speech and repetitions). In two validation experiments, a total number of 227 participants rated each video on several psychological dimensions (e.g., neutralness and naturalness of expressions, valence, and the perceived mental states of the models) using Likert scales. The database is freely accessible for research purposes.

Knowledge of identity reduces variability in trait judgements across face images

Faces vary from image to image, eliciting different judgements of traits and often different judgements of identity. Knowledge that two face images belong to the same person facilitates the processing of identity information across images, but it is unclear if this also applies to trait judgements. In this preregistered study, participants (N = 100) rated the same 340 face images on perceived trustworthiness, dominance, or attractiveness presented in randomised order and again later presented in sets consisting of the same identity. We also explored the role of implicit person theory beliefs in the variability of social judgements across images. We found that judgements of trustworthiness varied less when images were presented in sets consisting of the same identity than in randomised order and were more consistent for images presented later in a set than those presented earlier. However, knowledge of identity had little effect on perceptions of dominance and attractiveness. Finally, implicit person theory beliefs were not associated with variability in social judgements and did not account for effects of knowledge of identity. Our findings suggest that knowledge of identity and perceptual familiarity stabilises judgements of trustworthiness, but not perceptions of dominance and attractiveness.

Dissociations between face identity and face expression processing in developmental prosopagnosia

Individuals with developmental prosopagnosia (DPs) experience severe and lifelong deficits recognising faces, but whether their deficits are selective to the processing of face identity or extend to the processing of face expression remains unclear. Clarifying this issue is important for understanding DP impairments and advancing theories of face processing. We compared identity and expression processing in a large sample of DPs (N = 124) using three different matching tasks that each assessed identity and expression processing with identical experimental formats. We ran each task in upright and inverted orientations and we measured inversion effects to assess the integrity of upright-specific face processes. We report three main results. First, DPs showed large deficits at discriminating identity but only subtle deficits at discriminating expression. Second, DPs showed a reduced inversion effect for identity but a normal inversion effect for expression. Third, DPs' performance on the expression tasks were linked to autism traits, but their performance on the identity tasks were not. These results constitute several dissociations between identity and expression processing in DP, and they are consistent with the view that the core impairment in DP is highly selective to identity.

Differences between high and low performers in face recognition in electrophysiological correlates of face familiarity and distance-to-norm

Valentine's influential norm-based multidimensional face-space model (nMDFS) predicts that perceived distinctiveness of a face increases with its distance to the norm. Occipito-temporal event-related potentials (ERPs) have been recently shown to respond selectively to variations in distance-to-norm (P200) or familiarity (N250, late negativity), respectively (Wuttke & Schweinberger, 2019). Despite growing evidence on interindividual differences in face perception skills at the behavioral level, little research has focused on their electrophysiological correlates. To reveal potential interindividual differences in face spaces, we contrasted high and low performers in face recognition in regards to distance-to-norm (P200) and familiarity (N250). We replicated both the P200 distance-to-norm and the N250 familiarity effect. Importantly, we observed: i) reduced responses in low compared to high performers of face recognition, especially in terms of smaller distance-to-norm effects in the P200, possibly indicating less 'expanded' face spaces in low compared to high performers; ii) increased N250 responses to familiar original faces in high performers, suggesting more robust face identity representations. In summary, these findings suggest the contribution of both early norm-based face coding and robust face representations to individual face recognition skills, and indicate that ERPs can offer a promising route to understand individual differences in face perception and their neurocognitive correlates.

Posterior theta activity reveals an early signal of self-face recognition

Self-related visual information, especially one's own face and name, are processed in a specific, prioritized way. However, the spatio-temporal brain dynamics of self-prioritization have remained elusive. Moreover, it has been unclear whether this prioritization is an effect of enhancement and amplification, or rather a facilitating automatization of processing self-referential information. In this EEG study, 25 married women (who changed their surnames after marriage, so that their past and present surnames could be used as stimuli) performed a detection task with faces and names from five categories: self, self from the past, friend, famous, and unknown person. The aim was to determine the temporal and spatial characteristics of early electrophysiological markers of self-referential processing. We report results of event-related component (ERP) and time-frequency analyses. In the ERPs, the earliest self-relevance effect was displayed only 300 ms after stimulus onset in the midfrontal N2, and later in the parietal P3b, independently of the stimulus type. No self-relevance effect was found on the N170 component. However, local theta power at the occipito-temporal (visual) areas and inter-regional theta phase coherence between the visual and midfrontal areas showed that self-relevance differentiation of faces began already about 100-300 ms after stimulus onset. No such early effects were found for names. The results are discussed in terms of the time-course, functional localization, stimulus-specificity, and automatization of self-prioritization.

Real and Deepfake Face Recognition: An EEG Study on Cognitive and Emotive Implications

The human brain's role in face processing (FP) and decision making for social interactions depends on recognizing faces accurately. However, the prevalence of deepfakes, AI-generated images, poses challenges in discerning real from synthetic identities. This study investigated healthy individuals' cognitive and emotional engagement in a visual discrimination task involving real and deepfake human faces expressing positive, negative, or neutral emotions. Electroencephalographic (EEG) data were collected from 23 healthy participants using a 21-channel dry-EEG headset; power spectrum and event-related potential (ERP) analyses were performed. Results revealed statistically significant activations in specific brain areas depending on the authenticity and emotional content of the stimuli. Power spectrum analysis highlighted a right-hemisphere predominance in theta, alpha, high-beta, and gamma bands for real faces, while deepfakes mainly affected the frontal and occipital areas in the delta band. ERP analysis hinted at the possibility of discriminating between real and synthetic faces, as N250 (200-300 ms after stimulus onset) peak latency decreased when observing real faces in the right frontal (LF) and left temporo-occipital (LTO) areas, but also within emotions, as P100 (90-140 ms) peak amplitude was found higher in the right temporo-occipital (RTO) area for happy faces with respect to neutral and sad ones.

Face mask reduces gaze-cueing effect

Recent studies have found that face masks affect social cognition and behaviour in the context of the novel coronavirus (COVID-19) pandemic. The eyes, the only part of the face not covered by face masks, are an important spatial attention cue that can trigger social attention orienting. Here, we adopted a spatial gaze-cueing task to investigate whether face masks affect social attention orienting triggered by eye gaze cues. In Experiment 1, participants were asked to determine the orientation of a target line under two types of cues-masked and non-masked faces-and two stimulus onset asynchrony (SOA) conditions (300 ms and 1000 ms). The results showed that masked faces induced a smaller gaze-cueing effect (GCE) compared to non-masked faces at 300 ms SOA, while two face types induced similar GCEs at 1000 ms SOA. Experiment 2 used mouth-obscured faces and non-masked faces as cues and found that no significant difference in GCE between the two types at either 300 ms or 1000 ms SOA, indicating that the reduction of GCE caused by the masked face was due to the social meaning expressed by the mask rather than a physical effect of masking. The present study extends previous findings to support the idea that high-level social information affects the processing of eye gaze direction and provides evidence that face masks affect social cognition and behaviour in the context of COVID-19.

Hypoactive Visual Cortex, Prefrontal Cortex and Insula during Self-Face Recognition in Adults with First-Episode Major Depressive Disorder

Self-face recognition is a vital aspect of self-referential processing, which is closely related to affective states. However, neuroimaging research on self-face recognition in adults with major depressive disorder is lacking. This study aims to investigate the alteration of brain activation during self-face recognition in adults with first-episode major depressive disorder (FEMDD) via functional magnetic resonance imaging (fMRI); FEMDD (n = 59) and healthy controls (HC, n = 36) who performed a self-face-recognition task during the fMRI scan. The differences in brain activation signal values between the two groups were analyzed, and Pearson correlation analysis was used to evaluate the relationship between the brain activation of significant group differences and the severity of depressive symptoms and negative self-evaluation; FEMDD showed significantly decreased brain activation in the bilateral occipital cortex, bilateral fusiform gyrus, right inferior frontal gyrus, and right insula during the task compared with HC. No significant correlation was detected between brain activation with significant group differences and the severity of depression and negative self-evaluation in FEMDD or HC. The results suggest the involvement of the malfunctioning visual cortex, prefrontal cortex, and insula in the pathophysiology of self-face recognition in FEMDD, which may provide a novel therapeutic target for adults with FEMDD.

Role of facial familiarity and emotional expression intensity in ensemble emotion perception

When looking at groups of people, we can extract information from the different faces to derive properties of the group, such as its average facial emotion, although how this average is computed remains a matter of debate. Here, we examined whether our participants' personal familiarity with the faces in the group, as well as the intensity of the facial expressions, biased ensemble perception. Participants judged the average emotional expression of ensembles of four different identities whose expressions depicted either neutral, angry, or happy emotions. For the angry and happy expressions, the intensity of the emotion could be either low (e.g., slightly happy) or high (very happy). When all the identities in the ensemble were unfamiliar, the presence of any high intensity emotional face biased ensemble perception towards its emotion. However, when a familiar face was present in the ensemble, perception was biased towards the familiar face's emotion regardless of its intensity. These findings reveal that how we perceive the average emotion of a group is influenced by both the emotional intensity and familiarity of the faces comprising the group, supporting the idea that different faces may be weighted differently in ensemble perception. These findings have important implications for the judgements we make about a group's overall emotional state may be biased by individuals within the group.

Processing emotions from faces and words measured by event-related brain potentials

Affective aspects of a stimulus can be processed rapidly and before cognitive attribution, acting much earlier for verbal stimuli than previously considered. Aimed for specific mechanisms, event-related brain potentials (ERPs), expressed in facial expressions or word meaning and evoked by six basic emotions - anger, disgust, fear, happy, sad, and surprise - relative to emotionally neutral stimuli were analysed in a sample of 116 participants. Brain responses in the occipital and left temporal regions elicited by the sadness in facial expressions or words were indistinguishable from responses evoked by neutral faces or words. Confirming previous findings, facial fear elicited an early and strong posterior negativity. Instead of expected parietal positivity, both the happy faces and words produced significantly more negative responses compared to neutral. Surprise in facial expressions and words elicited a strong early response in the left temporal cortex, which could be a signature of appraisal. The results of this study are consistent with the view that both types of affective stimuli, facial emotions and word meaning, set off rapid processing and responses occur very early in the processing stage.

Embracing deepfakes and AI-generated images in neuroscience research

The rise of deepfakes and AI-generated images has raised concerns regarding their potential misuse. However, this commentary highlights the valuable opportunities these technologies offer for neuroscience research. Deepfakes deliver accessible, realistic and customisable dynamic face stimuli, while generative adversarial networks (GANs) can generate and modify diverse and high-quality static content. These advancements can enhance the variability and ecological validity of research methods and enable the creation of previously unattainable stimuli. When AI-generated images are informed by brain responses, they provide unique insights into the structure and function of visual systems. The authors argue that experimental psychologists and cognitive neuroscientists stay informed about these emerging tools and embrace their potential to advance the field of visual neuroscience.

Altered brain metabolism in frontotemporal dementia and psychiatric disorders: involvement of the anterior cingulate cortex

BACKGROUND

Behavioural symptoms and frontotemporal hypometabolism overlap between behavioural variant of frontotemporal dementia (bvFTD) and primary psychiatric disorders (PPD), hampering diagnostic distinction. Voxel-wise comparisons of brain metabolism might identify specific frontotemporal-(hypo)metabolic regions between bvFTD and PPD. We investigated brain metabolism in bvFTD and PPD and its relationship with behavioural symptoms, social cognition, severity of depressive symptoms and cognitive functioning.

RESULTS

Compared to controls, bvFTD showed decreased metabolism in the dorsal anterior cingulate cortex (dACC) (p < 0.001), orbitofrontal cortex (OFC), temporal pole, dorsolateral prefrontal cortex (dlPFC) and caudate, whereas PPD showed no hypometabolism. Compared to PPD, bvFTD showed decreased metabolism in the dACC (p < 0.001, p < 0.05_FWE), insula, Broca's area, caudate, thalamus, OFC and temporal cortex (p < 0.001), whereas PPD showed decreased metabolism in the motor cortex (p < 0.001). Across bvFTD and PPD, decreased metabolism in the temporal cortex (p < 0.001, p < 0.05_FWE), dACC and frontal cortex was associated with worse social cognition. Decreased metabolism in the dlPFC was associated with compulsiveness (p < 0.001). Across bvFTD, PPD and controls, decreased metabolism in the PFC and motor cortex was associated with executive dysfunctioning (p < 0.001).

CONCLUSIONS

Our findings indicate subtle but distinct metabolic patterns in bvFTD and PPD, most strongly in the dACC. The degree of frontotemporal and cingulate hypometabolism was related to impaired social cognition, compulsiveness and executive dysfunctioning. Our findings suggest that the dACC might be an important region to differentiate between bvFTD and PPD but needs further validation.

Specialized Networks for Social Cognition in the Primate Brain

Primates have evolved diverse cognitive capabilities to navigate their complex social world. To understand how the brain implements critical social cognitive abilities, we describe functional specialization in the domains of face processing, social interaction understanding, and mental state attribution. Systems for face processing are specialized from the level of single cells to populations of neurons within brain regions to hierarchically organized networks that extract and represent abstract social information. Such functional specialization is not confined to the sensorimotor periphery but appears to be a pervasive theme of primate brain organization all the way to the apex regions of cortical hierarchies. Circuits processing social information are juxtaposed with parallel systems involved in processing nonsocial information, suggesting common computations applied to different domains. The emerging picture of the neural basis of social cognition is a set of distinct but interacting subnetworks involved in component processes such as face perception and social reasoning, traversing large parts of the primate brain.

Analysis of convolutional neural networks reveals the computational properties essential for subcortical processing of facial expression

Perception of facial expression is crucial for primate social interactions. This visual information is processed through the ventral cortical pathway and the subcortical pathway. However, the subcortical pathway exhibits inaccurate processing, and the responsible architectural and physiological properties remain unclear. To investigate this, we constructed and examined convolutional neural networks with three key properties of the subcortical pathway: a shallow layer architecture, concentric receptive fields at the initial processing stage, and a greater degree of spatial pooling. These neural networks achieved modest accuracy in classifying facial expressions. By replacing these properties, individually or in combination, with corresponding cortical features, performance gradually improved. Similar to amygdala neurons, some units in the final processing layer exhibited sensitivity to retina-based spatial frequencies (SFs), while others were sensitive to object-based SFs. Replacement of any of these properties affected the coordinates of the SF encoding. Therefore, all three properties limit the accuracy of facial expression information and are essential for determining the SF representation coordinate. These findings characterize the role of the subcortical computational processes in facial expression recognition.

Early categorization of social affordances during the visual encoding of bodily stimuli

Interpersonal interactions rely on various communication channels, both verbal and non-verbal, through which information regarding one's intentions and emotions are perceived. Here, we investigated the neural correlates underlying the visual processing of hand postures conveying social affordances (i.e., hand-shaking), compared to control stimuli such as hands performing non-social actions (i.e., grasping) or showing no movement at all. Combining univariate and multivariate analysis on electroencephalography (EEG) data, our results indicate that occipito-temporal electrodes show early differential processing of stimuli conveying social information compared to non-social ones. First, the amplitude of the Early Posterior Negativity (EPN, an Event-Related Potential related to the perception of body parts) is modulated differently during the perception of social and non-social content carried by hands. Moreover, our multivariate classification analysis (MultiVariate Pattern Analysis - MVPA) expanded the univariate results by revealing early (<200 ms) categorization of social affordances over occipito-parietal sites. In conclusion, we provide new evidence suggesting that the encoding of socially relevant hand gestures is categorized in the early stages of visual processing.

Effective connectivity during face processing in major depression - distinguishing markers of pathology, risk, and resilience

BACKGROUND

Aberrant brain connectivity during emotional processing, especially within the fronto-limbic pathway, is one of the hallmarks of major depressive disorder (MDD). However, the methodological heterogeneity of previous studies made it difficult to determine the functional and etiological implications of specific alterations in brain connectivity. We previously reported alterations in psychophysiological interaction measures during emotional face processing, distinguishing depressive pathology from at-risk/resilient and healthy states. Here, we extended these findings by effective connectivity analyses in the same sample to establish a refined neural model of emotion processing in depression.

METHODS

Thirty-seven patients with MDD, 45 first-degree relatives of patients with MDD and 97 healthy controls performed a face-matching task during functional magnetic resonance imaging. We used dynamic causal modeling to estimate task-dependent effective connectivity at the subject level. Parametric empirical Bayes was performed to quantify group differences in effective connectivity.

RESULTS

MDD patients showed decreased effective connectivity from the left amygdala and left lateral prefrontal cortex to the fusiform gyrus compared to relatives and controls, whereas patients and relatives showed decreased connectivity from the right orbitofrontal cortex to the left insula and from the left orbitofrontal cortex to the right fusiform gyrus compared to controls. Relatives showed increased connectivity from the anterior cingulate cortex to the left dorsolateral prefrontal cortex compared to patients and controls.

CONCLUSIONS

Our results suggest that the depressive state alters top-down control of higher visual regions during face processing. Alterations in connectivity within the cognitive control network present potential risk or resilience mechanisms.

The conscious processing of emotion in depression disorder: a meta-analysis of neuroimaging studies

Background

Depression is generally accompanied by a disturbed conscious processing of emotion, which manifests as a negative bias to facial/voice emotion information and a decreased accuracy in emotion recognition tasks. Several studies have proved that abnormal brain activation was responsible for the deficit function of conscious emotion recognition in depression. However, the altered brain activation related to the conscious processing of emotion in depression was incongruent among studies. Therefore, we conducted an activation likelihood estimation (ALE) analysis to better understand the underlying neurophysiological mechanism of conscious processing of emotion in depression.

Method

Electronic databases were searched using the search terms "depression," "emotion recognition," and "neuroimaging" from inceptions to April 10th, 2023. We retrieved trials which explored the neuro-responses of depressive patients to explicit emotion recognition tasks. Two investigators independently performed literature selection, data extraction, and risk of bias assessment. The spatial consistency of brain activation in conscious facial expressions recognition was calculated using ALE. The robustness of the results was examined by Jackknife sensitivity analysis.

Results

We retrieved 11,365 articles in total, 28 of which were included. In the overall analysis, we found increased activity in the middle temporal gyrus, superior temporal gyrus, parahippocampal gyrus, and cuneus, and decreased activity in the superior temporal gyrus, inferior parietal lobule, insula, and superior frontal gyrus. In response to positive stimuli, depressive patients showed hyperactivity in the medial frontal gyrus, middle temporal gyrus, and insula (uncorrected p < 0.001). When receiving negative stimuli, a higher activation was found in the precentral gyrus, middle frontal gyrus, precuneus, and superior temporal gyrus (uncorrected p < 0.001).

Conclusion

Among depressive patients, a broad spectrum of brain areas was involved in a deficit of conscious emotion processing. The activation of brain regions was different in response to positive or negative stimuli. Due to potential clinical heterogeneity, the findings should be treated with caution.

Systematic review registration

https://inplasy.com/inplasy-2022-11-0057/, identifier: 2022110057.

Fine-scale dynamics of functional connectivity in the face-processing network during movie watching

Mapping the human face-processing network is typically done during rest or using isolated, static face images, overlooking widespread cortical interactions obtained in response to naturalistic face dynamics and context. To determine how inter-subject functional correlation (ISFC) relates to face recognition scores, we measure cortical connectivity patterns in response to a dynamic movie in typical adults (N = 517). We find a positive correlation with recognition scores in edges connecting the occipital visual and anterior temporal regions and a negative correlation in edges connecting the attentional dorsal, frontal default, and occipital visual regions. We measure the inter-subject stimulus-evoked response at a single TR resolution and demonstrate that co-fluctuations in face-selective edges are related to activity in core face-selective regions and that the ISFC patterns peak during boundaries between movie segments rather than during the presence of faces. Our approach demonstrates how face processing is linked to fine-scale dynamics in attentional, memory, and perceptual neural circuitry.