The distributed human neural system for face perception

Social cognition in Idiopathic generalised epilepsies

Social cognition is a set of mental skills necessary to create satisfactory interpersonal relationships and feel a sense of belonging to a social group. Its deficits significantly reduce the quality of life in people with epilepsy. Studies on social cognition and its impairments focus predominantly on people with focal epilepsies. Idiopathic generalised epilepsies are a group of diseases that share similar clinical, prognostic and electrographic characteristics. Despite their typically normal intelligence, people with Idiopathic generalised epilepsies can suffer from learning disabilities and executive dysfunctions. Current studies also suggest social cognition impairments, but their results are inconsistent. This review offers the latest knowledge of social cognition in adults with Idiopathic generalised epilepsies. In addition, we provide an overview of the most frequently used assessment methods. We explain possible reasons for different outcomes and discuss future research perspectives.

Development of human visual cortical function: A scoping review of task- and naturalistic-fMRI studies through the interactive specialization and maturational frameworks

Overarching theories such as the interactive specialization and maturational frameworks have been proposed to describe human functional brain development. However, these frameworks have not yet been systematically examined across the fMRI literature. Visual processing is one of the most well-studied fields in neuroimaging, and research in this area has recently expanded to include naturalistic paradigms that facilitate study in younger age ranges, allowing for an in-depth critical appraisal of these frameworks across childhood. To this end, we conducted a scoping review of 94 developmental visual fMRI studies, including both traditional experimental task and naturalistic studies, across multiple sub-domains (early visual processing, category-specific higher order processing, naturalistic visual processing). We found that across domains, many studies reported progressive development, but few studies describe regressive or emergent changes necessary to fit the maturational or interactive specialization frameworks. Our findings suggest a need for the expansion of developmental frameworks and clearer reporting of both progressive and regressive changes, along with well-powered, longitudinal studies.

Facial mimicry interference reduces working memory accuracy for facial emotion expressions

Facial mimicry, the tendency to imitate facial expressions of other individuals, has been shown to play a critical role in the processing of emotion expressions. At the same time, there is evidence suggesting that its role might change when the cognitive demands of the situation increase. In such situations, understanding another person is dependent on working memory. However, whether facial mimicry influences working memory representations for facial emotion expressions is not fully understood. In the present study, we experimentally interfered with facial mimicry by using established behavioral procedures, and investigated how this interference influenced working memory recall for facial emotion expressions. Healthy, young adults (N = 36) performed an emotion expression n-back paradigm with two levels of working memory load, low (1-back) and high (2-back), and three levels of mimicry interference: high, low, and no interference. Results showed that, after controlling for block order and individual differences in the perceived valence and arousal of the stimuli, the high level of mimicry interference impaired accuracy when working memory load was low (1-back) but, unexpectedly, not when load was high (2-back). Working memory load had a detrimental effect on performance in all three mimicry conditions. We conclude that facial mimicry might support working memory for emotion expressions when task load is low, but that the supporting effect possibly is reduced when the task becomes more cognitively challenging.

Face recognition's practical relevance: Social bonds, not social butterflies

Research on individual differences in face recognition has provided important foundational insights: their broad range, cognitive specificity, strong heritability, and resilience to change. Elusive, however, has been the key issue of practical relevance: do these individual differences correlate with aspects of life that go beyond the recognition of faces, per se? Though often assumed, especially in social realms, such correlates remain largely theoretical, without empirical support. Here, we investigate an array of potential social correlates of face recognition. We establish social relationship quality as a reproducible correlate. This link generalises across face recognition tasks and across independent samples. In contrast, we detect no robust association with the sheer quantity of social connections, whether measured directly via number of social contacts or indirectly via extraversion-related personality indices. These findings document the existence of a key social correlate of face recognition and provide some of the first evidence to support its practical relevance. At the same time, they challenge the naive assumption that face recognition relates equally to all social outcomes. In contrast, they suggest a focused link of face recognition to the quality, not quantity, of one's social connections.

Investigating the impact of motion visual synchrony on self face recognition using real time morphing

Face recognition is a crucial aspect of self-image and social interactions. Previous studies have focused on static images to explore the boundary of self-face recognition. Our research, however, investigates the dynamics of face recognition in contexts involving motor-visual synchrony. We first validated our morphing face metrics for self-face recognition. We then conducted an experiment using state-of-the-art video processing techniques for real-time face identity morphing during facial movement. We examined self-face recognition boundaries under three conditions: synchronous, asynchronous, and static facial movements. Our findings revealed that participants recognized a narrower self-face boundary with moving facial images compared to static ones, with no significant differences between synchronous and asynchronous movements. The direction of morphing consistently biased the recognized self-face boundary. These results suggest that while motor information of the face is vital for self-face recognition, it does not rely on movement synchronization, and the sense of agency over facial movements does not affect facial identity judgment. Our methodology offers a new approach to exploring the 'self-face boundary in action', allowing for an independent examination of motion and identity.

The neuropsychological evaluation of face identity recognition

Facial identity recognition (FIR) is arguably the ultimate form of recognition for the adult human brain. Even if the term prosopagnosia is reserved for exceptionally rare brain-damaged cases with a category-specific abrupt loss of FIR at adulthood, subjective and objective impairments or difficulties of FIR are common in the neuropsychological population. Here we provide a critical overview of the evaluation of FIR both for clinicians and researchers in neuropsychology. FIR impairments occur following many causes that should be identified objectively by both general and specific, behavioral and neural examinations. We refute the commonly used dissociation between perceptual and memory deficits/tests for FIR, since even a task involving the discrimination of unfamiliar face images presented side-by-side relies on cortical memories of faces in the right-lateralized ventral occipito-temporal cortex. Another frequently encountered confusion is between specific deficits of the FIR function and a more general impairment of semantic memory (of people), the latter being most often encountered following anterior temporal lobe damage. Many computerized tests aimed at evaluating FIR have appeared over the last two decades, as reviewed here. However, despite undeniable strengths, they often suffer from ecological limitations, difficulties of instruction, as well as a lack of consideration for processing speed and qualitative information. Taking into account these issues, a recently developed behavioral test with natural images manipulating face familiarity, stimulus inversion, and correct response times as a key variable appears promising. The measurement of electroencephalographic (EEG) activity in the frequency domain from fast periodic visual stimulation also appears as a particularly promising tool to complete and enhance the neuropsychological assessment of FIR.

The role of preSMA and STS in face recognition: A transcranial magnetic stimulation (TMS) study

Current models propose that facial recognition is mediated by two independent yet interacting anatomo-functional systems: one processing facial features mainly mediated by the Fusiform Face Area and the other involved in the extraction of dynamic information from faces, subserved by Superior Temporal Sulcus (STS). Also, the pre-Supplementary Motor Area (pre-SMA) is implicated in facial expression processing as it is involved in its motor mimicry. However, the literature only shows evidence of the implication of STS and preSMA for facial expression recognition, without relating it to face recognition. In addition, the literature shows a facilitatory role of facial motion in the recognition of unfamiliar faces, particularly for poor recognizers. The present study aimed at studying the role of STS and preSMA in unfamiliar face recognition in people with different face recognition skills. 34 healthy participants received repetitive transcranial magnetic stimulation over the right posterior STS, pre-SMA and as sham during a task of matching of faces encoded through: facial expression, rigid head movement or as static (i.e., absence of any facial or head motion). All faces were represented without emotional content. Results indicate that STS has a direct role in recognizing identities through rigid head movement and an indirect role in facial expression processing. This dissociation represents a step forward with respect to current face processing models suggesting that different types of motion involve separate brain and cognitive processes. PreSMA interacts with face recognition skills, increasing the performance of poor recognizers and decreasing that of good recognizers in all presentation conditions. Together, the results suggest the use of at least partially different mechanisms for face recognition in poor and good recognizers and a different role of STS and preSMA in face recognition.

Human genetics of face recognition: discovery of MCTP2 mutations in humans with face blindness (congenital prosopagnosia)

Face recognition is important for both visual and social cognition. While prosopagnosia or face blindness has been known for seven decades and face-specific neurons for half a century, the molecular genetic mechanism is not clear. Here we report results after 17 years of research with classic genetics and modern genomics. From a large family with 18 congenital prosopagnosia (CP) members with obvious difficulties in face recognition in daily life, we uncovered a fully cosegregating private mutation in the MCTP2 gene which encodes a calcium binding transmembrane protein expressed in the brain. After screening through cohorts of 6589, we found more CPs and their families, allowing detection of more CP associated mutations in MCTP2. Face recognition differences were detected between 14 carriers with the frameshift mutation S80fs in MCTP2 and 19 noncarrying volunteers. Six families including one with 10 members showed the S80fs-CP correlation. Functional magnetic resonance imaging found association of impaired recognition of individual faces by MCTP2 mutant CPs with reduced repetition suppression to repeated facial identities in the right fusiform face area. Our results have revealed genetic predisposition of MCTP2 mutations in CP, 76 years after the initial report of prosopagnosia and 47 years after the report of the first CP. This is the first time a gene required for a higher form of visual social cognition was found in humans.

Beyond faces: the contribution of the amygdala to visual processing in the macaque brain

The amygdala is present in a diverse range of vertebrate species, such as lizards, rodents, and primates; however, its structure and connectivity differs across species. The increased connections to visual sensory areas in primate species suggests that understanding the visual selectivity of the amygdala in detail is critical to revealing the principles underlying its function in primate cognition. Therefore, we designed a high-resolution, contrast-agent enhanced, event-related fMRI experiment, and scanned 3 adult rhesus macaques, while they viewed 96 naturalistic stimuli. Half of these stimuli were social (defined by the presence of a conspecific), the other half were nonsocial. We also nested manipulations of emotional valence (positive, neutral, and negative) and visual category (faces, nonfaces, animate, and inanimate) within the stimulus set. The results reveal widespread effects of emotional valence, with the amygdala responding more on average to inanimate objects and animals than faces, bodies, or social agents in this experimental context. These findings suggest that the amygdala makes a contribution to primate vision that goes beyond an auxiliary role in face or social perception. Furthermore, the results highlight the importance of stimulus selection and experimental design when probing the function of the amygdala and other visually responsive brain regions.

Autistic adults exhibit typical sensitivity to changes in interpersonal distance

The visual processing differences seen in autism often impede individuals' visual perception of the social world. In particular, many autistic people exhibit poor face recognition. Here, we sought to determine whether autistic adults also show impaired perception of dyadic social interactions-a class of stimulus thought to engage face-like visual processing. Our focus was the perception of interpersonal distance. Participants completed distance change detection tasks, in which they had to make perceptual decisions about the distance between two actors. On half of the trials, participants judged whether the actors moved closer together; on the other half, whether they moved further apart. In a nonsocial control task, participants made similar judgments about two grandfather clocks. We also assessed participants' face recognition ability using standardized measures. The autistic and nonautistic observers showed similar levels of perceptual sensitivity to changes in interpersonal distance when viewing social interactions. As expected, however, the autistic observers showed clear signs of impaired face recognition. Despite putative similarities between the visual processing of faces and dyadic social interactions, our results suggest that these two facets of social vision may dissociate.

P1, N170, and N250 Event-related Potential Components Reflect Temporal Perception Processing in Face and Body Personal Identification

Human faces and bodies represent various socially important signals. Although adults encounter numerous new people in daily life, they can recognize hundreds to thousands of different individuals. However, the neural mechanisms that differentiate one person from another person are unclear. This study aimed to clarify the temporal dynamics of the cognitive processes of face and body personal identification using face-sensitive ERP components (P1, N170, and N250). The present study performed three blocks (face-face, face-body, and body-body) of different ERP adaptation paradigms. Furthermore, in the above three blocks, ERP components were used to compare brain biomarkers under three conditions (same person, different person of the same sex, and different person of the opposite sex). The results showed that the P1 amplitude for the face-face block was significantly greater than that for the body-body block, that the N170 amplitude for a different person of the same sex condition was greater than that for the same person condition in the right hemisphere only, and that the N250 amplitude gradually increased as the degree of face and body sex-social categorization grew closer (i.e., same person condition > different person of the same sex condition > different person of the opposite sex condition). These results suggest that early processing of the face and body processes the face and body separately and that structural encoding and personal identification of the face and body process the face and body collaboratively.

The effect of emotion recognition and mindfulness on depression symptoms: A case-control study

Abnormalities in emotion recognition (ER) are frequently reported in depression, with lower recognition accuracy in patients with major depressive disorder (MDD) when compared to healthy individuals. Mindfulness was found to directly impact the severity of depressive symptoms, by recognizing negative cognitions and dysfunctional reactions. The aims of this study were to compare ER and mindfulness levels between MDD patients and healthy controls (HCs), as well as to examine whether ER and mindfulness are related to symptom severity in MDD patients. Sixty-eight patients with MDD and 93 HCs participated in the study. A sociodemographic form, reading the mind in the eyes test (RMET), five facet mindfulness questionnaire-short form (FFMQ-S) and the Montgomery-Asberg depression scale (MADRS) were administered. Group comparison in ER and mindfulness was performed using the multivariate analysis of covariance (MANCOVA). Bivariate correlations and hierarchical linear regression analyses were performed to assess the associations between depression severity, ER and mindfulness in the patient group. Higher level of mindfulness was found in HCs relative to MDD group, however, no ER difference was present between the groups. A positive association between depression severity and the non-reactivity facet of mindfulness was found. On the other hand, ER was not significantly associated with symptom severity among individuals with MDD. Non-reactivity, unlike other dimensions of mindfulness, seems to increase with the severity of depressive symptoms among MDD patients. A particular focus on this subdimension in mindfulness techniques may yield better outcomes in alleviation of depressive symptoms.

Investigating the neural effects of typicality and predictability for face and object stimuli

The brain calibrates itself based on the past stimulus diet, which makes frequently observed stimuli appear as typical (as opposed to uncommon stimuli, which appear as distinctive). Based on predictive processing theory, the brain should be more "prepared" for typical exemplars, because these contain information that has been encountered frequently, allowing it to economically represent items of that category. Thus, one could ask whether predictability and typicality of visual stimuli interact, or rather act in an additive manner. We adapted the design by Egner and colleagues (2010), who used cues to induce expectations about stimulus category (face vs. chair) occurrence during an orthogonal inversion detection task. We measured BOLD responses with fMRI in 35 participants. First, distinctive stimuli always elicited stronger responses than typical ones in all ROIs, and our whole-brain directional contrasts for the effects of typicality and distinctiveness converge with previous findings. Second and importantly, we could not replicate the interaction between category and predictability reported by Egner et al. (2010), which casts doubt on whether cueing designs are ideal to elicit reliable predictability effects. Third, likely as a consequence of the lack of predictability effects, we found no interaction between predictability and typicality in any of the four tested regions (bilateral fusiform face areas, lateral occipital complexes) when considering both categories, nor in the whole brain. We discuss the issue of replicability in neuroscience and sketch an agenda for how future studies might address the same question.

Sex differences in trajectories of cortical development in autistic children from 2-13 years of age

Previous studies have reported alterations in cortical thickness in autism. However, few have included enough autistic females to determine if there are sex specific differences in cortical structure in autism. This longitudinal study aimed to investigate autistic sex differences in cortical thickness and trajectory of cortical thinning across childhood. Participants included 290 autistic (88 females) and 139 nonautistic (60 females) individuals assessed at up to 4 timepoints spanning ~2-13 years of age (918 total MRI timepoints). Estimates of cortical thickness in early and late childhood as well as the trajectory of cortical thinning were modeled using spatiotemporal linear mixed effects models of age-by-sex-by-diagnosis. Additionally, the spatial correspondence between cortical maps of sex-by-diagnosis differences and neurotypical sex differences were evaluated. Relative to their nonautistic peers, autistic females had more extensive cortical differences than autistic males. These differences involved multiple functional networks, and were mainly characterized by thicker cortex at ~3 years of age and faster cortical thinning in autistic females. Cortical regions in which autistic alterations were different between the sexes significantly overlapped with regions that differed by sex in neurotypical development. Autistic females and males demonstrated some shared differences in cortical thickness and rate of cortical thinning across childhood relative to their nonautistic peers, however these areas were relatively small compared to the widespread differences observed across the sexes. These results support evidence of sex-specific neurobiology in autism and suggest that processes that regulate sex differentiation in the neurotypical brain contribute to sex differences in the etiology of autism.

Neural Representations of Observed Interpersonal Synchrony/Asynchrony in the Social Perception Network

The visual perception of individuals is thought to be mediated by a network of regions in the occipitotemporal cortex that supports specialized processing of faces, bodies, and actions. In comparison, we know relatively little about the neural mechanisms that support the perception of multiple individuals and the interactions between them. The present study sought to elucidate the visual processing of social interactions by identifying which regions of the social perception network represent interpersonal synchrony. In an fMRI study with 32 human participants (26 female, 6 male), we used multivoxel pattern analysis to investigate whether activity in face-selective, body-selective, and interaction-sensitive regions across the social perception network supports the decoding of synchronous versus asynchronous head-nodding and head-shaking. Several regions were found to support significant decoding of synchrony/asynchrony, including extrastriate body area (EBA), face-selective and interaction-sensitive mid/posterior right superior temporal sulcus, and occipital face area. We also saw robust cross-classification across actions in the EBA, suggestive of movement-invariant representations of synchrony/asynchrony. Exploratory whole-brain analyses also identified a region of the right fusiform cortex that responded more strongly to synchronous than to asynchronous motion. Critically, perceiving interpersonal synchrony/asynchrony requires the simultaneous extraction and integration of dynamic information from more than one person. Hence, the representation of synchrony/asynchrony cannot be attributed to augmented or additive processing of individual actors. Our findings therefore provide important new evidence that social interactions recruit dedicated visual processing within the social perception network that extends beyond that engaged by the faces and bodies of the constituent individuals.

Face detection mechanisms: Nature vs. nurture

For many animals, faces are a vitally important visual stimulus. Hence, it is not surprising that face perception has become a very popular research topic in neuroscience, with ca. 2000 papers published every year. As a result, significant progress has been made in understanding the intricate mechanisms underlying this phenomenon. However, the ontogeny of face perception, in particular the role of innate predispositions, remains largely unexplored at the neural level. Several influential studies in monkeys have suggested that seeing faces is necessary for the development of the face-selective brain domains. At the same time, behavioural experiments with newborn human babies and newly-hatched domestic chicks demonstrate that a spontaneous preference towards faces emerges early in life without pre-existing experience. Moreover, we were recently able to record face-selective neural responses in the brain of young, face-naïve chicks, thus demonstrating the existence of an innate face detection mechanism. In this review, we discuss these seemingly contradictory results and propose potential experimental approaches to resolve some of the open questions.

A behavioral advantage for the face pareidolia illusion in peripheral vision

Investigation of visual illusions helps us understand how we process visual information. For example, face pareidolia, the misperception of illusory faces in objects, could be used to understand how we process real faces. However, it remains unclear whether this illusion emerges from errors in face detection or from slower, cognitive processes. Here, our logic is straightforward; if examples of face pareidolia activate the mechanisms that rapidly detect faces in visual environments, then participants will look at objects more quickly when the objects also contain illusory faces. To test this hypothesis, we sampled continuous eye movements during a fast saccadic choice task-participants were required to select either faces or food items. During this task, pairs of stimuli were positioned close to the initial fixation point or further away, in the periphery. As expected, the participants were faster to look at face targets than food targets. Importantly, we also discovered an advantage for food items with illusory faces but, this advantage was limited to the peripheral condition. These findings are among the first to demonstrate that the face pareidolia illusion persists in the periphery and, thus, it is likely to be a consequence of erroneous face detection.

Neural computations in prosopagnosia

We report an investigation of the neural processes involved in the processing of faces and objects of brain-lesioned patient PS, a well-documented case of pure acquired prosopagnosia. We gathered a substantial dataset of high-density electrophysiological recordings from both PS and neurotypicals. Using representational similarity analysis, we produced time-resolved brain representations in a format that facilitates direct comparisons across time points, different individuals, and computational models. To understand how the lesions in PS's ventral stream affect the temporal evolution of her brain representations, we computed the temporal generalization of her brain representations. We uncovered that PS's early brain representations exhibit an unusual similarity to later representations, implying an excessive generalization of early visual patterns. To reveal the underlying computational deficits, we correlated PS' brain representations with those of deep neural networks (DNN). We found that the computations underlying PS' brain activity bore a closer resemblance to early layers of a visual DNN than those of controls. However, the brain representations in neurotypicals became more akin to those of the later layers of the model compared to PS. We confirmed PS's deficits in high-level brain representations by demonstrating that her brain representations exhibited less similarity with those of a DNN of semantics.

Conscious perception of fear in faces: Insights from high-density EEG and perceptual awareness scale with threshold stimuli

Contrary to the extensive research on processing subliminal and/or unattended emotional facial expressions, only a minority of studies have investigated the neural correlates of consciousness (NCCs) of emotions conveyed by faces. In the present high-density electroencephalography (EEG) study, we first employed a staircase procedure to identify each participant's perceptual threshold of the emotion expressed by the face and then compared the EEG signals elicited in trials where the participants were aware with the activity elicited in trials where participants were unaware of the emotions expressed by these, otherwise identical, faces. Drawing on existing knowledge of the neural mechanisms of face processing and NCCs, we hypothesized that activity in frontal electrodes would be modulated in relation to participants' awareness of facial emotional content. More specifically, we hypothesized that the NCC of fear seen on someone else's face could be detected as a modulation of a later and more anterior (i.e., at frontal sites) event-related potential (ERP) than the face-sensitive N170. By adopting a data-driven approach and cluster-based statistics to the analysis of EEG signals, the results were clear-cut in showing that visual awareness of fear was associated with the modulation of a frontal ERP component in a 150-300 msec interval. These insights are dissected and contextualized in relation to prevailing theories of visual consciousness and their proposed NCC benchmarks.

Prediction error processing and sharpening of expected information across the face-processing hierarchy

The perception and neural processing of sensory information are strongly influenced by prior expectations. The integration of prior and sensory information can manifest through distinct underlying mechanisms: focusing on unexpected input, denoted as prediction error (PE) processing, or amplifying anticipated information via sharpened representation. In this study, we employed computational modeling using deep neural networks combined with representational similarity analyses of fMRI data to investigate these two processes during face perception. Participants were cued to see face images, some generated by morphing two faces, leading to ambiguity in face identity. We show that expected faces were identified faster and perception of ambiguous faces was shifted towards priors. Multivariate analyses uncovered evidence for PE processing across and beyond the face-processing hierarchy from the occipital face area (OFA), via the fusiform face area, to the anterior temporal lobe, and suggest sharpened representations in the OFA. Our findings support the proposition that the brain represents faces grounded in prior expectations.

Dynamic brain communication underwriting face pareidolia

Face pareidolia is a tendency to seeing faces in nonface images that reflects high tuning to a face scheme. Yet, studies of the brain networks underwriting face pareidolia are scarce. Here, we examined the time course and dynamic topography of gamma oscillatory neuromagnetic activity while administering a task with nonface images resembling a face. Images were presented either with canonical orientation or with display inversion that heavily impedes face pareidolia. At early processing stages, the peaks in gamma activity (40 to 45 Hz) to images either triggering or not face pareidolia originate mainly from the right medioventral and lateral occipital cortices, rostral and caudal cuneus gyri, and medial superior occipital gyrus. Yet, the difference occurred at later processing stages in the high-frequency range of 80 to 85 Hz over a set of the areas constituting the social brain. The findings speak rather for a relatively late neural network playing a key role in face pareidolia. Strikingly, a cutting-edge analysis of brain connectivity unfolding over time reveals mutual feedforward and feedback intra- and interhemispheric communication not only within the social brain but also within the extended large-scale network of down- and upstream regions. In particular, the superior temporal sulcus and insula strongly engage in communication with other brain regions either as signal transmitters or recipients throughout the whole processing of face-pareidolia images.

Autistic traits and anthropomorphism: the case of vehicle fascia perception

Individuals high in autistic traits can have difficulties with social interactions which may stem from difficulties with mentalizing abilities, yet findings from research investigating anthropomorphism of non-human objects in high trait individuals are inconsistent. Measuring emotions and attributes of front-facing vehicles, individuals scoring high versus low on the AQ-10 were compared for ratings of angry-happy, hostile-friendly, masculine-feminine, and submissive-dominant, as a function of vehicle size (large versus small). Our results showed that participants perceived large vehicles as more angry, hostile, masculine, and dominant than small vehicles, with no significant difference in ratings between high and low AQ-10 scorers. The current findings support previous research reporting high autistic trait individuals' intact object processing. Our novel findings also suggest high autistic trait individuals' anthropomorphizing abilities are comparable to those found in low autistic trait individuals.

Spatial representation of multidimensional information in emotional faces revealed by fMRI

Face perception is a complex process that involves highly specialized procedures and mechanisms. Investigating into face perception can help us better understand how the brain processes fine-grained, multidimensional information. This research aimed to delve deeply into how different dimensions of facial information are represented in specific brain regions or through inter-regional connections via an implicit face recognition task. To capture the representation of various facial information in the brain, we employed support vector machine decoding, functional connectivity, and model-based representational similarity analysis on fMRI data, resulting in the identification of three crucial findings. Firstly, despite the implicit nature of the task, emotions were still represented in the brain, contrasting with all other facial information. Secondly, the connection between the medial amygdala and the parahippocampal gyrus was found to be essential for the representation of facial emotion in implicit tasks. Thirdly, in implicit tasks, arousal representation occurred in the parahippocampal gyrus, while valence depended on the connection between the primary visual cortex and the parahippocampal gyrus. In conclusion, these findings dissociate the neural mechanisms of emotional valence and arousal, revealing the precise spatial patterns of multidimensional information processing in faces.

Unconscious face processing shows a different lateralisation pattern

Faces contain rich information and play a pivotal role in human daily social interactions. Previous studies have provided evidence for the left-visual-field-advantage in face perception. The current study investigated lateralisation when face stimuli were unconsciously presented using interocular suppression methods. The results showed that when an unconscious face stimulus was presented in one side of the visual field without other face stimuli, the unconscious face in the right visual field could break through interocular suppression faster than that in the left (Experiments 1 and 2). However, this right visual field processing advantage reversed to the left when a face stimulus either with (Experiment 2) or without (Experiment 3) visual awareness was presented concurrently with or prior to (Experiment 4) the unconscious face stimuli. These results showed that the unconscious face might have a different processing pattern compared with the conscious face. The relationship between this novel behavioural observation and known functional lateralisation of the fusiform face areas is discussed, suggesting a dynamic interaction between the two cortical hemispheres may underlie the formation of visual awareness for faces. The current study expands our understanding of face processing lateralisation and provided evidence on the asymmetric inter-hemisphere interaction patterns in forming visual awareness.

Implicit weight bias: shared neural substrates for overweight and angry facial expressions revealed by cross-adaptation

The perception of facial expression plays a crucial role in social communication, and it is known to be influenced by various facial cues. Previous studies have reported both positive and negative biases toward overweight individuals. It is unclear whether facial cues, such as facial weight, bias facial expression perception. Combining psychophysics and event-related potential technology, the current study adopted a cross-adaptation paradigm to examine this issue. The psychophysical results of Experiments 1A and 1B revealed a bidirectional cross-adaptation effect between overweight and angry faces. Adapting to overweight faces decreased the likelihood of perceiving ambiguous emotional expressions as angry compared to adapting to normal-weight faces. Likewise, exposure to angry faces subsequently caused normal-weight faces to appear thinner. These findings were corroborated by bidirectional event-related potential results, showing that adaptation to overweight faces relative to normal-weight faces modulated the event-related potential responses of emotionally ambiguous facial expression (Experiment 2A); vice versa, adaptation to angry faces relative to neutral faces modulated the event-related potential responses of ambiguous faces in facial weight (Experiment 2B). Our study provides direct evidence associating overweight faces with facial expression, suggesting at least partly common neural substrates for the perception of overweight and angry faces.

What is developmental about developmental prosopagnosia?

Developmental prosopagnosia (DP) is characterised by difficulties recognising face identities and is associated with diverse co-occurring object recognition difficulties. The high co-occurrence rate and heterogeneity of associated difficulties in DP is an intrinsic feature of developmental conditions, where co-occurrence of difficulties is the rule, rather than the exception. However, despite its name, cognitive and neural theories of DP rarely consider the developmental context in which these difficulties occur. This leaves a large gap in our understanding of how DP emerges in light of the developmental trajectory of face recognition. Here, we argue that progress in the field requires re-considering the developmental origins of differences in face recognition abilities, rather than studying the end-state alone. In practice, considering development in DP necessitates a re-evaluation of current approaches in recruitment, design, and analyses.

Patterns of neural activity in response to threatening faces are predictive of autistic traits: modulatory effects of oxytocin receptor genotype

Autistic individuals generally demonstrate impaired emotion recognition but it is unclear whether effects are emotion-specific or influenced by oxytocin receptor (OXTR) genotype. Here we implemented a dimensional approach using an implicit emotion recognition task together with functional MRI in a large cohort of neurotypical adult participants (N = 255, male = 131, aged 17-29 years) to establish associations between autistic traits and neural and behavioral responses to specific face emotions, together with modulatory effects of OXTR genotype. A searchlight-based multivariate pattern analysis (MVPA) revealed an extensive network of frontal, basal ganglia, cingulate and limbic regions exhibiting significant predictability for autistic traits from patterns of responses to angry relative to neutral expression faces. Functional connectivity analyses revealed a genotype interaction (OXTR SNPs rs2254298, rs2268491) for coupling between the orbitofrontal cortex and mid-cingulate during angry expression processing, with a negative association between coupling and autistic traits in the risk-allele group and a positive one in the non-risk allele group. Overall, results indicate extensive emotion-specific associations primarily between patterns of neural responses to angry faces and autistic traits in regions processing motivation, reward and salience but not in early visual processing. Functional connections between these identified regions were not only associated with autistic traits but also influenced by OXTR genotype. Thus, altered patterns of neural responses to threatening faces may be a potential biomarker for autistic symptoms although modulatory influences of OXTR genotype need to be taken into account.

Preliminary Evidence for Global Properties in Human Listeners During Natural Auditory Scene Perception

Theories of auditory and visual scene analysis suggest the perception of scenes relies on the identification and segregation of objects within it, resembling a detail-oriented processing style. However, a more global process may occur while analyzing scenes, which has been evidenced in the visual domain. It is our understanding that a similar line of research has not been explored in the auditory domain; therefore, we evaluated the contributions of high-level global and low-level acoustic information to auditory scene perception. An additional aim was to increase the field's ecological validity by using and making available a new collection of high-quality auditory scenes. Participants rated scenes on 8 global properties (e.g., open vs. enclosed) and an acoustic analysis evaluated which low-level features predicted the ratings. We submitted the acoustic measures and average ratings of the global properties to separate exploratory factor analyses (EFAs). The EFA of the acoustic measures revealed a seven-factor structure explaining 57% of the variance in the data, while the EFA of the global property measures revealed a two-factor structure explaining 64% of the variance in the data. Regression analyses revealed each global property was predicted by at least one acoustic variable (R2 = 0.33-0.87). These findings were extended using deep neural network models where we examined correlations between human ratings of global properties and deep embeddings of two computational models: an object-based model and a scene-based model. The results support that participants' ratings are more strongly explained by a global analysis of the scene setting, though the relationship between scene perception and auditory perception is multifaceted, with differing correlation patterns evident between the two models. Taken together, our results provide evidence for the ability to perceive auditory scenes from a global perspective. Some of the acoustic measures predicted ratings of global scene perception, suggesting representations of auditory objects may be transformed through many stages of processing in the ventral auditory stream, similar to what has been proposed in the ventral visual stream. These findings and the open availability of our scene collection will make future studies on perception, attention, and memory for natural auditory scenes possible.

Both identity and non-identity face perception tasks predict developmental prosopagnosia and face recognition ability

Developmental prosopagnosia (DP) is characterised by deficits in face identification. However, there is debate about whether these deficits are primarily perceptual, and whether they extend to other face processing tasks (e.g., identifying emotion, age, and gender; detecting faces in scenes). In this study, 30 participants with DP and 75 controls completed a battery of eight tasks assessing four domains of face perception (identity; emotion; age and gender; face detection). The DP group performed worse than the control group on both identity perception tasks, and one task from each other domain. Both identity perception tests uniquely predicted DP/control group membership, and performance on two measures of face memory. These findings suggest that deficits in DP may arise from issues with face perception. Some non-identity tasks also predicted DP/control group membership and face memory, even when face identity perception was accounted for. Gender perception and speed of face detection consistently predicted unique variance in group membership and face memory; several other tasks were only associated with some measures of face recognition ability. These findings indicate that face perception deficits in DP may extend beyond identity perception. However, the associations between tasks may also reflect subtle aspects of task demands or stimuli.

Onscreen presence of instructors in video lectures affects learners' neural synchrony and visual attention during multimedia learning

COVID-19 forced students to rely on online learning using multimedia tools, and multimedia learning continues to impact education beyond the pandemic. In this study, we combined behavioral, eye-tracking, and neuroimaging paradigms to identify multimedia learning processes and outcomes. College students viewed four video lectures including slides with either an onscreen human instructor, an animated instructor, or no onscreen instructor. Brain activity was recorded via fMRI, visual attention was recorded via eye-tracking, and learning outcome was assessed via post-tests. Onscreen presence of instructor, compared with no instructor presence, resulted in superior post-test performance, less visual attention on the slide, more synchronized eye movements during learning, and higher neural synchronization in cortical networks associated with socio-emotional processing and working memory. Individual variation in cognitive and socio-emotional abilities and intersubject neural synchronization revealed different levels of cognitive and socio-emotional processing in different learning conditions. The instructor-present condition evoked increased synchronization, likely reflecting extra processing demands in attentional control, working memory engagement, and socio-emotional processing. Although human instructors and animated instructors led to comparable learning outcomes, the effects were due to the dynamic interplay of information processing vs. attentional distraction. These findings reflect a benefit-cost trade-off where multimedia learning outcome is enhanced only when the cognitive benefits motivated by the social presence of onscreen instructor outweigh the cognitive costs brought about by concurrent attentional distraction unrelated to learning.

Using optically pumped magnetometers to replicate task-related responses in next generation magnetoencephalography

Optically pumped magnetometers (OPMs) offer a new wearable means to measure magnetoencephalography (MEG) signals, with many advantages compared to conventional systems. However, OPMs are an emerging technology, thus characterizing and replicating MEG recordings is essential. Using OPM-MEG and SQUID-MEG, this study investigated evoked responses, oscillatory power, and functional connectivity during emotion processing in 20 adults, to establish replicability across the two technologies. Five participants with dental fixtures were included to assess the validity of OPM-MEG recordings in those with irremovable metal. Replicable task-related evoked responses were observed in both modalities. Similar patterns of oscillatory power to faces were observed in both systems. Increased connectivity was found in SQUID-versus OPM-MEG in an occipital and parietal anchored network. Notably, high quality OPM-MEG data were retained in participants with metallic fixtures, from whom no useable data were collected using conventional MEG.

Facial expressions and identities recognition in Parkinson disease

Parkinson's Disease (PD) is associated with motor and non-motor symptoms. Among the latter are deficits in matching, identification, and recognition of emotional facial expressions. On one hand, this deficit has been attributed to a dysfunction in emotion processing. Another explanation (which does not exclude the former) links this deficit with reduced facial expressiveness in these patients, which prevents them from properly understanding or embodying emotions. To disentangle the specific contribution of emotion comprehension and that of facial expression processing in PD's observed deficit with emotions we performed two experiments on non-emotional facial expressions. In Experiment 1, a group of PD patients and a group of Healthy Controls (HC) underwent a task of non-emotional expression recognition in faces of different identity and a task of identity recognition in faces with different expression. No differences were observed between the two groups in accuracies. In Experiment 2, PD patients and Healthy Controls underwent a task where they had to recognize the identity of faces encoded through a non-emotional facial expression, through a rigid head movement, or as neutral. Again, no group differences were observed. In none of the two experiments hypomimia scores had a specific effect on expression processing. We conclude that in PD patients the observed impairment with emotional expressions is likely due to a specific deficit for emotions to a greater extent than for facial expressivity processing.

Mapping of facial and vocal processing in common marmosets with ultra-high field fMRI

Primate communication relies on multimodal cues, such as vision and audition, to facilitate the exchange of intentions, enable social interactions, avoid predators, and foster group cohesion during daily activities. Understanding the integration of facial and vocal signals is pivotal to comprehend social interaction. In this study, we acquire whole-brain ultra-high field (9.4 T) fMRI data from awake marmosets (Callithrix jacchus) to explore brain responses to unimodal and combined facial and vocal stimuli. Our findings reveal that the multisensory condition not only intensifies activations in the occipito-temporal face patches and auditory voice patches but also engages a more extensive network that includes additional parietal, prefrontal and cingulate areas, compared to the summed responses of the unimodal conditions. By uncovering the neural network underlying multisensory audiovisual integration in marmosets, this study highlights the efficiency and adaptability of the marmoset brain in processing facial and vocal social signals, providing significant insights into primate social communication.

The fear of COVID-19 contagion: an exploratory EEG-fMRI study

Pandemics have the potential to change how people behave and feel. The COVID-19 pandemic is no exception; thus, it may serve as a "challenging context" for understanding how pandemics affect people's minds. In this study, we used high-density electroencephalography (EEG) and functional magnetic resonance imaging (fMRI) to examine the neural correlates of fear of contagion during the most critical moments of COVID-19 in Italy (i.e., October 2020-May 2021). To do that, we stimulated participants (N = 17; nine females) with artificial-intelligence-generated faces of people presented as healthy, recovered from COVID-19, or infected by SARS-CoV-2. The fMRI results documented a modulation of large bilateral fronto-temporo-parietal functional brain networks. Critically, we found selective recruitment of cortical (e.g., frontal lobes) and subcortical fear-related structures (e.g., amygdala and putamen) of the so-called social brain network when participants observed COVID-19-related faces. Consistently, EEG results showed distinct patterns of brain activity selectively associated with infected and recovered faces (e.g., delta and gamma rhythm). Together, these results highlight how pandemic contexts may reverberate in the human brain, thus influencing most basic social and cognitive functioning. This may explain the emergence of a cluster of psychopathologies during and after the COVID-19 pandemic. Therefore, this study underscores the need for prompt interventions to address pandemics' short- and long-term consequences on mental health.

Autistic Individuals Do Not Alter Visual Processing Strategy During Encoding Versus Recognition of Faces: A Hidden Markov Modeling Approach

PURPOSE

Visual face recognition-the ability to encode, discriminate, and recognize the faces of others-is fundamentally supported by eye movements and is a common source of difficulty for autistic individuals. We aimed to evaluate how visual processing strategies (i.e., eye movement patterns) directly support encoding and recognition of faces in autistic and neurotypical (NT) individuals.

METHODS

We used a hidden Markov modeling approach to evaluate the spatiotemporal dynamics of eye movements in autistic (n = 15) and neurotypical (NT) adolescents (n = 17) during a face identity recognition task.

RESULTS

We discovered distinct eye movement patterns among all participants, which included a focused and exploratory strategy. When evaluating change in visual processing strategy across encoding and recognition phases, autistic individuals did not shift their eye movement patterns like their NT peers, who shifted to a more exploratory visual processing strategy during recognition.

CONCLUSION

These findings suggest that autistic individuals do not modulate their visual processing strategy across encoding and recognition of faces, which may be an indicator of less efficient face processing.

Don't look now! Social elements are harder to avoid during scene viewing

Regions of social importance (i.e., other people) attract attention in real world scenes, but it is unclear how automatic this bias is and how it might interact with other guidance factors. To investigate this, we recorded eye movements while participants were explicitly instructed to avoid looking at one of two objects in a scene (either a person or a non-social object). The results showed that, while participants could follow these instructions, they still made errors (especially on the first saccade). Crucially, there were about twice as many erroneous looks towards the person than there were towards the other object. This indicates that it is hard to suppress the prioritization of social information during scene viewing, with implications for how quickly and automatically this information is perceived and attended to.

Sex differences in development of functional connections in the face processing network

BACKGROUND AND PURPOSE

Understanding sex differences in typical development of the face processing network is important for elucidating disruptions during atypical development in sex-linked developmental disorders like autism spectrum disorder. Based on prior sex difference studies in other cognitive domains, this study examined whether females show increased integration of core and extended face regions with age for face viewing, while males would show increased segregation.

METHODS

This study used a cross-sectional design with typically developing children and adults (n = 133) and a functional MRI face localizer task. Psychophysiological interaction (PPI) analysis examined functional connectivity between canonical and extended face processing network regions with age, with greater segregation indexed by decreased core-extended region connectivity with age and greater integration indexed by increased core-extended region connectivity with age.

RESULTS

PPI analysis confirmed increased segregation for males-right fusiform face area (FFA) coupling to right inferior frontal gyrus (IFG) opercular when viewing faces and left amygdala when viewing objects decreased with age. Females showed increased integration with age (increased coupling of the right FFA to right IFG opercular region and right occipital face area [OFA] to right IFG orbital when viewing faces and objects, respectively) and increased segregation (decreased coupling with age of the right OFA with IFG opercular region when viewing faces).

CONCLUSIONS

Development of core and extended face processing network connectivity follows sexually dimorphic paths. These differential changes mostly occur across childhood and adolescence, with males experiencing segregation and females both segregation and integration changes in connectivity.

Facial trustworthiness dampens own-gender bias in emotion recognition

Previous research suggests that emotion recognition is influenced by social categories derived by invariant facial features such as gender and inferences of trustworthiness from facial appearance. The current study sought to replicate and extend these findings by examining the intersection of these social categories on recognition of emotional facial expressions. We used a dynamic emotion recognition task to assess accuracy and response times in the happiness and anger categorization displayed by female and male faces that differed in the degree of facial trustworthiness (i.e., trustworthy- vs. untrustworthy-looking faces). We found that facial trustworthiness was able to modulate the own-gender bias on emotion recognition, as responses to untrustworthy-looking faces revealed a bias towards ingroup members. Conversely, when faces look trustworthy, no differences on emotion recognition between female and male faces were found. In addition, positive inferences of trustworthiness lead to faster recognition of happiness in females and anger in males, showing that facial appearance was able to influence also the intersection between social categories and specific emotional expressions. Together, these results suggest that facial appearance, probably due to the activation of approach or avoidance motivational systems, is able to modulate the own-gender bias on emotion recognition.

The anterior fusiform gyrus: The ghost in the cortical face machine

Face-selective regions in the human ventral occipito-temporal cortex (VOTC) have been defined for decades mainly with functional magnetic resonance imaging. This face-selective VOTC network is traditionally divided in a posterior 'core' system thought to subtend face perception, and regions of the anterior temporal lobe as a semantic memory component of an extended general system. In between these two putative systems lies the anterior fusiform gyrus and surrounding sulci, affected by magnetic susceptibility artifacts. Here we suggest that this methodological gap overlaps with and contributes to a conceptual gap between (visual) perception and semantic memory for faces. Filling this gap with intracerebral recordings and direct electrical stimulation reveals robust face-selectivity in the anterior fusiform gyrus and a crucial role of this region, especially in the right hemisphere, in identity recognition for both familiar and unfamiliar faces. Based on these observations, we propose an integrated theoretical framework for human face (identity) recognition according to which face-selective regions in the anterior fusiform gyrus join the dots between posterior and anterior cortical face memories.

Common and distinct neural correlates of emotional processing in individuals at familial risk for major depressive disorder and bipolar disorder: A comparative meta-analysis

Individuals at familial risk for mood disorders exhibit deficits in emotional processing and associated brain dysfunction prior to illness onset. However, such brain-behavior abnormalities related to familial predisposition remain poorly understood. To investigate robust abnormal functional activation patterns during emotional processing in unaffected at-risk relatives of patients with major depressive disorder (UAR-MDD) and bipolar disorder (UAR-BD), we performed a meta-analysis of task-based functional magnetic resonance imaging studies using Seed-based d Mapping (SDM) toolbox. Common and distinct patterns of abnormal functional activation between UAR-MDD and UAR-BD were detected via conjunction and differential analyses. A total of 17 studies comparing 481 UAR and 670 healthy controls (HC) were included. Compared with HC, UAR-MDD exhibited hyperactivation in the parahippocampal gyrus, amygdala and cerebellum, while UAR-BD exhibited parahippocampal hyperactivation and hypoactivation in the striatum and middle occipital gyrus (MOG). Conjunction analysis revealed shared hyperactivated PHG in both groups. Differential analysis indicated that the activation patterns of amygdala and MOG significantly differed between UAR-MDD and UAR-BD. These findings provide novel insights into common and distinct neural phenotypes for familial risk and associated risk mechanisms in MDD and BD, which may have implications in guiding precise prevention strategies tailored to the family context.

Perceiving the outlier in the crowd: The influence of facial identity

The accurate perception of groups with outliers can help us identify potential risks. However, it is unclear how outliers affect the perception of group emotion. To address this question, we conducted a study on group emotion perception in the context of facial identity. We presented 74 participants with pictures of crowds, and asked them to evaluate the valence ratios and intensity of the crowd by means of the Emotional Aperture Measure. The results revealed that outlier emotions were often overestimated within crowds. Moreover, we found that the emotional expression of a close friend modulated the perception of outliers. Specifically, when a close friend expressed the group emotion, participants overestimated the outlier less than when a close friend expressed the outlier emotion. These results suggest that people can detect outliers within groups, and that their perception of group emotion is influenced by close friends. Thus, we provide evidence that facial identity affects group emotion perception.

Face shape and motion are perceptually separable: Support for a revised model of face processing

A recent model of face processing proposes that face shape and motion are processed in parallel brain pathways. Although tested in neuroimaging, the assumptions of this theory remain relatively untested through controlled psychophysical studies until now. Recruiting undergraduate students over the age of 18, we test this hypothesis using a tight control of stimulus factors, through computerized three-dimensional face models and calibration of dimensional discriminability, and of decisional factors, through a model-based analysis using general recognition theory (GRT). Theoretical links between neural and perceptual forms of independence within GRT allowed us to derive the a priori hypotheses that perceptual separability of shape and motion should hold, while other forms of independence defined within GRT might fail. We found evidence to support both of those predictions.

Scene-selectivity in CA1/subicular complex: Multivoxel pattern analysis at 7T

Prior univariate functional magnetic resonance imaging (fMRI) studies in humans suggest that the anteromedial subicular complex of the hippocampus is a hub for scene-based cognition. However, it is possible that univariate approaches were not sufficiently sensitive to detect scene-related activity in other subfields that have been implicated in spatial processing (e.g., CA1). Further, as connectivity-based functional gradients in the hippocampus do not respect classical subfield boundary definitions, category selectivity may be distributed across anatomical subfields. Region-of-interest approaches, therefore, may limit our ability to observe category selectivity across discrete subfield boundaries. To address these issues, we applied searchlight multivariate pattern analysis to 7T fMRI data of healthy adults who undertook a simultaneous visual odd-one-out discrimination task for scene and non-scene (including face) visual stimuli, hypothesising that scene classification would be possible in multiple hippocampal regions within, but not constrained to, anteromedial subicular complex and CA1. Indeed, we found that the scene-selective searchlight map overlapped not only with anteromedial subicular complex (distal subiculum, pre/para subiculum), but also inferior CA1, alongside posteromedial (including retrosplenial) and parahippocampal cortices. Probabilistic overlap maps revealed gradients of scene category selectivity, with the strongest overlap located in the medial hippocampus, converging with searchlight findings. This was contrasted with gradients of face category selectivity, which had stronger overlap in more lateral hippocampus, supporting ideas of parallel processing streams for these two categories. Our work helps to map the scene, in contrast to, face processing networks within, and connected to, the human hippocampus.

Combining electrodermal activity analysis and dynamic causal modeling to investigate the visual-odor multimodal integration during face perception

Objective. This study presents a novel methodological approach for incorporating information related to the peripheral sympathetic response into the investigation of neural dynamics. Particularly, we explore how hedonic contextual olfactory stimuli influence the processing of neutral faces in terms of sympathetic response, event-related potentials and effective connectivity analysis. The objective is to investigate how the emotional valence of odors influences the cortical connectivity underlying face processing and the role of face-induced sympathetic arousal in this visual-olfactory multimodal integration.Approach. To this aim, we combine electrodermal activity (EDA) analysis and dynamic causal modeling to examine changes in cortico-cortical interactions.Results. The results reveal that stimuli arising sympathetic EDA responses are associated with a more negative N170 amplitude, which may be a marker of heightened arousal in response to faces. Hedonic odors, on the other hand, lead to a more negative N1 component and a reduced the vertex positive potential when they are unpleasant or pleasant. Concerning connectivity, unpleasant odors strengthen the forward connection from the inferior temporal gyrus (ITG) to the middle temporal gyrus, which is involved in processing changeable facial features. Conversely, the occurrence of sympathetic responses after a stimulus is correlated with an inhibition of this same connection and an enhancement of the backward connection from ITG to the fusiform face gyrus.Significance. These findings suggest that unpleasant odors may enhance the interpretation of emotional expressions and mental states, while faces capable of eliciting sympathetic arousal prioritize identity processing.

Functional brain network alterations in the co-occurrence of autism spectrum disorder and attention deficit hyperactivity disorder

Autism spectrum disorder (ASD) and attention deficit hyperactivity disorder (ADHD) are two highly prevalent and commonly co-occurring neurodevelopmental disorders. The neural mechanisms underpinning the comorbidity of ASD and ADHD (ASD + ADHD) remain unclear. We focused on the topological organization and functional connectivity of brain networks in ASD + ADHD patients versus ASD patients without ADHD (ASD-only). Resting-state functional magnetic resonance imaging (rs-fMRI) data from 114 ASD and 161 typically developing (TD) individuals were obtained from the Autism Brain Imaging Data Exchange II. The ASD patients comprised 40 ASD + ADHD and 74 ASD-only individuals. We constructed functional brain networks for each group and performed graph-theory and network-based statistic (NBS) analyses. Group differences between ASD + ADHD and ASD-only were analyzed at three levels: nodal, global, and connectivity. At the nodal level, ASD + ADHD exhibited topological disorganization in the temporal and occipital regions, compared with ASD-only. At the global level, ASD + ADHD and ASD-only displayed no significant differences. At the connectivity level, the NBS analysis revealed that ASD + ADHD showed enhanced functional connectivity between the prefrontal and frontoparietal regions, as well as between the orbitofrontal and occipital regions, compared with ASD-only. The hippocampus was the shared region in aberrant functional connectivity patterns in ASD + ADHD and ASD-only compared with TD. These findings suggests that ASD + ADHD displays altered topology and functional connectivity in the brain regions that undertake social cognition, language processing, and sensory processing.

No influence of emotional expression on size underestimation of upright faces

Faces are a primary means of conveying social information between humans. One important factor modulating the perception of human faces is emotional expression. Face inversion also affects perception, including judgments of emotional expression, possibly through the disruption of configural processing. One intriguing inversion effect is an illusion whereby faces appear to be physically smaller when upright than when inverted. This illusion appears to be highly selective for faces. In this study, we investigated whether the emotional expression of a face (neutral, happy, afraid, and angry) modulates the magnitude of this size illusion. Results showed that for all four expressions, there was a clear bias for inverted stimuli to be judged as larger than upright ones. This demonstrates that there is no influence of emotional expression on the size underestimation of upright faces, a surprising result given that recognition of different emotional expressions is known to be affected unevenly by inversion. Results are discussed considering recent neuroimaging research which used population receptive field (pRF) mapping to investigate the neural mechanisms underlying face perception features and which may provide an explanation for how an upright face appears smaller than an inverted one. Elucidation of this effect would lead to a greater understanding of how humans communicate.

Ensemble coding of facial identity is robust, but may not contribute to face learning

Ensemble coding - the rapid extraction of a perceptual average - has been proposed as a potential mechanism underlying face learning. We tested this proposal across five pre-registered experiments in which four ambient images of an identity were presented in the study phase. In Experiments 1 and 2a-c, participants were asked whether a test image was in the study array; these experiments examined the robustness of ensemble coding. Experiment 1 replicated ensemble coding in an online sample; participants recognize images from the study array and the average of those images. Experiments 2a-c provide evidence that ensemble coding meets several criteria of a possible learning mechanism: It is robust to changes in head orientation (± 60o), survives a short (30s) delay, and persists when images of two identities are interleaved during the study phase. Experiment 3 examined whether ensemble coding is sufficient for face learning (i.e., facilitates recognition of novel images of a target identity). Each study array comprised four ambient images (variability + average), a single image, or an average of four images (average only). Participants were asked whether a novel test image showed the identity from a study array. Performance was best in the four-image condition, with no difference between the single-image and average-only conditions. We conclude that ensemble coding of facial identity is robust but that the perceptual average per se is not sufficient for face learning.

Disentangled deep generative models reveal coding principles of the human face processing network

Despite decades of research, much is still unknown about the computations carried out in the human face processing network. Recently, deep networks have been proposed as a computational account of human visual processing, but while they provide a good match to neural data throughout visual cortex, they lack interpretability. We introduce a method for interpreting brain activity using a new class of deep generative models, disentangled representation learning models, which learn a low-dimensional latent space that "disentangles" different semantically meaningful dimensions of faces, such as rotation, lighting, or hairstyle, in an unsupervised manner by enforcing statistical independence between dimensions. We find that the majority of our model's learned latent dimensions are interpretable by human raters. Further, these latent dimensions serve as a good encoding model for human fMRI data. We next investigate the representation of different latent dimensions across face-selective voxels. We find that low- and high-level face features are represented in posterior and anterior face-selective regions, respectively, corroborating prior models of human face recognition. Interestingly, though, we find identity-relevant and irrelevant face features across the face processing network. Finally, we provide new insight into the few "entangled" (uninterpretable) dimensions in our model by showing that they match responses in the ventral stream and carry information about facial identity. Disentangled face encoding models provide an exciting alternative to standard "black box" deep learning approaches for modeling and interpreting human brain data.

Neural correlates of audiovisual narrative speech perception in children and adults on the autism spectrum: A functional magnetic resonance imaging study

Autistic individuals show substantially reduced benefit from observing visual articulations during audiovisual speech perception, a multisensory integration deficit that is particularly relevant to social communication. This has mostly been studied using simple syllabic or word-level stimuli and it remains unclear how altered lower-level multisensory integration translates to the processing of more complex natural multisensory stimulus environments in autism. Here, functional neuroimaging was used to examine neural correlates of audiovisual gain (AV-gain) in 41 autistic individuals to those of 41 age-matched non-autistic controls when presented with a complex audiovisual narrative. Participants were presented with continuous narration of a story in auditory-alone, visual-alone, and both synchronous and asynchronous audiovisual speech conditions. We hypothesized that previously identified differences in audiovisual speech processing in autism would be characterized by activation differences in brain regions well known to be associated with audiovisual enhancement in neurotypicals. However, our results did not provide evidence for altered processing of auditory alone, visual alone, audiovisual conditions or AV- gain in regions associated with the respective task when comparing activation patterns between groups. Instead, we found that autistic individuals responded with higher activations in mostly frontal regions where the activation to the experimental conditions was below baseline (de-activations) in the control group. These frontal effects were observed in both unisensory and audiovisual conditions, suggesting that these altered activations were not specific to multisensory processing but reflective of more general mechanisms such as an altered disengagement of Default Mode Network processes during the observation of the language stimulus across conditions.