Cerebral lateralization of face-sensitive areas in left-handers: Only the FFA does not get it right

Asymmetries in event-related potentials part 1: A systematic review of face processing studies

The human brain shows distinct lateralized activation patterns for a range of cognitive processes. One such function, which is thought to be lateralized to the right hemisphere (RH), is human face processing. Its importance for social communication and interaction has led to a plethora of studies investigating face processing in health and disease. Temporally highly resolved methods, like event-related potentials (ERPs), allow for a detailed characterization of different processing stages and their specific lateralization patterns. This systematic review aimed at disentangling some of the contradictory findings regarding the RH specialization in face processing focusing on ERP research in healthy participants. Two databases were searched for studies that investigated left and right electrodes while participants viewed (mostly neutral) facial stimuli. The included studies used a variety of different tasks, which ranged from passive viewing to memorizing faces. The final data selection highlights, that strongest lateralization to the RH was found for the N170, especially for right-handed young male participants. Left-handed, female, and older participants showed less consistent lateralization patterns. Other ERP components like the P1, P2, N2, P3, and the N400 were overall less clearly lateralized. The current review highlights that many of the assumed lateralization patterns are less clear than previously thought and that the variety of stimuli, tasks, and EEG setups used, might contribute to the ambiguous findings.

The neuropsychological evaluation of face identity recognition

Facial identity recognition (FIR) is arguably the ultimate form of recognition for the adult human brain. Even if the term prosopagnosia is reserved for exceptionally rare brain-damaged cases with a category-specific abrupt loss of FIR at adulthood, subjective and objective impairments or difficulties of FIR are common in the neuropsychological population. Here we provide a critical overview of the evaluation of FIR both for clinicians and researchers in neuropsychology. FIR impairments occur following many causes that should be identified objectively by both general and specific, behavioral and neural examinations. We refute the commonly used dissociation between perceptual and memory deficits/tests for FIR, since even a task involving the discrimination of unfamiliar face images presented side-by-side relies on cortical memories of faces in the right-lateralized ventral occipito-temporal cortex. Another frequently encountered confusion is between specific deficits of the FIR function and a more general impairment of semantic memory (of people), the latter being most often encountered following anterior temporal lobe damage. Many computerized tests aimed at evaluating FIR have appeared over the last two decades, as reviewed here. However, despite undeniable strengths, they often suffer from ecological limitations, difficulties of instruction, as well as a lack of consideration for processing speed and qualitative information. Taking into account these issues, a recently developed behavioral test with natural images manipulating face familiarity, stimulus inversion, and correct response times as a key variable appears promising. The measurement of electroencephalographic (EEG) activity in the frequency domain from fast periodic visual stimulation also appears as a particularly promising tool to complete and enhance the neuropsychological assessment of FIR.

Unconscious face processing shows a different lateralisation pattern

Faces contain rich information and play a pivotal role in human daily social interactions. Previous studies have provided evidence for the left-visual-field-advantage in face perception. The current study investigated lateralisation when face stimuli were unconsciously presented using interocular suppression methods. The results showed that when an unconscious face stimulus was presented in one side of the visual field without other face stimuli, the unconscious face in the right visual field could break through interocular suppression faster than that in the left (Experiments 1 and 2). However, this right visual field processing advantage reversed to the left when a face stimulus either with (Experiment 2) or without (Experiment 3) visual awareness was presented concurrently with or prior to (Experiment 4) the unconscious face stimuli. These results showed that the unconscious face might have a different processing pattern compared with the conscious face. The relationship between this novel behavioural observation and known functional lateralisation of the fusiform face areas is discussed, suggesting a dynamic interaction between the two cortical hemispheres may underlie the formation of visual awareness for faces. The current study expands our understanding of face processing lateralisation and provided evidence on the asymmetric inter-hemisphere interaction patterns in forming visual awareness.

Variability in Hemispheric Functional Segregation Phenotypes: A Review and General Mechanistic Model

Many functions of the human brain are organized asymmetrically and are subject to strong population biases. Some tasks, like speaking and making complex hand movements, exhibit left hemispheric dominance, whereas others, such as spatial processing and recognizing faces, favor the right hemisphere. While pattern of preference implies the existence of a stereotypical way of distributing functions between the hemispheres, an ever-increasing body of evidence indicates that not everyone follows this pattern of hemispheric functional segregation. On the contrary, the review conducted in this article shows that departures from the standard hemispheric division of labor are routinely observed and assume many distinct forms, each having a different prevalence rate. One of the key challenges in human neuroscience is to model this variability. By integrating well-established and recently emerged ideas about the mechanisms that underlie functional lateralization, the current article proposes a general mechanistic model that explains the observed distribution of segregation phenotypes and generates new testable hypotheses.

Interdependency in lateralization of written word and face processing in right-handed individuals

It has been suggested that the right hemisphere lateralization typically observed for face processing may depend on lateralization of written word processing to the left hemisphere; a pattern referred to as the causal complementary principle of lateralization. According to a strong version of this principle, a correlation should be found between the degree of left and right hemisphere lateralization for word and face processing respectively. This has been observed in two studies, but only for left-handed individuals. The present study tested whether a similar lateralization pattern could be found in a relatively large sample of right-handed individuals (N = 210) using behavioral measures (divided visual field paradigms). It was also tested whether the degree of right hemisphere lateralization for face and global shape processing would correlate positively, as predicted by a strong version of the input asymmetry principle of lateralization. This was tested in a subsample (n = 189). Bayesian analyses found no evidence for lateralization interdependency as the observed data were 4-17 times more likely under the null hypothesis. Unfortunately, the reliabilities of the lateralization measures were found to be poor. While this dampens the firmness of the conclusions that can be drawn, it is argued that at present there is no positive evidence for strong interdependency between written word and face processing in right-handed individuals.

Face distortions in prosopometamorphopsia provide new insights into the organization of face perception

Prosopometamorphopsia (PMO) is a striking condition of visual perception in which facial features appear distorted, for example drooping, swelling, or twisting. Although numerous cases have been reported, few of those investigations have carried out formal testing motivated by theories of face perception. However, because PMO involves conscious visual distortions to faces which participants can report, it can be used to probe fundamental questions about face representations. Here we review cases of PMO that address theoretical questions in visual neuroscience including face specificity, inverted face processing, the importance of the vertical midline, dissociable representations for each half of the face, hemispheric specialization, the relationship between face recognition and conscious face perception, and the reference frames that face representations are embedded within. Finally, we list and touch upon eighteen open questions that make clear how much is left to learn about PMO and the potential it has to provide important advances in face perception.

Attention and Interhemispheric Communication: Implications for Language Dominance

Dominance of the left hemisphere for language processing is a prominent feature of brain organisation. Whereas structural models clarify the functional asymmetry due to direct access to local language circuits, dynamic models propose functional states of intrahemispheric activation and interhemispheric inhibition that are coupled with attentional processes. Real word settings often require modulations of lateralised neural processing and further express individual heterogeneity. In this research, we tested left- and right-handers, and used a behavioural paradigm with presentation of lateralised cue-target pairs to the same or opposite visual field. We observed that handedness distinctly affected word processing in the left hemisphere following contralateral cueing. Moreover, left-hemispheric dominance strengthened for right-handers vs abolished for left-handers, influencing behavioural efficiency. In combination with eye dominance recordings, these data suggest that attentional biases guided the processing strategies of both groups and in turn their achievements. Therefore, hand and eye dominance are both essential factors with a functional role in directing the communication of visual information between both hemispheres. Overall, the findings underline the importance of interacting hand-eye control systems in contributing to interhemispheric patterns in the context of language processing.

Face shape processing via visual-to-auditory sensory substitution activates regions within the face processing networks in the absence of visual experience

Previous evidence suggests that visual experience is crucial for the emergence and tuning of the typical neural system for face recognition. To challenge this conclusion, we trained congenitally blind adults to recognize faces via visual-to-auditory sensory-substitution (SDD). Our results showed a preference for trained faces over other SSD-conveyed visual categories in the fusiform gyrus and in other known face-responsive-regions of the deprived ventral visual stream. We also observed a parametric modulation in the same cortical regions, for face orientation (upright vs. inverted) and face novelty (trained vs. untrained). Our results strengthen the conclusion that there is a predisposition for sensory-independent and computation-specific processing in specific cortical regions that can be retained in life-long sensory deprivation, independently of previous perceptual experience. They also highlight that if the right training is provided, such cortical preference maintains its tuning to what were considered visual-specific face features.

The dual neural effects of oxytocin in autistic youth: results from a randomized trial

Recent discoveries have highlighted the effects of oxytocin (OT) on social behavior and perception among autistic individuals. However, a gap persists in the literature regarding the potential effects of OT and the neural temporal dynamics due to OT administration. We explored the effect of OT on autistic individuals using magnetoencephalography (MEG), focusing on M100, M170, and M250, social perception-related components that tend to show atypical patterns in autistic individuals. Twenty-five autistic adolescents participated in this randomized, double-blind MEG study. Autistic individuals arrived at the lab twice and received an acute dose of intranasal OT or placebo in each session. During the scans, participants were asked to identify pictures of social and non-social stimuli. Additionally, 23 typically developing (TD) adolescents performed the same task in the MEG as a benchmark that allowed us to better characterize neural regions of interest and behavioral results for this age group in this task. A source-model beamformer analysis revealed that OT enhanced neural activity for social stimuli in frontal regions during M170. Additionally, in each of the preselected time windows, OT increased activation in the left hemisphere, regardless of the content of the presented stimuli. We suggest that OT increased the processing of social stimuli through two separate mechanisms. First, OT increased neural activity in a nonspecific manner, allowing increased allocation of attention toward the stimuli. Second, OT enhanced M170 activity in frontal regions only in response to social stimuli. These results reveal the temporal dynamics of the effects of OT on the early stages of social and non-social perception in autistic adolescents.

Trial registration: This study was a part of a project registered as clinical trial October 27th, 2021. ClinicalTrials.gov Identifier: NCT05096676.

Let's face it: The lateralization of the face perception network as measured with fMRI is not clearly right dominant

The neural face perception network is distributed across both hemispheres. However, the dominant role in humans is virtually unanimously attributed to the right hemisphere. Interestingly, there are, to our knowledge, no imaging studies that systematically describe the distribution of hemispheric lateralization in the core system of face perception across subjects in large cohorts so far. To address this, we determined the hemispheric lateralization of all core system regions (i.e., occipital face area (OFA), fusiform face area (FFA), posterior superior temporal sulcus (pSTS)) in 108 healthy subjects using functional magnetic resonance imaging (fMRI). We were particularly interested in the variability of hemispheric lateralization across subjects and explored how many subjects can be classified as right-dominant based on the fMRI activation pattern. We further assessed lateralization differences between different regions of the core system and analyzed the influence of handedness and sex on the lateralization with a generalized mixed effects regression model. As expected, brain activity was on average stronger in right-hemispheric brain regions than in their left-hemispheric homologues. This asymmetry was, however, only weakly pronounced in comparison to other lateralized brain functions (such as language and spatial attention) and strongly varied between individuals. Only half of the subjects in the present study could be classified as right-hemispheric dominant. Additionally, we did not detect significant lateralization differences between core system regions. Our data did also not support a general leftward shift of hemispheric lateralization in left-handers. Only the interaction of handedness and sex in the FFA revealed that specifically left-handed men were significantly more left-lateralized compared to right-handed males. In essence, our fMRI data did not support a clear right-hemispheric dominance of the face perception network. Our findings thus ultimately question the dogma that the face perception network - as measured with fMRI - can be characterized as "typically right lateralized".

Twenty years of investigation with the case of prosopagnosia PS to understand human face identity recognition. Part II: Neural basis

Patient PS sustained her dramatic brain injury in 1992, the same year as the first report of a neuroimaging study of human face recognition. The present paper complements the review on the functional nature of PS's prosopagnosia (part I), illustrating how her case study directly, i.e., through neuroimaging investigations of her brain structure and activity, but also indirectly, through neural studies performed on other clinical cases and neurotypical individuals, inspired and constrained neural models of human face recognition. In the dominant right hemisphere for face recognition in humans, PS's main lesion concerns (inputs to) the inferior occipital gyrus (IOG), in a region where face-selective activity is typically found in normal individuals ('Occipital Face Area', OFA). Her case study initially supported the criticality of this region for face identity recognition (FIR) and provided the impetus for transcranial magnetic stimulation (TMS), intracerebral electrical stimulation, and cortical surgery studies that have generally supported this view. Despite PS's right IOG lesion, typical face-selectivity is found anteriorly in the middle portion of the fusiform gyrus, a hominoid structure (termed the right 'Fusiform Face Area', FFA) that is widely considered to be the most important region for human face recognition. This finding led to the original proposal of direct anatomico-functional connections from early visual cortices to the FFA, bypassing the IOG/OFA (lulu), a hypothesis supported by further neuroimaging studies of PS, other neurological cases and neuro-typical individuals with original visual stimulation paradigms, data recordings and analyses. The proposal of a lack of sensitivity to face identity in PS's right FFA due to defective reentrant inputs from the IOG/FFA has also been supported by other cases, functional connectivity and cortical surgery studies. Overall, neural studies of, and based on, the case of prosopagnosia PS strongly question the hierarchical organization of the human neural face recognition system, supporting a more flexible and dynamic view of this key social brain function.

Higher-dimensional neural representations predict better episodic memory

Episodic memory enables humans to encode and later vividly retrieve information about our rich experiences, yet the neural representations that support this mental capacity are poorly understood. Using a large fMRI dataset (n = 468) of face-name associative memory tasks and principal component analysis to examine neural representational dimensionality (RD), we found that the human brain maintained a high-dimensional representation of faces through hierarchical representation within and beyond the face-selective regions. Critically, greater RD was associated with better subsequent memory performance both within and across participants, and this association was specific to episodic memory but not general cognitive abilities. Furthermore, the frontoparietal activities could suppress the shared low-dimensional fluctuations and reduce the correlations of local neural responses, resulting in greater RD. RD was not associated with the degree of item-specific pattern similarity, and it made complementary contributions to episodic memory. These results provide a mechanistic understanding of the role of RD in supporting accurate episodic memory.

Efficient Prestimulus Network Integration of Fusiform Face Area Biases Face Perception during Binocular Rivalry

Ongoing fluctuations in neural excitability and connectivity influence whether or not a stimulus is seen. Do they also influence which stimulus is seen? We recorded magnetoencephalography data while 21 human participants viewed face or house stimuli, either one at a time or under bistable conditions induced through binocular rivalry. Multivariate pattern analysis revealed common neural substrates for rivalrous versus nonrivalrous stimuli with an additional delay of ∼36 msec for the bistable stimulus, and poststimulus signals were source-localized to the fusiform face area. Before stimulus onset followed by a face versus house report, fusiform face area showed stronger connectivity to primary visual cortex and to the rest of the cortex in the alpha frequency range (8-13 Hz), but there were no differences in local oscillatory alpha power. The prestimulus connectivity metrics predicted the accuracy of poststimulus decoding and the delay associated with rivalry disambiguation suggesting that perceptual content is shaped by ongoing neural network states.

Face Processing in Developmental Prosopagnosia: Altered Neural Representations in the Fusiform Face Area

Rationale: Face expertise is a pivotal social skill. Developmental prosopagnosia (DP), i.e., the inability to recognize faces without a history of brain damage, affects about 2% of the general population, and is a renowned model system of the face-processing network. Within this network, the right Fusiform Face Area (FFA), is particularly involved in face identity processing and may therefore be a key element in DP. Neural representations within the FFA have been examined with Representational Similarity Analysis (RSA), a data-analytical framework in which multi-unit measures of brain activity are assessed with correlation analysis. Objectives: Our study intended to scrutinize modifications of FFA-activation during face encoding and maintenance based on RSA. Methods: Thirteen participants with DP (23-70 years) and 12 healthy control subjects (19-62 years) participated in a functional MRI study, including morphological MRI, a functional FFA-localizer and a modified Sternberg paradigm probing face memory encoding and maintenance. Memory maintenance of one, two, or four faces represented low, medium, and high memory load. We examined conventional activation differences in response to working memory load and applied RSA to compute individual correlation-matrices on the voxel level. Group correlation-matrices were compared via Donsker's random walk analysis. Results: On the functional level, increased memory load entailed both a higher absolute FFA-activation level and a higher degree of correlation between activated voxels. Both aspects were deficient in DP. Interestingly, control participants showed a homogeneous degree of correlation for successful trials during the experiment. In DP-participants, correlation levels between FFA-voxels were significantly lower and were less sustained during the experiment. In behavioral terms, DP-participants performed poorer and had longer reaction times in relation to DP-severity. Furthermore, correlation levels were negatively correlated with reaction times for the most demanding high load condition. Conclusion: We suggest that participants with DP fail to generate robust and maintained neural representations in the FFA during face encoding and maintenance, in line with poorer task performance and prolonged reaction times. In DP, alterations of neural coding in the FFA might therefore explain curtailing in working memory and contribute to impaired long-term memory and mental imagery.

Is human face recognition lateralized to the right hemisphere due to neural competition with left-lateralized visual word recognition? A critical review

The right hemispheric lateralization of face recognition, which is well documented and appears to be specific to the human species, remains a scientific mystery. According to a long-standing view, the evolution of language, which is typically substantiated in the left hemisphere, competes with the cortical space in that hemisphere available for visuospatial processes, including face recognition. Over the last decade, a specific hypothesis derived from this view according to which neural competition in the left ventral occipito-temporal cortex with selective representations of letter strings causes right hemispheric lateralization of face recognition, has generated considerable interest and research in the scientific community. Here, a systematic review of studies performed in various populations (infants, children, literate and illiterate adults, left-handed adults) and methodologies (behavior, lesion studies, (intra)electroencephalography, neuroimaging) offers little if any support for this reading lateralized neural competition hypothesis. Specifically, right-lateralized face-selective neural activity already emerges at a few months of age, well before reading acquisition. Moreover, consistent evidence of face recognition performance and its right hemispheric lateralization being modulated by literacy level during development or at adulthood is lacking. Given the absence of solid alternative hypotheses and the key role of neural competition in the sensory-motor cortices for selectivity of representations, learning, and plasticity, a revised language-related neural competition hypothesis for the right hemispheric lateralization of face recognition should be further explored in future research, albeit with substantial conceptual clarification and advances in methodological rigor.

Modeling temporal dynamics of face processing in youth and adults

A hierarchical model of temporal dynamics was examined in adults (n = 34) and youth (n = 46) across the stages of face processing during the perception of static and dynamic faces. Three ERP components (P100, N170, N250) and spectral power in the mu range were extracted, corresponding to cognitive stages of face processing: low-level vision processing, structural encoding, higher-order processing, and action understanding. Youth and adults exhibited similar yet distinct patterns of hierarchical temporal dynamics such that earlier cognitive stages predicted later stages, directly and indirectly. However, latent factors indicated unique profiles related to behavioral performance for adults and youth and age as a continuous factor. The application of path analysis to electrophysiological data can yield novel insights into the cortical dynamics of social information processing.

Positive and negative prediction error signals to violated expectations of face and place stimuli distinctively activate FFA and PPA

Surprising scenarios can have different behavioural and neuronal consequences depending on the violation of the expectation. On the one hand, previous research has shown that the omission of a visual stimulus results in a robust cortical response representing that missing stimulus, a so-called negative prediction error. On the other hand, a large amount of studies revealed positive prediction error signals, entailing an increased neural response that can be attributed to the experience of a surprising, unexpected stimulus. However, there has been no evidence, so far, regarding how and when these prediction error signals co-occur. Here, we argue that the omission of an expected stimulus can and often does coincide with the appearance of an unexpected one. Therefore, we investigated whether positive and negative prediction error signals evoked by unpredicted cross-category stimulus transitions would temporally coincide during a speeded forced-choice fMRI paradigm. Foremost, our findings provide evidence of a behavioural effect regarding the facilitation of responses linked to expected stimuli. In addition, we obtained evidence for negative prediction error signals as seen in differential activation of FFA and PPA during unexpected place and face trials, respectively. Lastly, a psychophysiological interaction analysis revealed evidence for positive prediction error signals represented by context-dependent functional coupling between the right IFG and FFA or PPA, respectively, implicating a network that updates the internal representation after the appearance of an unexpected stimulus through involvement of this frontal area. The current results are consistent with a predictive coding account of cognition and underline the importance of considering the potential dual nature of expectation violations. Furthermore, our results put forward that positive and negative prediction error signalling can be directly linked to regions associated with the processing of different stimulus categories.

Intracerebral electrical stimulation to understand the neural basis of human face identity recognition

Recognizing people's identity by their faces is a key function in the human species, supported by regions of the ventral occipito-temporal cortex (VOTC). In the last decade, there have been several reports of perceptual face distortion during direct electrical stimulation (DES) with subdural electrodes positioned over a well-known face-selective VOTC region of the right lateral middle fusiform gyrus (LatMidFG; i.e., the "Fusiform Face Area", FFA). However, transient impairments of face identity recognition (FIR) have been extremely rare and only behaviorally quantified during DES with intracerebral (i.e., depth) electrodes in stereo-electroencephalography (SEEG). The three detailed cases reported so far, summarized here, were specifically impaired at FIR during DES inside different anatomical VOTC regions of the right hemisphere: the inferior occipital gyrus (IOG) and the LatMidFG, as well as a region that lies at the heart of a large magnetic susceptibility artifact in functional magnetic resonance imaging (fMRI): the anterior fusiform gyrus (AntFG). In the first two regions, the eloquent electrode contacts were systematically associated with the highest face-selective and (unfamiliar) face individuation responses as measured with intracerebral electrophysiology. Stimulation in the right AntFG did not lead to perceptual changes but also caused an inability to remember having been presented face pictures, as if the episode was never recorded in memory. These observations support the view of an extensive network of face-selective VOTC regions subtending human FIR, with at least three critical nodes in the right hemisphere associated with differential intrinsic and extrinsic patterns of reentrant connectivity.

Visual mental imagery engages the left fusiform gyrus, but not the early visual cortex: A meta-analysis of neuroimaging evidence

The dominant neural model of visual mental imagery (VMI) stipulates that memories from the medial temporal lobe acquire sensory features in early visual areas. However, neurological patients with damage restricted to the occipital cortex typically show perfectly vivid VMI, while more anterior damages extending into the temporal lobe, especially in the left hemisphere, often cause VMI impairments. Here we present two major results reconciling neuroimaging findings in neurotypical subjects with the performance of brain-damaged patients: (1) A large-scale meta-analysis of 46 fMRI studies, of which 27 investigated specifically visual mental imagery, revealed that VMI engages fronto-parietal networks and a well-delimited region in the left fusiform gyrus. (2) A Bayesian analysis showed no evidence for imagery-related activity in early visual cortices. We propose a revised neural model of VMI that draws inspiration from recent cytoarchitectonic and lesion studies, whereby fronto-parietal networks initiate, modulate, and maintain activity in a core temporal network centered on the fusiform imagery node, a high-level visual region in the left fusiform gyrus.

Distinct mechanisms drive hemispheric lateralization of object recognition in the visual word form and fusiform face areas

The Visual Word Form Area (VWFA) and the Fusiform Face Area (FFA) represent classical examples of functional lateralization. The known hypothesis that lateralization of the VWFA and FFA are related remains controversial. We hypothesized that lateralization is independent and might be associated with lateralized high-level top-down mechanisms. For the VWFA this could emerge from left-lateralized language regions. This driving force might modulate local reorganization/recycling of function. Using an fMRI recognition paradigm, we quantified lateralization and investigated effective connectivity to examine mechanisms associated with lateralization in these regions (n = 58). Laterality patterns were more pronounced for VWFA than for FFA. Granger Causality Analysis found top-down effects only for the VWFA (left-lateralized, stemming from Broca's area). FFA exerted top-down effects on low-level visual areas. These findings suggest that distinct mechanisms are associated with hemispheric lateralization in object recognition: left lateralized top-down for VWFA and only early visual top-down effects concerning the FFA.

The Trajectory of Hemispheric Lateralization in the Core System of Face Processing: A Cross-Sectional Functional Magnetic Resonance Imaging Pilot Study

Face processing is mediated by a distributed neural network commonly divided into a “core system” and an “extended system.” The core system consists of several, typically right-lateralized brain regions in the occipito-temporal cortex, including the occipital face area (OFA), the fusiform face area (FFA) and the posterior superior temporal sulcus (pSTS). It was recently proposed that the face processing network is initially bilateral and becomes right-specialized in the course of the development of reading abilities due to the competition between language-related regions in the left occipito-temporal cortex (e.g., the visual word form area, VWFA) and the FFA for common neural resources. In the present pilot study, we assessed the neural face processing network in 12 children (aged 7–9 years) and 10 adults with functional magnetic resonance imaging (fMRI). The hemispheric lateralization of the core face regions was compared between both groups. The study had two goals: First, we aimed to establish an fMRI paradigm suitable for assessing activation in the core system of face processing in young children at the single subject level. Second, we planned to collect data for a power analysis to calculate the necessary group size for a large-scale cross-sectional imaging study assessing the ontogenetic development of the lateralization of the face processing network, with focus on the FFA. It was possible to detect brain activity in the core system of 75% of children at the single subject level. The average scan-to-scan motion of the included children was comparable to adults, ruling out that potential activation differences between groups are caused by unequal motion artifacts. Hemispheric lateralization of the FFA was 0.07 ± 0.48 in children (indicating bilateral activation) and −0.32 ± 0.52 in adults (indicating right-hemispheric dominance). These results thus showed, as expected, a trend for increased lateralization in adults. The estimated effect size for the FFA lateralization difference was d = 0.78 (indicating medium to large effects). An adequately powered follow-up study (sensitivity 0.8) testing developmental changes of FFA lateralization would therefore require the inclusion of 18 children and 26 adults.

The occipital face area is causally involved in identity-related visual-semantic associations

Faces are processed in a network of areas within regions of the ventral visual stream. However, familiar faces typically are characterized by additional associated information, such as episodic memories or semantic biographical information as well. The acquisition of such non-sensory, identity-specific knowledge plays a crucial role in our ability to recognize and identify someone we know. The occipital face area (OFA), an early part of the core face-processing network, is recently found to be involved in the formation of identity-specific memory traces but it is currently unclear if this role is limited to unimodal visual information. The current experiments used transcranial magnetic stimulation (TMS) to test whether the OFA is involved in the association of a face with identity-specific semantic information, such as the name or job title of a person. We applied an identity-learning task where unfamiliar faces were presented together with a name and a job title in the first encoding phase. Simultaneously, TMS pulses were applied either to the left or right OFA or to Cz, as a control. In the subsequent retrieval phase, the previously seen faces were presented either with two names or with two job titles and the task of the participants was to select the semantic information previously learned. We found that the stimulation of the right or left OFA reduced subsequent retrieval performance for the face-associated job titles. This suggests a causal role of the OFA in the association of faces and related semantic information. Furthermore, in contrast to prior findings, we did not observe hemispherical differences of the TMS intervention, suggesting a similar role of the left and right OFAs in the formation of the visual-semantic associations. Our results suggest the necessity to reconsider the hierarchical face-perception models and support the distributed and recurrent models.

Multimodal mapping of the face connectome

Face processing supports our ability to recognize friend from foe, form tribes and understand the emotional implications of changes in facial musculature. This skill relies on a distributed network of brain regions, but how these regions interact is poorly understood. Here we integrate anatomical and functional connectivity measurements with behavioural assays to create a global model of the face connectome. We dissect key features, such as the network topology and fibre composition. We propose a neurocognitive model with three core streams; face processing along these streams occurs in a parallel and reciprocal manner. Although long-range fibre paths are important, the face network is dominated by short-range fibres. Finally, we provide evidence that the well-known right lateralization of face processing arises from imbalanced intra- and interhemispheric connections. In summary, the face network relies on dynamic communication across highly structured fibre tracts, enabling coherent face processing that underpins behaviour and cognition.

Neuromagnetic correlates of hemispheric specialization for face and word recognition

The adult human brain appears to have specialized and independent neural systems for the visual processing of faces and words: greater selectivity for faces in the right hemisphere (RH) while greater selectivity for words in the left hemisphere (LH). Nevertheless, the nature of functional differences between the hemispheres is still largely unknown. To elucidate the hemispheric specialization for face and word recognition, event-related magnetic fields (ERFs) were recorded in young adults while they passively viewed faces and words presented either in the right visual field or in the left visual field. If the neural correlates of face recognition and word recognition reflect the same lateralization profile, then the lateralization of the magnetic source of the M170 component should follow a similar profile, with a greater M170 response for faces in the RH and a greater M170 response for words in the LH. We observed the expected finding of a larger M170 in the LH for words. Unexpectedly, a larger M170 response in the RH for faces was not found. Thus, the hemispheric organization of face recognition is different from that of word recognition in terms of specificity.

Laterality for recognizing written words and faces in the fusiform gyrus covaries with language dominance

Recognizing words and faces engages highly specialized sites within the middle fusiform gyrus, known as the visual word form area (VWFA) and fusiform face area (FFA) respectively. The VWFA and FFA have clear but opposite population-level asymmetries, with the VWFA typically being lateralized to the left and the FFA to the right hemisphere. The present study investigates how language dominance may relate to these asymmetries. We hypothesize that individuals with left hemisphere dominance for word production (i.e., left language dominance, LLD) will have typical lateralization for word and face recognition in the fusiform gyrus, whereas participants with right language dominance (RLD) will demonstrate 'atypical' rightward laterality for words and leftward dominance for faces. To test this hypothesis, we recruited twenty-seven left-handers who had previously been identified as being LLD or RLD based on a visual half field task. Using fMRI, hemisphere dominance was determined for language (Broca's region) as well as for word and face recognition in the middle fusiform gyrus for each participant. The direction of asymmetry correlated significantly between language and recognizing words (ρ = .648, p < .001) as well as between language and face recognition (ρ = -.620, p = .001). Moreover, most LLD-participants were typically lateralized for faces and written words, while both functions tended to be reversed in individuals with RLD. However, segregation between language and face recognition was less clear in participants with RLD, as many of them lacked an obvious asymmetry for faces. Although our results thus suggest there is no one-on-one relationship between asymmetries for language, written word and face recognition, they also argue against a complete independence of their lateralization.

The relationship between behavioral language laterality, face laterality and language performance in left-handers

Left-handers provide unique information about the relationship between cognitive functions because of their larger variability in hemispheric dominance. This study presents the laterality distribution of, correlations between and test-retest reliability of behavioral lateralized language tasks (speech production, reading and speech perception), face recognition tasks, handedness measures and language performance tests based on data from 98 left-handers. The results show that a behavioral test battery leads to percentages of (a)typical dominance that are similar to those found in neuropsychological studies even though the incidence of clear atypical lateralization (about 20%) may be overestimated at the group level. Significant correlations were found between the language tasks for both reaction time and accuracy lateralization indices. The degree of language laterality could however not be linked to face laterality, handedness or language performance. Finally, individuals were classified less consistently than expected as being typical, bilateral or atypical across all tasks. This may be due to the often good (speech production and perception tasks) but sometimes weak (reading and face tasks) test-retest reliabilities. The lack of highly reliable and valid test protocols for functions unrelated to speech remains one of the largest impediments for individual analysis and cross-task investigations in laterality research.

Influence of task instructions and stimuli on the neural network of face processing: An ALE meta-analysis

Many neuroimaging studies have investigated the neural correlates of face processing. However, the location of face-preferential regions differs considerably between studies, possibly due to the use of different stimuli or tasks. By using Activation likelihood estimation meta-analyses, we aimed to a) delineate regions consistently involved in face processing and b) to assess the influence of stimuli and task on convergence of activation patterns. In total, we included 77 neuroimaging experiments in healthy subjects comparing face processing to a control condition. Results revealed a core face-processing network encompassing bilateral fusiform gyrus (FFG), inferior occipital (IOG) gyrus, superior temporal sulcus/middle temporal gyrus (STS/MTG), amygdala, inferior frontal junction (IFJ) and gyrus (IFG), left anterior insula as well as pre-supplementary motor area (pre-SMA). Furthermore, separate meta-analyses showed, that while significant convergence across all task and stimuli conditions was found in bilateral amygdala, right IOG, right mid-FFG, and right IFG, convergence in IFJ, STS/MTG, right posterior FFG, left FFG and pre-SMA differed between conditions. Thus, our results point to an occipito-frontal-amygdalae system that is involved regardless of stimulus and attention, whereas the remaining regions of the face-processing network are influenced by the task-dependent focus on specific facial characteristics as well as the type of stimuli processed.

Face Processing Systems: From Neurons to Real-World Social Perception

Primate face processing depends on a distributed network of interlinked face-selective areas composed of face-selective neurons. In both humans and macaques, the network is divided into a ventral stream and a dorsal stream, and the functional similarities of the areas in humans and macaques indicate they are homologous. Neural correlates for face detection, holistic processing, face space, and other key properties of human face processing have been identified at the single neuron level, and studies providing causal evidence have established firmly that face-selective brain areas are central to face processing. These mechanisms give rise to our highly accurate familiar face recognition but also to our error-prone performance with unfamiliar faces. This limitation of the face system has important implications for consequential situations such as eyewitness identification and policing.

The non-linear development of the right hemispheric specialization for human face perception

The developmental origins of human adults' right hemispheric specialization for face perception remain unclear. On the one hand, infant studies have shown a right hemispheric advantage for face perception. On the other hand, it has been proposed that the adult right hemispheric lateralization for face perception slowly emerges during childhood due to reading acquisition, which increases left lateralized posterior responses to competing written material (e.g., visual letters and words). Since methodological approaches used in infant and children typically differ when their face capabilities are explored, resolving this issue has been difficult. Here we tested 5-year-old preschoolers varying in their level of visual letter knowledge with the same fast periodic visual stimulation (FPVS) paradigm leading to strongly right lateralized electrophysiological occipito-temporal face-selective responses in 4- to 6-month-old infants (de Heering and Rossion, 2015). Children's face-selective response was quantitatively larger and differed in scalp topography from infants', but did not differ across hemispheres. There was a small positive correlation between preschoolers' letter knowledge and a non-normalized index of right hemispheric specialization for faces. These observations show that previous discrepant results in the literature reflect a genuine nonlinear development of the neural processes underlying face perception and are not merely due to methodological differences across age groups. We discuss several factors that could contribute to the adult right hemispheric lateralization for faces, such as myelination of the corpus callosum and reading acquisition. Our findings point to the value of FPVS coupled with electroencephalography to assess specialized face perception processes throughout development with the same methodology.

Modifications of Visual Field Asymmetries for Face Categorization in Early Deaf Adults: A Study With Chimeric Faces

Right hemisphere lateralization for face processing is well documented in typical populations. At the behavioral level, this right hemisphere bias is often related to a left visual field (LVF) bias. A conventional mean to study this phenomenon consists of using chimeric faces that are composed of the left and right parts of two faces. In this paradigm, participants generally use the left part of the chimeric face, mostly processed through the right optic tract, to determine its identity, gender or age. To assess the impact of early auditory deprivation on face processing abilities, we tested the LVF bias in a group of early deaf participants and hearing controls. In two experiments, deaf and hearing participants performed a gender categorization task with chimeric and normal average faces. Over the two experiments the results confirmed the presence of a LVF bias in participants, which was less frequent in deaf participants. This result suggested modifications of hemispheric lateralization for face processing in deaf participants. In Experiment 2 we also recorded eye movements to examine whether the LVF bias could be related to face scanning behavior. In this second study, participants performed a similar task while we recorded eye movements using an eye tracking system. Using areas of interest analysis we observed that the proportion of fixations on the mouth relatively to the other areas was increased in deaf participants in comparison with the hearing group. This was associated with a decrease of the proportion of fixations on the eyes. In addition these measures were correlated to the LVF bias suggesting a relationship between the LVF bias and the patterns of facial exploration. Taken together, these results suggest that early auditory deprivation results in plasticity phenomenon affecting the perception of static faces through modifications of hemispheric lateralization and of gaze behavior.

Altered Dynamics of the fMRI Response to Faces in Individuals with Autism

Abnormal fMRI habituation in autism spectrum disorders (ASDs) has been proposed as a critical component in social impairment. This study investigated habituation to fearful faces and houses in ASD and whether fMRI measures of brain activity discriminate between ASD and typically developing (TD) controls. Two identical fMRI runs presenting masked fearful faces, houses, and scrambled images were collected. We found significantly slower fMRI responses to fearful faces but not houses in ASD. In addition, the pattern of slow to emerge amygdala activation to faces had robust discriminability [ASD vs. TD; area under the curve (AUC) = .852, p < .001]. In contrast, habituation to houses had no predictive value (AUC = .573, p = .365). Amygdala habituation to emotional faces may be useful for quantifying risk in ASD.

A face-selective ventral occipito-temporal map of the human brain with intracerebral potentials

Human neuroimaging studies have identified a network of distinct face-selective regions in the ventral occipito-temporal cortex (VOTC), with a right hemispheric dominance. To date, there is no evidence for this hemispheric and regional specialization with direct measures of brain activity. To address this gap in knowledge, we recorded local neurophysiological activity from 1,678 contact electrodes implanted in the VOTC of a large group of epileptic patients (n = 28). They were presented with natural images of objects at a rapid fixed rate (six images per second: 6 Hz), with faces interleaved as every fifth stimulus (i.e., 1.2 Hz). High signal-to-noise ratio face-selective responses were objectively (i.e., exactly at the face stimulation frequency) identified and quantified throughout the whole VOTC. Face-selective responses were widely distributed across the whole VOTC, but also spatially clustered in specific regions. Among these regions, the lateral section of the right middle fusiform gyrus showed the largest face-selective response by far, offering, to our knowledge, the first supporting evidence of two decades of neuroimaging observations with direct neural measures. In addition, three distinct regions with a high proportion of face-selective responses were disclosed in the right ventral anterior temporal lobe, a region that is undersampled in neuroimaging because of magnetic susceptibility artifacts. A high proportion of contacts responding only to faces (i.e., "face-exclusive" responses) were found in these regions, suggesting that they contain populations of neurons involved in dedicated face-processing functions. Overall, these observations provide a comprehensive mapping of visual category selectivity in the whole human VOTC with direct neural measures.

Handedness is related to neural mechanisms underlying hemispheric lateralization of face processing

While the right-hemispheric lateralization of the face perception network is well established, recent evidence suggests that handedness affects the cerebral lateralization of face processing at the hierarchical level of the fusiform face area (FFA). However, the neural mechanisms underlying differential hemispheric lateralization of face perception in right- and left-handers are largely unknown. Using dynamic causal modeling (DCM) for fMRI, we aimed to unravel the putative processes that mediate handedness-related differences by investigating the effective connectivity in the bilateral core face perception network. Our results reveal an enhanced recruitment of the left FFA in left-handers compared to right-handers, as evidenced by more pronounced face-specific modulatory influences on both intra- and interhemispheric connections. As structural and physiological correlates of handedness-related differences in face processing, right- and left-handers varied with regard to their gray matter volume in the left fusiform gyrus and their pupil responses to face stimuli. Overall, these results describe how handedness is related to the lateralization of the core face perception network, and point to different neural mechanisms underlying face processing in right- and left-handers. In a wider context, this demonstrates the entanglement of structurally and functionally remote brain networks, suggesting a broader underlying process regulating brain lateralization.

Asymmetry of fusiform structure in autism spectrum disorder: trajectory and association with symptom severity

Background

While asymmetry in the fusiform gyrus (FFG) has been reported in functional and structural studies in typically developing controls (TDC), few studies have examined FFG asymmetry in autism spectrum disorder (ASD) subjects and those studies are limited by small sample sizes, and confounded by cognitive ability or handedness. No previous work has examined FFG surface area or cortical thickness asymmetry in ASD; nor do we understand the trajectory of FFG asymmetry over time. Finally, it is not known how FFG structural asymmetry relates to ASD symptom severity.

Methods

In this study, we examined FFG volume, surface area, and cortical thickness asymmetry, as well as their cross-sectional trajectories in a large sample of right-handed males aged 7 to 25 years with 128 ASD and 127 TDC subjects using general linear models. In addition, we examined the relationship between FFG asymmetry and ASD severity using the Autism Diagnostic Observation Schedule (ADOS) and Gotham autism severity scores.

Results

Findings revealed that while group differences were evident with mean leftward asymmetry in ASD and mean near symmetry in TDC volume and surface area, asymmetry for both groups existed on a spectrum encompassing leftward and rightward asymmetry. In ASD subjects, volume asymmetry was negatively associated with ADOS and autism severity score symptom measures, with a subset of rightward asymmetric patients being most severely affected. We also observed differential trajectory of surface area asymmetry: ASD subjects exhibited a change from leftward asymmetry toward symmetry from age 7 to 25, whereas TDCs exhibited the reverse trend with a change from near symmetry toward leftward symmetry over the observed age range.

Conclusions

Abnormalities in FFG structural asymmetry are related to symptom severity in ASD and show differential developmental trajectory compared to TDC. This study is the first to note these findings. These results may have important implications for understanding the role of FFG asymmetry in ASD.

Electronic supplementary material

The online version of this article (doi:10.1186/s13229-016-0089-5) contains supplementary material, which is available to authorized users.

The relationship between visual word and face processing lateralization in the fusiform gyri: A cross-sectional study

Visual words and faces activate similar networks but with complementary hemispheric asymmetries, faces being lateralized to the right and words to the left. A recent theory proposes that this reflects developmental competition between visual word and face processing. We investigated whether this results in an inverse correlation between the degree of lateralization of visual word and face activation in the fusiform gyri. 26 literate right-handed healthy adults underwent functional MRI with face and word localizers. We derived lateralization indices for cluster size and peak responses for word and face activity in left and right fusiform gyri, and correlated these across subjects. A secondary analysis examined all face- and word-selective voxels in the inferior occipitotemporal cortex. No negative correlations were found. There were positive correlations for the peak MR response between word and face activity within the left hemisphere, and between word activity in the left visual word form area and face activity in the right fusiform face area. The face lateralization index was positively rather than negatively correlated with the word index. In summary, we do not find a complementary relationship between visual word and face lateralization across subjects. The significance of the positive correlations is unclear: some may reflect the influences of general factors such as attention, but others may point to other factors that influence lateralization of function.

Neural Univariate Activity and Multivariate Pattern in the Posterior Superior Temporal Sulcus Differentially Encode Facial Expression and Identity

Faces contain a variety of information such as one’s identity and expression. One prevailing model suggests a functional division of labor in processing faces that different aspects of facial information are processed in anatomically separated and functionally encapsulated brain regions. Here, we demonstrate that facial identity and expression can be processed in the same region, yet with different neural coding strategies. To this end, we employed functional magnetic resonance imaging to examine two types of coding schemes, namely univariate activity and multivariate pattern, in the posterior superior temporal cortex (pSTS) - a face-selective region that is traditionally viewed as being specialized for processing facial expression. With the individual difference approach, we found that participants with higher overall face selectivity in the right pSTS were better at differentiating facial expressions measured outside of the scanner. In contrast, individuals whose spatial pattern for faces in the right pSTS was less similar to that for objects were more accurate in identifying previously presented faces. The double dissociation of behavioral relevance between overall neural activity and spatial neural pattern suggests that the functional-division-of-labor model on face processing is over-simplified, and that coding strategies shall be incorporated in a revised model.

A Revised Neural Framework for Face Processing

Face perception relies on computations carried out in face-selective cortical areas. These areas have been intensively investigated for two decades, and this work has been guided by an influential neural model suggested by Haxby and colleagues in 2000. Here, we review new findings about face-selective areas that suggest the need for modifications and additions to the Haxby model. We suggest a revised framework based on (a) evidence for multiple routes from early visual areas into the face-processing system, (b) information about the temporal characteristics of these areas, (c) indications that the fusiform face area contributes to the perception of changeable aspects of faces, (d) the greatly elevated responses to dynamic compared with static faces in dorsal face-selective brain areas, and (e) the identification of three new anterior face-selective areas. Together, these findings lead us to suggest that face perception depends on two separate pathways: a ventral stream that represents form information and a dorsal stream driven by motion and form information.

Association between polymorphisms in NOS3 and KCNH2 and social memory

Social memory, including the ability to recognize faces and voices, is essential for social relationships. It has a large heritable component, but the knowledge about the contributing genes is sparse. The genetic variation underlying inter-individual differences in social memory was investigated in an exploratory sample (n = 55), genotyped with a chip comprising approximately 200,000 single nucleotide polymorphisms (SNPs), and in a validation sample (n = 582), where 30 SNPs were targeted. In the exploratory study face identity recognition was measured. The validation study also measured vocal sound recognition, as well as recognition of faces and vocal sounds combined (multimodal condition). In the exploratory study, the 30 SNPs that were associated with face recognition at p_uncorrected < 0.001 and located in genes, were chosen for further study. In the validation study two of these SNPs showed significant associations with recognition of faces, vocal sounds, and multimodal stimuli: rs1800779 in the gene encoding nitric oxide synthase 3 (NOS3) and rs3807370 in the gene encoding the voltage-gated channel, subfamily H, member 2 (KCNH2), in strong linkage disequilibrium with each other. The uncommon alleles were associated with superior performance, and the effects were present for men only (p < 0.0002). The exploratory study also showed a weaker but significant association with (non-emotional) word recognition, an effect that was independent of the effect on face recognition. This study demonstrates evidence for an association between NOS3 and KCNH2 SNPs and social memory.

Functional asymmetry between the left and right human fusiform gyrus explored through electrical brain stimulation

The ventral temporal cortex (VTC) contains several areas with selective responses to words, numbers, faces, and objects as demonstrated by numerous human and primate imaging and electrophysiological studies. Our recent work using electrocorticography (ECoG) confirmed the presence of face-selective neuronal populations in the human fusiform gyrus (FG) in patients implanted with intracranial electrodes in either the left or right hemisphere. Electrical brain stimulation (EBS) disrupted the conscious perception of faces only when it was delivered in the right, but not left, FG. In contrast to our previous findings, here we report both negative and positive EBS effects in right and left FG, respectively. The presence of right hemisphere language dominance in the first, and strong left-handedness and poor language processing performance in the second case, provide indirect clues about the functional architecture of the human VTC in relation to hemispheric asymmetries in language processing and handedness.

A vision of graded hemispheric specialization

Understanding the process by which the cerebral hemispheres reach their mature functional organization remains challenging. We propose a theoretical account in which, in the domain of vision, faces and words come to be represented adjacent to retinotopic cortex by virtue of the need to discriminate among homogeneous exemplars. Orthographic representations are further constrained to be proximal to typically left-lateralized language-related information to minimize connectivity length between visual and language areas. As reading is acquired, orthography comes to rely more heavily (albeit not exclusively) on the left fusiform region to bridge vision and language. Consequently, due to competition from emerging word representations, face representations that were initially bilateral become lateralized to the right fusiform region (albeit, again, not exclusively). We review recent research that describes constraints that give rise to this graded hemispheric arrangement. We then summarize empirical evidence from a variety of studies (behavioral, evoked response potential, functional imaging) across different populations (children, adolescents, and adults; left handers and individuals with developmental dyslexia) that supports the claims that hemispheric lateralization is graded rather than binary and that this graded organization emerges dynamically over the course of development. Perturbations of this system either during development or in adulthood provide further insights into the principles governing hemispheric organization.