Face perception: domain specific, not process specific

Human genetics of face recognition: discovery of MCTP2 mutations in humans with face blindness (congenital prosopagnosia)

Face recognition is important for both visual and social cognition. While prosopagnosia or face blindness has been known for seven decades and face-specific neurons for half a century, the molecular genetic mechanism is not clear. Here we report results after 17 years of research with classic genetics and modern genomics. From a large family with 18 congenital prosopagnosia (CP) members with obvious difficulties in face recognition in daily life, we uncovered a fully cosegregating private mutation in the MCTP2 gene which encodes a calcium binding transmembrane protein expressed in the brain. After screening through cohorts of 6589, we found more CPs and their families, allowing detection of more CP associated mutations in MCTP2. Face recognition differences were detected between 14 carriers with the frameshift mutation S80fs in MCTP2 and 19 noncarrying volunteers. Six families including one with 10 members showed the S80fs-CP correlation. Functional magnetic resonance imaging found association of impaired recognition of individual faces by MCTP2 mutant CPs with reduced repetition suppression to repeated facial identities in the right fusiform face area. Our results have revealed genetic predisposition of MCTP2 mutations in CP, 76 years after the initial report of prosopagnosia and 47 years after the report of the first CP. This is the first time a gene required for a higher form of visual social cognition was found in humans.

Dynamic brain communication underwriting face pareidolia

Face pareidolia is a tendency to seeing faces in nonface images that reflects high tuning to a face scheme. Yet, studies of the brain networks underwriting face pareidolia are scarce. Here, we examined the time course and dynamic topography of gamma oscillatory neuromagnetic activity while administering a task with nonface images resembling a face. Images were presented either with canonical orientation or with display inversion that heavily impedes face pareidolia. At early processing stages, the peaks in gamma activity (40 to 45 Hz) to images either triggering or not face pareidolia originate mainly from the right medioventral and lateral occipital cortices, rostral and caudal cuneus gyri, and medial superior occipital gyrus. Yet, the difference occurred at later processing stages in the high-frequency range of 80 to 85 Hz over a set of the areas constituting the social brain. The findings speak rather for a relatively late neural network playing a key role in face pareidolia. Strikingly, a cutting-edge analysis of brain connectivity unfolding over time reveals mutual feedforward and feedback intra- and interhemispheric communication not only within the social brain but also within the extended large-scale network of down- and upstream regions. In particular, the superior temporal sulcus and insula strongly engage in communication with other brain regions either as signal transmitters or recipients throughout the whole processing of face-pareidolia images.

Rapid, concerted switching of the neural code in inferotemporal cortex

A fundamental paradigm in neuroscience is the concept of neural coding through tuning functions 1 . According to this idea, neurons encode stimuli through fixed mappings of stimulus features to firing rates. Here, we report that the tuning of visual neurons can rapidly and coherently change across a population to attend to a whole and its parts. We set out to investigate a longstanding debate concerning whether inferotemporal (IT) cortex uses a specialized code for representing specific types of objects or whether it uses a general code that applies to any object. We found that face cells in macaque IT cortex initially adopted a general code optimized for face detection. But following a rapid, concerted population event lasting < 20 ms, the neural code transformed into a face-specific one with two striking properties: (i) response gradients to principal detection-related dimensions reversed direction, and (ii) new tuning developed to multiple higher feature space dimensions supporting fine face discrimination. These dynamics were face specific and did not occur in response to objects. Overall, these results show that, for faces, face cells shift from detection to discrimination by switching from an object-general code to a face-specific code. More broadly, our results suggest a novel mechanism for neural representation: concerted, stimulus-dependent switching of the neural code used by a cortical area.

Altered Gaze Control During Emotional Face Exploration in Patients With Amyotrophic Lateral Sclerosis

OBJECTIVES

Up to 50% of patients with amyotrophic lateral sclerosis (ALS) present with cognitive problems and behavioral dysfunctions including recognition of human faces presenting different emotions. We investigated whether impaired processing of emotional faces is associated with abnormal scan paths during visual exploration.

METHODS

Cognitively unimpaired patients with ALS (n = 45) and matched healthy controls (n = 37) underwent neuropsychological assessment and video-based eye tracking. Eye movements were recorded while participants visually explored faces expressing different emotions (neutral, disgusted, happy, fearful, and sad) and houses mimicking faces.

RESULTS

Compared with controls, patients with ALS fixated significantly longer to regions which are not relevant for emotional information when faces expressed fear (p = 0.007) and disgust (p = 0.006), whereas the eyes received less attention in faces expressing disgust (p = 0.041). Fixation duration in any area of interest was not significantly associated with the cognitive state or clinical symptoms of disease severity.

DISCUSSION

In cognitively unimpaired patients with ALS, altered gaze patterns while visually exploring faces expressing different emotions might derive from impaired top-down attentional control with possible involvement of subliminal frontotemporal areas. This may account for indistinctness in emotion recognition reported in previous studies because nonsalient features retrieve more attention compared with salient areas. Current findings may indicate distinct emotion processing dysfunction of ALS pathology, which may be different from, for example, executive dysfunction.

Deep learning models challenge the prevailing assumption that face-like effects for objects of expertise support domain-general mechanisms

The question of whether task performance is best achieved by domain-specific, or domain-general processing mechanisms is fundemental for both artificial and biological systems. This question has generated a fierce debate in the study of expert object recognition. Because humans are experts in face recognition, face-like neural and cognitive effects for objects of expertise were considered support for domain-general mechanisms. However, effects of domain, experience and level of categorization, are confounded in human studies, which may lead to erroneous inferences. To overcome these limitations, we trained deep learning algorithms on different domains (objects, faces, birds) and levels of categorization (basic, sub-ordinate, individual), matched for amount of experience. Like humans, the models generated a larger inversion effect for faces than for objects. Importantly, a face-like inversion effect was found for individual-based categorization of non-faces (birds) but only in a network specialized for that domain. Thus, contrary to prevalent assumptions, face-like effects for objects of expertise do not support domain-general mechanisms but may originate from domain-specific mechanisms. More generally, we show how deep learning algorithms can be used to dissociate factors that are inherently confounded in the natural environment of biological organisms to test hypotheses about their isolated contributions to cognition and behaviour.

fMRI evidence that hyper-caricatured faces activate object-selective cortex

Many brain imaging studies have looked at the cortical responses to object categories and faces. A popular way to manipulate face stimuli is by using a "face space," a high dimensional representation of individual face images, with the average face located at the origin. However, how the brain responds to faces that deviate substantially from average has not been much explored. Increasing the distance from the average (leading to increased caricaturing) could increase neural responses in face-selective regions, an idea supported by results from non-human primates. Here, we used a face space based on principal component analysis (PCA) to generate faces ranging from average to heavily caricatured. Using functional magnetic resonance imaging (fMRI), we first independently defined face-, object- and scene-selective areas with a localiser scan and then measured responses to parametrically caricatured faces. We also included conditions in which the images of faces were inverted. Interestingly in the right fusiform face area (FFA), we found that the patterns of fMRI response were more consistent as caricaturing increased. However, we found no consistent effect of either caricature level or facial inversion on the average fMRI response in the FFA or face-selective regions more broadly. In contrast, object-selective regions showed an increase in both the consistency of response pattern and the average fMRI response with increasing caricature level. This shows that caricatured faces recruit processing from regions typically defined as object-selective, possibly through enhancing low-level properties that are characteristic of objects.

Contrasting domain-general and domain-specific accounts in cognitive neuropsychology: An outline of a new approach with developmental prosopagnosia as a case

The backbone of cognitive neuropsychology is the observation of (double) dissociations in performance between patients, suggesting some degree of independence between cognitive processes (domain specificity). In comparison, observations of associations between disorders/deficits have been deemed less evidential in neuropsychological theorizing about cognitive architecture. The reason is that associations can reflect damage to independent cognitive processes that happen to be mediated by structures commonly affected by the same brain disorder rather than damage to a shared (domain-general) mechanism. Here we demonstrate that it is in principle possible to discriminate between these alternatives by means of a procedure involving large unbiased samples. We exemplify the procedure in the context of developmental prosopagnosia (DP), but the procedure is in principle applicable to all neuropsychological deficits/disorders. A simulation of the procedure on a dataset yields estimates of dissociations/associations that are well in line with existing DP-studies, and also suggests that seemingly selective disorders can reflect damage to both domain-general and domain-specific cognitive processes. However, the simulation also highlights some limitations that should be considered if the procedure is to be applied prospectively. The main advantage of the procedure is that allows for examination of both associations and dissociations in the same sample. Hence, it may help even the balance in the use of associations and dissociations as grounds for neuropsychological theorizing.

Local features drive identity responses in macaque anterior face patches

Humans and other primates recognize one another in part based on unique structural details of the face, including both local features and their spatial configuration within the head and body. Visual analysis of the face is supported by specialized regions of the primate cerebral cortex, which in macaques are commonly known as face patches. Here we ask whether the responses of neurons in anterior face patches, thought to encode face identity, are more strongly driven by local or holistic facial structure. We created stimuli consisting of recombinant photorealistic images of macaques, where we interchanged the eyes, mouth, head, and body between individuals. Unexpectedly, neurons in the anterior medial (AM) and anterior fundus (AF) face patches were predominantly tuned to local facial features, with minimal neural selectivity for feature combinations. These findings indicate that the high-level structural encoding of face identity rests upon populations of neurons specialized for local features.

Anterior face patches in the macaque have been assumed to represent face identity in a holistic manner. Here the authors show that the neural encoding of face identity in the anterior medial and anterior fundus face patches are instead driven principally by local features.

Improving face identification of mask-wearing individuals

Research has consistently shown that concealing facial features can hinder subsequent identification. The widespread adoption of face masks due to the COVID-19 pandemic has highlighted the critical and urgent need to discover techniques to improve identification of people wearing face coverings. Despite years of research on face recognition and eyewitness identifications, there are currently no evidence-based recommendations for lineup construction for cases involving masked individuals. The purpose of this study was to examine identification accuracy of a masked perpetrator as a function of lineup type (i.e., unmasked or masked lineups) and perpetrator presence (i.e., absent or present). In both experiments, discriminability was superior for masked lineups, a result that was due almost exclusively to higher hits rates in target-present conditions. These data suggest that presenting a masked lineup can enhance identification of masked faces, and they have important implications for both eyewitness identification and everyday face recognition of people with face coverings.

Compositionality of the Constituent Characters in Chinese Two-Character-Word Recognition by Adult Readers of High and Low Chinese Proficiency

In Chinese, the graphic units are Chinese characters, most of which are compound characters. Since a compound character can be different from another one in being regarded as composed of components (compositionality), readers might have developed a compositionality awareness of the constituent characters in two-character word (2C-word) recognition. Two experiments were conducted in a lexical decision task on the same set of 2C-words, the first constituent characters of which were manipulated in compositionality. Given that a Chinese character is more difficult to recognize when it is presented upside-down than when it is presented in an upright orientation and that it is inevitable to perceive the constituent characters in 2C-word recognition, we manipulated the first constituent characters' presentation orientation to increase the task difficulty. The two constituent characters of a 2C-word target were displayed simultaneously in a trial in Experiment 1 but were shown sequentially in Experiment 2. Participants were two cohorts of adult Chinese native speakers (CNS1s and CNS2s). CNS1s had a significantly lower level of reading proficiency than CNS2s. The influence of orientation was observed in both CNS1s and CNS2s' performance across the two experiments, but only CNS2s' reaction times seemed to have indicated the effect of compositionality in Experiment 2. Skilled readers are more likely than less skilled readers to be conscious of compositionality of the first constituent characters, which are presented separately from the second ones, in 2C-word recognition.

The impact of newly self-associated pictorial and letter-based stimuli in attention holding

Familiar self-associated stimuli such as one's own name and face are more efficient in guiding attention than other-associated stimuli. Remarkably, a short association of geometric shapes to the self versus others is sufficient to induce prioritization of the self- (vs. other-) associated shape in a matching task. Replications with other tasks measuring different stages of information processing, however, produced mixed results. It thus remains unclear whether the effect can be attributed to the newly associated stimulus alone. Therefore, in Study 1 (N = 28), we implemented the matching task and additionally compared the effectiveness of familiar versus newly self-associated stimuli with that of stranger-related stimuli to hold attention as cues in a dot-probe task. The self and the stranger were either represented by familiar labels ("I" vs. "stranger"), newly associated shapes, or shape-label pairs. In Study 2 (N = 31), participants associated nonwords to themselves and a stranger to compare the attentional impact of familiar and new self-associated letter combinations. Thus, we addressed the potential limitation due to modality present in former studies-which used mostly pictorial stimuli as new representations and letter combinations as familiar representations. Across both studies, in the dot-probe task, responses were faster towards targets following the self-associated stimuli compared with stranger-associated stimuli but only when familiar representations were used. Responses in the matching task were faster when confirming the correct self-associated pair. The results suggest that, under conditions of attentional competition, the prioritization of self-associated compared with other-associated cues does not generalize to newly associated stimuli.

Blocking facial mimicry during binocular rivalry modulates visual awareness of faces with a neutral expression

Several previous studies have interfered with the observer’s facial mimicry during a variety of facial expression recognition tasks providing evidence in favor of the role of facial mimicry and sensorimotor activity in emotion processing. In this theoretical context, a particularly intriguing facet has been neglected, namely whether blocking facial mimicry modulates conscious perception of facial expressions of emotions. To address this issue, we used a binocular rivalry paradigm, in which two dissimilar stimuli presented to the two eyes alternatingly dominate conscious perception. On each trial, female participants (N = 32) were exposed to a rivalrous pair of a neutral and a happy expression of the same individual through anaglyph glasses in two conditions: in one, they could freely use their facial mimicry, in the other they had to keep a chopstick between their lips, constraining the mobility of the zygomatic muscle and producing ‘noise’ for sensorimotor simulation. We found that blocking facial mimicry affected the perceptual dominance in terms of cumulative time favoring neutral faces, but it did not change the time before the first dominance was established. Taken together, our results open a door to future investigation of the intersection between sensorimotor simulation models and conscious perception of emotional facial expressions.

The composite face effect is robust against perceptual misfit

The composite face effect—the failure of selective attention toward a target face half—is frequently used to study mechanisms of feature integration in faces. Here we studied how this effect depends on the perceptual fit between attended and unattended halves. We used composite faces that were rated by trained observers as either a seamless fit (i.e., close to a natural and homogeneous face) or as a deliberately bad quality of fit (i.e., unnatural, strongly segregated face halves). In addition, composites created by combining face halves randomly were tested. The composite face effect was measured as the alignment × congruency interaction (Gauthier and Bukach Cognition, 103, 322–330 2007), but also with alternative data analysis procedures (Rossion and Boremanse Journal of Vision, 8, 1–13 2008). We found strong but identical composite effects in all fit conditions. Fit quality neither increased the composite face effect nor was it attenuated by bad or random fit quality. The implications for a Gestalt account of holistic face processing are discussed.

The constancy of the holistic processing of unfamiliar faces: Evidence from the study-test consistency effect and the within-person motion and viewpoint invariance

It has been well documented that static face processing is holistic. Faces contain variant (e.g., motion, viewpoint) and invariant (race, sex) features. However, little research has focused on whether holistic face representations are tolerant of within-person variations. The present study thus investigated whether holistic face representations of faces are tolerant of within-person motion and viewpoint variations by manipulating study-test consistency using a complete composite paradigm. Participants were shown two faces sequentially and were asked to judge whether the faces' top halves were identical or different. The first face was a static face or a dynamic face rotated in depth at 30°, 60°, and 90°. The second face was either a different front-view static face (Experiment 1a, study-test inconsistent) or identical to the first face (Experiment 1b, study-test consistent). In Experiment 2, study-test consistency was manipulated within subjects, and inverted faces were included. Our results show that study-test consistency significantly enhanced the holistic processing of upright and inverted faces; this study-test consistency effect and holistic processing were not modulated by motion and viewpoint changes via depth rotation. Interestingly, we found holistic processing for moving study-test consistent inverted faces, but not for static inverted faces. What these results tell us about the nature of holistic face representation is discussed in depth with respect to earlier and current theories on face processing.

Reversing the Luminance Polarity of Control Faces: Why Are Some Negative Faces Harder to Recognize, but Easier to See?

Control stimuli are key for understanding the extent to which face processing relies on holistic processing, and affective evaluation versus the encoding of low-level image properties. Luminance polarity (LP) reversal combined with face inversion is a popular tool for severely disrupting the recognition of face controls. However, recent findings demonstrate visibility-recognition trade-offs for LP-reversed faces, where these face controls sometimes appear more salient despite being harder to recognize. The present report brings together findings from image analysis, simple stimuli, and behavioral data for facial recognition and visibility, in an attempt to disentangle instances where LP-reversed control faces are associated with a performance bias in terms of their perceived salience. These findings have important implications for studies of subjective face appearance, and highlight that future research must be aware of behavioral artifacts due to the possibility of trade-off effects.

Putting the Nonsocial Into Social Neuroscience: A Role for Domain-General Priority Maps During Social Interactions

Whether on a first date or during a team briefing at work, people’s daily lives are inundated with social information, and in recent years, researchers have begun studying the neural mechanisms that support social-information processing. We argue that the focus of social neuroscience research to date has been skewed toward specialized processes at the expense of general processing mechanisms with a consequence that unrealistic expectations have been set for what specialized processes alone can achieve. We propose that for social neuroscience to develop into a more mature research program, it needs to embrace hybrid models that integrate specialized person representations with domain-general solutions, such as prioritization and selection, which operate across all classes of information (both social and nonsocial). To illustrate our central arguments, we first describe and then evaluate a hybrid model of information processing during social interactions that (a) generates novel and falsifiable predictions compared with existing models; (b) is predicated on a wealth of neurobiological evidence spanning many decades, methods, and species; (c) requires a superior standard of evidence to substantiate domain-specific mechanisms of social behavior; and (d) transforms expectations of what types of neural mechanisms may contribute to social-information processing in both typical and atypical populations.

Neural Correlates of Gender Face Perception in Transgender People

To date, MRI studies focused on brain sexual dimorphism have not explored the presence of specific neural patterns in gender dysphoria (GD) using gender discrimination tasks. Considering the central role of body image in GD, the present study aims to evaluate brain activation patterns with 3T-scanner functional MRI (fMRI) during gender face discrimination task in a sample of 20 hormone-naïve transgender and 20 cisgender individuals. Additionally, participants were asked to complete psychometric measures. The between-group analysis of average blood oxygenation level dependent (BOLD) activations of female vs. male face contrast showed a significant positive cluster in the bilateral precuneus in transmen when compared to the ciswomen. In addition. the transwomen group compared to the cismen showed higher activations also in the precuneus, as well as in the posterior cingulate gyrus, the angular gyrus and the lateral occipital cortices. Moreover, the activation of precuneus, angular gyrus, lateral occipital cortices and posterior cingulate gyrus was significantly associated with higher levels of body uneasiness. These results show for the first time the existence of a possible specific GD-neural pattern. However, it remains unclear if the differences in brain phenotype of transgender people may be the result of a sex-atypical neural development or of a lifelong experience of gender non-conformity.

Investigating face and house discrimination at foveal to parafoveal locations reveals category-specific characteristics

Since perceptual and neural face sensitivity is associated with a foveal bias, and neural place sensitivity is associated with a peripheral bias (integration over space), we hypothesized that face perception ability will decline more with eccentricity than place perception ability. We also wanted to examine whether face perception ability would show a left visual field (LeVF) bias due to earlier reports suggesting right hemisphere dominance for faces, or would show an upper or lower visual field bias. Participants performed foveal and parafoveal face and house discrimination tasks for upright or inverted stimuli (≤4°) while their eye movements were monitored. Low-level visual tasks were also measured. The eccentricity-related accuracy reductions were evident for all categories. Through detailed analyses we found (i) a robust face inversion effect across the parafovea, while for houses an opposite effect was found, (ii) higher eccentricity-related sensitivity for face performance than for house performance (via inverted vs. upright within-category eccentricity-driven reductions), (iii) within-category but not across-category performance associations across eccentricities, and (iv) no hemifield biases. Our central to parafoveal investigations suggest that high-level vision processing may be reflected in behavioural performance.

Emotions and brain function are altered up to one month after a single high dose of psilocybin

Psilocybin is a classic psychedelic compound that may have efficacy for the treatment of mood and substance use disorders. Acute psilocybin effects include reduced negative mood, increased positive mood, and reduced amygdala response to negative affective stimuli. However, no study has investigated the long-term, enduring impact of psilocybin on negative affect and associated brain function. Twelve healthy volunteers (7F/5M) completed an open-label pilot study including assessments 1-day before, 1-week after, and 1-month after receiving a 25 mg/70 kg dose of psilocybin to test the hypothesis that psilocybin administration leads to enduring changes in affect and neural correlates of affect. One-week post-psilocybin, negative affect and amygdala response to facial affect stimuli were reduced, whereas positive affect and dorsal lateral prefrontal and medial orbitofrontal cortex responses to emotionally-conflicting stimuli were increased. One-month post-psilocybin, negative affective and amygdala response to facial affect stimuli returned to baseline levels while positive affect remained elevated, and trait anxiety was reduced. Finally, the number of significant resting-state functional connections across the brain increased from baseline to 1-week and 1-month post-psilocybin. These preliminary findings suggest that psilocybin may increase emotional and brain plasticity, and the reported findings support the hypothesis that negative affect may be a therapeutic target for psilocybin.

Measurement of ultra-fast signal progression related to face processing by 7T fMRI

Given that the brain is a dynamic system, the temporal characteristics of brain function are important. Previous functional magnetic resonance imaging (fMRI) studies have attempted to overcome the limitations of temporal resolution to investigate dynamic states of brain activity. However, finding an fMRI method with sufficient temporal resolution to keep up with the progress of neuronal signals in the brain is challenging. This study aimed to detect between‐hemisphere signal progression, occurring on a timescale of tens of milliseconds, in the ventral brain regions involved in face processing. To this end, we devised an inter‐stimulus interval (ISI) stimulation scheme and used a 7T MRI system to obtain fMRI signals with a high signal‐to‐noise ratio. We conducted two experiments: one to measure signal suppression depending on the ISI and another to measure the relationship between the amount of suppression and the ISI. These two experiments enabled us to measure the signal transfer time from a brain region in the ventral visual stream to its counterpart in the opposite hemisphere through the corpus callosum. These findings demonstrate the feasibility of using fMRI to measure ultra‐fast signals (tens of milliseconds) and could facilitate the elucidation of further aspects of dynamic brain function.

Humans judge faces in incomplete photographs as physically more attractive

Attractive people are perceived to be healthier, wealthier, and more sociable. Yet, people often judge the attractiveness of others based on incomplete and inaccurate facial information. Here, we test the hypothesis that people fill in the missing information with positive inferences when judging others' facial beauty. To test this hypothesis, we conducted seven experiments where participants judged the attractiveness of human faces in complete and incomplete photographs. Our data shows that-relative to complete photographs-participants judge faces in incomplete photographs as physically more attractive. This positivity bias is replicated for different types of incompleteness; is mostly specific to aesthetic judgments; is stronger for male participants; is specific to human faces when compared to pets, flowers, and landscapes; seems to involve a holistic processing; and is stronger for atypical faces. These findings contribute to our understanding of how people perceive and make inferences about others' beauty.

The effects of face inversion on perceiving- and sensing-based change detection

Face perception is more difficult when faces are inverted compared to when they are upright. However, it is not known whether face inversion disrupts the ability to make perceiving-based discriminations (i.e., the ability to identify a specific feature change), or sensing-based discriminations (i.e., the ability to detect there was a change without the ability to identify what changed). In the current study, we used confidence-based receiver operating characteristics (ROCs) in a change detection test to examine the effect of face inversion on perceiving and sensing. In Experiment 1, face inversion led to a reduction in the probability of perceiving but did not impact sensing-based discriminations. In Experiment 2, we replicated these results, and verified that the findings based on ROC estimates paralleled participants' phenomenological experiences of perceiving and sensing. Furthermore, the perceiving-based face inversion effect was found to reflect a reduction in the ability to accurately report specific feature changes. These findings indicate that face inversion does not reduce the ability to sense there was a change in the absence of identification, but rather it reduces the ability to consciously identify specific characteristics of faces in service of perceiving-based discriminations. In addition, they suggest that sensing responds to global differences across the visual image, rather than to changes in holistic processing of the visual input. These results further our understanding of the face inversion effect and clarify the nature of the processes underlying visual perception. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

Face Representations via Tensorfaces of Various Complexities

Neurons selective for faces exist in humans and monkeys. However, characteristics of face cell receptive fields are poorly understood. In this theoretical study, we explore the effects of complexity, defined as algorithmic information (Kolmogorov complexity) and logical depth, on possible ways that face cells may be organized. We use tensor decompositions to decompose faces into a set of components, called tensorfaces, and their associated weights, which can be interpreted as model face cells and their firing rates. These tensorfaces form a high-dimensional representation space in which each tensorface forms an axis of the space. A distinctive feature of the decomposition algorithm is the ability to specify tensorface complexity. We found that low-complexity tensorfaces have blob-like appearances crudely approximating faces, while high-complexity tensorfaces appear clearly face-like. Low-complexity tensorfaces require a larger population to reach a criterion face reconstruction error than medium- or high-complexity tensorfaces, and thus are inefficient by that criterion. Low-complexity tensorfaces, however, generalize better when representing statistically novel faces, which are faces falling beyond the distribution of face description parameters found in the tensorface training set. The degree to which face representations are parts based or global forms a continuum as a function of tensorface complexity, with low and medium tensorfaces being more parts based. Given the computational load imposed in creating high-complexity face cells (in the form of algorithmic information and logical depth) and in the absence of a compelling advantage to using high-complexity cells, we suggest face representations consist of a mixture of low- and medium-complexity face cells.

Enhanced striatal and prefrontal activity is associated with individual differences in nonreinforced preference change for faces

Developing effective preference modification paradigms is crucial to improve the quality of life in a wide range of behaviors. The cue‐approach training (CAT) paradigm has been introduced as an effective tool to modify preferences lasting months, without external reinforcements, using the mere association of images with a cue and a speeded button response. In the current work for the first time, we used fMRI with faces as stimuli in the CAT paradigm, focusing on face‐selective brain regions. We found a behavioral change effect of CAT with faces immediately and 1‐month after training, however face‐selective regions were not indicative of behavioral change and thus preference change is less likely to rely on face processing brain regions. Nevertheless, we found that during training, fMRI activations in the ventral striatum were correlated with individual preference change. We also found a correlation between preference change and activations in the ventromedial prefrontal cortex during the binary choice phase. Functional connectivity among striatum, prefrontal regions, and high‐level visual regions was also related to individual preference change. Our work sheds new light on the involvement of neural mechanisms in the process of valuation. This could lead to development of novel real‐world interventions.

Universal Mechanisms and the Development of the Face Network: What You See Is What You Get

Our assignment was to review the development of the face-processing network, an assignment that carries the presupposition that a face-specific developmental program exists. We hope to cast some doubt on this assumption and instead argue that the development of face processing is guided by the same ubiquitous rules that guide the development of cortex in general.

A machine learning approach to predict perceptual decisions: an insight into face pareidolia

The perception of an external stimulus not only depends upon the characteristics of the stimulus but is also influenced by the ongoing brain activity prior to its presentation. In this work, we directly tested whether spontaneous electrical brain activities in prestimulus period could predict perceptual outcome in face pareidolia (visualizing face in noise images) on a trial-by-trial basis. Participants were presented with only noise images but with the prior information that some faces would be hidden in these images, while their electrical brain activities were recorded; participants reported their perceptual decision, face or no-face, on each trial. Using differential hemispheric asymmetry features based on large-scale neural oscillations in a machine learning classifier, we demonstrated that prestimulus brain activities could achieve a classification accuracy, discriminating face from no-face perception, of 75% across trials. The time–frequency features representing hemispheric asymmetry yielded the best classification performance, and prestimulus alpha oscillations were found to be mostly involved in predicting perceptual decision. These findings suggest a mechanism of how prior expectations in the prestimulus period may affect post-stimulus decision making.

Orientation-invariance of individual differences in three face processing tasks

Numerous studies have reported impairments in perception and recognition, and, particularly, in part-integration of faces following picture-plane inversion. Whether these findings support the notion that inversion changes face processing qualitatively remains a topic of debate. To examine whether associations and dissociations of the human face processing ability depend on stimulus orientation, we measured face recognition with the Cambridge Face Memory Test (CFMT), along with experimental tests of face perception and selective attention to faces and non-face objects in a sample of 314 participants. Results showed strong inversion effects for all face-related tasks, and modest ones for non-face objects. Individual differences analysis revealed that the CFMT shared common variance with face perception and face-selective attention, however, independent of orientation. Regardless of whether predictor and criterion had same or different orientation, face recognition was best predicted by the same test battery. Principal component decomposition revealed a common factor for face recognition and face perception, a second common factor for face recognition and face-selective attention, and two unique factors. The patterns of factor loadings were nearly identical for upright and inverted presentation. These results indicate orientation-invariance of common variance in three domains of face processing. Since inversion impaired performance, but did not affect domain-related associations and dissociations, the findings suggest process-specific but orientation-general mechanisms. Specific limitations by constraints of individual differences analysis and test selection are discussed.

A face is more than just the eyes, nose, and mouth: fMRI evidence that face-selective cortex represents external features

What is a face? Intuition, along with abundant behavioral and neural evidence, indicates that internal features (e.g., eyes, nose, mouth) are critical for face recognition, yet some behavioral and neural findings suggest that external features (e.g., hair, head outline, neck and shoulders) may likewise be processed as a face. Here we directly test this hypothesis by investigating how external (and internal) features are represented in the brain. Using fMRI, we found highly selective responses to external features (relative to objects and scenes) within the face processing system in particular, rivaling that observed for internal features. We then further asked how external and internal features are represented in regions of the cortical face processing system, and found a similar division of labor for both kinds of features, with the occipital face area and posterior superior temporal sulcus representing the parts of both internal and external features, and the fusiform face area representing the coherent arrangement of both internal and external features. Taken together, these results provide strong neural evidence that a "face" is composed of both internal and external features.

Body inversion effect in monkeys

Humans visually process human body images depending on the configuration of the parts. However, little is known about whether this function is evolutionarily shared with nonhuman animals. In this study, we examined the body posture discrimination performance of capuchin monkeys, a highly social platyrrhine primate, in comparison to humans. We demonstrate that, like humans, monkeys exhibit a body inversion effect: body posture discrimination is impaired by inversion, which disrupts the configural relationships of body parts. The inversion effect in monkeys was observed when human body images were used, but not when the body parts were replaced with cubic and cylindrical figures, the positions of the parts were scrambled, or only part of a body was presented. Results in human participants showed similar patterns, though they also showed the inversion effect when the cubic/cylindrical body images were used. These results provide the first evidence for configural processing of body forms in monkeys and suggest that the visual attunement to social signals mediated by body postures is conserved through the evolution of primate vision.

The Fusiform and Occipital Face Areas Can Process a Nonface Category Equivalently to Faces

The fusiform and occipital face areas (FFA and OFA) are functionally defined brain regions in human ventral occipitotemporal cortex associated with face perception. There is an ongoing debate, however, whether these regions are face-specific or whether they also facilitate the perception of nonface object categories. Here, we present evidence that, under certain conditions, bilateral FFA and OFA respond to a nonface category equivalently to faces. In two fMRI sessions, participants performed same–different judgments on two object categories (faces and chairs). In one session, participants differentiated between distinct exemplars of each category, and in the other session, participants differentiated between exemplars that differed only in the shape or spatial configuration of their features (featural/configural differences). During the latter session, the within-category similarity was comparable for both object categories. When differentiating between distinct exemplars of each category, bilateral FFA and OFA responded more strongly to faces than to chairs. In contrast, during featural/configural difference judgments, bilateral FFA and OFA responded equivalently to both object categories. Importantly, during featural/configural difference judgments, the magnitude of activity within FFA and OFA evoked by the chair task predicted the participants' behavioral performance. In contrast, when participants differentiated between distinct chair exemplars, activity within these face regions did not predict the behavioral performance of the chair task. We conclude that, when the within-category similarity of a face and a nonface category is comparable and when the same cognitive strategies used to process a face are applied to a nonface category, the FFA and OFA respond equivalently to that nonface category and faces.

Adults’ Markers of Face Processing Are Present at Age 6 and Are Interconnected Along Development

Recent studies on the development of face processing argue for a late, quantitative, domain-specific development of face processing, and face memory in particular. Most previous findings were based on separately tracking the developmental course of face perception skills, comparing performance across different age groups. Here, we adopted a different approach studying the mechanisms underlying the development of face processing by focusing on how different face skills are interrelated over the years (age 6 to adulthood). Specifically, we examined correlations within and between different categories of tasks: face domain-specific skills involving face recognition based on long-term representations (famous face), and short-term memory retention (Cambridge Face Memory Test), perceptual face-specific marker (inversion effect), global effects in scene perception (global–local task), and the perception of facial expressions. Factor analysis revealed that face identity skills have a similar pattern of interrelations throughout development, identifying two factors: a face domain-specific factor comprising adultlike markers of face processing and a general factor incorporating related, but nonspecific perceptual skills. Domain-specific age-related changes in face recognition entailing short- and long-term retention of face representations were observed, along with mature perceptual face-specific markers and more general perceptual effects predicting face perception skills already at age 6. The results suggest that the domain-specific changes in face processing are unlikely to result from developmental changes in perceptual skills driving face recognition. Instead, development may either involve improvement in the ability to retain face representations in memory or changes in the interactions between the perceptual representations of faces and their representations in long-term memory.

Social Cognition through the Lens of Cognitive and Clinical Neuroscience

Social cognition refers to a set of processes, ranging from perception to decision-making, underlying the ability to decode others' intentions and behaviors to plan actions fitting with social and moral, besides individual and economic considerations. Its centrality in everyday life reflects the neural complexity of social processing and the ubiquity of social cognitive deficits in different pathological conditions. Social cognitive processes can be clustered in three domains associated with (a) perceptual processing of social information such as faces and emotional expressions (social perception), (b) grasping others' cognitive or affective states (social understanding), and (c) planning behaviors taking into consideration others', in addition to one's own, goals (social decision-making). We review these domains from the lens of cognitive neuroscience, i.e., in terms of the brain areas mediating the role of such processes in the ability to make sense of others' behavior and plan socially appropriate actions. The increasing evidence on the “social brain” obtained from healthy young individuals nowadays constitutes the baseline for detecting changes in social cognitive skills associated with physiological aging or pathological conditions. In the latter case, impairments in one or more of the abovementioned domains represent a prominent concern, or even a core facet, of neurological (e.g., acquired brain injury or neurodegenerative diseases), psychiatric (e.g., schizophrenia), and developmental (e.g., autism) disorders. To pave the way for the other papers of this issue, addressing the social cognitive deficits associated with severe acquired brain injury, we will briefly discuss the available evidence on the status of social cognition in normal aging and its breakdown in neurodegenerative disorders. Although the assessment and treatment of such impairments is a relatively novel sector in neurorehabilitation, the evidence summarized here strongly suggests that the development of remediation procedures for social cognitive skills will represent a future field of translational research in clinical neuroscience.

Stimulus Dependent Dynamic Reorganization of the Human Face Processing Network

Using the "face inversion effect", a hallmark of face perception, we examined network mechanisms supporting face representation by tracking functional magnetic resonance imaging (fMRI) stimulus-dependent dynamic functional connectivity within and between brain networks associated with the processing of upright and inverted faces. We developed a novel approach adapting the general linear model (GLM) framework classically used for univariate fMRI analysis to capture stimulus-dependent fMRI dynamic connectivity of the face network. We show that under the face inversion manipulation, the face and non-face networks have complementary roles that are evident in their stimulus-dependent dynamic connectivity patterns as assessed by network decomposition into components or communities. Moreover, we show that connectivity patterns are associated with the behavioral face inversion effect. Thus, we establish "a network-level signature" of the face inversion effect and demonstrate how a simple physical transformation of the face stimulus induces a dramatic functional reorganization across related brain networks. Finally, we suggest that the dynamic GLM network analysis approach, developed here for the face network, provides a general framework for modeling the dynamics of blocked stimulus-dependent connectivity experimental designs and hence can be applied to a host of neuroimaging studies.

Beauty-related perceptual bias: Who captures the mind of the beholder?

INTRODUCTION

To explore the beauty-related perceptual bias and answers the question: Who can capture the mind of the beholder? Many studies have explored the specificity of human faces through ERP or other ways, and the materials they used are general human faces and other objects. Therefore, we want to further explore the difference between attractive faces and beautiful objects such as flowers.

METHODS

We recorded the eye movement of 22 male observers and 23 female observers using a standard two-alternative forced choice.

RESULTS

(1) The attractive faces were looked at longer and more often in comparison with the beautiful flowers; (2) fixation counts of female participants are more than male participants; and (3) the participants watched the beautiful flowers first, followed by the attractive faces, but there was no significant difference on the first fixation duration between the beautiful flowers and the attractive faces.

CONCLUSIONS

The data in this study may suggest that people prefer attractive faces to beautiful flowers.

Spatial Mechanisms within the Dorsal Visual Pathway Contribute to the Configural Processing of Faces

Human face recognition is often attributed to configural processing; namely, processing the spatial relationships among the features of a face. If configural processing depends on fine-grained spatial information, do visuospatial mechanisms within the dorsal visual pathway contribute to this process? We explored this question in human adults using functional magnetic resonance imaging and transcranial magnetic stimulation (TMS) in a same-different face detection task. Within localized, spatial-processing regions of the posterior parietal cortex, configural face differences led to significantly stronger activation compared to featural face differences, and the magnitude of this activation correlated with behavioral performance. In addition, detection of configural relative to featural face differences led to significantly stronger functional connectivity between the right FFA and the spatial processing regions of the dorsal stream, whereas detection of featural relative to configural face differences led to stronger functional connectivity between the right FFA and left FFA. Critically, TMS centered on these parietal regions impaired performance on configural but not featural face difference detections. We conclude that spatial mechanisms within the dorsal visual pathway contribute to the configural processing of facial features and, more broadly, that the dorsal stream may contribute to the veridical perception of faces.

Inversion Impairs Expert Budgerigar Identity Recognition: A Face-Like Effect for a Nonface Object of Expertise

The face-inversion effect is the finding that picture-plane inversion disproportionately impairs face recognition compared to object recognition and is now attributed to greater orientation-sensitivity of holistic processing for faces but not common objects. Yet, expert dog judges have showed similar recognition deficits for inverted dogs and inverted faces, suggesting that holistic processing is not specific to faces but to the expert recognition of perceptually similar objects. Although processing changes in expert object recognition have since been extensively documented, no other studies have observed the distinct recognition deficits for inverted objects-of-expertise that people as face experts show for faces. However, few studies have examined experts who recognize individual objects similar to how people recognize individual faces. Here we tested experts who recognize individual budgerigar birds. The effect of inversion on viewpoint-invariant budgerigar and face recognition was compared for experts and novices. Consistent with the face-inversion effect, novices showed recognition deficits for inverted faces but not for inverted budgerigars. By contrast, experts showed equal recognition deficits for inverted faces and budgerigars. The results are consistent with the hypothesis that processes underlying the face-inversion effect are specific to the expert individuation of perceptually similar objects.

Sensitivity to Faces with Typical and Atypical Part Configurations within Regions of the Face-processing Network: An fMRI Study

Perception of faces has been shown to engage a domain-specific set of brain regions, including the occipital face area (OFA) and the fusiform face area (FFA). It is commonly held that the OFA is responsible for the detection of faces in the environment, whereas the FFA is responsible for processing the identity of the face. However, an alternative model posits that the FFA is responsible for face detection and subsequently recruits the OFA to analyze the face parts in the service of identification. An essential prediction of the former model is that the OFA is not sensitive to the arrangement of internal face parts. In the current fMRI study, we test the sensitivity of the OFA and FFA to the configuration of face parts. Participants were shown faces in which the internal parts were presented in a typical configuration (two eyes above a nose above a mouth) or in an atypical configuration (the locations of individual parts were shuffled within the face outline). Perception of the atypical faces evoked a significantly larger response than typical faces in the OFA and in a wide swath of the surrounding posterior occipitotemporal cortices. Surprisingly, typical faces did not evoke a significantly larger response than atypical faces anywhere in the brain, including the FFA (although some subthreshold differences were observed). We propose that face processing in the FFA results in inhibitory sculpting of activation in the OFA, which accounts for this region's weaker response to typical than to atypical configurations.

Multivariate Pattern Classification of Facial Expressions Based on Large-Scale Functional Connectivity

It is an important question how human beings achieve efficient recognition of others’ facial expressions in cognitive neuroscience, and it has been identified that specific cortical regions show preferential activation to facial expressions in previous studies. However, the potential contributions of the connectivity patterns in the processing of facial expressions remained unclear. The present functional magnetic resonance imaging (fMRI) study explored whether facial expressions could be decoded from the functional connectivity (FC) patterns using multivariate pattern analysis combined with machine learning algorithms (fcMVPA). We employed a block design experiment and collected neural activities while participants viewed facial expressions of six basic emotions (anger, disgust, fear, joy, sadness, and surprise). Both static and dynamic expression stimuli were included in our study. A behavioral experiment after scanning confirmed the validity of the facial stimuli presented during the fMRI experiment with classification accuracies and emotional intensities. We obtained whole-brain FC patterns for each facial expression and found that both static and dynamic facial expressions could be successfully decoded from the FC patterns. Moreover, we identified the expression-discriminative networks for the static and dynamic facial expressions, which span beyond the conventional face-selective areas. Overall, these results reveal that large-scale FC patterns may also contain rich expression information to accurately decode facial expressions, suggesting a novel mechanism, which includes general interactions between distributed brain regions, and that contributes to the human facial expression recognition.

The Cue-Approach Task as a General Mechanism for Long-Term Non-Reinforced Behavioral Change

Recent findings show that preferences for food items can be modified without external reinforcements using the cue-approach task. In the task, the mere association of food item images with a neutral auditory cue and a speeded button press, resulted in enhanced preferences for the associated stimuli. In a series of 10 independent samples with a total of 255 participants, we show for the first time that using this non-reinforced method we can enhance preferences for faces, fractals and affective images, as well as snack foods, using auditory, visual and even aversive cues. This change was highly durable in follow-up sessions performed one to six months after training. Preferences were successfully enhanced for all conditions, except for negative valence items. These findings promote our understanding of non-reinforced change, suggest a boundary condition for the effect and lay the foundation for development of novel applications.

Congenital prosopagnosia without object agnosia? A literature review

A longstanding controversy concerns the functional organization of high-level vision, and the extent to which the recognition of different classes of visual stimuli engages a single system or multiple independent systems. We examine this in the context of congenital prosopagnosia (CP), a neurodevelopmental disorder in which individuals, without a history of brain damage, are impaired at face recognition. This paper reviews all CP cases from 1976 to 2016, and explores the evidence for the association or dissociation of face and object recognition. Of the 238 CP cases with data permitting a satisfactory evaluation, 80.3% evinced an association between impaired face and object recognition whereas 19.7% evinced a dissociation. We evaluate the strength of the evidence and correlate the face and object recognition behaviour. We consider the implications for theories of functional organization of the visual system, and offer suggestions for further adjudication of the relationship between face and object recognition.

The Functional Neuroanatomy of Human Face Perception

Face perception is critical for normal social functioning and is mediated by a network of regions in the ventral visual stream. In this review, we describe recent neuroimaging findings regarding the macro- and microscopic anatomical features of the ventral face network, the characteristics of white matter connections, and basic computations performed by population receptive fields within face-selective regions composing this network. We emphasize the importance of the neural tissue properties and white matter connections of each region, as these anatomical properties may be tightly linked to the functional characteristics of the ventral face network. We end by considering how empirical investigations of the neural architecture of the face network may inform the development of computational models and shed light on how computations in the face network enable efficient face perception.

Altered topology of neural circuits in congenital prosopagnosia

Using a novel, fMRI-based inter-subject functional correlation (ISFC) approach, which isolates stimulus-locked inter-regional correlation patterns, we compared the cortical topology of the neural circuit for face processing in participants with an impairment in face recognition, congenital prosopagnosia (CP), and matched controls. Whereas the anterior temporal lobe served as the major network hub for face processing in controls, this was not the case for the CPs. Instead, this group evinced hyper-connectivity in posterior regions of the visual cortex, mostly associated with the lateral occipital and the inferior temporal cortices. Moreover, the extent of this hyper-connectivity was correlated with the face recognition deficit. These results offer new insights into the perturbed cortical topology in CP, which may serve as the underlying neural basis of the behavioral deficits typical of this disorder. The approach adopted here has the potential to uncover altered topologies in other neurodevelopmental disorders, as well.

DOI:http://dx.doi.org/10.7554/eLife.25069.001

Human babies prefer to look at faces and pictures of faces over any other object or pattern. A recent study found that even fetuses in the womb will turn their heads towards dots of light shone through the mother’s skin if the dots broadly resemble a face. Brain imaging studies show that face recognition depends on the coordinated activity of multiple brain regions. A core set of areas towards the back of the brain processes the visual features of faces, while regions elsewhere process more variable features such as emotional expressions.

Around 2% of people are born with difficulties in recognizing faces, a condition known as congenital prosopagnosia. These individuals have no obvious anatomical abnormalities in the brain, and brain scans reveal normal activity in core regions of the face processing network. So why do these people have difficulty with face recognition?

One possibility is that the condition reflects differences in the number of connections (or “connectivity”) between brain regions within the face processing network. To test this idea, Rosenthal et al. compared connectivity in individuals with congenital prosopagnosia with that in healthy volunteers. In the healthy volunteers, an area of the network called the anterior temporal cortex was highly connected to many other face processing regions: that is, it acted as a face processing hub. In individuals with congenital prosopagnosia, this hub-like connectivity was missing. Instead, a number of core regions involved in processing the basic visual features of faces, were more highly connected to one another. The greater this “hyperconnectivity”, the better the individual’s face processing abilities.

The findings of Rosenthal et al. pave the way for developing imaging-based tools to diagnose congenital prosopagnosia. The same approach could then be used to investigate the basis of other neurodevelopmental disorders that are thought to involve abnormal communication within brain networks, such as developmental dyslexia.

DOI:http://dx.doi.org/10.7554/eLife.25069.002

Functional Subpopulations of Neurons in a Macaque Face Patch Revealed by Single-Unit fMRI Mapping

Neurons within fMRI-defined face patches of the macaque brain exhibit shared categorical responses to flashed images but diverge in their responses under more natural viewing conditions. Here we investigate functional diversity among neurons in the anterior fundus (AF) face patch, combining whole-brain fMRI with longitudinal single-unit recordings in a local population (<1 mm³). For each cell, we computed a whole-brain correlation map based on its shared time course with voxels throughout the brain during naturalistic movie viewing. Based on this mapping, neighboring neurons showed markedly different affiliation with distant visually responsive areas and fell coarsely into subpopulations. Of these, only one subpopulation (∼16% of neurons) yielded similar correlation maps to the local fMRI signal. The results employ the readout of large-scale fMRI networks and, by indicating multiple functional domains within a single voxel, present a new view of functional diversity within a local neural population.

Development of Neural Sensitivity to Face Identity Correlates with Perceptual Discriminability

Face perception is subserved by a series of face-selective regions in the human ventral stream, which undergo prolonged development from childhood to adulthood. However, it is unknown how neural development of these regions relates to the development of face-perception abilities. Here, we used functional magnetic resonance imaging (fMRI) to measure brain responses of ventral occipitotemporal regions in children (ages, 5-12 years) and adults (ages, 19-34 years) when they viewed faces that parametrically varied in dissimilarity. Since similar faces generate lower responses than dissimilar faces due to fMRI adaptation, this design objectively evaluates neural sensitivity to face identity across development. Additionally, a subset of subjects participated in a behavioral experiment to assess perceptual discriminability of face identity. Our data reveal three main findings: (1) neural sensitivity to face identity increases with age in face-selective but not object-selective regions; (2) the amplitude of responses to faces increases with age in both face-selective and object-selective regions; and (3) perceptual discriminability of face identity is correlated with the neural sensitivity to face identity of face-selective regions. In contrast, perceptual discriminability is not correlated with the amplitude of response in face-selective regions or of responses of object-selective regions. These data suggest that developmental increases in neural sensitivity to face identity in face-selective regions improve perceptual discriminability of faces. Our findings significantly advance the understanding of the neural mechanisms of development of face perception and open new avenues for using fMRI adaptation to study the neural development of high-level visual and cognitive functions more broadly.

SIGNIFICANCE STATEMENT

Face perception, which is critical for daily social interactions, develops from childhood to adulthood. However, it is unknown what developmental changes in the brain lead to improved performance. Using fMRI in children and adults, we find that from childhood to adulthood, neural sensitivity to changes in face identity increases in face-selective regions. Critically, subjects' perceptual discriminability among faces is linked to neural sensitivity: participants with higher neural sensitivity in face-selective regions demonstrate higher perceptual discriminability. Thus, our results suggest that developmental increases in face-selective regions' sensitivity to face identity improve perceptual discrimination of faces. These findings significantly advance understanding of the neural mechanisms underlying the development of face perception and have important implications for assessing both typical and atypical development.

Object Localization Does Not Imply Awareness of Object Category at the Break of Continuous Flash Suppression

In continuous flash suppression (CFS), a dynamic noise masker, presented to one eye, suppresses conscious perception of a test stimulus, presented to the other eye, until the suppressed stimulus comes to awareness after few seconds. But what do we see breaking the dominance of the masker in the transition period? We addressed this question with a dual-task in which observers indicated (i) whether the test object was left or right of the fixation mark (localization) and (ii) whether it was a face or a house (categorization). As done recently Stein et al. (2011a), we used two experimental varieties to rule out confounds with decisional strategy. In the terminated mode, stimulus and masker were presented for distinct durations, and the observers were asked to give both judgments at the end of the trial. In the self-paced mode, presentation lasted until the observers responded. In the self-paced mode, b-CFS durations for object categorization were about half a second longer than for object localization. In the terminated mode, correct categorization rates were consistently lower than correct detection rates, measured at five duration intervals ranging up to 2 s. In both experiments we observed an upright face advantage compared to inverted faces and houses, as concurrently reported in b-CFS studies. Our findings reveal that more time is necessary to enable observers judging the nature of the object, compared to judging that there is “something other” than the noise which can be localized, but not recognized. This suggests gradual transitions in the first break of CFS. Further, the results imply that suppression is such that no cues to object identity are conveyed in potential “leaks” of CFS (Gelbard-Sagiv et al., 2016).

Decoding facial expressions based on face-selective and motion-sensitive areas

Humans can easily recognize others' facial expressions. Among the brain substrates that enable this ability, considerable attention has been paid to face-selective areas; in contrast, whether motion-sensitive areas, which clearly exhibit sensitivity to facial movements, are involved in facial expression recognition remained unclear. The present functional magnetic resonance imaging (fMRI) study used multi-voxel pattern analysis (MVPA) to explore facial expression decoding in both face-selective and motion-sensitive areas. In a block design experiment, participants viewed facial expressions of six basic emotions (anger, disgust, fear, joy, sadness, and surprise) in images, videos, and eyes-obscured videos. Due to the use of multiple stimulus types, the impacts of facial motion and eye-related information on facial expression decoding were also examined. It was found that motion-sensitive areas showed significant responses to emotional expressions and that dynamic expressions could be successfully decoded in both face-selective and motion-sensitive areas. Compared with static stimuli, dynamic expressions elicited consistently higher neural responses and decoding performance in all regions. A significant decrease in both activation and decoding accuracy due to the absence of eye-related information was also observed. Overall, the findings showed that emotional expressions are represented in motion-sensitive areas in addition to conventional face-selective areas, suggesting that motion-sensitive regions may also effectively contribute to facial expression recognition. The results also suggested that facial motion and eye-related information played important roles by carrying considerable expression information that could facilitate facial expression recognition. Hum Brain Mapp 38:3113-3125, 2017. © 2017 Wiley Periodicals, Inc.

Neurophysiological Correlates of Featural and Spacing Processing for Face and Non-face Stimuli

The peculiar ability of humans to recognize hundreds of faces at a glance has been attributed to face-specific perceptual mechanisms known as holistic processing. Holistic processing includes the ability to discriminate individual facial features (i.e., featural processing) and their spatial relationships (i.e., spacing processing). Here, we aimed to characterize the spatio-temporal dynamics of featural- and spacing-processing of faces and objects. Nineteen healthy volunteers completed a newly created perceptual discrimination task for faces and objects (i.e., the "University of East London Face Task") while their brain activity was recorded with a high-density (128 electrodes) electroencephalogram. Our results showed that early event related potentials at around 100 ms post-stimulus onset (i.e., P100) are sensitive to both facial features and spacing between the features. Spacing and features discriminability for objects occurred at circa 200 ms post-stimulus onset (P200). These findings indicate the existence of neurophysiological correlates of spacing vs. features processing in both face and objects, and demonstrate faster brain processing for faces.

Is the Thatcher Illusion Modulated by Face Familiarity? Evidence from an Eye Tracking Study

Thompson (1980) first detected and described the Thatcher Illusion, where participants instantly perceive an upright face with inverted eyes and mouth as grotesque, but fail to do so when the same face is inverted. One prominent but controversial explanation is that the processing of configural information is disrupted in inverted faces. Studies investigating the Thatcher Illusion either used famous faces or non-famous faces. Highly familiar faces were often thought to be processed in a pronounced configural mode, so they seem ideal candidates to be tested in one Thatcher study against unfamiliar faces–but this has never been addressed so far. In our study, participants evaluated 16 famous and 16 non-famous faces for their grotesqueness. We tested whether familiarity (famous/non-famous faces) modulates reaction times, correctness of grotesqueness assessments (accuracy), and eye movement patterns for the factors orientation (upright/inverted) and Thatcherisation (Thatcherised/non-Thatcherised). On a behavioural level, familiarity effects were only observable via face inversion (higher accuracy and sensitivity for famous compared to non-famous faces) but not via Thatcherisation. Regarding eye movements, however, Thatcherisation influenced the scanning of famous and non-famous faces, for instance, in scanning the mouth region of the presented faces (higher number, duration and dwell time of fixations for famous compared to non-famous faces if Thatcherised). Altogether, famous faces seem to be processed in a more elaborate, more expertise-based way than non-famous faces, whereas non-famous, inverted faces seem to cause difficulties in accurate and sensitive processing. Results are further discussed in the face of existing studies of familiar vs. unfamiliar face processing.

Dissociating Attention Effects from Categorical Perception with ERP Functional Microstates

When faces appear in our visual environment we naturally attend to them, possibly to the detriment of other visual information. Evidence from behavioural studies suggests that faces capture attention because they are more salient than other types of visual stimuli, reflecting a category-dependent modulation of attention. By contrast, neuroimaging data has led to a domain-specific account of face perception that rules out the direct contribution of attention, suggesting a dedicated neural network for face perception. Here we sought to dissociate effects of attention from categorical perception using Event Related Potentials. Participants viewed physically matched face and butterfly images, with each category acting as a target stimulus during different blocks in an oddball paradigm. Using a data-driven approach based on functional microstates, we show that the locus of endogenous attention effects with ERPs occurs in the N1 time range. Earlier categorical effects were also found around the level of the P1, reflecting either an exogenous increase in attention towards face stimuli, or a putative face-selective measure. Both category and attention effects were dissociable from one another hinting at the role that faces may play in early capturing of attention before top-down control of attention is observed. Our data support the conclusion that certain object categories, in this experiment, faces, may capture attention before top-down voluntary control of attention is initiated.