Preferential orienting to faces in newborns: a temporal-nasal asymmetry

The development of upright face perception depends on evolved orientation-specific mechanisms and experience

Here we examine whether our impressive ability to perceive upright faces arises from evolved orientation-specific mechanisms, our extensive experience with upright faces, or both factors. To do so, we tested Claudio, a man with a congenital joint disorder causing his head to be rotated back so that it is positioned between his shoulder blades. As a result, Claudio has seen more faces reversed in orientation to his own face than matched to it. Controls exhibited large inversion effects on all tasks, but Claudio performed similarly with upright and inverted faces in both detection and identity-matching tasks, indicating these abilities are the product of evolved mechanisms and experience. In contrast, he showed clear upright superiority when detecting "Thatcherized" faces (faces with vertically flipped features), suggesting experience plays a greater role in this judgment. Together, these findings indicate that both evolved orientation-specific mechanisms and experience contribute to our proficiency with upright faces.

Intersensory redundancy impedes face recognition in 12-month-old infants

This study examined the role of intersensory redundancy on 12-month-old infants' attention to and processing of face stimuli. Two experiments were conducted. In Experiment 1, 72 12-month-olds were tested using an online platform called Lookit. Infants were familiarized with two videos of an actor reciting a children's story presented simultaneously. A soundtrack either matched one of the videos (experimental condition) or neither of the videos (control condition). Visual-paired comparison (VPC) trials were completed to measure looking preferences for the faces presented synchronously and asynchronously during familiarization and for novel faces. Neither group displayed looking preferences during the VPC trials. It is possible that the complexity of the familiarization phase made the modality-specific face properties (i.e., facial characteristics and configuration) difficult to process. In Experiment 2, 56 12-month-old infants were familiarized with the video of only one actor presented either synchronously or asynchronously with the soundtrack. Following familiarization, participants completed a VPC procedure including the familiar face and a novel face. Results from Experiment 2 showed that infants in the synchronous condition paid more attention during familiarization than infants in the asynchronous condition. Infants in the asynchronous condition demonstrated recognition of the familiar face. These findings suggest that the competing face stimuli in the Experiment 1 were too complex for the facial characteristics to be processed. The procedure in Experiment 2 led to increased processing of the face in the asynchronous presentation. These results indicate that intersensory redundancy in the presentation of synchronous audiovisual faces is very salient, discouraging the processing of modality-specific visual properties. This research contributes to the understanding of face processing in multimodal contexts, which have been understudied, although a great deal of naturalistic face exposure occurs multimodally.

Children perceive illusory faces in objects as male more often than female

Face pareidolia is the experience of seeing illusory faces in inanimate objects. While children experience face pareidolia, it is unknown whether they perceive gender in illusory faces, as their face evaluation system is still developing in the first decade of life. In a sample of 412 children and adults from 4 to 80 years of age we found that like adults, children perceived many illusory faces in objects to have a gender and had a strong bias to see them as male rather than female, regardless of their own gender identification. These results provide evidence that the male bias for face pareidolia emerges early in life, even before the ability to discriminate gender from facial cues alone is fully developed. Further, the existence of a male bias in children suggests that any social context that elicits the cognitive bias to see faces as male has remained relatively consistent across generations.

Overwhelmed by the man in the moon? Pareidolic objects provoke increased amygdala activation in autism

An interesting feature of the primate face detection system results in the perception of illusory faces in objects, or pareidolia. These illusory faces do not per se contain social information, such as eye-gaze or specific identities, yet they activate the cortical brain face-processing network, possibly via the subcortical route, including the amygdala. In autism spectrum disorder (ASD), aversion to eye-contact is commonly reported, and so are alterations in face processing more generally, yet the underlying reasons are not clear. Here we show that in autistic participants (N=37), but not in non-autistic controls (N=34), pareidolic objects increase amygdala activation bilaterally (right amygdala peak: X = 26, Y = -6, Z = -16; left amygdala peak X = -24, Y = -6, Z = -20). In addition, illusory faces engage the face-processing cortical network significantly more in ASD than in controls. An early imbalance in the excitatory and inhibitory systems in autism, affecting typical brain maturation, may be at the basis of an overresponsive reaction to face configuration and to eye contact. Our data add to the evidence of an oversensitive subcortical face processing system in ASD.

Face perception: computational insights from phylogeny

Studies of face perception in primates elucidate the psychological and neural mechanisms that support this critical and complex ability. Recent progress in characterizing face perception across species, for example in insects and reptiles, has highlighted the ubiquity over phylogeny of this key ability for social interactions and survival. Here, we review the competence in face perception across species and the types of computation that support this behavior. We conclude that the computational complexity of face perception evinced by a species is not related to phylogenetic status and is, instead, largely a product of environmental context and social and adaptive pressures. Integrating findings across evolutionary data permits the derivation of computational principles that shed further light on primate face perception.

Visual input to the left versus right eye yields differences in face preferences in 3-month-old infants

From birth, infants prefer looking at faces over scrambled faces. This face input is important for the development of face processing: individuals who experienced early visual deprivation due to congenital cataracts have long-lasting face processing deficits. Interestingly, the deficits are eye-specific such that left eye cataracts disrupt the development of face processing, whereas right eye cataracts do not. This raises the question of whether infant face preferences are driven primarily by faces observed through the left eye. To investigate this, we presented 3-month-old infants with intact faces paired with scrambled faces. Infants viewed the moving stimuli binocularly, only with their left eye, or only with their right eye. Infants viewing stimuli binocularly or with only the left eye spent significantly more time looking at intact faces than scrambled faces, but this effect was equivocal in infants viewing stimuli through only their right eye. Infants in the binocular group had the greatest preference for faces, and this preference was greater than the right eye group's preference for faces. The left eye group's preference for faces was not statistically different from the other two groups' preference for faces, but additional analyses revealed a correlation between preference for faces and age for the right eye group only, indicating that preference for faces seen with the right eye increase from 3 to 4 months of age. These results indicate that the left eye plays a special role in face processing at, or before 3 months of age, but a preference for faces through the right eye emerges soon after.

A transient time window for early predispositions in newborn chicks

Neonates of different species are born with a set of predispositions that influence their early orienting responses toward the first stimuli encountered in their life. Human neonates and domestic chicks exhibit several similarities in the predisposition for attending to objects that move with speed changes, face-like stimuli and biological motion. Although early predispositions are connected to physiological development, little is known on the temporal course of early predispositions (whether they are stable or change in time) and on the associated genetic variability. To address these issues, we tested the preference for objects that change in speed vs. linear motion in three chicken breeds (Padovana, Polverara and Robusta maculata) within one day after hatching and three days after hatching. We found that the predisposition to preferentially attend to changes in speed is shared by different breeds on the first day of life and that it disappears by day three. These results indicate the existence of a short and transient time window of early predispositions that does not depend on visual experience.

Methodological problems in a study of fetal visual perception

Reid et al.[1] analysed data from 39 third-trimester fetuses, concluding that they showed a preferential head-orienting reaction towards lights projected through the uterine wall in a face-like arrangement, as opposed to an inverted triangle of dots. These results imply not only that assessment of visual-perceptive responses is possible in prenatal subjects, but also that a measurable preference for faces exists before birth. However, we have identified three substantial problems with Reid et al.'s [1] method and analyses, which we outline here.

How Infants' Arousal Influences Their Visual Search

The influence of arousal on visual attention was examined in 6.5-month-old infants (N = 42) in the context of a visual search task. Phasic increases in arousal were induced with brief sounds and measured with pupil dilation. Evidence was found for an inverted U-shaped relation between pupil dilation amplitude and visual orienting, with highest likelihood of a target fixation at intermediate levels of arousal. Effects were similar for facial stimuli and simple objects. Together, these results contribute to our understanding of the relation between arousal and attention in infancy. The study also demonstrates that infants have a bias to orient to human eyes, even when presented in isolation.

Cortical route for facelike pattern processing in human newborns

Humans are endowed with an exceptional ability for detecting faces, a competence that, in adults, is supported by a set of face-specific cortical patches. Human newborns, already shortly after birth, preferentially orient to faces, even when they are presented in the form of highly schematic geometrical patterns vs. perceptually equivalent nonfacelike stimuli. The neural substrates underlying this early preference are still largely unexplored. Is the adult face-specific cortical circuit already active at birth, or does its specialization develop slowly as a function of experience and/or maturation? We measured EEG responses in 1- to 4-day-old awake, attentive human newborns to schematic facelike patterns and nonfacelike control stimuli, visually presented with slow oscillatory "peekaboo" dynamics (0.8 Hz) in a frequency-tagging design. Despite the limited duration of newborns' attention, reliable frequency-tagged responses could be estimated for each stimulus from the peak of the EEG power spectrum at the stimulation frequency. Upright facelike stimuli elicited a significantly stronger frequency-tagged response than inverted facelike controls in a large set of electrodes. Source reconstruction of the underlying cortical activity revealed the recruitment of a partially right-lateralized network comprising lateral occipitotemporal and medial parietal areas overlapping with the adult face-processing circuit. This result suggests that the cortical route specialized in face processing is already functional at birth.

Adults’ Markers of Face Processing Are Present at Age 6 and Are Interconnected Along Development

Recent studies on the development of face processing argue for a late, quantitative, domain-specific development of face processing, and face memory in particular. Most previous findings were based on separately tracking the developmental course of face perception skills, comparing performance across different age groups. Here, we adopted a different approach studying the mechanisms underlying the development of face processing by focusing on how different face skills are interrelated over the years (age 6 to adulthood). Specifically, we examined correlations within and between different categories of tasks: face domain-specific skills involving face recognition based on long-term representations (famous face), and short-term memory retention (Cambridge Face Memory Test), perceptual face-specific marker (inversion effect), global effects in scene perception (global–local task), and the perception of facial expressions. Factor analysis revealed that face identity skills have a similar pattern of interrelations throughout development, identifying two factors: a face domain-specific factor comprising adultlike markers of face processing and a general factor incorporating related, but nonspecific perceptual skills. Domain-specific age-related changes in face recognition entailing short- and long-term retention of face representations were observed, along with mature perceptual face-specific markers and more general perceptual effects predicting face perception skills already at age 6. The results suggest that the domain-specific changes in face processing are unlikely to result from developmental changes in perceptual skills driving face recognition. Instead, development may either involve improvement in the ability to retain face representations in memory or changes in the interactions between the perceptual representations of faces and their representations in long-term memory.

Neonatal Transitions in Social Behavior and Their Implications for Autism

Within the context of early infant-caregiver interaction, we review a series of pivotal transitions that occur within the first 6 months of typical infancy, with emphasis on behavior and brain mechanisms involved in preferential orientation towards, and interaction with, other people. Our goal in reviewing these transitions is to better understand how they may lay a necessary and/or sufficient groundwork for subsequent phases of development, and also to understand how the breakdown thereof, when development is atypical and those transitions become derailed, may instead yield disability. We review these developmental processes in light of recent studies documenting disruptions to early-emerging brain and behavior mechanisms in infants later diagnosed with autism spectrum disorder, shedding light on the brain-behavior pathogenesis of autism.

The Development of Attentional Biases for Faces in Infancy: A Developmental Systems Perspective

We present an integrative review of research and theory on major factors involved in the early development of attentional biases to faces. Research utilizing behavioral, eye-tracking, and neuroscience measures with infant participants as well as comparative research with animal subjects are reviewed. We begin with coverage of research demonstrating the presence of an attentional bias for faces shortly after birth, such as newborn infants' visual preference for face-like over non-face stimuli. The role of experience and the process of perceptual narrowing in face processing are examined as infants begin to demonstrate enhanced behavioral and neural responsiveness to mother over stranger, female over male, own- over other-race, and native over non-native faces. Next, we cover research on developmental change in infants' neural responsiveness to faces in multimodal contexts, such as audiovisual speech. We also explore the potential influence of arousal and attention on early perceptual preferences for faces. Lastly, the potential influence of the development of attention systems in the brain on social-cognitive processing is discussed. In conclusion, we interpret the findings under the framework of Developmental Systems Theory, emphasizing the combined and distributed influence of several factors, both internal (e.g., arousal, neural development) and external (e.g., early social experience) to the developing child, in the emergence of attentional biases that lead to enhanced responsiveness and processing of faces commonly encountered in the native environment.

Bumetanide for autism: more eye contact, less amygdala activation

We recently showed that constraining eye contact leads to exaggerated increase of amygdala activation in autism. Here, in a proof of concept pilot study, we demonstrate that administration of bumetanide (a NKCC1 chloride importer antagonist that restores GABAergic inhibition) normalizes the level of amygdala activation during constrained eye contact with dynamic emotional face stimuli in autism. In addition, eye-tracking data reveal that bumetanide administration increases the time spent in spontaneous eye gaze during in a free-viewing mode of the same face stimuli. In keeping with clinical trials, our data support the Excitatory/Inhibitory dysfunction hypothesis in autism, and indicate that bumetanide may improve specific aspects of social processing in autism. Future double-blind placebo controlled studies with larger cohorts of participants will help clarify the mechanisms of bumetanide action in autism.

Gaze-contingent reinforcement learning reveals incentive value of social signals in young children and adults

While numerous studies have demonstrated that infants and adults preferentially orient to social stimuli, it remains unclear as to what drives such preferential orienting. It has been suggested that the learned association between social cues and subsequent reward delivery might shape such social orienting. Using a novel, spontaneous indication of reinforcement learning (with the use of a gaze contingent reward-learning task), we investigated whether children and adults' orienting towards social and non-social visual cues can be elicited by the association between participants' visual attention and a rewarding outcome. Critically, we assessed whether the engaging nature of the social cues influences the process of reinforcement learning. Both children and adults learned to orient more often to the visual cues associated with reward delivery, demonstrating that cue–reward association reinforced visual orienting. More importantly, when the reward-predictive cue was social and engaging, both children and adults learned the cue–reward association faster and more efficiently than when the reward-predictive cue was social but non-engaging. These new findings indicate that social engaging cues have a positive incentive value. This could possibly be because they usually coincide with positive outcomes in real life, which could partly drive the development of social orienting.

ERP responses greater for faces in the temporal compared to the nasal visual field

The distribution of retino-tectal projections is dissimilar depending on whether the receptors are situated in the nasal and temporal visual hemiretinas. Indeed, it has been claimed that the superior colliculus receives a greater proportion of its input from the temporal visual hemifield (nasal hemi-retina) relative to the nasal hemifield (temporal hemi-retina). In order to investigate whether these subcortical projections influence face processing, we investigated the early cortical ERP responses to faces and houses presented in the temporal and nasal retinas using monocular viewing. Neutral or fearful faces were presented concurrently with houses on either side of a central fixation cross, while participants were asked to discriminate changes in luminance at the center. Results showed that the lateralized N170, computed as the contralateral-ipsilateral electrode difference, was greater for faces appearing in the nasal relative to the temporal visual hemifield. This was due to a greater ipsilateral N170 for temporal relative to nasal presentations. By contrast, no difference was found across emotional expressions. The enhanced ERP response to faces appearing in the temporal visual field, suggests that the retinotectal pathway modulates cortical processing, most likely through activation of a colliculo-pulvino-amygdalar pathway, with subsequent back-projections from the amygdala to visual cortical regions. However, unattended facial expressions do not seem to modulate the response, at least at these angles of eccentricity.

The Human Fetus Preferentially Engages with Face-like Visual Stimuli

In the third trimester of pregnancy, the human fetus has the capacity to process perceptual information [1-3]. With advances in 4D ultrasound technology, detailed assessment of fetal behavior [4] is now possible. Furthermore, modeling of intrauterine conditions has indicated a substantially greater luminance within the uterus than previously thought [5]. Consequently, light conveying perceptual content could be projected through the uterine wall and perceived by the fetus, dependent on how light interfaces with maternal tissue. We do know that human infants at birth show a preference to engage with a top-heavy, face-like stimulus when contrasted with all other forms of stimuli [6, 7]. However, the viability of performing such an experiment based on visual stimuli projected through the uterine wall with fetal participants is not currently known. We examined fetal head turns to visually presented upright and inverted face-like stimuli. Here we show that the fetus in the third trimester of pregnancy is more likely to engage with upright configural stimuli when contrasted to inverted visual stimuli, in a manner similar to results with newborn participants. The current study suggests that postnatal experience is not required for this preference. In addition, we describe a new method whereby it is possible to deliver specific visual stimuli to the fetus. This new technique provides an important new pathway for the assessment of prenatal visual perceptual capacities.

Naso-Temporal Asymmetries: Suppression of Emotional Faces in the Temporal Visual Hemifield

An ongoing debate exists regarding the possible existence of a retino-tectal visual pathway projecting to the amygdala, which would rapidly process information involving threatening or behaviorally-relevant stimuli. It has been suggested that this route might be responsible for the involuntary capture of attention by potentially dangerous stimuli. In separate studies, anatomical evidence has suggested that the retino-tectal pathway relies essentially on projections from the nasal hemiretina (temporal visual field). In this study, we chose to take advantage of this anatomical difference to further investigate whether emotional facial expressions are indeed processed through a subcortical pathway. Using EEG, participants performed a monocular spatial attention paradigm in which lateralized, task-irrelevant distractors were presented, followed by a target. The distractors were fearful faces that appeared either in nasal or temporal visual hemifield (by virtue of their monocular presentations), while the neutral face was presented simultaneously on the opposite side. Participants were asked to identify a target letter that appeared subsequently in the nasal or temporal visual hemifield. Event-related potentials (ERPs) results revealed that fearful faces appearing in the temporal visual hemifield produced a strong inhibitory response, while a negative deflection reflecting attentional capture followed presentations of fear in the nasal hemifield. These effects can be explained by a greater sensitivity of the subcortical pathway for emotional stimuli. Fearful faces conveyed through this route are processed more effectively, consequently necessitating more vigorous suppression in order for targets to be dealt with adequately.

Neural mechanisms of face perception, their emergence over development, and their breakdown

Face perception is probably the most developed visual perceptual skill in humans, most likely as a result of its unique evolutionary and social significance. Much recent research has converged to identify a host of relevant psychological mechanisms that support face recognition. In parallel, there has been substantial progress in uncovering the neural mechanisms that mediate rapid and accurate face perception, with specific emphasis on a broadly distributed neural circuit, comprised of multiple nodes whose joint activity supports face perception. This article focuses specifically on the neural underpinnings of face recognition, and reviews recent structural and functional imaging studies that elucidate the neural basis of this ability. In addition, the article covers some of the recent investigations that characterize the emergence of the neural basis of face recognition over the course of development, and explores the relationship between these changes and increasing behavioural competence. This paper also describes studies that characterize the nature of the breakdown of face recognition in individuals who are impaired in face recognition, either as a result of brain damage acquired at some point or as a result of the failure to master face recognition over the course of development. Finally, information regarding similarities between the neural circuits for face perception in humans and in nonhuman primates is briefly covered, as is the contribution of subcortical regions to face perception. WIREs Cogn Sci 2016, 7:247-263. doi: 10.1002/wcs.1388 For further resources related to this article, please visit the WIREs website.

The two-process theory of face processing: modifications based on two decades of data from infants and adults

Johnson and Morton (1991. Biology and Cognitive Development: The Case of Face Recognition. Blackwell, Oxford) used Gabriel Horn's work on the filial imprinting model to inspire a two-process theory of the development of face processing in humans. In this paper we review evidence accrued over the past two decades from infants and adults, and from other primates, that informs this two-process model. While work with newborns and infants has been broadly consistent with predictions from the model, further refinements and questions have been raised. With regard to adults, we discuss more recent evidence on the extension of the model to eye contact detection, and to subcortical face processing, reviewing functional imaging and patient studies. We conclude with discussion of outstanding caveats and future directions of research in this field.

Modeling the minimal newborn's intersubjective mind: the visuotopic-somatotopic alignment hypothesis in the superior colliculus

The question whether newborns possess inborn social skills is a long debate in developmental psychology. Fetal behavioral and anatomical observations show evidences for the control of eye movements and facial behaviors during the third trimester of pregnancy whereas specific sub-cortical areas, like the superior colliculus (SC) and the striatum appear to be functionally mature to support these behaviors. These observations suggest that the newborn is potentially mature for developing minimal social skills. In this manuscript, we propose that the mechanism of sensory alignment observed in SC is particularly important for enabling the social skills observed at birth such as facial preference and facial mimicry. In a computational simulation of the maturing superior colliculus connected to a simulated facial tissue of a fetus, we model how the incoming tactile information is used to direct visual attention toward faces. We suggest that the unisensory superficial visual layer (eye-centered) and the deep somatopic layer (face-centered) in SC are combined into an intermediate layer for visuo-tactile integration and that multimodal alignment in this third layer allows newborns to have a sensitivity to configuration of eyes and mouth. We show that the visual and tactile maps align through a Hebbian learning stage and and strengthen their synaptic links from each other into the intermediate layer. It results that the global network produces some emergent properties such as sensitivity toward the spatial configuration of face-like patterns and the detection of eyes and mouth movement.

Development of Recognition of Face Parts from Unfamiliar Faces

The present study examined developmental changes in the ability to recognize face parts. In Experiment 1, participants were familiarized with whole faces and given a recognition test with old and new eyes, noses, mouths, inner faces, outer faces, or whole faces. Adults were above chance in their recognition of the eye and mouth regions. However, children did not naturally encode and recognize face parts independently of the entire face. In addition, all age groups showed comparable inner and outer face recognition, except for 8- to 9-year-olds who showed a recognition advantage for outer faces. In Experiment 2, when participants were familiarized with eyes, noses, or mouths and tested with eyes, noses, or mouths, respectively, all ages showed above-chance recognition of eyes and mouths. Thirteen- to 14-year-olds were adult-like in their recognition of the eye region, but mouth recognition continued to develop beyond 14 years of age. Nose recognition was above chance among 13- to 14-year-olds, but recognition scores remained low even in adulthood. The present findings reveal unique developmental trajectories in the use of isolated facial regions in face recognition and suggest that featural cues (as a class) have a different ontogenetic course relative to holistic and configural cues.

Do young infants prefer an infant-directed face or a happy face?

Infants’ visual preference for infant-directed (ID) faces over adult-directed (AD) faces was examined in two experiments that introduced controls for emotion. Infants’ eye movements were recorded as they viewed a series of side-by-side dynamic faces. When emotion was held constant, 6-month-old infants showed no preference for ID faces over AD faces, but a second group of infants looked significantly longer at AD faces conveying happy emotion over sad ID faces conveying sad emotion. Together, these findings suggest that infants’ visual preference for ID faces is mediated, at least in part, by the presence of happy emotion. The relations between happy emotion and ID faces are discussed.

Is face recognition not so unique after all?

In monkeys, a number of different neocortical as well as limbic structures have cell populations that respond preferentially to face stimuli. Face selectivity is also differentiated within itself: Cells in the inferior temporal and prefrontal cortex tend to respond to facial identity, others in the upper bank of the superior temporal sulcus to gaze directions, and yet another population in the amygdala to facial expression. The great majority of these cells are sensitive to the entire configuration of a face. Changing the spatial arrangement of the facial features greatly diminishes the neurons' response. It would appear, then, that an entire neural network for faces exists which contains units highly selective to complex configurations and that respond to different aspects of the object "face." Given the vital importance of face recognition in primates, this may not come as a surprise. But are faces the only objects represented in this way? Behavioural work in humans suggests that nonface objects may be processed like faces if subjects are required to discriminate between visually similar exemplars and acquire sufficient expertise in doing so. Recent neuroimaging studies in humans indicate that level of categorisation and expertise interact to produce the specialisation for faces in the middle fusiform gyrus. Here we discuss some new evidence in the monkey suggesting that any arbitrary homogeneous class of artificial objects-which the animal has to individually learn, remember, and recognise again and again from among a large number of distractors sharing a number of common features with the target-can induce configurational selectivity in the response of neurons in the visual system. For all of the animals tested, the neurons from which we recorded were located in the anterior inferotemporal cortex. However, as we have only recorded from the posterior and anterior ventrolateral temporal lobe, other cells with a similar selectivity for the same objects may also exist in areas of the medial temporal lobe or in the limbic structures of the same "expert" monkeys. It seems that the encoding scheme used for faces may also be employed for other classes with similar properties. Thus, regarding their neural encoding, faces are not "special" but rather the "default special" class in the primate recognition system.

Cortical sensitivity to contrast polarity and orientation of faces is modulated by temporal-nasal hemifield asymmetry

Behavioral studies demonstrate that the efficiency of detection of faces is dependent on configural and contrast polarity information characteristic to human faces. Stimulus inversion or contrast polarity reversal can disrupt this process. We investigated whether a face-sensitive event-related potential component, the N170, is modulated by the orientation and contrast polarity of highly degraded schematic face-like patterns (Experiment 1) in the same manner as it is for face photographs (Experiment 2). Inversion and/or contrast reversal delayed and enhanced the N170 for both kinds of stimuli, suggesting that a white oval with three black squares is sufficient to elicit face-sensitive cortical responses. In Experiment 3 we further tested whether the extrageniculate visual pathways modulate early cortical responses to faces. We found that the N170 responses to configural and contrast information are modulated by temporal-nasal visual field asymmetry under monocular viewing conditions, suggesting the involvement of subcortical, extrageniculate visual pathways in face detection. These results are consistent with the idea that an ontogenetically early and primitive bias to orient towards face-like patterns with relevant configural and contrast information influences the early stages of cortical face processing.

Discrimination of facial expression by 5-month-old infants of nondepressed and clinically depressed mothers

Five-month-old infants of nondepressed and clinically depressed mothers were habituated to either a face with a neutral expression or the same face with a smile. Infants of nondepressed mothers subsequently discriminated between neutral and smiling facial expressions, whereas infants of clinically depressed mothers failed to make the same discrimination.

Neural bases of the non-conscious perception of emotional signals

Many emotional stimuli are processed without being consciously perceived. Recent evidence indicates that subcortical structures have a substantial role in this processing. These structures are part of a phylogenetically ancient pathway that has specific functional properties and that interacts with cortical processes. There is now increasing evidence that non-consciously perceived emotional stimuli induce distinct neurophysiological changes and influence behaviour towards the consciously perceived world. Understanding the neural bases of the non-conscious perception of emotional signals will clarify the phylogenetic continuity of emotion systems across species and the integration of cortical and subcortical activity in the human brain.

Early Visually Evoked Electrophysiological Responses Over the Human Brain (P1, N170) Show Stable Patterns of Face-Sensitivity from 4 years to Adulthood

Whether the development of face recognition abilities truly reflects changes in how faces, specifically, are perceived, or rather can be attributed to more general perceptual or cognitive development, is debated. Event-related potential (ERP) recordings on the scalp offer promise for this issue because they allow brain responses to complex visual stimuli to be relatively well isolated from other sensory, cognitive and motor processes. ERP studies in 5- to 16-year-old children report large age-related changes in amplitude, latency (decreases) and topographical distribution of the early visual components, the P1 and the occipito-temporal N170. To test the face specificity of these effects, we recorded high-density ERPs to pictures of faces, cars, and their phase-scrambled versions from 72 children between the ages of 4 and 17, and a group of adults. We found that none of the previously reported age-dependent changes in amplitude, latency or topography of the P1 or N170 were specific to faces. Most importantly, when we controlled for age-related variations of the P1, the N170 appeared remarkably similar in amplitude and topography across development, with much smaller age-related decreases in latencies than previously reported. At all ages the N170 showed equivalent face-sensitivity: it had the same topography and right hemisphere dominance, it was absent for meaningless (scrambled) stimuli, and larger and earlier for faces than cars. The data also illustrate the large amount of inter-individual and inter-trial variance in young children's data, which causes the N170 to merge with a later component, the N250, in grand-averaged data. Based on our observations, we suggest that the previously reported “bi-fid” N170 of young children is in fact the N250. Overall, our data indicate that the electrophysiological markers of face-sensitive perceptual processes are present from 4 years of age and do not appear to change throughout development.

Rapid orienting toward face-like stimuli with gaze-relevant contrast information

Human faces under natural illumination, and human eyes in their unique morphology, include specific contrast polarity relations that face-detection mechanisms could capitalise on. Newborns have been shown to preferentially orient to simple face-like patterns only when they contain face- or gaze-relevant contrast. We investigated whether human adults show similar preferential orienting towards schematic face-like stimuli, and whether this effect depends on the contrast polarity of the stimuli. In two experiments we demonstrate that upright schematic face-like patterns elicit faster eye movements in adult humans than inverted ones, and that this occurs only if they contain face- or gaze-relevant contrast information in the whole stimulus or in the eye region only. These results suggest that primitive mechanisms underlying the orienting bias towards faces and eyes influence and modulate social cognition not just in infants but in adults as well.

Mechanisms of face perception

Faces are among the most informative stimuli we ever perceive: Even a split-second glimpse of a person's face tells us his identity, sex, mood, age, race, and direction of attention. The specialness of face processing is acknowledged in the artificial vision community, where contests for face-recognition algorithms abound. Neurological evidence strongly implicates a dedicated machinery for face processing in the human brain to explain the double dissociability of face- and object-recognition deficits. Furthermore, recent evidence shows that macaques too have specialized neural machinery for processing faces. Here we propose a unifying hypothesis, deduced from computational, neurological, fMRI, and single-unit experiments: that what makes face processing special is that it is gated by an obligatory detection process. We clarify this idea in concrete algorithmic terms and show how it can explain a variety of phenomena associated with face processing.

Recognizing emotion from facial expressions: psychological and neurological mechanisms

Recognizing emotion from facial expressions draws on diverse psychological processes implemented in a large array of neural structures. Studies using evoked potentials, lesions, and functional imaging have begun to elucidate some of the mechanisms. Early perceptual processing of faces draws on cortices in occipital and temporal lobes that construct detailed representations from the configuration of facial features. Subsequent recognition requires a set of structures, including amygdala and orbitofrontal cortex, that links perceptual representations of the face to the generation of knowledge about the emotion signaled, a complex set of mechanisms using multiple strategies. Although recent studies have provided a wealth of detail regarding these mechanisms in the adult human brain, investigations are also being extended to nonhuman primates, to infants, and to patients with psychiatric disorders.

Backward masking: evidence of reduced subcortical amygdala engagement in autism

Recent data suggest that subthreshold presentation of emotional information is relayed to the amygdala along subcortical pathways. We examined the effect of backward masked neutral and anxious faces on the social decisions of a group of high functioning children with autism ages 7-13 years and matched controls. Participants were asked to select the friendliest of two faces, one of which was associated with the subthreshold (33 ms) presentation of an anxious face (A/N) and the other a subthreshold neutral face (N/N). Neutral paired faces were selected more often than A/N paired faces by both groups. However, children with autism selected significantly fewer N/N stimuli and more A/N stimuli than controls. These results suggest that the social choices of children with autism were influenced less by emotional information presented subconsciously and suggest a subcortical contribution to the social/emotional processing deficits observed in autism.

Featural and configural face processing in adults and infants: a behavioral and electrophysiological investigation

We sought to elucidate the behavioral and electrophysiological correlates of face processing, in adults and infants, by manipulating either the featural or configural information within the face. Two different experiments are reported. In these experiments, event-related potentials (ERPs) were recorded from the scalp while adult, 8-month-old, and 4-month-old participants completed configural-change and featural-change face tasks. The infants also completed a behavioral visual paired-comparison task with featural and configural face changes. ERP results reveal hemispheric differences in processing featural but not configural changes for the N170 in adults. Furthermore, featural and configural changes are processed differently within the right and left hemispheres. The right hemisphere N170 is significantly greater for configural compared to featural changes. The left hemisphere N170, however, exhibits the opposite effect. Infant data suggest that similar to adults, 8-month-old, but not 4-month-old participants, exhibit similar hemispheric differences between featural and configural changes for the P400 component. Behavioral results suggest increased sensitivity to both featural and configural face changes in 8-month-olds compared to 4-month-olds.

The perception of facial expressions in newborns

The ability of newborns to discriminate and respond to different emotional facial expressions remains controversial. We conducted three experiments in which we tested newborns’ preferences, and their ability to discriminate between neutral, fearful, and happy facial expressions, using visual preference and habituation procedures. In the first two experiments, no evidence was found that newborns discriminate, or show a preference between, a fearful and a neutral face. In the third experiment, newborns looked significantly longer at a happy facial expression than a fearful one. We raise the possibility that this preference reflects experience acquired over the first few days of life. These results show that at least some expressions are discriminated and preferred in newborns only a few days old.

Seeing the face through the eyes: a developmental perspective on face expertise

Most people are experts in face recognition. We propose that the special status of this particular body part in telling individuals apart is the result of a developmental process that heavily biases human infants and children to attend towards the eyes of others. We review the evidence supporting this proposal, including neuroimaging results and studies in developmental disorders, like autism. We propose that the most likely explanation of infants' bias towards eyes is the fact that eye gaze serves important communicative functions in humans.

Development of structure and function in the infant brain: implications for cognition, language and social behaviour

Recent advances in cognitive neuroscience have allowed us to begin investigating the development of both structure and function in the infant brain. However, despite the rapid evolution of technology, surprisingly few studies have examined the intersection between brain and behaviour over the first years of life. Even fewer have done so in the context of a particular research question. This paper aims to provide an overview of four domains that have been studied using techniques amenable to elucidating the brain/behaviour interface: language, face processing, object permanence, and joint attention, with particular emphasis on studies focusing on early development. The importance of the unique role of development and the interplay between structure and function is stressed throughout. It is hoped that this review will serve as a catalyst for further thinking about the substantial gaps in our understanding of the relationship between brain and behaviour across development. Further, our aim is to provide ideas about candidate brain areas that are likely to be implicated in particular behaviours or cognitive domains.

Subcortical face processing

Recent functional imaging, neuropsychological and electrophysiological studies on adults have provided evidence for a fast, low-spatial-frequency, subcortical face-detection pathway that modulates the responses of certain cortical areas to faces and other social stimuli. These findings shed light on an older literature on the face-detection abilities of newborn infants, and the hypothesis that these newborn looking preferences are generated by a subcortical route. Converging lines of evidence indicate that the subcortical face route provides a developmental foundation for what later becomes the adult cortical 'social brain' network, and that disturbances to this pathway might contribute to certain developmental disorders.

Newborns' preference for face-relevant stimuli: effects of contrast polarity

There is currently no agreement as to how specific or general are the mechanisms underlying newborns' face preferences. We address this issue by manipulating the contrast polarity of schematic and naturalistic face-related images and assessing the preferences of newborns. We find that for both schematic and naturalistic face images, the contrast polarity is important. Newborns did not show a preference for an upright face-related image unless it was composed of darker areas around the eyes and mouth. This result is consistent with either sensitivity to the shadowed areas of a face with overhead (natural) illumination and/or to the detection of eye contact.

Developmental deficits in social perception in autism: the role of the amygdala and fusiform face area

Autism is a severe developmental disorder marked by a triad of deficits, including impairments in reciprocal social interaction, delays in early language and communication, and the presence of restrictive, repetitive and stereotyped behaviors. In this review, it is argued that the search for the neurobiological bases of the autism spectrum disorders should focus on the social deficits, as they alone are specific to autism and they are likely to be most informative with respect to modeling the pathophysiology of the disorder. Many recent studies have documented the difficulties persons with an autism spectrum disorder have accurately perceiving facial identity and facial expressions. This behavioral literature on face perception abnormalities in autism is reviewed and integrated with the functional magnetic resonance imaging (fMRI) literature in this area, and a heuristic model of the pathophysiology of autism is presented. This model posits an early developmental failure in autism involving the amygdala, with a cascading influence on the development of cortical areas that mediate social perception in the visual domain, specifically the fusiform "face area" of the ventral temporal lobe. Moreover, there are now some provocative data to suggest that visual perceptual areas of the ventral temporal pathway are also involved in important ways in representations of the semantic attributes of people, social knowledge and social cognition. Social perception and social cognition are postulated as normally linked during development such that growth in social perceptual skills during childhood provides important scaffolding for social skill development. It is argued that the development of face perception and social cognitive skills are supported by the amygdala-fusiform system, and that deficits in this network are instrumental in causing autism.

Naso-temporal asymmetry of the N170 for processing faces in normal viewers but not in developmental prosopagnosia

Some elementary aspects of faces can be processed before cortical maturation or after lesion of primary visual cortex. Recent findings suggesting a role of an evolutionary ancient visual system in face processing have exploited the relative advantage of the temporal hemifield (nasal hemiretina). Here, we investigated whether under some circumstances face processing also shows a temporal hemifield advantage. We measured the face sensitive N170 to laterally presented faces viewed passively under monocular conditions and compared face recognition in the temporal and nasal hemiretina. A N170 response for upright faces was observed which was larger for projections to the nasal hemiretina/temporal hemifields. This pattern was not observed in a developmental prosopagnosic. These results point to the importance of the early stages of face processing for normal face recognition abilities and suggest a potentially important factor in the origins of developmental prosopagnosia.

Visual facial grasp

Some patients with degenerative neurological diseases have a release of the vestibular-ocular reflex (VOR), as detected by passive head movement during visual fixation on a moving target ("doll's eyes"maneuver). However, a positive doll's eyes sign might be induced by other defects and the purpose of this article is to describe a new ocular sign of cortical dysfunction, the visual facial grasp. We observed three patients, one with progressive supranuclear palsy (PSP), another with probable Alzheimer's disease (AD) and a third with cortico-basal degeneration (CBD) all of whom appeared to demonstrate a release of the vestibulo-ocular reflex (VOR) with passive head movements. Whereas the patient with PSP, who was unable to inhibit the VOR regardless of the visual target used probably had a true release of the VOR, the patients with AD and CBD were able to inhibit this reflex when the visual target was the examiner's moving face. These two patients also exhibited spontaneous preference for visual fixation on the examiner's face and improvement in smooth pursuit when the examiner's face was the visual target. This clinical observation suggests that the deficits in these two patients with AD and CBD were related to the emergence of a primitive stimulus-bound behavior, the visual facial grasp.