Direction of gaze effects on early face processing: eyes-only versus full faces

Psychophysiological responses to eye contact with a humanoid robot: Impact of perceived intentionality

Eye contact with a social robot has been shown to elicit similar psychophysiological responses to eye contact with another human. However, it is becoming increasingly clear that the attention- and affect-related psychophysiological responses differentiate between direct (toward the observer) and averted gaze mainly when viewing embodied faces that are capable of social interaction, whereas pictorial or pre-recorded stimuli have no such capability. It has been suggested that genuine eye contact, as indicated by the differential psychophysiological responses to direct and averted gaze, requires a feeling of being watched by another mind. Therefore, we measured event-related potentials (N170 and frontal P300) with EEG, facial electromyography, skin conductance, and heart rate deceleration responses to seeing a humanoid robot's direct versus averted gaze, while manipulating the impression of the robot's intentionality. The results showed that the N170 and the facial zygomatic responses were greater to direct than to averted gaze of the robot, and independent of the robot's intentionality, whereas the frontal P300 responses were more positive to direct than to averted gaze only when the robot appeared intentional. The study provides further evidence that the gaze behavior of a social robot elicits attentional and affective responses and adds that the robot's seemingly autonomous social behavior plays an important role in eliciting higher-level socio-cognitive processing.

Reputation Reminders: When do Eye Cues Promote Prosocial Behavior?

The watching eyes effect has gained significant attention in recent years both from scientists and from policy makers and professionals in the field. The phenomenon posits that the mere presence of eye cues can promote prosocial behavior. However, there is a growing debate about the generality of the effect across various measures and contexts. This review seeks to combine various distinct -and formerly isolated- perspectives by identifying four key components for effective interventions based on the watching eyes effect: Anonymity, crowdedness, costs, and exposure. Eye cues need to reduce perceived anonymity, be placed in non-crowded places, target low-cost prosocial acts and appear for a short amount of time. Next to these conditions, we discuss implications for other cues to reputation and recommend directions that will stimulate further research and applications in society.

Nudging the N170 forward with prior stimulation-Bridging the gap between N170 and recognition potential

Evoked response potentials are often divided up into numerous components, each with their own body of literature. But is there less variety than we might suppose? In this study, we nudge one component into looking like another. Both the N170 and recognition potential (RP) are N1 components in response to familiar objects. However, the RP is often measured with a forward mask that ends at stimulus onset whereas the N170 is often measured with no masking at all. This study investigates how inter‐stimulus interval (ISI) may delay and distort the N170 into an RP by manipulating the temporal gap (ISI) between forward mask and target. The results revealed reverse relationships between the ISI on the one hand, and the N170 latency, single‐trial N1 jitter (an approximation of N1 width) and reaction time on the other hand. Importantly, we find that scalp topographies have a unique signature at the N1 peak across all conditions, from the longest gap (N170) to the shortest (RP). These findings prove that the mask‐delayed N1 is still the same N170, even under conditions that are normally associated with a different component like the RP. In general, our results suggest greater synthesis in the study of event related potential components.

Eye Direction Detection and Perception as Premises of a Social Brain: A Narrative Review of Behavioral and Neural Data

The eyes and the gaze are important stimuli for social interaction in humans. Impaired recognition of facial identity, facial emotions, and inference of the intentions of others may result from difficulties in extracting information relevant to the eye region, mainly the direction of gaze. Therefore, a review of these data is of interest. Behavioral data demonstrating the importance of the eye region and how humans respond to gaze direction are reviewed narratively, and several theoretical models on how visual information on gaze is processed are discussed to propose a unified hypothesis. Several issues that have not yet been investigated are identified. The authors tentatively suggest experiments that might help progress research in this area. The neural aspects are subsequently reviewed to best describe the low-level and higher-level visual information processing stages in the targeted subcortical and cortical areas. A specific neural network is proposed on the basis of the literature. Various gray areas, such as the temporality of the processing of visual information, the question of salience priority, and the coordination between the two hemispheres, remain unclear and require further investigations. Finally, disordered gaze direction detection mechanisms and their consequences on social cognition and behavior are discussed as key deficiencies in several conditions, such as autism spectrum disorder, 22q11.2 deletion, schizophrenia, and social anxiety disorder. This narrative review provides significant additional data showing that the detection and perception of someone's gaze is an essential part of the development of our social brain.

I can see it in your eyes: Perceived gaze direction impacts ERP and behavioural measures of affective theory of mind

Looking at someone's eyes is thought to be important for affective theory of mind (aTOM), our ability to infer their emotional state. However, it is unknown whether an individual's gaze direction influences our aTOM judgements and what the time course of this influence might be. We presented participants with sentences describing individuals in positive, negative or neutral scenarios, followed by direct or averted gaze neutral face pictures of those individuals. Participants made aTOM judgements about each person's mental state, including their affective valence and arousal, and we investigated whether the face gaze direction impacted those judgements. Participants rated that gazers were feeling more positive when they displayed direct gaze as opposed to averted gaze, and that they were feeling more aroused during negative contexts when gaze was averted as opposed to direct. Event-related potentials associated with face perception and affective processing were examined using mass-univariate analyses to track the time-course of this eye-gaze and affective processing interaction at a neural level. Both positive and negative trials were differentiated from neutral trials at many stages of processing. This included the early N200 and EPN components, believed to reflect automatic emotion areas activation and attentional selection respectively. This also included the later P300 and LPP components, thought to reflect elaborative cognitive appraisal of emotional content. Critically, sentence valence and gaze direction interacted over these later components, which may reflect the incorporation of eye-gaze in the cognitive evaluation of another's emotional state. The results suggest that gaze perception directly impacts aTOM processes, and that altered eye-gaze processing in clinical populations may contribute to associated aTOM impairments.

Feeling through another's eyes: Perceived gaze direction impacts ERP and behavioural measures of positive and negative affective empathy

Looking at the eyes informs us about the thoughts and emotions of those around us, and impacts our own emotional state. However, it is unknown how perceiving direct and averted gaze impacts our ability to share the gazer's positive and negative emotions, abilities referred to as positive and negative affective empathy. We presented 44 participants with contextual sentences describing positive, negative and neutral events happening to other people (e.g. "Her newborn was saved/killed/fed yesterday afternoon."). These were designed to elicit positive, negative, or little to no empathy, and were followed by direct or averted gaze images of the individuals described. Participants rated their affective empathy for the individual and their own emotional valence on each trial. Event-related potentials time-locked to face-onset and associated with empathy and emotional processing were recorded to investigate whether they were modulated by gaze direction. Relative to averted gaze, direct gaze was associated with increased positive valence in the positive and neutral conditions and with increased positive empathy ratings. A similar pattern was found at the neural level, using robust mass-univariate statistics. The N100, thought to reflect an automatic activation of emotion areas, was modulated by gaze in the affective empathy conditions, with opposite effect directions in positive and negative conditions.. The P200, an ERP component sensitive to positive stimuli, was modulated by gaze direction only in the positive empathy condition. Positive and negative trials were processed similarly at the early N200 processing stage, but later diverged, with only negative trials modulating the EPN, P300 and LPP components. These results suggest that positive and negative affective empathy are associated with distinct time-courses, and that perceived gaze direction uniquely modulates positive empathy, highlighting the importance of studying empathy with face stimuli.

Comparing electrophysiological correlates of judgment of learning and feeling of knowing during face-name recognition

We investigated the event-related potential (ERP) correlates of two metacognitive judgments, namely judgment of learning (JOL) and feeling of knowing (FOK) induced by a face-name recognition (FNR) task in 60 participants. The FNR produced N170 and P100 components at posterior, and an N100 component at anterior electrodes. Posterior P200, anterior N200 components were recorded during JOL and FOK judgments. Our data showed that ERP correlates of JOL and FOK emerge as rapidly as 200 ms following stimulus presentation, and these two metacognitive judgments are based on both perceptual fluency and conflict processes. However, these ERP components affected by the degree of JOL and FOK judgments. Thus, we concluded that even though JOL and FOK judgments produced similar ERP wave forms temporal dynamics of these two judgments are different. Also, our results support the hypothesis that metacognitive judgments are linked to distributed neural substrates rather than strictly to frontal lobe function.

From eye to face: The impact of face outline, feature number, and feature saliency on the early neural response to faces

The LIFTED model of early face perception postulates that the face-sensitive N170 event-related potential may reflect underlying neural inhibition mechanisms which serve to regulate holistic and featural processing. It remains unclear, however, what specific factors impact these neural inhibition processes. Here, N170 peak responses were recorded whilst adults maintained fixation on a single eye using a gaze-contingent paradigm, and the presence/absence of a face outline, as well as the number and type of parafoveal features within the outline, were manipulated. N170 amplitudes and latencies were reduced when a single eye was fixated within a face outline compared to fixation on the same eye in isolation, demonstrating that the simple presence of a face outline is sufficient to elicit a shift towards a more face-like neural response. A monotonic decrease in the N170 amplitude and latency was observed with increasing numbers of parafoveal features, and the type of feature(s) present in parafovea further modulated this early face response. These results support the idea of neural inhibition exerted by parafoveal features onto the foveated feature as a function of the number, and possibly the nature, of parafoveal features. Specifically, the results suggest the use of a feature saliency framework (eyes > mouth > nose) at the neural level, such that the parafoveal eye may play a role in down-regulating the response to the other eye (in fovea) more so than the nose or the mouth. These results confirm the importance of parafoveal features and the face outline in the neural inhibition mechanism, and provide further support for a feature saliency mechanism guiding early face perception.

Perceived Gaze Direction Differentially Affects Discrimination of Facial Emotion, Attention, and Gender - An ERP Study

The perception of eye-gaze is thought to be a key component of our everyday social interactions. While the neural correlates of direct and averted gaze processing have been investigated, there is little consensus about how these gaze directions may be processed differently as a function of the task being performed. In a within-subject design, we examined how perception of direct and averted gaze affected performance on tasks requiring participants to use directly available facial cues to infer the individuals' emotional state (emotion discrimination), direction of attention (attention discrimination) and gender (gender discrimination). Neural activity was recorded throughout the three tasks using EEG, and ERPs time-locked to face onset were analyzed. Participants were most accurate at discriminating emotions with direct gaze faces, but most accurate at discriminating attention with averted gaze faces, while gender discrimination was not affected by gaze direction. At the neural level, direct and averted gaze elicited different patterns of activation depending on the task over frontal sites, from approximately 220-290 ms. More positive amplitudes were seen for direct than averted gaze in the emotion discrimination task. In contrast, more positive amplitudes were seen for averted gaze than for direct gaze in the gender discrimination task. These findings are among the first direct evidence that perceived gaze direction modulates neural activity differently depending on task demands, and that at the behavioral level, specific gaze directions functionally overlap with emotion and attention discrimination, precursors to more elaborated theory of mind processes.

The influence of top-down modulation on the processing of direct gaze

Gaze or eye contact is one of the most important nonverbal social cues, which is fundamental to human social interactions. To achieve real time and dynamic face-to-face communication, our brain needs to process another person's gaze direction rapidly and without explicit instruction. In order to explain the fast and spontaneous processing of direct gaze, the fast-track modulator model was proposed. Here, we review recent developments in gaze processing research in the last decade to extend the fast-track modulator model. In particular, we propose that task demand or top-down modulation could play a more crucial role at gaze processing than formerly assumed. We suggest that under different task demands, top-down modulation can facilitate or interfere with the direct gaze effects for early visual processing. The proposed modification of the model extends the role of task demand and its implication on the direct gaze effect, as well as the need to better control for top-down processing in order to better disentangle the role of top-down and bottom-up processing on the direct gaze effect. This article is categorized under: Cognitive Biology > Evolutionary Roots of Cognition Psychology > Perception and Psychophysics Neuroscience > Cognition.

One versus two eyes makes a difference! Early face perception is modulated by featural fixation and feature context

The N170 event-related potential component is an early marker of face perception that is particularly sensitive to isolated eye regions and to eye fixations within a face. Here, this eye sensitivity was tested further by measuring the N170 to isolated facial features and to the same features fixated within a face, using a gaze-contingent procedure. The neural response to single isolated eyes and eye regions (two eyes) was also compared. Pixel intensity and contrast were controlled at the global (image) and local (featural) levels. Consistent with previous findings, larger N170 amplitudes were elicited when the left or right eye was fixated within a face, compared to the mouth or nose, demonstrating that the N170 eye sensitivity reflects higher-order perceptual processes and not merely low-level perceptual effects. The N170 was also largest and most delayed for isolated features, compared to equivalent fixations within a face. Specifically, mouth fixation yielded the largest amplitude difference, and nose fixation yielded the largest latency difference between these two contexts, suggesting the N170 may reflect a complex interplay between holistic and featural processes. Critically, eye regions elicited consistently larger and shorter N170 responses compared to single eyes, with enhanced responses for contralateral eye content, irrespective of eye or nasion fixation. These results confirm the importance of the eyes in early face perception, and provide novel evidence of an increased sensitivity to the presence of two symmetric eyes compared to only one eye, consistent with a neural eye region detector rather than an eye detector per se.

Early and late cortical responses to directly gazing faces are task dependent

Gender categorisation of human faces is facilitated when gaze is directed toward the observer (i.e., a direct gaze), compared with situations where gaze is averted or the eyes are closed (Macrae, Hood, Milne, Rowe, & Mason, Psychological Science, 13(5), 460-464, 2002). However, the temporal dynamics underlying this phenomenon remain to some extent unknown. Here, we used electroencephalography (EEG) to assess the neural correlates of this effect, focusing on the event-related potential (ERP) components known to be sensitive to gaze perception (i.e., P1, N170, and P3b). We first replicated the seminal findings of Macrae et al. (2002, Experiment 1) regarding facilitated gender discrimination, and subsequently measured the underlying neural responses. Our data revealed an early preferential processing of direct gaze as compared with averted gaze and closed eyes at the P1, which reverberated at the P3b (Experiment 2). Critically, using the same material, we failed to reproduce these effects when gender categorisation was not required (Experiment 3). Taken together, our data confirm that direct gaze enhances the early P1, as well as later cortical responses to face processing, although the effect appears to be task dependent.

Spatiotemporal commonalities of fronto-parietal activation in attentional orienting triggered by supraliminal and subliminal gaze cues: An event-related potential study

Eye gaze triggers attentional shifts with and without conscious awareness. It remains unclear whether the spatiotemporal patterns of electric neural activity are the same for conscious and unconscious attentional shifts. Thus, the present study recorded event-related potentials (ERPs) and evaluated the neural activation involved in attentional orienting induced by subliminal and supraliminal gaze cues. Nonpredictive gaze cues were presented in the central field of vision, and participants were asked to detect a subsequent peripheral target. The mean reaction time was shorter for congruent gaze cues than for incongruent gaze cues under both presentation conditions, indicating that both types of cues reliably trigger attentional orienting. The ERP analysis revealed that averted versus straight gaze induced greater negative deflection in the bilateral fronto-central and temporal regions between 278 and 344 ms under both supraliminal and subliminal presentation conditions. Supraliminal cues, irrespective of gaze direction, induced a greater negative amplitude than did subliminal cues at the right posterior cortices at a peak of approximately 170 ms and in the 200-300 ms. These results suggest that similar spatial and temporal fronto-parietal activity is involved in attentional orienting triggered by both supraliminal and subliminal gaze cues, although inputs from different visual processing routes (cortical and subcortical regions) may trigger activity in the attentional network.

Is having similar eye movement patterns during face learning and recognition beneficial for recognition performance? Evidence from hidden Markov modeling

The hidden Markov model (HMM)-based approach for eye movement analysis is able to reflect individual differences in both spatial and temporal aspects of eye movements. Here we used this approach to understand the relationship between eye movements during face learning and recognition, and its association with recognition performance. We discovered holistic (i.e., mainly looking at the face center) and analytic (i.e., specifically looking at the two eyes in addition to the face center) patterns during both learning and recognition. Although for both learning and recognition, participants who adopted analytic patterns had better recognition performance than those with holistic patterns, a significant positive correlation between the likelihood of participants' patterns being classified as analytic and their recognition performance was only observed during recognition. Significantly more participants adopted holistic patterns during learning than recognition. Interestingly, about 40% of the participants used different patterns between learning and recognition, and among them 90% switched their patterns from holistic at learning to analytic at recognition. In contrast to the scan path theory, which posits that eye movements during learning have to be recapitulated during recognition for the recognition to be successful, participants who used the same or different patterns during learning and recognition did not differ in recognition performance. The similarity between their learning and recognition eye movement patterns also did not correlate with their recognition performance. These findings suggested that perceptuomotor memory elicited by eye movement patterns during learning does not play an important role in recognition. In contrast, the retrieval of diagnostic information for recognition, such as the eyes for face recognition, is a better predictor for recognition performance.

Early Left Parietal Activity Elicited by Direct Gaze: A High-Density EEG Study

Gaze is one of the most important cues for human communication and social interaction. In particular, gaze contact is the most primary form of social contact and it is thought to capture attention. A very early-differentiated brain response to direct versus averted gaze has been hypothesized. Here, we used high-density electroencephalography to test this hypothesis. Topographical analysis allowed us to uncover a very early topographic modulation (40-80 ms) of event-related responses to faces with direct as compared to averted gaze. This modulation was obtained only in the condition where intact broadband faces-as opposed to high-pass or low-pas filtered faces-were presented. Source estimation indicated that this early modulation involved the posterior parietal region, encompassing the left precuneus and inferior parietal lobule. This supports the idea that it reflected an early orienting response to direct versus averted gaze. Accordingly, in a follow-up behavioural experiment, we found faster response times to the direct gaze than to the averted gaze broadband faces. In addition, classical evoked potential analysis showed that the N170 peak amplitude was larger for averted gaze than for direct gaze. Taken together, these results suggest that direct gaze may be detected at a very early processing stage, involving a parallel route to the ventral occipito-temporal route of face perceptual analysis.

Rapid gamma oscillations in the inferior occipital gyrus in response to eyes

Eyes are an indispensable communication medium for human social interactions. Although previous neuroscientific evidence suggests the activation of the inferior occipital gyrus (IOG) during eye processing, the temporal profile of this activation remains unclear. To investigate this issue, we analyzed intracranial electroencephalograms of the IOG during the presentation of eyes and mosaics, in either averted or straight directions. Time–frequency statistical parametric mapping analyses revealed greater gamma-band activation in the right IOG beginning at 114 ms in response to eyes relative to mosaics, irrespective of their averted or straight direction. These results suggest that gamma oscillations in the right IOG are involved in the early stages of eye processing, such as eye detection.

Representational Dynamics of Facial Viewpoint Encoding

Faces provide a wealth of information, including the identity of the seen person and social cues, such as the direction of gaze. Crucially, different aspects of face processing require distinct forms of information encoding. Another person's attentional focus can be derived based on a view-dependent code. In contrast, identification benefits from invariance across all viewpoints. Different cortical areas have been suggested to subserve these distinct functions. However, little is known about the temporal aspects of differential viewpoint encoding in the human brain. Here, we combine EEG with multivariate data analyses to resolve the dynamics of face processing with high temporal resolution. This revealed a distinct sequence of viewpoint encoding. Head orientations were encoded first, starting after around 60 msec of processing. Shortly afterward, peaking around 115 msec after stimulus onset, a different encoding scheme emerged. At this latency, mirror-symmetric viewing angles elicited highly similar cortical responses. Finally, about 280 msec after visual onset, EEG response patterns demonstrated a considerable degree of viewpoint invariance across all viewpoints tested, with the noteworthy exception of the front-facing view. Taken together, our results indicate that the processing of facial viewpoints follows a temporal sequence of encoding schemes, potentially mirroring different levels of computational complexity.

Direct gaze facilitates rapid orienting to faces: Evidence from express saccades and saccadic potentials

•

We investigated the role of direct gaze for rapid orienting to faces.

•

Faster express saccades towards faces occurred only when faces were with direct gaze.

•

Saccade-locked ERPs discriminated between gaze directions from the saccade onset.

Direct gaze is a crucial signal in human social communication, which is known to attract visual attention and modulate a wide range of behaviours. The present study investigated whether direct gaze facilitates rapid orienting to faces, which is important for adaptive on-line communication, and its neural correlates. Fifteen participants performed a rapid orienting task, in which they were instructed to saccade to peripherally presented buildings or faces containing direct or averted gaze as quickly as possible. Electroencephalographic recordings were made during the task. Shorter express saccade latencies were found for faces with direct gaze, compared to averted gaze or buildings, while no significant difference was found between faces with averted gaze and buildings. Furthermore, saccade-locked event-related potential (ERP) amplitudes in parieto-occipital areas discriminated faces with direct gaze from buildings and faces with averted gaze corroborating behavioural results. These results show that detection of direct gaze facilitates rapid orienting to faces.

Eyes Wide Open

Research from evolutionary psychology suggests that the mere presence of eye images can promote prosocial behavior. However, the “eye images effect” is a source of considerable debate, and findings across studies have yielded somewhat inconsistent support. We suggest that one critical factor may be whether the eyes really need to be watching to effectively enhance prosocial behavior. In three experiments, we investigated the impact of eye images on prosocial behavior, assessed in a laboratory setting. Participants were randomly assigned to view an image of watching eyes (eyes with direct gaze), an image of nonwatching eyes (i.e., eyes closed for Study 1 and averted eyes for Studies 2 and 3), or an image of flowers (control condition). Upon exposure to the stimuli, participants decided whether or not to help another participant by completing a dull cognitive task. Three independent studies produced somewhat mixed results. However, combined analysis of all three studies, with a total of 612 participants, showed that the watching component of the eyes is important for decision-making in this context. Images of watching eyes led to significantly greater inclination to offer help as compared to images of nonwatching eyes (i.e., eyes closed and averted eyes) or images of flowers. These findings suggest that eyes gazing at an individual, rather than any proxy to social presence (e.g., just the eyes), serve as a reminder of reputation. Taken together, we conclude that it is “eyes that pay attention” that can lift the veil of anonymity and potentially facilitate prosocial behavior.

Social decisions affect neural activity to perceived dynamic gaze

Gaze direction, a cue of both social and spatial attention, is known to modulate early neural responses to faces e.g. N170. However, findings in the literature have been inconsistent, likely reflecting differences in stimulus characteristics and task requirements. Here, we investigated the effect of task on neural responses to dynamic gaze changes: away and toward transitions (resulting or not in eye contact). Subjects performed, in random order, social (away/toward them) and non-social (left/right) judgment tasks on these stimuli. Overall, in the non-social task, results showed a larger N170 to gaze aversion than gaze motion toward the observer. In the social task, however, this difference was no longer present in the right hemisphere, likely reflecting an enhanced N170 to gaze motion toward the observer. Our behavioral and event-related potential data indicate that performing social judgments enhances saliency of gaze motion toward the observer, even those that did not result in gaze contact. These data and that of previous studies suggest two modes of processing visual information: a 'default mode' that may focus on spatial information; a 'socially aware mode' that might be activated when subjects are required to make social judgments. The exact mechanism that allows switching from one mode to the other remains to be clarified.

Developmental precursors of social brain networks: the emergence of attentional and cortical sensitivity to facial expressions in 5 to 7 months old infants

Biases in attention towards facial cues during infancy may have an important role in the development of social brain networks. The current study used a longitudinal design to examine the stability of infants' attentional biases towards facial expressions and to elucidate how these biases relate to emerging cortical sensitivity to facial expressions. Event-related potential (ERP) and attention disengagement data were acquired in response to the presentation of fearful, happy, neutral, and phase-scrambled face stimuli from the same infants at 5 and 7 months of age. The tendency to disengage from faces was highly consistent across both ages. However, the modulation of this behavior by fearful facial expressions was uncorrelated between 5 and 7 months. In the ERP data, fear-sensitive activity was observed over posterior scalp regions, starting at the latency of the N290 wave. The scalp distribution of this sensitivity to fear in ERPs was dissociable from the topography of face-sensitive modulation within the same latency range. While attentional bias scores were independent of co-registered ERPs, attention bias towards fearful faces at 5 months of age predicted the fear-sensitivity in ERPs at 7 months of age. The current results suggest that the attention bias towards fear could be involved in the developmental tuning of cortical networks for social signals of emotion.

Early sensitivity for eyes within faces: a new neuronal account of holistic and featural processing

Eyes are central to face processing however their role in early face encoding as reflected by the N170 ERP component is unclear. Using eye tracking to enforce fixation on specific facial features, we found that the N170 was larger for fixation on the eyes compared to fixation on the forehead, nasion, nose or mouth, which all yielded similar amplitudes. This eye sensitivity was seen in both upright and inverted faces and was lost in eyeless faces, demonstrating it was due to the presence of eyes at fovea. Upright eyeless faces elicited largest N170 at nose fixation. Importantly, the N170 face inversion effect (FIE) was strongly attenuated in eyeless faces when fixation was on the eyes but was less attenuated for nose fixation and was normal when fixation was on the mouth. These results suggest the impact of eye removal on the N170 FIE is a function of the angular distance between the fixated feature and the eye location. We propose the Lateral Inhibition, Face Template and Eye Detector based (LIFTED) model which accounts for all the present N170 results including the FIE and its interaction with eye removal. Although eyes elicit the largest N170 response, reflecting the activity of an eye detector, the processing of upright faces is holistic and entails an inhibitory mechanism from neurons coding parafoveal information onto neurons coding foveal information. The LIFTED model provides a neuronal account of holistic and featural processing involved in upright and inverted faces and offers precise predictions for further testing.

Children's neural response to contrast-negated faces is species specific

Face recognition abilities develop dramatically during the first year of life, but comparatively little is known about the nature of face-specific perceptual development during early childhood. Face-specific effects of image appearance on recognition, including face inversion and contrast negation, are a useful means of understanding the functional properties of face perception developmentally. Here, we examined the generality of the impact of contrast negation on face perception during early childhood using event-related potentials (ERPs). Specifically, we recorded continuous electroencephalography (EEG) while adult participants and children between 4 and 6 years of age viewed human and non-human primate faces presented in either positive or negative contrast. We examined both the P100 and N170 components to determine whether or not sensitivity to contrast polarity was evident in face-sensitive components during early childhood and also whether or not that sensitivity was specific to species category. We found evidence of a species-specific effect of contrast negation at the N170, suggesting that by early childhood some aspects of face-specific processing have been restricted to a relatively narrow class of face stimuli. However, this effect is of the opposite sign relative to adults, suggesting that there is continued maturation of face-specific processing during childhood.

Neural activity in the posterior superior temporal region during eye contact perception correlates with autistic traits

The present study investigated the relationship between neural activity associated with gaze processing and autistic traits in typically developed subjects using magnetoencephalography. Autistic traits in 24 typically developed college students with normal intelligence were assessed using the Autism Spectrum Quotient (AQ). The Minimum Current Estimates method was applied to estimate the cortical sources of magnetic responses to gaze stimuli. These stimuli consisted of apparent motion of the eyes, displaying direct or averted gaze motion. Results revealed gaze-related brain activations in the 150-250 ms time window in the right posterior superior temporal sulcus (pSTS), and in the 150-450 ms time window in medial prefrontal regions. In addition, the mean amplitude in the 150-250 ms time window in the right pSTS region was modulated by gaze direction, and its activity in response to direct gaze stimuli correlated with AQ score. pSTS activation in response to direct gaze is thought to be related to higher-order social processes. Thus, these results suggest that brain activity linking eye contact and social signals is associated with autistic traits in a typical population.

The role of the eyes in processing an intact face and its scrambled image: a dense array ERP and low-resolution electromagnetic tomography (sLORETA) study

The aim of the present study was to test whether the eyes of an intact face produced a specific brain response compared to the mouth, nose, or hair and whether their specificity was also maintained in a scrambled face. Fifteen subjects were asked to focus visual attention on global and single elements in intact faces and in their scrambled image. EEG data were recorded from 256-Hydrocel Geodesic Sensor-Net200. Event-related potentials (ERPs) analyses showed a difference between the intact face and the scrambled face from N170 component until 600 ms on the occipito-temporal montage and at 400-600 ms on the frontal montage. Only the eyes showed a difference between conditions (intact/scrambled face) at 500 ms. The most activated source detected by sLORETA was the right middle temporal gyrus (BA21) for both conditions and for all elements. Left BA21 resulted in significantly more activation in response to eyes in the intact face compared to the eyes in the scrambled face at 500 ms. The left BA21 has a central role in high-level visual processing and in understanding others' intentions. These findings suggest a specificity of the eyes and indicate that the eyes play the social and communicative role of comprehending the nonverbal intentions of others only when inserted in an intact face.

Neural competition as a developmental process: early hemispheric specialization for word processing delays specialization for face processing

Little is known about the impact of learning to read on early neural development for word processing and its collateral effects on neural development in non-word domains. Here, we examined the effect of early exposure to reading on neural responses to both word and face processing in preschool children with the use of the Event Related Potential (ERP) methodology. We specifically linked children's reading experience (indexed by their sight vocabulary) to two major neural markers: the amplitude differences between the left and right N170 on the bilateral posterior scalp sites and the hemispheric spectrum power differences in the γ band on the same scalp sites. The results showed that the left-lateralization of both the word N170 and the spectrum power in the γ band were significantly positively related to vocabulary. In contrast, vocabulary and the word left-lateralization both had a strong negative direct effect on the face right-lateralization. Also, vocabulary negatively correlated with the right-lateralized face spectrum power in the γ band even after the effects of age and the word spectrum power were partialled out. The present study provides direct evidence regarding the role of reading experience in the neural specialization of word and face processing above and beyond the effect of maturation. The present findings taken together suggest that the neural development of visual word processing competes with that of face processing before the process of neural specialization has been consolidated.

Neurophysiological responses to faces and gaze direction differentiate children with ASD, ADHD and ASD+ADHD

Children with autism spectrum disorder (ASD) and attention deficit hyperactivity disorder (ADHD) demonstrate face processing abnormalities that may underlie social impairment. Despite substantial overlap between ASD and ADHD, ERP markers of face and gaze processing have not been directly compared across pure and comorbid cases. Children with ASD (n=19), ADHD (n=18), comorbid ASD+ADHD (n=29) and typically developing (TD) controls (n=26) were presented with upright/inverted faces with direct/averted gaze, with concurrent recording of the P1 and N170 components. While the N170 was predominant in the right hemisphere in TD and ADHD, children with ASD (ASD/ASD+ADHD) showed a bilateral distribution. In addition, children with ASD demonstrated altered response to gaze direction on P1 latency and no sensitivity to gaze direction on midline-N170 amplitude compared to TD and ADHD. In contrast, children with ADHD (ADHD/ASD+ADHD) exhibited a reduced face inversion effect on P1 latency compared to TD and ASD. These findings suggest children with ASD have specific abnormalities in gaze processing and altered neural specialisation, whereas children with ADHD show abnormalities at early visual attention stages. Children with ASD+ADHD are an additive co-occurrence with deficits of both disorders. Elucidating the neural basis of the overlap between ASD and ADHD is likely to inform aetiological investigation and clinical assessment.

Aesthetic appreciation: event-related field and time-frequency analyses

Improvements in neuroimaging methods have afforded significant advances in our knowledge of the cognitive and neural foundations of aesthetic appreciation. We used magnetoencephalography (MEG) to register brain activity while participants decided about the beauty of visual stimuli. The data were analyzed with event-related field (ERF) and Time-Frequency (TF) procedures. ERFs revealed no significant differences between brain activity related with stimuli rated as “beautiful” and “not beautiful.” TF analysis showed clear differences between both conditions 400 ms after stimulus onset. Oscillatory power was greater for stimuli rated as “beautiful” than those regarded as “not beautiful” in the four frequency bands (theta, alpha, beta, and gamma). These results are interpreted in the frame of synchronization studies.

Atypical disengagement from faces and its modulation by the control of eye fixation in children with autism spectrum disorder

By using the gap overlap task, we investigated disengagement from faces and objects in children (9-17 years old) with and without autism spectrum disorder (ASD) and its neurophysiological correlates. In typically developing (TD) children, faces elicited larger gap effect, an index of attentional engagement, and larger saccade-related event-related potentials (ERPs), compared to objects. In children with ASD, by contrast, neither gap effect nor ERPs differ between faces and objects. Follow-up experiments demonstrated that instructed fixation on the eyes induces larger gap effect for faces in children with ASD, whereas instructed fixation on the mouth can disrupt larger gap effect in TD children. These results suggest a critical role of eye fixation on attentional engagement to faces in both groups.

The role of eyes in early face processing: a rapid adaptation study of the inversion effect

The current study employed a rapid adaptation procedure to test the neuronal mechanisms of the face inversion effect (FIE) on the early face-sensitive event-related potential (ERP) component N170. Five categories of face-related stimuli (isolated eyes, isolated mouths, eyeless faces, mouthless faces, and full faces) and houses were presented in upright and inverted orientations as adaptors for inverted full face test stimuli. Strong adaptation was found for all face-related stimuli except mouths. The adaptation effect was larger for inverted than upright stimuli, but only when eyes were present. These results underline an important role of eyes in early face processing. A mechanism of eye-dependent orientation sensitivity during the structural encoding stage of faces is proposed.

Early processing of emotional faces in children with autism: An event-related potential study

Social deficits are one of the most striking manifestations of autism spectrum disorders (ASDs). Among these social deficits, the recognition and understanding of emotional facial expressions has been widely reported to be affected in ASDs. We investigated emotional face processing in children with and without autism using event-related potentials (ERPs). High-functioning children with autism (n=15, mean age=10.5±3.3 years) completed an implicit emotional task while visual ERPs were recorded. Two groups of typically developing children (chronological age-matched and verbal equivalent age-matched [both ns=15, mean age=7.7±3.8 years]) also participated in this study. The early ERP responses to faces (P1 and N170) were delayed, and the P1 was smaller in children with autism than in typically developing children of the same chronological age, revealing that the first stages of emotional face processing are affected in autism. However, when matched by verbal equivalent age, only P1 amplitude remained affected in autism. Our results suggest that the emotional and facial processing difficulties in autism could start from atypicalities in visual perceptual processes involving rapid feedback to primary visual areas and subsequent holistic processing.

Modulation of face processing by emotional expression and gaze direction during intracranial recordings in right fusiform cortex

We recorded intracranial local field potentials from structurally intact human visual cortex during several face processing tasks in a patient before brain surgery. Intracranial local field potentials were measured from subdural electrodes implanted in a right fusiform region with face-sensitive activity and a more medial location in posterior parahippocampal gyrus with house-selective activity. This electrode implantation allowed us to compare neural responses with different facial properties within two adjacent but functionally distinct cortical regions. Five experiments were conducted to determine the temporal dynamics of perceptual (Experiments 1 and 5), emotional (Experiments 2 and 3), and social (Experiment 4) effects on face-specific responses in the right fusiform. Our findings showed an early negative deflection (N200) that primarily reflected category-selective perceptual encoding of facial information, whereas higher order effects of face individuation, emotional expression, and gaze direction produced selective modulations in the same face-specific region during a later time period (from 200 to 1000 msec after onset). These results shed new lights on the time course of face recognition mechanisms in human visual cortex and reveal for the first time anatomically overlapping but temporally distinct influences of identity or emotional/social factors on face processing in right fusiform gyrus, which presumably reflect top-down feedback effects from distant brain areas.

Species sensitivity of early face and eye processing

Humans are better at recognizing human faces than faces of other species. However, it is unclear whether this species sensitivity can be seen at early perceptual stages of face processing and whether it involves species sensitivity for important facial features like the eyes. These questions were addressed by comparing the modulations of the N170 ERP component to faces, eyes and eyeless faces of humans, apes, cats and dogs, presented upright and inverted. Although all faces and isolated eyes yielded larger responses than the control object category (houses), the N170 was shorter and smaller to human than animal faces and larger to human than animal eyes. Most importantly, while the classic inversion effect was found for human faces, animal faces yielded no inversion effect or an opposite inversion effect, as seen for objects, suggesting a different neural process involved for humans faces compared to faces of other species. Thus, in addition to its general face and eye categorical sensitivity, the N170 appears particularly sensitive to the human species for both faces and eyes. The results are discussed in the context of a recent model of the N170 response involving face and eye sensitive neurons (Itier et al., 2007) where the eyes play a central role in face perception. The data support the intuitive idea that eyes are what make animal head fronts look face-like and that proficiency for the human species involves visual expertise for the human eyes.

Does it make a difference if I have an eye contact with you or with your picture? An ERP study

Several recent studies have begun to examine the neurocognitive mechanisms involved in perceiving and responding to eye contact, a salient social signal of interest and readiness for interaction. Laboratory experiments measuring observers' responses to pictorial instead of live eye gaze cues may, however, only vaguely approximate the real-life affective significance of gaze direction cues. To take this into account, we measured event-related brain potentials and subjective affective responses in healthy adults while viewing live faces with a neutral expression through an electronic shutter and faces as pictures on a computer screen. Direct gaze elicited greater face-sensitive N170 amplitudes and early posterior negativity potentials than averted gaze or closed eyes, but only in the live condition. The results show that early-stage processing of facial information is enhanced by another person's direct gaze when the person is faced live. We propose that seeing a live face with a direct gaze is processed more intensely than a face with averted gaze or closed eyes, as the direct gaze is capable of intensifying the feeling of being the target of the other's interest and intentions. These results may have implications for the use of pictorial stimuli in the social cognition studies.

Neural bases of eye and gaze processing: the core of social cognition

Eyes and gaze are very important stimuli for human social interactions. Recent studies suggest that impairments in recognizing face identity, facial emotions or in inferring attention and intentions of others could be linked to difficulties in extracting the relevant information from the eye region including gaze direction. In this review, we address the central role of eyes and gaze in social cognition. We start with behavioral data demonstrating the importance of the eye region and the impact of gaze on the most significant aspects of face processing. We review neuropsychological cases and data from various imaging techniques such as fMRI/PET and ERP/MEG, in an attempt to best describe the spatio-temporal networks underlying these processes. The existence of a neuronal eye detector mechanism is discussed as well as the links between eye gaze and social cognition impairments in autism. We suggest impairments in processing eyes and gaze may represent a core deficiency in several other brain pathologies and may be central to abnormal social cognition.

Face and gaze processing in Prader-Willi syndrome

A number of developmental disorders of genetic origin show atypical aspects of face processing. However, little is known about face processing in Prader-Willi syndrome (PWS). PWS is of specific interest because it has two modes of inheritance (paternally derived deletion, DEL; maternal uniparental disomy, UPD) only one of which (UPD) is associated with an increased risk of autistic symptomology. We conducted electrophysiological (ERP) and behavioural measurements of face and eye-gaze processing in individuals with PWS derived from both modes of inheritance. Our hypothesis that UPD PWS would show a pattern of deficits resembling those seen in autism was only partially confirmed. Although some individuals from both groups showed deficits, as a whole the UPD group (N=8) and the DEL group (N=8) did not differ on behavioural measures of face processing or autistic symptoms. In contrast, the effect of face orientation and gaze direction on the amplitude of the N170 ERP component differed between the two PWS sub-types. Thus, while the behavioural tests did not discriminate between the UPD and deletion forms of the syndrome, electrophysiological measures of face processing did differentiate the groups.