The face inversion effect is not a consequence of aberrant eye movements

Eye movement differences when recognising and learning moving and static faces

Seeing a face in motion can help subsequent face recognition. Several explanations have been proposed for this "motion advantage," but other factors that might play a role have received less attention. For example, facial movement might enhance recognition by attracting attention to the internal facial features, thereby facilitating identification. However, there is no direct evidence that motion increases attention to regions of the face that facilitate identification (i.e., internal features) compared with static faces. We tested this hypothesis by recording participants' eye movements while they completed the famous face recognition (Experiment 1, N = 32), and face-learning (Experiment 2, N = 60, Experiment 3, N = 68) tasks, with presentation style manipulated (moving or static). Across all three experiments, a motion advantage was found, and participants directed a higher proportion of fixations to the internal features (i.e., eyes, nose, and mouth) of moving faces versus static. Conversely, the proportion of fixations to the internal non-feature area (i.e., cheeks, forehead, chin) and external area (Experiment 3) was significantly reduced for moving compared with static faces (all ps < .05). Results suggest that during both familiar and unfamiliar face recognition, facial motion is associated with increased attention to internal facial features, but only during familiar face recognition is the magnitude of the motion advantage significantly related functionally to the proportion of fixations directed to the internal features.

A perceptual field test in object experts using gaze-contingent eye tracking

A hallmark of expert object recognition is rapid and accurate subordinate-category recognition of visually homogenous objects. However, the perceptual strategies by which expert recognition is achieved is less known. The current study investigated whether visual expertise changes observers' perceptual field (e.g., their ability to use information away from fixation for recognition) for objects in their domain of expertise, using a gaze-contingent eye-tracking paradigm. In the current study, bird experts and novices were presented with two bird images sequentially, and their task was to determine whether the two images were of the same species (e.g., two different song sparrows) or different species (e.g., song sparrow and chipping sparrow). The first study bird image was presented in full view. The second test bird image was presented fully visible (full-view), restricted to a circular window centered on gaze position (central-view), or restricted to image regions beyond a circular mask centered on gaze position (peripheral-view). While experts and novices did not differ in their eye-movement behavior, experts' performance on the discrimination task for the fastest responses was less impaired than novices in the peripheral-view condition. Thus, the experts used peripheral information to a greater extent than novices, indicating that the experts have a wider perceptual field to support their speeded subordinate recognition.

The face inversion effect or the face upright effect?

The face inversion effect (FIE) refers to the observation that presenting stimuli upside-down impairs the processing of faces disproportionally more than other mono-oriented objects. This has been taken as evidence that processing of faces and objects differ qualitatively. However, nearly all FIE studies are based on comparing individuation of upright faces, which most people are rather good at, with individuation of objects most people are much less familiar with individuating (e.g., radios and airplanes). Consequently, the FIE may mainly reflect differences between categories in how they are processed prior to inversion, with within-category discrimination of upright faces being a much more familiar task than within-category discrimination among members belonging to other object classes. We tested this hypothesis by comparing inversion effects for faces and objects using object recognition tasks that do not require within-category discrimination (object decision and old/new recognition memory tasks). In all tasks (seven with objects and two with faces) we find credible inversion effects, but in no instance were these effects significantly larger for faces than for objects. This suggests that the FIE can be a product of familiarity with the type of identification process required in the upright conditions rather than some process that is selectively affected for faces when stimuli are inverted.

How We Perceive Others Resembling Us

Eye contact is essential for social cognition, acting as an important tool for social communication. While differences in face scanning patterns concerning familiarity have been thoroughly investigated, the impact of facial similarity on gaze behavior has not been examined yet. We addressed this topic by recording subjects' eye-directed gazing while looking at faces that were individually created systematically varying in terms of similarity to the self-face and familiarity. Subjects' self-faces were morphed into three other faces including a close friend of the same sex. Afterwards, they rated similarity to their self-face of those morphed face stimuli in a separate rating task. Our results show a general preference for the eyes' area as well as differences regarding fixation patterns depending on similarity to the self-face. The lower the similarity to the self-face, the more fixations on the eyes' area. Subjects' ratings followed a linear line, indicating well-pronounced face perception. Nevertheless, other faces were rated faster than the self-face independent of familiarity, while morphed faces got the slowest ratings. Our results mirror the importance of similarity to the self-face as a factor shaping the way we look at the eyes of others explaining variance apart from familiarity.

How does gaze to faces support face-to-face interaction? A review and perspective

Gaze-where one looks, how long, and when-plays an essential part in human social behavior. While many aspects of social gaze have been reviewed, there is no comprehensive review or theoretical framework that describes how gaze to faces supports face-to-face interaction. In this review, I address the following questions: (1) When does gaze need to be allocated to a particular region of a face in order to provide the relevant information for successful interaction; (2) How do humans look at other people, and faces in particular, regardless of whether gaze needs to be directed at a particular region to acquire the relevant visual information; (3) How does gaze support the regulation of interaction? The work reviewed spans psychophysical research, observational research, and eye-tracking research in both lab-based and interactive contexts. Based on the literature overview, I sketch a framework for future research based on dynamic systems theory. The framework holds that gaze should be investigated in relation to sub-states of the interaction, encompassing sub-states of the interactors, the content of the interaction as well as the interactive context. The relevant sub-states for understanding gaze in interaction vary over different timescales from microgenesis to ontogenesis and phylogenesis. The framework has important implications for vision science, psychopathology, developmental science, and social robotics.

Non-invasive Eye Tracking Methods for New World and Old World Monkeys

Eye-tracking methods measure what humans and other animals visually attend to in the environment. In nonhuman primates, eye tracking can be used to test hypotheses about how primates process social information. This information can further our understanding of primate behavior as well as offer unique translational potential to explore causes of or treatments for altered social processing as seen in people with neurodevelopmental disorders such as autism spectrum disorder and schizophrenia. However, previous methods for collecting eye-tracking data in nonhuman primates required some form of head restraint, which limits the opportunities for research with respect to the number of or kinds of primates that can undergo an eye-tracking study. We developed a novel, noninvasive method for collecting eye tracking data that can be used both in animals that are difficult to restrain without sedation as well as animals that are of different ages and sizes as the box size can be adjusted. Using a transport box modified with a viewing window, we collected eye-tracking data in both New (Callicebus cupreus) and Old World monkeys (Macaca mulatta) across multiple developmental time points. These monkeys had the option to move around the box and avert their eyes from the screen, yet, they demonstrated a natural interest in viewing species-specific imagery with no previous habituation to the eye-tracking paradigm. Provided with opportunistic data from voluntary viewing of stimuli, we found that juveniles viewed stimuli more than other age groups, videos were viewed more than static photo imagery, and that monkeys increased their viewing time when presented with multiple eye tracking sessions. This noninvasive approach opens new opportunities to integrate eye-tracking studies into nonhuman primate research.

Task-driven visual exploration at the foveal scale

Humans use saccades to inspect objects of interest with the foveola, the small region of the retina with highest acuity. This process of visual exploration is normally studied over large scenes. However, in everyday tasks, the stimulus within the foveola is complex, and the need for visual exploration may extend to this smaller scale. We have previously shown that fixational eye movements, in particular microsaccades, play an important role in fine spatial vision. Here, we investigate whether task-driven visual exploration occurs during the fixation pauses in between large saccades. Observers judged the expression of faces covering approximately 1°, as if viewed from a distance of many meters. We use a custom system for accurately localizing the line of sight and continually track gaze position at high resolution. Our findings reveal that active spatial exploration, a process driven by the goals of the task, takes place at the foveal scale. The scanning strategies used at this scale resemble those used when examining larger scenes, with idiosyncrasies maintained across spatial scales. These findings suggest that the visual system possesses not only a coarser priority map of the extrafoveal space to guide saccades, but also a finer-grained priority map that is used to guide microsaccades once the region of interest is foveated.

Shape representation modulating the effect of motion on visual search performance

The effect of motion on visual search has been extensively investigated, but that of uniform linear motion of display on search performance for tasks with different target-distractor shape representations has been rarely explored. The present study conducted three visual search experiments. In Experiments 1 and 2, participants finished two search tasks that differed in target-distractor shape representations under static and dynamic conditions. Two tasks with clear and blurred stimuli were performed in Experiment 3. The experiments revealed that target-distractor shape representation modulated the effect of motion on visual search performance. For tasks with low target-distractor shape similarity, motion negatively affected search performance, which was consistent with previous studies. However, for tasks with high target-distractor shape similarity, if the target differed from distractors in that a gap with a linear contour was added to the target, and the corresponding part of distractors had a curved contour, motion positively influenced search performance. Motion blur contributed to the performance enhancement under dynamic conditions. The findings are useful for understanding the influence of target-distractor shape representation on dynamic visual search performance when display had uniform linear motion.

Is the Thatcher Illusion Modulated by Face Familiarity? Evidence from an Eye Tracking Study

Thompson (1980) first detected and described the Thatcher Illusion, where participants instantly perceive an upright face with inverted eyes and mouth as grotesque, but fail to do so when the same face is inverted. One prominent but controversial explanation is that the processing of configural information is disrupted in inverted faces. Studies investigating the Thatcher Illusion either used famous faces or non-famous faces. Highly familiar faces were often thought to be processed in a pronounced configural mode, so they seem ideal candidates to be tested in one Thatcher study against unfamiliar faces–but this has never been addressed so far. In our study, participants evaluated 16 famous and 16 non-famous faces for their grotesqueness. We tested whether familiarity (famous/non-famous faces) modulates reaction times, correctness of grotesqueness assessments (accuracy), and eye movement patterns for the factors orientation (upright/inverted) and Thatcherisation (Thatcherised/non-Thatcherised). On a behavioural level, familiarity effects were only observable via face inversion (higher accuracy and sensitivity for famous compared to non-famous faces) but not via Thatcherisation. Regarding eye movements, however, Thatcherisation influenced the scanning of famous and non-famous faces, for instance, in scanning the mouth region of the presented faces (higher number, duration and dwell time of fixations for famous compared to non-famous faces if Thatcherised). Altogether, famous faces seem to be processed in a more elaborate, more expertise-based way than non-famous faces, whereas non-famous, inverted faces seem to cause difficulties in accurate and sensitive processing. Results are further discussed in the face of existing studies of familiar vs. unfamiliar face processing.

Super-Memorizers Are Not Super-Recognizers

Humans have a natural expertise in recognizing faces. However, the nature of the interaction between this critical visual biological skill and memory is yet unclear. Here, we had the unique opportunity to test two individuals who have had exceptional success in the World Memory Championships, including several world records in face-name association memory. We designed a range of face processing tasks to determine whether superior/expert face memory skills are associated with distinctive perceptual strategies for processing faces. Superior memorizers excelled at tasks involving associative face-name learning. Nevertheless, they were as impaired as controls in tasks probing the efficiency of the face system: face inversion and the other-race effect. Super memorizers did not show increased hippocampal volumes, and exhibited optimal generic eye movement strategies when they performed complex multi-item face-name associations. Our data show that the visual computations of the face system are not malleable and are robust to acquired expertise involving extensive training of associative memory.

Modulations of eye movement patterns by spatial filtering during the learning and testing phases of an old/new face recognition task

In two experiments, we examined the effects of varying the spatial frequency (SF) content of face images on eye movements during the learning and testing phases of an old/new recognition task. At both learning and testing, participants were presented with face stimuli band-pass filtered to 11 different SF bands, as well as an unfiltered baseline condition. We found that eye movements varied significantly as a function of SF. Specifically, the frequency of transitions between facial features showed a band-pass pattern, with more transitions for middle-band faces (≈5-20 cycles/face) than for low-band (≈<5 cpf) or high-band (≈>20 cpf) ones. These findings were similar for the learning and testing phases. The distributions of transitions across facial features were similar for the middle-band, high-band, and unfiltered faces, showing a concentration on the eyes and mouth; conversely, low-band faces elicited mostly transitions involving the nose and nasion. The eye movement patterns elicited by low, middle, and high bands are similar to those previous researchers have suggested reflect holistic, configural, and featural processing, respectively. More generally, our results are compatible with the hypotheses that eye movements are functional, and that the visual system makes flexible use of visuospatial information in face processing. Finally, our finding that only middle spatial frequencies yielded the same number and distribution of fixations as unfiltered faces adds more evidence to the idea that these frequencies are especially important for face recognition, and reveals a possible mediator for the superior performance that they elicit.

Faces in the eye of the beholder: unique and stable eye scanning patterns of individual observers

Eye scanning patterns while viewing pictures have provided valuable information in many domains of visual cognition. Such patterns are determined by the type of image viewed (e.g., faces, scenes) as well as the task individuals are asked to perform (e.g., visual search, memory). Here we show that another key factor that significantly influences eye scanning patterns but has been mostly overlooked is the individual observer. During face viewing, we found that individuals showed diverse scanning patterns that, in many cases, were inconsistent with the typical triangular shape pattern that is commonly observed when eye scanning patterns are averaged across individuals. These idiosyncratic eye scanning patterns were not random but highly stable even when examined 18 months later. Interestingly, these eye-tracking patterns were not predictive of behavioral performance. Such stable and unique scanning patterns may represent a specific behavioral trait/signature and be formed early in development, reflecting idiosyncratic strategies for performing visual recognition tasks.

The role of inner and outer face parts in holistic processing: a developmental study

The effects of inner-outer feature interactions with unfamiliar faces were investigated in 6- and 10-year-old children and adults (20-30 years) to determine their contribution in holistic face vision. Participants completed a two-alternative forced-choice (2AFC) task under two conditions. The congruent condition used whole, inner-only, and outer-only stimuli. The incongruent condition used stimuli combining the inner features from one face with outer features from a novel face, or vice versa. Results yielded strong congruency effects which were moderated by pronounced feature-type asymmetries specific to developmental stage. Adults showed an inner-feature preference during congruent trials, but no asymmetry for incongruent trials. Children showed no asymmetry for congruent trials, but an outer-feature preference for incongruent trials. These findings concur with recent theoretical developments indicating that adults and children are likely to differ in the types of feature-specific information they preferentially encode in face perception, and that holistic effects are moderated differently in adults and children as a function of feature type.

Configural processing in body posture recognition: an eye-tracking study

The body inversion effect is the finding that inverted body posture pictures are more difficult to recognize than upright body posture pictures are. The present study reinvestigated the body inversion effect in human observers using behavioral and eye movement measures to explore whether the body inversion effect correlates with specific eye movement features. Results showed that body postures elicited a robust and stable body inversion effect in reaction time throughout the experimental sessions. Eye-tracking data showed that the body inversion effect was robust only in the first fixation duration, but not in the second fixation duration. The analysis of the regions of interest showed that most fixations were located in the upper body for both the upright and the inverted body postures. Compared with inverted body postures, the upright postures led to a shorter reaction time and a shorter first fixation duration, but a larger portion of time to fixate on the head region, suggesting that participants tended to use head as a reference point to process upright body postures. For both the behavioral and the eye movement measures, the body inversion effect was robust for biomechanically possible body postures. However, for biomechanically impossible body postures (with angular manipulation of two joints), the effect was mixed. Although the error rate failed to show the body inversion effect, the reaction time measure and most eye movement measures, however, showed a body inversion effect. Overall, these results suggested that upright body postures are processed in expertise recognition and are processed configurally by human observers.

The Muslim headscarf and face perception: "they all look the same, don't they?"

The headscarf conceals hair and other external features of a head (such as the ears). It therefore may have implications for the way in which such faces are perceived. Images of faces with hair (H) or alternatively, covered by a headscarf (HS) were used in three experiments. In Experiment 1 participants saw both H and HS faces in a yes/no recognition task in which the external features either remained the same between learning and test (Same) or switched (Switch). Performance was similar for H and HS faces in both the Same and Switch condition, but in the Switch condition it dropped substantially compared to the Same condition. This implies that the mere presence of the headscarf does not reduce performance, rather, the change between the type of external feature (hair or headscarf) causes the drop in performance. In Experiment 2, which used eye-tracking methodology, it was found that almost all fixations were to internal regions, and that there was no difference in the proportion of fixations to external features between the Same and Switch conditions, implying that the headscarf influenced processing by virtue of extrafoveal viewing. In Experiment 3, similarity ratings of the internal features of pairs of HS faces were higher than pairs of H faces, confirming that the internal and external features of a face are perceived as a whole rather than as separate components.

Young children's difficulty in disregarding information from external features when matching unfamiliar faces

Three experiments were conducted to examine developmental differences in reliance on internal (i.e., eyes, nose, mouth, and cheeks) or external (i.e., hairstyle) facial features between young children and adults when matching two unfamiliar faces. Participants viewed two facial images and were asked to decide whether the images showed the identical person or two different people. Four different types of stimuli were presented: two incongruent stimuli, in which the two images showed either the same internal face (i.e., same person) with different hairstyles or two different internal faces (i.e., different people) with the same hairstyle, and two congruent stimuli, in which the two images showed either the same face and hairstyle or two different faces and hairstyles. We found that children were more likely to base their responses on external hairstyles for the incongruent stimuli, unlike adults (Experiment 1), even when they were instructed to attend to internal features (Experiment 2). Eye movement data showed that both children and adults spent the most time gazing on the internal features and gave little attention to the external hairstyle, and children attended to each part of the internal features as long as, or even longer than, adults (Experiment 3). Children's response based on external hairstyles was due to their inability to disregard external information and was not attributed to their tendency to attend more frequently to external parts rather than internal parts.

Optimal eye-gaze fixation position for face-related neural responses

It is generally agreed that some features of a face, namely the eyes, are more salient than others as indexed by behavioral diagnosticity, gaze-fixation patterns and evoked-neural responses. However, because previous studies used unnatural stimuli, there is no evidence so far that the early encoding of a whole face in the human brain is based on the eyes or other facial features. To address this issue, scalp electroencephalogram (EEG) and eye gaze-fixations were recorded simultaneously in a gaze-contingent paradigm while observers viewed faces. We found that the N170 indexing the earliest face-sensitive response in the human brain was the largest when the fixation position is located around the nasion. Interestingly, for inverted faces, this optimal fixation position was more variable, but mainly clustered in the upper part of the visual field (around the mouth). These observations extend the findings of recent behavioral studies, suggesting that the early encoding of a face, as indexed by the N170, is not driven by the eyes per se, but rather arises from a general perceptual setting (upper-visual field advantage) coupled with the alignment of a face stimulus to a stored face template.

Individual differences in eye movements during face identification reflect observer-specific optimal points of fixation

In general, humans tend to first look just below the eyes when identifying another person. Does everybody look at the same place on a face during identification, and, if not, does this variability in fixation behavior lead to functional consequences? In two conditions, observers had their free eye movements recorded while they performed a face-identification task. In another condition, the same observers identified faces while their gaze was restricted to specific locations on each face. We found substantial differences, which persisted over time, in where individuals chose to first move their eyes. Observers' systematic departure from a canonical, theoretically optimal fixation point did not correlate with performance degradation. Instead, each individual's looking preference corresponded to an idiosyncratic performance-maximizing point of fixation: Those who looked lower on the face performed better when forced to fixate the lower part of the face. The results suggest an observer-specific synergy between the face-recognition and eye movement systems that optimizes face-identification performance.

Mapping Face Recognition Information Use across Cultures

Face recognition is not rooted in a universal eye movement information-gathering strategy. Western observers favor a local facial feature sampling strategy, whereas Eastern observers prefer sampling face information from a global, central fixation strategy. Yet, the precise qualitative (the diagnostic) and quantitative (the amount) information underlying these cultural perceptual biases in face recognition remains undetermined. To this end, we monitored the eye movements of Western and Eastern observers during a face recognition task, with a novel gaze-contingent technique: the Expanding Spotlight. We used 2° Gaussian apertures centered on the observers' fixations expanding dynamically at a rate of 1° every 25 ms at each fixation - the longer the fixation duration, the larger the aperture size. Identity-specific face information was only displayed within the Gaussian aperture; outside the aperture, an average face template was displayed to facilitate saccade planning. Thus, the Expanding Spotlight simultaneously maps out the facial information span at each fixation location. Data obtained with the Expanding Spotlight technique confirmed that Westerners extract more information from the eye region, whereas Easterners extract more information from the nose region. Interestingly, this quantitative difference was paired with a qualitative disparity. Retinal filters based on spatial-frequency decomposition built from the fixations maps revealed that Westerners used local high-spatial-frequency information sampling, covering all the features critical for effective face recognition (the eyes and the mouth). In contrast, Easterners achieved a similar result by using global low-spatial-frequency information from those facial features. Our data show that the face system flexibly engages into local or global eye movement strategies across cultures, by relying on distinct facial information span and culturally tuned spatially filtered information. Overall, our findings challenge the view of a unique putative process for face recognition.

First fixations in face processing: the more diagnostic they are the smaller the face-inversion effect

Hills, Ross, and Lewis (2011) introduced the concept that the face-inversion effect may, in part, be carried by the first feature attended to, since the first feature fixated upon is different for upright and inverted faces. An eye-tracking study that directly assesses this hypothesis by using fixation crosses to guide attention to the eye or mouth region of the to-be-presented upright and inverted faces was devised. Recognition was better when the fixation cross appeared at the eye region than at the mouth region. The face-inversion effect was smaller when the eyes were cued than when the mouth was cued or when there was no cueing. The eye-tracking measures confirmed that the fixation crosses attracted the first fixation but did not affect other measures of eye-movements. Furthermore, the location of the first fixation predicted recognition accuracy: when the first fixation was to the eyes, recognition accuracy was higher than when the first fixation was to the mouth, irrespective of facial orientation. The results suggest that the first facial feature attended to is more predictive of recognition accuracy than the face orientation in which they are presented.

The Gender Typicality of Faces and Its Impact on Visual Processing and on Hiring Decisions

Past research has shown that the gender typicality of applicants’ faces affects leadership selection irrespective of a candidate’s gender: A masculine facial appearance is congruent with masculine-typed leadership roles, thus masculine-looking applicants are hired more certainly than feminine-looking ones. In the present study, we extended this line of research by investigating hiring decisions for both masculine- and feminine-typed professional roles. Furthermore, we used eye tracking to examine the visual exploration of applicants’ portraits. Our results indicate that masculine-looking applicants were favored for the masculine-typed role (leader) and feminine-looking applicants for the feminine-typed role (team member). Eye movement patterns showed that information about gender category and facial appearance was integrated during first fixations of the portraits. Hiring decisions, however, were not based on this initial analysis, but occurred at a second stage, when the portrait was viewed in the context of considering the applicant for a specific job.

Looking just below the eyes is optimal across face recognition tasks

When viewing a human face, people often look toward the eyes. Maintaining good eye contact carries significant social value and allows for the extraction of information about gaze direction. When identifying faces, humans also look toward the eyes, but it is unclear whether this behavior is solely a byproduct of the socially important eye movement behavior or whether it has functional importance in basic perceptual tasks. Here, we propose that gaze behavior while determining a person's identity, emotional state, or gender can be explained as an adaptive brain strategy to learn eye movement plans that optimize performance in these evolutionarily important perceptual tasks. We show that humans move their eyes to locations that maximize perceptual performance determining the identity, gender, and emotional state of a face. These optimal fixation points, which differ moderately across tasks, are predicted correctly by a Bayesian ideal observer that integrates information optimally across the face but is constrained by the decrease in resolution and sensitivity from the fovea toward the visual periphery (foveated ideal observer). Neither a model that disregards the foveated nature of the visual system and makes fixations on the local region with maximal information, nor a model that makes center-of-gravity fixations correctly predict human eye movements. Extension of the foveated ideal observer framework to a large database of real-world faces shows that the optimality of these strategies generalizes across the population. These results suggest that the human visual system optimizes face recognition performance through guidance of eye movements not only toward but, more precisely, just below the eyes.

Start position strongly influences fixation patterns during face processing: difficulties with eye movements as a measure of information use

Fixation patterns are thought to reflect cognitive processing and, thus, index the most informative stimulus features for task performance. During face recognition, initial fixations to the center of the nose have been taken to indicate this location is optimal for information extraction. However, the use of fixations as a marker for information use rests on the assumption that fixation patterns are predominantly determined by stimulus and task, despite the fact that fixations are also influenced by visuo-motor factors. Here, we tested the effect of starting position on fixation patterns during a face recognition task with upright and inverted faces. While we observed differences in fixations between upright and inverted faces, likely reflecting differences in cognitive processing, there was also a strong effect of start position. Over the first five saccades, fixation patterns across start positions were only coarsely similar, with most fixations around the eyes. Importantly, however, the precise fixation pattern was highly dependent on start position with a strong tendency toward facial features furthest from the start position. For example, the often-reported tendency toward the left over right eye was reversed for the left starting position. Further, delayed initial saccades for central versus peripheral start positions suggest greater information processing prior to the initial saccade, highlighting the experimental bias introduced by the commonly used center start position. Finally, the precise effect of face inversion on fixation patterns was also dependent on start position. These results demonstrate the importance of a non-stimulus, non-task factor in determining fixation patterns. The patterns observed likely reflect a complex combination of visuo-motor effects and simple sampling strategies as well as cognitive factors. These different factors are very difficult to tease apart and therefore great caution must be applied when interpreting absolute fixation locations as indicative of information use, particularly at a fine spatial scale.

The role of eyes in early face processing: a rapid adaptation study of the inversion effect

The current study employed a rapid adaptation procedure to test the neuronal mechanisms of the face inversion effect (FIE) on the early face-sensitive event-related potential (ERP) component N170. Five categories of face-related stimuli (isolated eyes, isolated mouths, eyeless faces, mouthless faces, and full faces) and houses were presented in upright and inverted orientations as adaptors for inverted full face test stimuli. Strong adaptation was found for all face-related stimuli except mouths. The adaptation effect was larger for inverted than upright stimuli, but only when eyes were present. These results underline an important role of eyes in early face processing. A mechanism of eye-dependent orientation sensitivity during the structural encoding stage of faces is proposed.

Individual differences in face memory and eye fixation patterns during face learning

This study examined the relationship between individual differences in face memory and eye fixation patterns during face learning. Participants watched short movies of 20 faces and were divided into high and low face memory groups based on their performance in a recognition memory test. No qualitative difference was observed in the eye fixation distribution between high and low groups. Both groups mostly fixed on the internal region of faces, especially the eyes. A difference in the eye fixation pattern by groups was observed in the number of fixations and total fixation time on the eyes, which reflected high face memory participants moving their eyes between the left and right eyes more frequently than low face memory participants. These findings suggest that fixation on the eyes has a functional role in face memory and is related to individual differences in face memory.

Holistic face processing in newborns, 3-month-old infants, and adults: evidence from the composite face effect

Holistic face processing was investigated in newborns, 3-month-old infants, and adults through a modified version of the composite face paradigm and the recording of eye movements. After familiarization to the top portion of a face, participants (N = 70) were shown 2 aligned or misaligned faces, 1 of which comprised the familiar top part. In the aligned condition, no visual preference was found at any group age. In the misaligned condition, 3-month-olds preferred the face stimulus with the familiar top part, adults preferred the face stimulus with the novel one, and newborns did not manifest any visual preference. Results revealed that both infants' and adults' eye movements may be affected by holistic face information and demonstrated holistic face processing in 3-month-olds.

Inverting faces does not abolish cultural diversity in eye movements

Face processing is widely understood to be a basic, universal visual function effortlessly achieved by people from all cultures and races. The remarkable recognition performance for faces is markedly and specifically affected by picture-plane inversion: the so-called face-inversion effect (FIE), a finding often used as evidence for face-specific mechanisms. However, it has recently been shown that culture shapes the way people deploy eye movements to extract information from faces. Interestingly, the comparable lack of experience with inverted faces across cultures offers a unique opportunity to establish the extent to which such cultural perceptual biases in eye movements are robust, but also to assess whether face-specific mechanisms are universally tuned. Here we monitored the eye movements of Western Caucasian (WC) and East Asian (EA) observers while they learned and recognised WC and EA inverted faces. Both groups of observers showed a comparable impairment in recognising inverted faces of both races. WC observers deployed a scattered inverted triangular scanpath with a bias towards the mouth, whereas EA observers uniformly extended the focus of their fixations from the centre towards the eyes. Overall, our data show that cultural perceptual differences in eye movements persist during the FIE, questioning the universality of face-processing mechanisms.

Configural Face Processing: A Meta-Analytic Survey

In the field of face processing, the configural hypothesis is defended by many researchers. It is often claimed that this thesis is robustly supported by a large number of experiments exploring the face-inversion effect, the composite face effect, the face superiority effect, and the negative face effect. However, this claim is generally based on a rudimentary and approximate vote-counting approach. In this paper, I use meta-analyses to examine the relevant literature in more depth. The analysis supports the vote-counting argument.

Animal Recognition and Eye Movements

We assessed the importance of outline contour and individual features in mediating the recognition of animals by examining response times and eye movements in an animal-object decision task (i.e., deciding whether or not an object was an animal that may be encountered in real life). There were shorter latencies for animals as compared with nonanimals and performance was similar for shaded line drawings and silhouettes, suggesting that important information for recognition lies in the outline contour. The most salient information in the outline contour was around the head, followed by the lower torso and leg regions. We also observed effects of object orientation and argue that the usefulness of the head and lower torso/leg regions is consistent with a role for the object axis in recognition.

Fixation patterns during recognition of personally familiar and unfamiliar faces

Previous studies recording eye gaze during face perception have rendered somewhat inconclusive findings with respect to fixation differences between familiar and unfamiliar faces. This can be attributed to a number of factors that differ across studies: the type and extent of familiarity with the faces presented, the definition of areas of interest subject to analyses, as well as a lack of consideration for the time course of scan patterns. Here we sought to address these issues by recording fixations in a recognition task with personally familiar and unfamiliar faces. After a first common fixation on a central superior location of the face in between features, suggesting initial holistic encoding, and a subsequent left eye bias, local features were focused and explored more for familiar than unfamiliar faces. Although the number of fixations did not differ for un-/familiar faces, the locations of fixations began to differ before familiarity decisions were provided. This suggests that in the context of familiarity decisions without time constraints, differences in processing familiar and unfamiliar faces arise relatively early – immediately upon initiation of the first fixation to identity-specific information – and that the local features of familiar faces are processed more than those of unfamiliar faces.

The time course of face matching by internal and external features: Effects of context and inversion

Effects of context and inversion were studied in face matching tasks by measuring proportion correct as a function of exposure duration. Subjects were instructed to attend either internal features (task A) or external features (task B) and matched two consecutive face stimuli, which included either congruent, incongruent, or no facial context features. In congruent contexts matching performance rose fast and took very similar courses for both types of facial features. With no contexts internal and external features were found to be matched at an equal speed, while incongruent contexts seriously delayed matching performance for internal, but not for external features. Analysing the effects of context and inversion showed strong interactions with time scale and the features to be attended. At brief timings effects of inversion and context were strong for both feature types. At longer exposure durations there were pronounced effects of inversion and context for internal features while for external features inversion effects were absent and context effects at just moderate degrees. Moreover, deteriorating effects of incongruent contexts, which were strong at brief timings, were attenuated at longer exposure durations, while facilitative effects of congruent contexts resided at high levels. These findings indicate that global and holistic processing modes dominate the early epoch of the face specific visual response, but can be replaced by modes that allow observers to regulate contextual influences and to access facial features more focused when the first 200 ms have passed.

Featural, configural, and holistic face-processing strategies evoke different scan patterns

In two experiments we investigated the role of eye movements during face processing. In experiment 1, using modified faces with primarily featural (scrambled faces) or configural (blurred faces) information as cue stimuli, we manipulated the way participants processed subsequently presented intact faces. In a sequential same-different task, participants decided whether the identity of an intact test face matched a preceding scrambled or blurred cue face. Analysis of eye movements for test faces showed more interfeatural saccades when they followed a blurred face, and longer gaze duration within the same feature when they followed scrambled faces. In experiment 2, we used a similar paradigm except that test faces were cued by intact faces, low-level blurred stimuli, or second-order scrambled stimuli (features were cut out but maintained their first-order relations). We found that in the intact condition participants performed fewer interfeatural saccades than in low-level blurred condition and had shorter gaze duration than in second-order scrambled condition. Moreover, participants fixated the centre of the test face to grasp the information from the whole face. Our findings suggest a differentiation between featural, configural, and holistic processing strategies, which can be associated with specific patterns of eye movements.

Recognition and eye movements with partially hidden pictures of faces and cars in different orientations

Inverted faces are more difficult to identify than upright ones. This even applies when pictures of faces are partially hidden in geometrical designs so that it takes some seconds to recognise them. Similar, though not as pronounced, orientation preferences apply to familiar objects. We compared the recognition times and patterns of eye movements for two sets of familiar symmetrical objects. Pictures of faces and of cars were embedded in patterns of concentric circles in order to render them difficult to recognise. They were presented in four orientations, at 90° intervals from upright. Two experiments were conducted with the same set of stimuli; experiment 1 required participants to respond in terms of faces or cars, and in experiment 2 responses were made to the orientation of the embedded image independently of its class. Upright faces were recognised more accurately and faster than those in other orientations; fixation durations were longer for upright faces even before recognition. These results applied to both experiments. Orientation effects for cars were not pronounced and distinctions between 90°, 180°, and 270° embedded images were not consistent; this was the case in both experiments.

Does matching of internal and external facial features depend on orientation and viewpoint?

Although it is recognized that external (hair, head and face outline, ears) and internal (eyes, eyebrows, nose, mouth) features contribute differently to face recognition it is unclear whether both feature classes predominantly stimulate different sensory pathways. We employed a sequential speed-matching task to study face perception with internal and external features in the context of intact faces, and at two levels of contextual congruency. Both internal and external features were matched faster and more accurately in the context of totally congruent/incongruent facial stimuli compared to just featurally congruent/incongruent faces. Matching of totally congruent/incongruent faces was not affected by the matching criteria, but was strongly modulated by orientation and viewpoint. On the contrary, matching of just featurally congruent/incongruent faces was found to depend on the feature class to be attended, with strong effects of orientation and viewpoint only for matching of internal features, but not of external features. The data support the notion that different processing mechanisms are involved for both feature types, with internal features being handled by configuration sensitive mechanisms whereas featural processing modes dominate when external features are the focus.

Distinguishing the cause and consequence of face inversion: the perceptual field hypothesis

I published a critical review of the face inversion effect (Rossion, 2008) that triggered a few reactions and commentaries by colleagues in the field (Riesenhuber & Wolff, 2009; Yovel, in press). Here, I summarize my original paper and attempt to identify the source of both the agreements and disagreements with my colleagues, as well as other authors, regarding the nature of the face inversion effect. My view is that the major cause of the detrimental effect of inversion on an observer's performance at individual face recognition is the disruption of a perceptual process. This perceptual process is makes and observer see the multiple features of a whole individual upright face at once. It also makes the percept of a given facial feature highly dependent on the location and identity of the other features in the whole face. The perceptual process is holistic because it is driven by a holistic face representation, derived from visual experience. Hence, an inverted face cannot be perceived holistically: the perceptual field of the observer is constricted for inverted faces, each facial feature having to be processed sequentially, independently, i.e. over a smaller spatial window than the whole face. Consequently, it is particularly difficult to perceive diagnostic cues that involve several elements over a wide space on an inverted face, such as long-range relative distances between features (e.g., relative distance between eyes and mouth), or diagnostic cues that are located far away from usual gaze fixation (e.g., mouth-nose distance or mouth shape when fixating between the eyes). These difficulties are mere consequences of face inversion--the cause being a loss of holistic perception--, and it does not follow that relative distances between internal features are necessarily particularly important to recognize faces, that they should be labeled "configural", or should be given a specific status at the representational level. I argue that distinguishing the cause and consequence(s) of face inversion this way can provide a parsimonious and yet complete theoretical account of the face inversion effect.

Deficits in cross-race face learning: insights from eye movements and pupillometry

The own-race bias (ORB) is a well-known finding wherein people are better able to recognize and discriminate own-race faces, relative to cross-race faces. In 2 experiments, participants viewed Asian and Caucasian faces, in preparation for recognition memory tests, while their eye movements and pupil diameters were continuously monitored. In Experiment 1 (with Caucasian participants), systematic differences emerged in both measures as a function of depicted race: While encoding cross-race faces, participants made fewer (and longer) fixations, they preferentially attended to different sets of features, and their pupils were more dilated, all relative to own-race faces. Also, in both measures, a pattern emerged wherein some participants reduced their apparent encoding effort to cross-race faces over trials. In Experiment 2 (with Asian participants), the authors observed the same patterns, although the ORB favored the opposite set of faces. Taken together, the results suggest that the ORB appears during initial perceptual encoding. Relative to own-race face encoding, cross-race encoding requires greater effort, which may reduce vigilance in some participants.

The 35th Sir Frederick Bartlett Lecture: Eye movements and attention in reading, scene perception, and visual search

Eye movements are now widely used to investigate cognitive processes during reading, scene perception, and visual search. In this article, research on the following topics is reviewed with respect to reading: (a) the perceptual span (or span of effective vision), (b) preview benefit, (c) eye movement control, and (d) models of eye movements. Related issues with respect to eye movements during scene perception and visual search are also reviewed. It is argued that research on eye movements during reading has been somewhat advanced over research on eye movements in scene perception and visual search and that some of the paradigms developed to study reading should be more widely adopted in the study of scene perception and visual search. Research dealing with “real-world” tasks and research utilizing the visual-world paradigm are also briefly discussed.