View-Specific Coding of Face Shape

Identity adaptation is mediated and moderated by visualisation ability

Depending on the previous research one reads, face aftereffects may or may not partially transfer across viewpoints. Two experiments are reported that explore this face-identity aftereffect by varying the adaptor type. Adaptation occurs when different views of the identity are used and even when the person's name is the adaptor. Brief exposure or nationality did not produce adaptation. In a third experiment, the role of visualisation was explored. Participants with higher visualisation scores showed greater adaptation to names than those with lower scores. These findings suggest non-facial identity cues can lead to a facial adaptation effect and that visualisation may be the mechanism behind this.

The influence of recent experience on perceptions of attractiveness

Adults rate average faces as more attractive than most of the faces used in the creation of the average. One explanation for this is that average faces appear as both more familiar and more attractive because they resemble internal face prototypes formed from experience. Here we evaluated that explanation by examining the influence of recent experience on participants' subsequent judgments of attractiveness. Participants first performed a memory task lasting 8 min in which all of the female faces to be remembered had their features placed in a low, average, or high position, depending on experimental condition. In what was described as a separate experiment, participants then moved the features of a female face with averaged features to their most attractive vertical location. The most attractive location was affected by the faces seen during the memory task, with participants who saw faces with features in the high position placing features in higher locations than participants who saw faces with features in either the low or average positions. The results demonstrate that perceptions of attractiveness are influenced by recent experience, and suggest that internal face prototypes are constantly being updated by experience.

Mechanisms of face perception

Faces are among the most informative stimuli we ever perceive: Even a split-second glimpse of a person's face tells us his identity, sex, mood, age, race, and direction of attention. The specialness of face processing is acknowledged in the artificial vision community, where contests for face-recognition algorithms abound. Neurological evidence strongly implicates a dedicated machinery for face processing in the human brain to explain the double dissociability of face- and object-recognition deficits. Furthermore, recent evidence shows that macaques too have specialized neural machinery for processing faces. Here we propose a unifying hypothesis, deduced from computational, neurological, fMRI, and single-unit experiments: that what makes face processing special is that it is gated by an obligatory detection process. We clarify this idea in concrete algorithmic terms and show how it can explain a variety of phenomena associated with face processing.

Radial frequency adaptation suggests polar-based coding of local shape cues

The study of shape processing in the human visual system has frequently employed radial frequency (RF) patterns as conveniently manipulable stimuli. This study uses an adaptation paradigm to investigate how local shape information is sampled in the processing of RF contour shapes. Experiment 1 measured thresholds for detecting a fixed mean radius RF contour following adaptation to RF patterns which, in separate conditions, varied in mean radius and radial frequency. Results reveal that, adaptation is strongly tuned for RF over a range of pattern radii, but is not tuned for the number of cycles of radial modulation per visual degree of contour length; a characteristic that changes with both radius and radial frequency. Experiment 2 manipulated the polar angle separation on the fronto-parallel plane between curvature features on a fixed RF by foreshortening the pattern appearance (consistent with a rotation in depth) and shows that RF shape processing is tuned for fronto-parallel separation angles between curvature features. Results were near identical when a stereo rotation cue was added to the perspective modified RF. In the second part of Experiment 2 we showed that RF shape adaptation is also tuned for the polar angular extent of the curvature represented by the lobe at that angle. Collectively, our results indicate that the polar angle at which local curvature features appear, in addition to the angular extent of the curvature feature at that location, are both critical parameters for coding specific RF shapes.

Turning the other cheek: the viewpoint dependence of facial expression after-effects

How do we visually encode facial expressions? Is this done by viewpoint-dependent mechanisms representing facial expressions as two-dimensional templates or do we build more complex viewpoint independent three-dimensional representations? Recent facial adaptation techniques offer a powerful way to address these questions. Prolonged viewing of a stimulus (adaptation) changes the perception of subsequently viewed stimuli (an after-effect). Adaptation to a particular attribute is believed to target those neural mechanisms encoding that attribute. We gathered images of facial expressions taken simultaneously from five different viewpoints evenly spread from the three-quarter leftward to the three-quarter rightward facing view. We measured the strength of expression after-effects as a function of the difference between adaptation and test viewpoints. Our data show that, although there is a decrease in after-effect over test viewpoint, there remains a substantial after-effect when adapt and test are at differing three-quarter views. We take these results to indicate that neural systems encoding facial expressions contain a mixture of viewpoint-dependent and viewpoint-independent elements. This accords with evidence from single cell recording studies in macaque and is consonant with a view in which viewpoint-independent expression encoding arises from a combination of view-dependent expression-sensitive responses.

Sex-contingent face aftereffects depend on perceptual category rather than structural encoding

Many studies have used visual adaptation to investigate how recent experience with faces influences perception. While faces similar to those seen during adaptation phases are typically perceived as more 'normal' after adaptation, it is possible to induce aftereffects in one direction for one category (e.g. female) and simultaneously induce aftereffects in the opposite direction for another category (e.g. male). Such aftereffects could reflect 'category-contingent' adaptation of neurons selective for perceptual category (e.g. male or female) or 'structure-contingent' adaptation of lower-level neurons coding the physical characteristics of different face patterns. We compared these explanations by testing for simultaneous opposite after effects following adaptation to (a) two groups of faces from distinct sex categories (male and female) or (b) two groups of faces from the same sex category (female and hyper-female) where the structural differences between the female and hyper-female groups were mathematically identical to those between male and female groups. We were able to induce opposite aftereffects following adaptation between sex categories but not after adaptation within a sex category. These findings indicate the involvement of neurons coding perceptual category in sex-contingent face aftereffects and cannot be explained by neurons coding only the physical aspects of face patterns.

Hemispheric asymmetries in image-specific and abstractive priming of famous faces: evidence from reaction times and event-related brain potentials

We investigated hemispheric differences in image-specific and abstractive immediate repetition priming of famous faces. Participants performed speeded familiarity decisions for centrally presented famous and unfamiliar target faces. Target faces were preceded by lateralized primes (150 ms), presented either in the left or right visual field (LVF or RVF). Primes were either an identical photograph of the famous target face (image-specific priming), a different image of the famous target face (abstractive priming) or a different familiar face (unprimed condition). Reaction times (RTs) revealed significant effects of priming for both image-specific and abstractive priming overall. In addition, image-specific priming was more than twice the magnitude for targets following LVF primes as compared to RVF primes. By contrast, no hemispheric differences emerged for abstractive face priming across different images. Whereas ERPs revealed no evidence that priming affected the N170 component, both image-specific and abstractive priming significantly modulated the amplitudes of a right temporal N250r and a parietal N400 component. Behavioural and electrophysiological evidence for hemispheric differences in image-specific and abstractive face priming are discussed with respect to current theories of how the human left and right ventral temporal cortices represent abstractive and form-specific visual information.

Are face representations viewpoint dependent? A stereo advantage for generalizing across different views of faces

Almost all previous studies of face recognition have found that matching the same face depicted from different viewpoints incurs both reaction time and accuracy costs. This has been interpreted as evidence that the underlying neural representations of faces are viewpoint-specific, but such a conclusion depends on the experimental data being an accurate reflection of real-world viewpoint generalisation. An equally plausible explanation for poor viewpoint generalisation in experimental situations is that important information that is normally used to generalize across views in real-world settings is not available in the experiment. Stereoscopic information about the three-dimensional structure of the face is systematically misleading in nearly all previous investigations of face recognition, since a face depicted on a computer monitor contains explicit stereoscopic information that the face is flat. The current experiment demonstrates that viewpoint costs are reduced by depicting the face with stereoscopic three-dimensionality (compared to a synoptically presented face), raising the possibility that the viewpoint costs found in face recognition experiments might be a better reflection of the information that is typically unavailable in the experimental stimuli than of the underlying neural representation of facial identity.

The role of familiarity in three-dimensional view-transferability of face identity adaptation

Recent studies show that face adaptation effects partially transfer across three-dimensional viewpoint change. Here we investigated whether the degree of adaptation transfer is mediated by experience with a face. We manipulated face familiarity and measured identity aftereffects both within- and across-viewpoint. Familiarity enhanced the overall strength of identity adaptation as well as the degree to which adaptation transferred across-viewpoint change. These findings support the idea that transfer effects in adaptation vary as a function of experience with particular faces, and suggest the use of adaptation as a tool for tracking face representations as they develop.