Adaptation to asymmetrically distorted faces and its lack of effect on mirror images

Face adaptation effects: reviewing the impact of adapting information, time, and transfer

The ability to adapt is essential to live and survive in an ever-changing environment such as the human ecosystem. Here we review the literature on adaptation effects of face stimuli to give an overview of existing findings in this area, highlight gaps in its research literature, initiate new directions in face adaptation research, and help to design future adaptation studies. Furthermore, this review should lead to better understanding of the processing characteristics as well as the mental representations of face-relevant information. The review systematizes studies at a behavioral level in respect of a framework which includes three dimensions representing the major characteristics of studies in this field of research. These dimensions comprise (1) the specificity of adapting face information, e.g., identity, gender, or age aspects of the material to be adapted to (2) aspects of timing (e.g., the sustainability of adaptation effects) and (3) transfer relations between face images presented during adaptation and adaptation tests (e.g., images of the same or different identities). The review concludes with options for how to combine findings across different dimensions to demonstrate the relevance of our framework for future studies.

Stimulus requirements for face perception: an analysis based on "totem poles"

The stimulus requirements for perceiving a face are not well defined but are presumably simple, for vivid faces can often by seen in random or natural images such as cloud or rock formations. To characterize these requirements, we measured where observers reported the impression of faces in images defined by symmetric 1/f noise. This allowed us to examine the prominence and properties of different features and their necessary configurations. In these stimuli many faces can be perceived along the vertical midline, and appear stacked at multiple scales, reminiscent of "totem poles." In addition to symmetry, the faces in noise are invariably upright and thus reveal the inversion effects that are thought to be a defining property of configural face processing. To a large extent, seeing a face required seeing eyes, and these were largely restricted to dark regions in the images. Other features were more subordinate and showed relatively little bias in polarity. Moreover, the prominence of eyes depended primarily on their luminance contrast and showed little influence of chromatic contrast. Notably, most faces were rated as clearly defined with highly distinctive attributes, suggesting that once an image area is coded as a face it is perceptually completed consistent with this interpretation. This suggests that the requisite trigger features are sufficient to holistically "capture" the surrounding noise structure to form the facial representation. Yet despite these well articulated percepts, we show in further experiments that while a pair of dark spots added to noise images appears face-like, these impressions fail to elicit other signatures of face processing, and in particular, fail to elicit an N170 or fixation patterns typical for images of actual faces. These results suggest that very simple stimulus configurations are sufficient to invoke many aspects of holistic and configural face perception while nevertheless failing to fully engage the neural machinery of face coding, implying that that different signatures of face processing may have different stimulus requirements.

Visual adaptation and face perception

The appearance of faces can be strongly affected by the characteristics of faces viewed previously. These perceptual after-effects reflect processes of sensory adaptation that are found throughout the visual system, but which have been considered only relatively recently in the context of higher level perceptual judgements. In this review, we explore the consequences of adaptation for human face perception, and the implications of adaptation for understanding the neural-coding schemes underlying the visual representation of faces. The properties of face after-effects suggest that they, in part, reflect response changes at high and possibly face-specific levels of visual processing. Yet, the form of the after-effects and the norm-based codes that they point to show many parallels with the adaptations and functional organization that are thought to underlie the encoding of perceptual attributes like colour. The nature and basis for human colour vision have been studied extensively, and we draw on ideas and principles that have been developed to account for norms and normalization in colour vision to consider potential similarities and differences in the representation and adaptation of faces.

Electrophysiological correlates of face distortion after-effects

When observers are exposed to a distorted face the perceived configuration of a subsequently presented face is altered, a phenomenon called face distortion after-effect (FDAE). We compared the face-related components of the event-related potential (ERP) after adaptation to noise images—veridical and distorted faces. We found large bilateral adaptation effects on the P100 and N170 components that are related to face detection. Moreover, we found smaller adaptation effects on the N170, recorded over the right hemisphere, which can be related to the behavioural distortion after-effect and to face configurations. Our results suggest that the observed ERP adaptation effects are general for various steps of face processing and that the FDAEs similarly to gender after-effects are related to the early face-specific ERP components.

Photorealism aftereffect

This study reports a novel visual aftereffect for photorealism judgments. Participants observed image sequences where a photograph was gradually transformed into an artificial image (a painting or a sketch). Their task was to choose the image that was the category boundary between the photograph and the artificial image among the frames of each image sequence. This task was performed before and after observing photographs or artificial images for 1 min. The chosen images were less photorealistic after the observation of artificial images, suggesting an aftereffect for photorealism judgments. However, observation of photographs did not induce an aftereffect. It is known that the observation of the norms for perceptual judgments (e.g., the prototypical face for facial judgments) does not induce aftereffects. Thus, these results suggest that photorealistic images serve as the norm for the perceptual judgment of photorealism. The human visual system may represent the photorealism of artificial images as a deviation from photorealistic images.

Probing the face-space of individuals with prosopagnosia

A useful framework for understanding the mental representation of facial identity is face-space (Valentine, 1991), a multi-dimensional cognitive map in which individual faces are coded relative to the average of previously encountered faces, and in which the distance among faces represents their perceived similarity. We examined whether individuals with prosopagnosia, a disorder characterized by an inability to recognize familiar faces despite normal visual acuity and intellectual abilities, evince behavior consistent with this underlying representational schema. To do so, we compared the performance of 6 individuals with congenital prosopagnosia (CP), with a group of age- and gender-matched control participants in a series of experiments involving judgments of facial identity. We used digital images of male and female faces and morphed them to varying degrees relative to an average face, to create caricatures, anti-caricatures, and anti-faces (i.e. faces of the opposite identity). Across 5 behavioral tasks, CP individuals' performance was similar to that of the control group and consistent with the face-space framework. As a test of the sensitivity of our measures in revealing face processing abnormalities, we also tested a single acquired prosopagnosic (AP) individual, whose performance on the same tasks deviated significantly from the control and CP groups. The findings suggest that, despite an inability to recognize individual identities, CPs perceive faces in a manner consistent with norm-based coding of facial identity, although their representation is likely supported by a feature-based strategy. We suggest that the apparently normal posterior cortical regions, including the fusiform face area, serve as the neural substrate for at least a coarse, feature-based face-space map in CP and that their face recognition impairment arises from the disconnection between these regions and more anterior cortical sites.