Developmental processes in face perception

Meowing dogs: can dogs recognize cats in a cross-modal violation of expectancy task (Canis familiaris)?

Dogs can recognize conspecifics in cross-modal audio-video presentations. In this paper, we aimed at exploring if such capability extends to the recognition of cats, and whether it is influenced by exposure to these animals. To reach our aim, we enrolled 64 pet dogs. Half of the dogs were currently living with cats, while the rest had never been living with cats, nor were at the time of the experiment. All dogs underwent a cross-modal violation of expectancy experiment, where they were presented with either a cat or a dog vocalization, followed by a video of either species on a blank background. The result revealed that dogs did not exhibit a surprise reaction towards the incoherent stimuli of a cat vocalization and a dog video or vice-versa, implying that they had not recognized the stimuli portraying cats. The pattern of results did not differ between dogs living or not with cats, implying that exposure to a limited number of cats, however, prolonged, is not sufficient to grant dogs with the ability to recognize them on audio-video presentations. We propose that the lack of recognition could be due to the small number of individual cats the dogs are regularly exposed to, or to the possible lack of early exposure to cats during the socialization phase.

Do chimpanzees see a face on Mars? A search for face pareidolia in chimpanzees

We sometimes perceive meaningful patterns or images in random arrangements of colors and shapes. This phenomenon is called pareidolia and has recently been studied intensively, especially face pareidolia. In contrast, there are few comparative-cognitive studies on face pareidolia with nonhuman primates. This study explored behavioral evidence for face pareidolia in chimpanzees using visual search and matching tasks. Faces are processed in a configural manner, and their perception and recognition are hampered by inversion and misalignment of top and bottom parts. We investigated whether the same effect occurs in a visual search for face-like objects. The results showed an effect of misalignment. On the other hand, consistent results were not obtained with the photographs of fruits. When only the top or bottom half of the face-like object was presented, chimpanzees showed better performance for the top-half condition, suggesting the importance of the eye area in face pareidolia. In the positive-control experiments, chimpanzees received the same experiment using human faces and human participants with face-like objects and fruits. As a result, chimpanzees showed an inefficient search for inverted and misaligned faces and humans for manipulated face-like objects. Finally, to examine the role of face awareness, we tested matching a human face to a face-like object in chimpanzees but obtained no substantial evidence that they saw the face-like object as a "face." Based on these results, we discussed the extents and limits of face pareidolia in chimpanzees.

Faces and Voices Processing in Human and Primate Brains: Rhythmic and Multimodal Mechanisms Underlying the Evolution and Development of Speech

While influential works since the 1970s have widely assumed that imitation is an innate skill in both human and non-human primate neonates, recent empirical studies and meta-analyses have challenged this view, indicating other forms of reward-based learning as relevant factors in the development of social behavior. The visual input translation into matching motor output that underlies imitation abilities instead seems to develop along with social interactions and sensorimotor experience during infancy and childhood. Recently, a new visual stream has been identified in both human and non-human primate brains, updating the dual visual stream model. This third pathway is thought to be specialized for dynamics aspects of social perceptions such as eye-gaze, facial expression and crucially for audio-visual integration of speech. Here, we review empirical studies addressing an understudied but crucial aspect of speech and communication, namely the processing of visual orofacial cues (i.e., the perception of a speaker's lips and tongue movements) and its integration with vocal auditory cues. Along this review, we offer new insights from our understanding of speech as the product of evolution and development of a rhythmic and multimodal organization of sensorimotor brain networks, supporting volitional motor control of the upper vocal tract and audio-visual voices-faces integration.

Impairment effect of infantile coloration on face discrimination in chimpanzees

Impaired face recognition for certain face categories, such as faces of other species or other age class faces, is known in both humans and non-human primates. A previous study found that it is more difficult for chimpanzees to differentiate infant faces than adult faces. Infant faces of chimpanzees differ from adult faces in shape and colour, but the latter is especially a salient cue for chimpanzees. Therefore, impaired face differentiation of infant faces may be due to a specific colour. In the present study, we investigated which feature of infant faces has a greater effect on face identification difficulty. Adult chimpanzees were tested using a matching-to-sample task with four types of face stimuli whose shape and colour were manipulated as either infant or adult one independently. Chimpanzees' discrimination performance decreased as they matched faces with infant coloration, regardless of the shape. This study is the first to demonstrate the impairment effect of infantile coloration on face recognition in non-human primates, suggesting that the face recognition strategies of humans and chimpanzees overlap as both species show proficient face recognition for certain face colours.

Cats match voice and face: cross-modal representation of humans in cats (Felis catus)

We examined whether cats have a cross-modal representation of humans, using a cross-modal expectancy violation paradigm originally used with dogs by Adachi et al. (Anim Cogn 10:17-21, 2007). We compared cats living in houses and in cat cafés to assess the potential effect of postnatal experience. Cats were presented with the face of either their owner or a stranger on a laptop monitor after playing back the voice of one of two people calling the subject's name. In half of the trials the voice and face were of the same person (congruent condition) whereas in the other half of trials the stimuli did not match (incongruent condition). The café cats paid attention to the monitor longer in incongruent than congruent conditions, showing an expectancy violation. By contrast, house cats showed no similar tendency. These results show that at least café cats can predict their owner's face upon hearing the owner's voice, suggesting possession of cross-modal representation of at least one human. There may be a minimal kind or amount of postnatal experiences that lead to formation of a cross-modal representation of a specific person.

Exploring attentional bias towards threatening faces in chimpanzees using the dot probe task

Primates have evolved to rapidly detect and respond to danger in their environment. However, the mechanisms involved in attending to threatening stimuli are not fully understood. The dot-probe task is one of the most widely used experimental paradigms to investigate these mechanisms in humans. However, to date, few studies have been conducted in non-human primates. The aim of this study was to investigate whether the dot-probe task can measure attentional biases towards threatening faces in chimpanzees. Eight adult chimpanzees participated in a series of touch screen dot-probe tasks. We predicted faster response times towards chimpanzee threatening faces relative to neutral faces and faster response times towards faces of high threat intensity (scream) than low threat intensity (bared teeth). Contrary to prediction, response times for chimpanzee threatening faces relative to neutral faces did not differ. In addition, we found no difference in response times for faces of high and low threat intensity. In conclusion, we found no evidence that the touch screen dot-probe task can measure attentional biases specifically towards threatening faces in our chimpanzees. Methodological limitations of using the task to measure emotional attention in human and non-human primates, including stimulus threat intensity, emotional state, stimulus presentation duration and manual responding are discussed.

Crucial information for efficient face searching by humans and Japanese macaques

Humans can efficiently detect a face among non-face objects, but few studies of this ability have been conducted in animals. Here, in Japanese macaques and humans, we examined visual searching for a face and explored what factors contribute to efficient facial information processing. Subjects were asked to search for an odd target among the different numbers of distracters. Faces of the subjects' own species, the backs of the head of the subjects' own species, faces of the subjects' closely related species or race, and faces of species that are clearly different from the subjects' own species were used as the target. Both the macaques and humans detected a face of their own species more efficiently than a face from a clearly different species. Similar efficient detections were confirmed for the faces of the subjects' closely related species or race. These results suggest that conspecific faces and faces that share morphological similarity with conspecific faces can be detected efficiently among non-face objects by both humans and Japanese macaques. In another experiment, facial recognition efficiency was observed when the subjects searched for own-species faces that had lower-spatial-frequency components compared to faces with higher-spatial-frequency components. It seems reasonable that the ability to search efficiently for faces by using holistic face processing is derived from fundamental social cognition abilities that are broadly shared among species.

Getting to the Bottom of Face Processing. Species-Specific Inversion Effects for Faces and Behinds in Humans and Chimpanzees (Pan Troglodytes)

For social species such as primates, the recognition of conspecifics is crucial for their survival. As demonstrated by the 'face inversion effect', humans are experts in recognizing faces and unlike objects, recognize their identity by processing it configurally. The human face, with its distinct features such as eye-whites, eyebrows, red lips and cheeks signals emotions, intentions, health and sexual attraction and, as we will show here, shares important features with the primate behind. Chimpanzee females show a swelling and reddening of the anogenital region around the time of ovulation. This provides an important socio-sexual signal for group members, who can identify individuals by their behinds. We hypothesized that chimpanzees process behinds configurally in a way humans process faces. In four different delayed matching-to-sample tasks with upright and inverted body parts, we show that humans demonstrate a face, but not a behind inversion effect and that chimpanzees show a behind, but no clear face inversion effect. The findings suggest an evolutionary shift in socio-sexual signalling function from behinds to faces, two hairless, symmetrical and attractive body parts, which might have attuned the human brain to process faces, and the human face to become more behind-like.

Familiar face + novel face = familiar face? Representational bias in the perception of morphed faces in chimpanzees

Highly social animals possess a well-developed ability to distinguish the faces of familiar from novel conspecifics to induce distinct behaviors for maintaining society. However, the behaviors of animals when they encounter ambiguous faces of familiar yet novel conspecifics, e.g., strangers with faces resembling known individuals, have not been well characterised. Using a morphing technique and preferential-looking paradigm, we address this question via the chimpanzee’s facial–recognition abilities. We presented eight subjects with three types of stimuli: (1) familiar faces, (2) novel faces and (3) intermediate morphed faces that were 50% familiar and 50% novel faces of conspecifics. We found that chimpanzees spent more time looking at novel faces and scanned novel faces more extensively than familiar or intermediate faces. Interestingly, chimpanzees looked at intermediate faces in a manner similar to familiar faces with regards to the fixation duration, fixation count, and saccade length for facial scanning, even though the participant was encountering the intermediate faces for the first time. We excluded the possibility that subjects merely detected and avoided traces of morphing in the intermediate faces. These findings suggest a bias for a feeling-of-familiarity that chimpanzees perceive familiarity with an intermediate face by detecting traces of a known individual, as 50% alternation is sufficient to perceive familiarity.

Integration or separation in the processing of facial properties--a computational view

A face recognition system ought to read out information about the identity, facial expression and invariant properties of faces, such as sex and race. A current debate is whether separate neural units in the brain deal with these face properties individually or whether a single neural unit processes in parallel all aspects of faces. While the focus of studies has been directed toward the processing of identity and facial expression, little research exists on the processing of invariant aspects of faces. In a theoretical framework we tested whether a system can deal with identity in combination with sex, race or facial expression using the same underlying mechanism. We used dimension reduction to describe how the representational face space organizes face properties when trained on different aspects of faces. When trained to learn identities, the system not only successfully recognized identities, but also was immediately able to classify sex and race, suggesting that no additional system for the processing of invariant properties is needed. However, training on identity was insufficient for the recognition of facial expressions and vice versa. We provide a theoretical approach on the interconnection of invariant facial properties and the separation of variant and invariant facial properties.

Which person is my trainer? Spontaneous visual discrimination of human individuals by bottlenose dolphins (Tursiops truncatus)

Bottlenose dolphins are known to use signature whistles to identify conspecifics auditorily. However, the way in which they recognize individuals visually is less well known. We investigated their visual recognition of familiar human individuals under the spontaneous discrimination task. In each trial, the main trainer appeared from behind a panel. In test trials, two persons (one was the main trainer) appeared from the left and right sides of the panel and moved along the poolside in opposite directions. Three of the four dolphins spontaneously followed their main trainers significantly above the level of chance. Subsequent tests, however, revealed that when the two persons wore identical clothing, the following response deteriorated. This suggests that dolphins can spontaneously discriminate human individuals using visual cues, but they do not utilize facial cues, but body area for this discrimination.

Efficient search for a face by chimpanzees (Pan troglodytes)

The face is quite an important stimulus category for human and nonhuman primates in their social lives. Recent advances in comparative-cognitive research clearly indicate that chimpanzees and humans process faces in a special manner; that is, using holistic or configural processing. Both species exhibit the face-inversion effect in which the inverted presentation of a face deteriorates their perception and recognition. Furthermore, recent studies have shown that humans detect human faces among non-facial objects rapidly. We report that chimpanzees detected chimpanzee faces among non-facial objects quite efficiently. This efficient search was not limited to own-species faces. They also found human adult and baby faces-but not monkey faces-efficiently. Additional testing showed that a front-view face was more readily detected than a profile, suggesting the important role of eye-to-eye contact. Chimpanzees also detected a photograph of a banana as efficiently as a face, but a further examination clearly indicated that the banana was detected mainly due to a low-level feature (i.e., color). Efficient face detection was hampered by an inverted presentation, suggesting that configural processing of faces is a critical element of efficient face detection in both species. This conclusion was supported by a simple simulation experiment using the saliency model.

Own-race and own-species advantages in face perception: a computational view

The frequency to which an organism is exposed to a particular type of face influences recognition performance. For example, Asians are better in individuating Asian than Caucasian faces, known as the own-race advantage. Similarly, humans in general are better in individuating human than monkey faces, known as the own-species advantage. It is an open question whether the underlying mechanisms causing these effects are similar. We hypothesize that these processes are governed by neural plasticity of the face discrimination system to retain optimal discrimination performance in its environment. Using common face features derived from a set of images from various face classes, we show that maximizing the feature variance between different individuals while ensuring minimal variance within individuals achieved good discrimination performances on own-class faces when selecting a subset of feature dimensions. Further, the selected subset of features does not necessarily lead to an optimal performance on the other class of faces. Thus, the face discrimination system continuously re-optimizes its space constraint face representation to optimize recognition performance on the current distribution of faces in its environment. This model can account for both, the own-race and own-species advantages. We name this approach Space Constraint Optimized Representational Embedding (SCORE).

The other-race and other-species effects in face perception - a subordinate-level analysis

The ability of face discrimination is modulated by the frequency of exposure to a category of faces. In other words, lower discrimination performance was measured for infrequently encountered faces as opposed to frequently encountered ones. This phenomenon has been described in the literature: the own-race advantage, a benefit in processing own-race as opposed to the other-race faces, and the own-species advantage, a benefit in processing the conspecific type of faces as opposed to the heterospecific type. So far, the exact parameters that drive either of these two effects are not fully understood. In the following we present a full assessment of data in human participants describing the discrimination performances across two races (Asian and Caucasian) as well as a range of non-human primate faces (chimpanzee, Rhesus macaque and marmoset). We measured reaction times of Asian participants performing a delayed matching-to-sample task, and correlated the results with similarity estimates of facial configuration and face parts. We found faster discrimination of own-race above other-race/species faces. Further, we found a strong reliance on configural information in upright own-species/-race faces and on individual face parts in all inverted face classes, supporting the assumption of specialized processing for the face class of most frequent exposure.

The importance of visual features in generic vs. specialized object recognition: a computational study

It is debated whether the representation of objects in inferior temporal (IT) cortex is distributed over activities of many neurons or there are restricted islands of neurons responsive to a specific set of objects. There are lines of evidence demonstrating that fusiform face area (FFA-in human) processes information related to specialized object recognition (here we say within category object recognition such as face identification). Physiological studies have also discovered several patches in monkey ventral temporal lobe that are responsible for facial processing. Neuronal recording from these patches shows that neurons are highly selective for face images whereas for other objects we do not see such selectivity in IT. However, it is also well-supported that objects are encoded through distributed patterns of neural activities that are distinctive for each object category. It seems that visual cortex utilize different mechanisms for between category object recognition (e.g., face vs. non-face objects) vs. within category object recognition (e.g., two different faces). In this study, we address this question with computational simulations. We use two biologically inspired object recognition models and define two experiments which address these issues. The models have a hierarchical structure of several processing layers that simply simulate visual processing from V1 to aIT. We show, through computational modeling, that the difference between these two mechanisms of recognition can underlie the visual feature and extraction mechanism. It is argued that in order to perform generic and specialized object recognition, visual cortex must separate the mechanisms involved in within category from between categories object recognition. High recognition performance in within category object recognition can be guaranteed when class-specific features with intermediate size and complexity are extracted. However, generic object recognition requires a distributed universal dictionary of visual features in which the size of features does not have significant difference.

Neural representation of face familiarity in an awake chimpanzee

Evaluating the familiarity of faces is critical for social animals as it is the basis of individual recognition. In the present study, we examined how face familiarity is reflected in neural activities in our closest living relative, the chimpanzee. Skin-surface event-related brain potentials (ERPs) were measured while a fully awake chimpanzee observed photographs of familiar and unfamiliar chimpanzee faces (Experiment 1) and human faces (Experiment 2). The ERPs evoked by chimpanzee faces differentiated unfamiliar individuals from familiar ones around midline areas centered on vertex sites at approximately 200 ms after the stimulus onset. In addition, the ERP response to the image of the subject's own face did not significantly diverge from those evoked by familiar chimpanzees, suggesting that the subject's brain at a minimum remembered the image of her own face. The ERPs evoked by human faces were not influenced by the familiarity of target individuals. These results indicate that chimpanzee neural representations are more sensitive to the familiarity of conspecific than allospecific faces.

Early experience shapes amygdala sensitivity to race: an international adoption design

In the current study, we investigated how complete infant deprivation to out-group race impacts behavioral and neural sensitivity to race. Although monkey models have successfully achieved complete face deprivation in early life, this is typically impossible in human studies. We overcame this barrier by examining youths with exclusively homogenous racial experience in early postnatal development. These were youths raised in orphanage care in either East Asia or Eastern Europe as infants and later adopted by American families. The use of international adoption bolsters confidence of infant exposure to race (e.g., to solely Asian faces or European faces). Participants completed an emotional matching task during functional MRI. Our findings show that deprivation to other-race faces in infancy disrupts recognition of emotion and results in heightened amygdala response to out-group faces. Greater early deprivation (i.e., later age of adoption) is associated with greater biases to race. These data demonstrate how early social deprivation to race shapes amygdala function later in life and provides support that early postnatal development may represent a sensitive period for race perception.

Laterality effect for faces in chimpanzees (Pan troglodytes)

Face perception in humans is governed more by right-hemispheric than left-hemispheric neural correlate. Some but not all neurophysiological studies depict a right-side dominance for face responsive neurons in the brains of macaques. Hence, it is an open question whether and to what extent a right-hemisphere preference of processing faces exists across primate brains. We investigated chimpanzees discriminating chimeric faces of chimpanzees and humans, i.e., the combination of either left or right sides of a face vertically flipped and merged into a whole face. We found an effect of choosing the left-chimeric face more often than the right-chimeric face as being the one of the two that is closer to the original face, reflecting an advantage for the right side of the brain to process faces, as reported in humans. Moreover, we found a modulation by age of the participants, suggesting that the exposure history with a particular category shapes the right-hemispheric neural correlate to a configural/holistic processing strategy. In other words, the findings in chimpanzee participants parallel those in human participants and are suggestive for similar neural machineries in the occipital-temporal cortices in both species.

Conceptual metaphorical mapping in chimpanzees (Pan troglodytes)

Conceptual metaphors are linguistic constructions. Such a metaphor is humans’ mental representation of social rank as a pyramidal-like structure. High-ranked individuals are represented in higher positions than low-ranked individuals. We show that conceptual metaphorical mapping between social rank and the representational domain exists in our closest evolutionary relatives, the chimpanzees. Chimpanzee participants were requested to discriminate face identities in a vertical arrangement. We found a modulation of response latencies by the rank of the presented individual and the position on the display: a high-ranked individual presented in the higher and a low-ranked individual in the lower position led to quicker identity discrimination than a high-ranked individual in the lower and a low-ranked individual in the higher position. Such a spatial representation of dominance hierarchy in chimpanzees suggests that a natural tendency to systematically map an abstract dimension exists in the common ancestor of humans and chimpanzees.

DOI:http://dx.doi.org/10.7554/eLife.00932.001

It is thought that the ability to connect an abstract concept to something physical helps us to understand abstract ideas more easily. Examples include the use of conceptual metaphors that draw parallels between something abstract, such as social status, and physical position, even though there is no connection between them: familiar examples include phrases such as ‘top dog’ or ‘upper class’. It has long been assumed that the use of such conceptual metaphors is uniquely human.

Many social animals have hierarchies of dominance within groups, with particular individuals being ranked above or below other individuals. Chimpanzees—our closest relatives in the animal kingdom—are a good example of this, and although their cognitive processes are known to be similar to those of humans in many ways, we do not know if they make use of conceptual metaphors. Moreover, we don’t even know if conceptual metaphors can exist in the absence of language.

When researchers want to investigate how concepts are cognitively linked in the brain, they often use ‘coherent’ or ‘incoherent’ stimuli. A good example of an incoherent stimulus would be the word ‘red’ printed in blue ink. Because our neural representations of the colour blue and the word blue are linked, it is harder for a person to read the word red when it is printed in blue than when it is printed in red (which would be a coherent stimulus).

To test whether chimpanzees use a conceptual metaphor in which social status corresponds to height, Dahl and Adachi showed six chimpanzees photographs of four other chimpanzees who were known to them, and tested whether the relative positions of the photographs affected the ability of the chimpanzees to identify which of the two photographs they had been shown earlier. For example, a photograph of a high-ranked, dominant chimpanzee could be shown above a photograph of a lower-ranked chimpanzee (a coherent stimulus) or below a photograph of a lower-ranked chimpanzee (an incoherent stimulus). The chimpanzees doing the tests had to identify which of the photographs they had been shown earlier by touching the correct photograph on a screen.

Dahl and Adachi found that it took longer for chimpanzees to complete the task when the photograph was in the ‘wrong’ position. This suggests that the neural representations of social status and physical position might be linked in chimpanzees. If the social status and the physical position of the photograph match, the chimpanzee doing the test can quickly identify the photograph that it has been shown earlier. However, if they do not match, the conflict between the neural representations of social status and physical position slows down the response. These findings suggest that conceptual metaphors are not uniquely human and, moreover, that they could have emerged before the development of language.

DOI:http://dx.doi.org/10.7554/eLife.00932.002

Developing Race Categories in Infancy via Bayesian Face Recognition

The other-race effect emerges during infancy following the perceptual narrowing of face recognition. Other-race faces that were previously discriminable in early infancy cannot be distinguished by older infants. Presently, I discuss a Bayesian model of this process that posits that the other-race effect may be a consequence of learning to distinguish between intra-personal variation (changes to face appearance that preserve identity) and extra-personal variation (changes that do not preserve identity) in a visual environment in which a subset of race categories dominate. I demonstrate that race categories, which I have previously argued are a critical pre-cursor to the emergence of the other-race effect in infancy, are a natural by-product of this model. Perceptual narrowing for race may thus be a natural consequence of visual experience and the estimation of face variability based on a growing number of exemplars. I describe the basic architecture of the model, its applicability to a range of visual learning scenarios, and identify critical choices one faces in applying the model to a specific perceptual task. Despite the success of the model in accounting for these behavioral results, I conclude by identifying important shortcomings of the model and describe important challenges for future efforts to characterize the development of the other-race effect computationally.

The face inversion effect in non-human primates revisited - an investigation in chimpanzees (Pan troglodytes)

Faces presented upside-down are harder to recognize than presented right-side up, an effect known as the face inversion effect. With inversion the perceptual processing of the spatial relationship among facial parts is disrupted. Previous literature indicates a face inversion effect in chimpanzees toward familiar and conspecific faces. Although these results are not inconsistent with findings from humans they have some controversy in their methodology. Here, we employed a delayed matching-to-sample task to test captive chimpanzees on discriminating chimpanzee and human faces. Their performances were deteriorated by inversion. More importantly, the discrimination deterioration was systematically different between the two age groups of chimpanzee participants, i.e. young chimpanzees showed a stronger inversion effect for chimpanzee than for human faces, while old chimpanzees showed a stronger inversion effect for human than for chimpanzee faces. We conclude that the face inversion effect in chimpanzees is modulated by the level of expertise of face processing.