Own-race and own-species advantages in face perception: a computational view

Shape-invariant encoding of dynamic primate facial expressions in human perception

Dynamic facial expressions are crucial for communication in primates. Due to the difficulty to control shape and dynamics of facial expressions across species, it is unknown how species-specific facial expressions are perceptually encoded and interact with the representation of facial shape. While popular neural network models predict a joint encoding of facial shape and dynamics, the neuromuscular control of faces evolved more slowly than facial shape, suggesting a separate encoding. To investigate these alternative hypotheses, we developed photo-realistic human and monkey heads that were animated with motion capture data from monkeys and humans. Exact control of expression dynamics was accomplished by a Bayesian machine-learning technique. Consistent with our hypothesis, we found that human observers learned cross-species expressions very quickly, where face dynamics was represented largely independently of facial shape. This result supports the co-evolution of the visual processing and motor control of facial expressions, while it challenges appearance-based neural network theories of dynamic expression recognition.

Reduced perceptual narrowing in synesthesia

Synesthesia is a neurologic trait in which specific inducers, such as sounds, automatically elicit additional idiosyncratic percepts, such as color (thus "colored hearing"). One explanation for this trait-and the one tested here-is that synesthesia results from unusually weak pruning of cortical synaptic hyperconnectivity during early perceptual development. We tested the prediction from this hypothesis that synesthetes would be superior at making discriminations from nonnative categories that are normally weakened by experience-dependent pruning during a critical period early in development-namely, discrimination among nonnative phonemes (Hindi retroflex /d̪a/ and dental /ɖa/), among chimpanzee faces, and among inverted human faces. Like the superiority of 6-mo-old infants over older infants, the synesthetic groups were significantly better than control groups at making all the nonnative discriminations across five samples and three testing sites. The consistent superiority of the synesthetic groups in making discriminations that are normally eliminated during infancy suggests that residual cortical connectivity in synesthesia supports changes in perception that extend beyond the specific synesthetic percepts, consistent with the incomplete pruning hypothesis.

Viewing heterospecific facial expressions: an eye-tracking study of human and monkey viewers

Common facial expressions of emotion have distinctive patterns of facial muscle movements that are culturally similar among humans, and perceiving these expressions is associated with stereotypical gaze allocation at local facial regions that are characteristic for each expression, such as eyes in angry faces. It is, however, unclear to what extent this 'universality' view can be extended to process heterospecific facial expressions, and how 'social learning' process contributes to heterospecific expression perception. In this eye-tracking study, we examined face-viewing gaze allocation of human (including dog owners and non-dog owners) and monkey observers while exploring expressive human, chimpanzee, monkey and dog faces (positive, neutral and negative expressions in human and dog faces; neutral and negative expressions in chimpanzee and monkey faces). Human observers showed species- and experience-dependent expression categorization accuracy. Furthermore, both human and monkey observers demonstrated different face-viewing gaze distributions which were also species dependent. Specifically, humans predominately attended at human eyes but animal mouth when judging facial expressions. Monkeys' gaze distributions in exploring human and monkey faces were qualitatively different from exploring chimpanzee and dog faces. Interestingly, the gaze behaviour of both human and monkey observers were further affected by their prior experience of the viewed species. It seems that facial expression processing is species dependent, and social learning may play a significant role in discriminating even rudimentary types of heterospecific expressions.

Running in fear: an investigation into the dimensional account of emotion in discriminating emotional expressions

Emotion can be conceptualized by the dimensional account of emotion with the dimensions of valence and arousal. There is little discussion of the difference in discriminability across the dimensions. The present study hypothesized that any pair of emotional expressions differing in the polarity of both valence and arousal dimensions would be easier to distinguish than a pair differing in only one dimension. The results indicate that the difference in the dimensions did not affect participants' reaction time. Most pairs of emotional expressions, except those involving fear, were similarly discriminative. Reaction times to pairs with a fearful expression were faster than to those without. The fast reaction time to fearful facial expressions underscores the survival value of emotions.

Sequential information in a great ape utterance

Birdsong is a prime example of acoustically sophisticated vocal behaviour, but its complexity has evolved mainly through sexual selection to attract mates and repel sexual rivals. In contrast, non-human primate calls often mediate complex social interactions, but are generally regarded as acoustically simple. Here, we examine arguably the most complex call in great ape vocal communication, the chimpanzee (Pan troglodytes schweinfurthii) 'pant hoot'. This signal consists of four acoustically distinct phases: introduction, build-up, climax and let-down. We applied state-of-the-art Support Vector Machines (SVM) methodology to pant hoots produced by wild male chimpanzees of Budongo Forest, Uganda. We found that caller identity was apparent in all four phases, but most strongly in the low-amplitude introduction and high-amplitude climax phases. Age was mainly correlated with the low-amplitude introduction and build-up phases, dominance rank (i.e. social status) with the high-amplitude climax phase, and context (reflecting activity of the caller) with the low-amplitude let-down phase. We conclude that the complex acoustic structure of chimpanzee pant hoots is linked to a range of socially relevant information in the different phases of the call, reflecting the complex nature of chimpanzee social lives.

Developing the Own-Race Advantage in 4-, 6-, and 9-Month-Old Taiwanese Infants: A Perceptual Learning Perspective

Previous infant studies on the other-race effect have favored the perceptual narrowing view, or declined sensitivities to rarely exposed other-race faces. Here we wish to provide an alternative possibility, perceptual learning, manifested by improved sensitivity for frequently exposed own-race faces in the first year of life. Using the familiarization/visual-paired comparison paradigm, we presented 4-, 6-, and 9-month-old Taiwanese infants with oval-cropped Taiwanese, Caucasian, Filipino faces, and each with three different manipulations of increasing task difficulty (i.e., change identity, change eyes, and widen eye spacing). An adult experiment was first conducted to verify the task difficulty. Our results showed that, with oval-cropped faces, the 4 month-old infants could only discriminate Taiwanese "change identity" condition and not any others, suggesting an early own-race advantage at 4 months. The 6 month-old infants demonstrated novelty preferences in both Taiwanese and Caucasian "change identity" conditions, and proceeded to the Taiwanese "change eyes" condition. The 9-month-old infants demonstrated novelty preferences in the "change identity" condition of all three ethnic faces. They also passed the Taiwanese "change eyes" condition but could not extend this refined ability of detecting a change in the eyes for the Caucasian or Philippine faces. Taken together, we interpret the pattern of results as evidence supporting perceptual learning during the first year: the ability to discriminate own-race faces emerges at 4 months and continues to refine, while the ability to discriminate other-race faces emerges between 6 and 9 months and retains at 9 months. Additionally, the discrepancies in the face stimuli and methods between studies advocating the narrowing view and those supporting the learning view were discussed.

The evolution of general intelligence

The presence of general intelligence poses a major evolutionary puzzle, which has led to increased interest in its presence in nonhuman animals. The aim of this review is to critically evaluate this question and to explore the implications for current theories about the evolution of cognition. We first review domain-general and domain-specific accounts of human cognition in order to situate attempts to identify general intelligence in nonhuman animals. Recent studies are consistent with the presence of general intelligence in mammals (rodents and primates). However, the interpretation of a psychometric g factor as general intelligence needs to be validated, in particular in primates, and we propose a range of such tests. We then evaluate the implications of general intelligence in nonhuman animals for current theories about its evolution and find support for the cultural intelligence approach, which stresses the critical importance of social inputs during the ontogenetic construction of survival-relevant skills. The presence of general intelligence in nonhumans implies that modular abilities can arise in two ways, primarily through automatic development with fixed content and secondarily through learning and automatization with more variable content. The currently best-supported model, for humans and nonhuman vertebrates alike, thus construes the mind as a mix of skills based on primary and secondary modules. The relative importance of these two components is expected to vary widely among species, and we formulate tests to quantify their strength.

A specialized face-processing model inspired by the organization of monkey face patches explains several face-specific phenomena observed in humans

Converging reports indicate that face images are processed through specialized neural networks in the brain –i.e. face patches in monkeys and the fusiform face area (FFA) in humans. These studies were designed to find out how faces are processed in visual system compared to other objects. Yet, the underlying mechanism of face processing is not completely revealed. Here, we show that a hierarchical computational model, inspired by electrophysiological evidence on face processing in primates, is able to generate representational properties similar to those observed in monkey face patches (posterior, middle and anterior patches). Since the most important goal of sensory neuroscience is linking the neural responses with behavioral outputs, we test whether the proposed model, which is designed to account for neural responses in monkey face patches, is also able to predict well-documented behavioral face phenomena observed in humans. We show that the proposed model satisfies several cognitive face effects such as: composite face effect and the idea of canonical face views. Our model provides insights about the underlying computations that transfer visual information from posterior to anterior face patches.

Converging Evidence of Ubiquitous Male Bias in Human Sex Perception

Visually judging the sex of another can be achieved easily in most social encounters. When the signals that inform such judgements are weak (e.g. outdoors at night), observers tend to expect the presence of males-an expectation that may facilitate survival-critical decisions under uncertainty. The present aim was to examine whether this male bias depends on expertise. To that end, Caucasian and Asian observers targeted female and male hand images that were either the same or different to the observers' race (i.e. long term experience was varied) while concurrently, the proportion of targets changed across presentation blocks (i.e. short term experience change). It was thus found that: (i) observers of own-race stimuli were more likely to report the presence of males and absence of females, however (ii) observers of other-race stimuli--while still tending to accept stimuli as male--were not prone to rejecting female cues. Finally, (iii) male-biased measures did not track the relative frequency of targets or lures, disputing the notion that male bias derives from prior expectation about the number of male exemplars in a set. Findings are discussed in concert with the pan-stimulus model of human sex perception.

Integration or separation in the processing of facial properties--a computational view

A face recognition system ought to read out information about the identity, facial expression and invariant properties of faces, such as sex and race. A current debate is whether separate neural units in the brain deal with these face properties individually or whether a single neural unit processes in parallel all aspects of faces. While the focus of studies has been directed toward the processing of identity and facial expression, little research exists on the processing of invariant aspects of faces. In a theoretical framework we tested whether a system can deal with identity in combination with sex, race or facial expression using the same underlying mechanism. We used dimension reduction to describe how the representational face space organizes face properties when trained on different aspects of faces. When trained to learn identities, the system not only successfully recognized identities, but also was immediately able to classify sex and race, suggesting that no additional system for the processing of invariant properties is needed. However, training on identity was insufficient for the recognition of facial expressions and vice versa. We provide a theoretical approach on the interconnection of invariant facial properties and the separation of variant and invariant facial properties.