Humans and macaques employ similar face-processing strategies

Neuronal composition of processing modules in human V1: laminar density for neuronal and non-neuronal populations and a comparison with macaque

The neuronal composition of homologous brain regions in different primates is important for understanding their processing capacities. Primary visual cortex (V1) has been widely studied in different members of the catarrhines. Neuronal density is considered to be central in defining the structure-function relationship. In human, there are large variations in the reported neuronal density from prior studies. We found the neuronal density in human V1 was 79,000 neurons/mm3, which is 35% of the neuronal density previously determined in macaque V1. Laminar density was proportionally similar between human and macaque. In V1, the ocular dominance column (ODC) contains the circuits for the emergence of orientation preference and spatial processing of a point image in many mammalian species. Analysis of the total neurons in an ODC and of the full number of neurons in macular vision (the central 15°) indicates that humans have 1.3× more neurons than macaques even though the density of neurons in macaque is 3× the density in human V1. We propose that the number of neurons in a functional processing unit rather than the number of neurons under a mm2 of cortex is more appropriate for cortical comparisons across species.

Does the primate face cue personality?

When looking at others, primates primarily focus on the face - detecting the face first and looking at it longer than other parts of the body. This is because primate faces, even without expression, convey trait information crucial for navigating social relationships. Recent studies on primates, including humans, have linked facial features, specifically facial width-to-height ratio (fWHR), to rank and Dominance-related personality traits, suggesting these links' potential role in social decisions. However, studies on the association between dominance and fWHR report contradictory results in humans and variable patterns in nonhuman primates. It is also not clear whether and how nonhuman primates perceive different facial cues to personality traits and whether these may have evolved as social signals. This review summarises the variable facial-personality links, their underlying proximate and evolutionary mechanisms and their perception across primates. We emphasise the importance of employing comparative research, including various primate species and human populations, to disentangle phylogeny from socio-ecological drivers and to understand the selection pressures driving the facial-personality links in humans. Finally, we encourage researchers to move away from single facial measures and towards holistic measures and to complement perception studies using neuroscientific methods.

The use of gaze to study cognition: limitations, solutions, and applications to animal welfare

The study of gaze responses, typically using looking time paradigms, has become a popular approach to improving our understanding of cognitive processes in non-verbal individuals. Our interpretation of data derived from these paradigms, however, is constrained by how we conceptually and methodologically approach these problems. In this perspective paper, we outline the application of gaze studies in comparative cognitive and behavioral research and highlight current limitations in the interpretation of commonly used paradigms. Further, we propose potential solutions, including improvements to current experimental approaches, as well as broad-scale benefits of technology and collaboration. Finally, we outline the potential benefits of studying gaze responses from an animal welfare perspective. We advocate the implementation of these proposals across the field of animal behavior and cognition to aid experimental validity, and further advance our knowledge on a variety of cognitive processes and welfare outcomes.

Attention to Stimuli of Learned versus Innate Biological Value Relies on Separate Neural Systems

The neural bases of attention, a set of neural processes that promote behavioral selection, is a subject of intense investigation. In humans, rewarded cues influence attention, even when those cues are irrelevant to the current task. Because the amygdala plays a role in reward processing, and the activity of amygdala neurons has been linked to spatial attention, we reasoned that the amygdala may be essential for attending to rewarded images. To test this possibility, we used an attentional capture task, which provides a quantitative measure of attentional bias. Specifically, we compared reaction times (RTs) of adult male rhesus monkeys with bilateral amygdala lesions and unoperated controls as they made a saccade away from a high- or low-value rewarded image to a peripheral target. We predicted that: (1) RTs will be longer for high- compared with low-value images, revealing attentional capture by rewarded stimuli; and (2) relative to controls, monkeys with amygdala lesions would exhibit shorter RT for high-value images. For comparison, we assessed the same groups of monkeys for attentional capture by images of predators and conspecifics, categories thought to have innate biological value. In performing the attentional capture task, all monkeys were slowed more by high-value relative to low-value rewarded images. Contrary to our prediction, amygdala lesions failed to disrupt this effect. When presented with images of predators and conspecifics, however, monkeys with amygdala lesions showed significantly diminished attentional capture relative to controls. Thus, separate neural pathways are responsible for allocating attention to stimuli with learned versus innate value.SIGNIFICANCE STATEMENT Valuable objects attract attention. The amygdala is known to contribute to reward processing and the encoding of object reward value. We therefore examined whether the amygdala is necessary for allocating attention to rewarded objects. For comparison, we assessed the amygdala's contribution to attending to objects with innate biological value: predators and conspecifics. We found that the macaque amygdala is necessary for directing attention to images with innate biological value, but not for directing attention to recently learned reward-predictive images. These findings indicate that the amygdala makes selective contributions to attending to valuable objects. The data are relevant to mental health disorders, such as social anxiety disorders and small animal phobias, that arise from biased attention to select categories of objects.

Monkey visual attention does not fall into the uncanny valley

Very humanlike artificial agents can induce feelings of uneasiness in human perceivers. Stimuli that generate this response are said to occupy "the uncanny valley". Given inconsistent findings in the literature, whether or not nonhuman animals experience the uncanny valley is unclear. Here, we recorded the visual attention of eleven male rhesus monkeys as they viewed faces varying in realness across five levels, with visual attention measured by both number and duration of visual fixations on faces as a whole and on areas of interest within the faces (e.g., eyes, mouth). Face stimuli varied in terms of the realism of the image and behavior depicted by the face (lipsmack, threat, bared teeth, and neutral). We largely found no support that rhesus monkeys perceive an uncanny valley when viewing our stimuli; however, monkeys did generally pay more attention to eyes and less attention to mouths in real images compared to less realistic images. Across all stimuli, monkeys' visual attention was drawn to the mouths of images when teeth were visible. These findings suggest that rhesus monkeys in our study did not display an uncanny valley effect when viewing realistic stimuli but did percieve affective information depicted by faces regardless of how real those faces appear.

Human face and gaze perception is highly context specific and involves bottom-up and top-down neural processing

This review summarizes human perception and processing of face and gaze signals. Face and gaze signals are important means of non-verbal social communication. The review highlights that: (1) some evidence is available suggesting that the perception and processing of facial information starts in the prenatal period; (2) the perception and processing of face identity, expression and gaze direction is highly context specific, the effect of race and culture being a case in point. Culture affects by means of experiential shaping and social categorization the way in which information on face and gaze is collected and perceived; (3) face and gaze processing occurs in the so-called 'social brain'. Accumulating evidence suggests that the processing of facial identity, facial emotional expression and gaze involves two parallel and interacting pathways: a fast and crude subcortical route and a slower cortical pathway. The flow of information is bi-directional and includes bottom-up and top-down processing. The cortical networks particularly include the fusiform gyrus, superior temporal sulcus (STS), intraparietal sulcus, temporoparietal junction and medial prefrontal cortex.

Shape-invariant encoding of dynamic primate facial expressions in human perception

Dynamic facial expressions are crucial for communication in primates. Due to the difficulty to control shape and dynamics of facial expressions across species, it is unknown how species-specific facial expressions are perceptually encoded and interact with the representation of facial shape. While popular neural network models predict a joint encoding of facial shape and dynamics, the neuromuscular control of faces evolved more slowly than facial shape, suggesting a separate encoding. To investigate these alternative hypotheses, we developed photo-realistic human and monkey heads that were animated with motion capture data from monkeys and humans. Exact control of expression dynamics was accomplished by a Bayesian machine-learning technique. Consistent with our hypothesis, we found that human observers learned cross-species expressions very quickly, where face dynamics was represented largely independently of facial shape. This result supports the co-evolution of the visual processing and motor control of facial expressions, while it challenges appearance-based neural network theories of dynamic expression recognition.

Bodily emotional expressions are a primary source of information for dogs, but not for humans

Dogs have remarkable abilities to synergise their behaviour with that of people, but how dogs read facial and bodily emotional cues in comparison to humans remains unclear. Both species share the same ecological niche, are highly social and expressive, making them an ideal comparative model for intra- and inter-species emotion perception. We compared eye-tracking data from unrestrained humans and dogs when viewing dynamic and naturalistic emotional expressions in humans and dogs. Dogs attended more to the body than the head of human and dog figures, unlike humans who focused more on the head of both species. Dogs and humans also showed a clear age effect that reduced head gaze. Our results indicate a species-specific evolutionary adaptation for emotion perception, which is only partly modified for heterospecific cues. These results have important implications for managing the risk associated with human-dog interactions, where expressive and perceptual differences are crucial.

Individual recognition is associated with holistic face processing in Polistes paper wasps in a species-specific way

Most recognition is based on identifying features, but specialization for face recognition in primates relies on a different mechanism, termed 'holistic processing' where facial features are bound together into a gestalt which is more than the sum of its parts. Here, we test whether individual face recognition in paper wasps also involved holistic processing using a modification of the classic part-whole test in two related paper wasp species: Polistes fuscatus, which use facial patterns to individually identify conspecifics, and Polistes dominula, which lacks individual recognition. We show that P. fuscatus use holistic processing to discriminate between P. fuscatus face images but not P. dominula face images. By contrast, P. dominula do not rely on holistic processing to discriminate between conspecific or heterospecific face images. Therefore, P. fuscatus wasps have evolved holistic face processing, but this ability is highly specific and shaped by species-specific and stimulus-specific selective pressures. Convergence towards holistic face processing in distant taxa (primates, wasps) as well as divergence among closely related taxa with different recognition behaviour (P. dominula, P. fuscatus) suggests that holistic processing may be a universal adaptive strategy to facilitate expertise in face recognition.

Observing animals and humans: dogs target their gaze to the biological information in natural scenes

BACKGROUND

This study examines how dogs observe images of natural scenes containing living creatures (wild animals, dogs and humans) recorded with eye gaze tracking. Because dogs have had limited exposure to wild animals in their lives, we also consider the natural novelty of the wild animal images for the dogs.

METHODS

The eye gaze of dogs was recorded while they viewed natural images containing dogs, humans, and wild animals. Three categories of images were used: naturalistic landscape images containing single humans or animals, full body images containing a single human or an animal, and full body images containing a pair of humans or animals. The gazing behavior of two dog populations, family and kennel dogs, were compared.

RESULTS

As a main effect, dogs gazed at living creatures (object areas) longer than the background areas of the images; heads longer than bodies; heads longer than background areas; and bodies longer than background areas. Dogs gazed less at the object areas vs. the background in landscape images than in the other image categories. Both dog groups also gazed wild animal heads longer than human or dog heads in the images. When viewing single animal and human images, family dogs focused their gaze very prominently on the head areas, but in images containing a pair of animals or humans, they gazed more at the body than the head areas. In kennel dogs, the difference in gazing times of the head and body areas within single or paired images failed to reach significance.

DISCUSSION

Dogs focused their gaze on living creatures in all image categories, also detecting them in the natural landscape images. Generally, they also gazed at the biologically informative areas of the images, such as the head, which supports the importance of the head/face area for dogs in obtaining social information. The natural novelty of the species represented in the images as well as the image category affected the gazing behavior of dogs. Furthermore, differences in the gazing strategy between family and kennel dogs was obtained, suggesting an influence of different social living environments and life experiences.

Observing animals and humans: dogs target their gaze to the biological information in natural scenes

Background

This study examines how dogs observe images of natural scenes containing living creatures (wild animals, dogs and humans) recorded with eye gaze tracking. Because dogs have had limited exposure to wild animals in their lives, we also consider the natural novelty of the wild animal images for the dogs.

Methods

The eye gaze of dogs was recorded while they viewed natural images containing dogs, humans, and wild animals. Three categories of images were used: naturalistic landscape images containing single humans or animals, full body images containing a single human or an animal, and full body images containing a pair of humans or animals. The gazing behavior of two dog populations, family and kennel dogs, were compared.

Results

As a main effect, dogs gazed at living creatures (object areas) longer than the background areas of the images; heads longer than bodies; heads longer than background areas; and bodies longer than background areas. Dogs gazed less at the object areas vs. the background in landscape images than in the other image categories. Both dog groups also gazed wild animal heads longer than human or dog heads in the images. When viewing single animal and human images, family dogs focused their gaze very prominently on the head areas, but in images containing a pair of animals or humans, they gazed more at the body than the head areas. In kennel dogs, the difference in gazing times of the head and body areas within single or paired images failed to reach significance.

Discussion

Dogs focused their gaze on living creatures in all image categories, also detecting them in the natural landscape images. Generally, they also gazed at the biologically informative areas of the images, such as the head, which supports the importance of the head/face area for dogs in obtaining social information. The natural novelty of the species represented in the images as well as the image category affected the gazing behavior of dogs. Furthermore, differences in the gazing strategy between family and kennel dogs was obtained, suggesting an influence of different social living environments and life experiences.

New approaches to quantify social development in rhesus macaques (Macaca mulatta): Integrating eye tracking with traditional assessments of social behavior

The nonhuman primate provides a sophisticated animal model system both to explore neurobiological mechanisms underlying complex behaviors and to facilitate preclinical research for neurodevelopmental and neuropsychiatric disease. A better understanding of evolutionarily conserved behaviors and brain processes between humans and nonhuman primates will be needed to successfully apply recently released NIMH guidelines (NOT-MH-19-053) for conducting rigorous nonhuman primate neurobehavioral research. Here, we explore the relationship between two measures of social behavior that can be used in both humans and nonhuman primates-traditional observations of social interactions with conspecifics and eye gaze detection in response to social stimuli. Infant male rhesus macaques (Macaca mulatta) serving as controls (N = 14) for an ongoing study were observed in their social rearing groups and participated in a noninvasive, longitudinal eye-tracking study. We found significant positive relationships between time spent viewing eyes of faces in an eye tracker and number of initiations made for social interactions with peers that is consistent with similar observations in human populations. Although future studies are needed to determine if this relationship represents species-typical social developmental processes, these preliminary results provide a novel framework to explore the relationship between social interactions and social attention in nonhuman primate models for neurobehavioral development.

Macaque Gaze Responses to the Primatar: A Virtual Macaque Head for Social Cognition Research

Following the expanding use and applications of virtual reality in everyday life, realistic virtual stimuli are of increasing interest in cognitive studies. They allow for control of features such as gaze, expression, appearance, and movement, which may help to overcome limitations of using photographs or video recordings to study social responses. In using virtual stimuli however, one must be careful to avoid the uncanny valley effect, where realistic stimuli can be perceived as eerie, and induce an aversion response. At the same time, it is important to establish whether responses to virtual stimuli mirror responses to depictions of a real conspecific. In the current study, we describe the development of a new virtual monkey head with realistic facial features for experiments with nonhuman primates, the "Primatar." As a first step toward validation, we assessed how monkeys respond to facial images of a prototype of this Primatar compared to images of real monkeys (RMs), and an unrealistic model. We also compared gaze responses between original images and scrambled as well as obfuscated versions of these images. We measured looking time to images in six freely moving long-tailed macaques (Macaca fascicularis) and gaze exploration behavior in three rhesus macaques (Macaca mulatta). Both groups showed more signs of overt attention to original images than scrambled or obfuscated images. In addition, we found no evidence for an uncanny valley effect; since for both groups, looking times did not differ between real, realistic, or unrealistic images. These results provide important data for further development of our Primatar for use in social cognition studies and more generally for cognitive research with virtual stimuli in nonhuman primates. Future research on the absence of an uncanny valley effect in macaques is needed, to elucidate the roots of this mechanism in humans.

The structure of species discrimination signals across a primate radiation

Discriminating conspecifics from heterospecifics can help avoid costly interactions between closely related sympatric species. The guenons, a recent primate radiation, exhibit high degrees of sympatry and form multi-species groups. Guenons have species-specific colorful face patterns hypothesized to function in species discrimination. Here, we use a machine learning approach to identify face regions most essential for species classification across fifteen guenon species. We validate these computational results using experiments with live guenons, showing that facial traits critical for accurate classification influence selective attention toward con- and heterospecific faces. Our results suggest variability among guenon species in reliance on single-trait-based versus holistic facial characteristics for species discrimination, with behavioral responses and computational results indicating variation from single-trait to whole-face patterns. Our study supports a role for guenon face patterns in species discrimination, and shows how complex signals can be informative about differences between species across a speciose and highly sympatric radiation.

Bridging the species gap in translational research for neurodevelopmental disorders

The prevalence and societal impact of neurodevelopmental disorders (NDDs) continue to increase despite years of research in both patient populations and animal models. There remains an urgent need for translational efforts between clinical and preclinical research to (i) identify and evaluate putative causes of NDD, (ii) determine their underlying neurobiological mechanisms, (iii) develop and test novel therapeutic approaches, and (iv) translate basic research into safe and effective clinical practices. Given the complexity behind potential causes and behaviors affected by NDDs, modeling these uniquely human brain disorders in animals will require that we capitalize on unique advantages of a diverse array of species. While much NDD research has been conducted in more traditional animal models such as the mouse, ultimately, we may benefit from creating animal models with species that have a more sophisticated social behavior repertoire such as the rat (Rattus norvegicus) or species that more closely related to humans, such as the rhesus macaque (Macaca mulatta). Here, we highlight the rat and rhesus macaque models for their role in previous psychological research discoveries, current efforts to understand the neurobiology of NDDs, and focus on the convergence of behavior outcome measures that parallel features of human NDDs.

A parameterized digital 3D model of the Rhesus macaque face for investigating the visual processing of social cues

BACKGROUND

Rhesus macaques are the most popular model species for studying the neural basis of visual face processing and social interaction using intracranial methods. However, the challenge of creating realistic, dynamic, and parametric macaque face stimuli has limited the experimental control and ethological validity of existing approaches.

NEW METHOD

We performed statistical analyses of in vivo computed tomography data to generate an anatomically accurate, three-dimensional representation of Rhesus macaque cranio-facial morphology. The surface structures were further edited, rigged and textured by a professional digital artist with careful reference to photographs of macaque facial expression, colouration and pelage.

RESULTS

The model offers precise, continuous, parametric control of craniofacial shape, emotional expression, head orientation, eye gaze direction, and many other parameters that can be adjusted to render either static or dynamic high-resolution faces. Example single-unit responses to such stimuli in macaque inferotemporal cortex demonstrate the value of parametric control over facial appearance and behaviours.

COMPARISON WITH EXISTING METHOD(S)

The generation of such a high-dimensionality and systematically controlled stimulus set of conspecific faces, with accurate craniofacial modelling and professional finalization of facial details, is currently not achievable using existing methods.

CONCLUSIONS

The results herald a new set of possibilities in adaptive sampling of a high-dimensional and socially meaningful feature space, thus opening the door to systematic testing of hypotheses about the abundant neural specialization for faces found in the primate.

Fish focus primarily on the faces of other fish

“Face” is a special stimulus in humans and, nonhuman primates, and some other social mammals; that is, they perceive the face differently from the other body parts and other stimuli. In these species, the face conveys much information, so individuals examine the face at first sight rather than other body parts. Similar to mammals, the faces of fish also convey much information, but little is known about whether fish pay attention to the face or face-viewing patterns. Here we document the face-viewing patterns of the cichlid fish Neolamprologus brichardi, which can distinguish between conspecifics based on facial colouration. First, we established a method to identify the point at which subject fish inspected. Fish often fixated in direction to their heads toward the object of attention, suggesting that the extended body axis indicated the attention point. Using this attribute, we examined the point of attention of subject fish presented with photographs of conspecifics and heterospecifics. The results revealed that the fish inspected initially and repeatedly at the face and the duration was longer for the face than other body parts.

Viewing heterospecific facial expressions: an eye-tracking study of human and monkey viewers

Common facial expressions of emotion have distinctive patterns of facial muscle movements that are culturally similar among humans, and perceiving these expressions is associated with stereotypical gaze allocation at local facial regions that are characteristic for each expression, such as eyes in angry faces. It is, however, unclear to what extent this 'universality' view can be extended to process heterospecific facial expressions, and how 'social learning' process contributes to heterospecific expression perception. In this eye-tracking study, we examined face-viewing gaze allocation of human (including dog owners and non-dog owners) and monkey observers while exploring expressive human, chimpanzee, monkey and dog faces (positive, neutral and negative expressions in human and dog faces; neutral and negative expressions in chimpanzee and monkey faces). Human observers showed species- and experience-dependent expression categorization accuracy. Furthermore, both human and monkey observers demonstrated different face-viewing gaze distributions which were also species dependent. Specifically, humans predominately attended at human eyes but animal mouth when judging facial expressions. Monkeys' gaze distributions in exploring human and monkey faces were qualitatively different from exploring chimpanzee and dog faces. Interestingly, the gaze behaviour of both human and monkey observers were further affected by their prior experience of the viewed species. It seems that facial expression processing is species dependent, and social learning may play a significant role in discriminating even rudimentary types of heterospecific expressions.

Non-invasive Eye Tracking Methods for New World and Old World Monkeys

Eye-tracking methods measure what humans and other animals visually attend to in the environment. In nonhuman primates, eye tracking can be used to test hypotheses about how primates process social information. This information can further our understanding of primate behavior as well as offer unique translational potential to explore causes of or treatments for altered social processing as seen in people with neurodevelopmental disorders such as autism spectrum disorder and schizophrenia. However, previous methods for collecting eye-tracking data in nonhuman primates required some form of head restraint, which limits the opportunities for research with respect to the number of or kinds of primates that can undergo an eye-tracking study. We developed a novel, noninvasive method for collecting eye tracking data that can be used both in animals that are difficult to restrain without sedation as well as animals that are of different ages and sizes as the box size can be adjusted. Using a transport box modified with a viewing window, we collected eye-tracking data in both New (Callicebus cupreus) and Old World monkeys (Macaca mulatta) across multiple developmental time points. These monkeys had the option to move around the box and avert their eyes from the screen, yet, they demonstrated a natural interest in viewing species-specific imagery with no previous habituation to the eye-tracking paradigm. Provided with opportunistic data from voluntary viewing of stimuli, we found that juveniles viewed stimuli more than other age groups, videos were viewed more than static photo imagery, and that monkeys increased their viewing time when presented with multiple eye tracking sessions. This noninvasive approach opens new opportunities to integrate eye-tracking studies into nonhuman primate research.

Emotion recognition from body movement and gesture in children with Autism Spectrum Disorder is improved by situational cues

BACKGROUND

Research shows people with Autism Spectrum Disorder (ASD) have poorer emotion recognition (ER) compared to their typically developing (TD) peers. However, it is not known whether this is the case when stimuli are limited to gesture and posture, and lack facial expressions.

METHOD

Fifty-four children with (n = 27) and without (n = 27) ASD, matched on age and gender, completed an ER task, that used dynamic stimuli. Processing style bias, Autistic-like-traits and empathy were also measured. With ER as the outcome variable, a multilevel logistic model was created.

RESULTS

Children with ASD were found to be significantly less accurate in identifying emotions, compared to the control group. Presence of situational cues aided both groups. Autistic-like-traits and empathy were found to correlate too highly with the diagnosed condition to use in the multilevel model. Processing style did not significantly impact ER ability.

CONCLUSIONS

This study supports previous research which finds ER ability in people with ASD to be poorer than that of TD peers and that situational cues can aid ER ability. Importantly, the latter is true for people with ASD. The implication of these findings are programmes that aim to improve ER should consider using cues. Limitations of the study are discussed.

Visual preferences for direct-gaze faces in infant macaques (Macaca mulatta) with limited face exposure

From birth, human and nonhuman primates attend more to faces with direct gaze compared with averted gaze, and previous studies report that attention to the eyes is linked to the emergence of later social skills. Here, we explored whether early experiences influence attraction to eye contact in infant macaques by examining their attention to face pairs varying in their gaze direction across the first 13 weeks of life. Infants raised by human caretakers had limited conspecific interactions (nursery-reared; N = 16) and were compared to infants raised in rich social environments (mother-reared; N = 20). Both groups looked longer to faces and the eyes of direct compared to averted-gaze faces. Looking to all faces and eyes also increased with age. Nursery-reared infants did not display age-associated increases in attention to direct-gaze faces specifically, suggesting that, while there may be an initial preference for direct-gaze faces from birth, social experiences may support its early development.

Implicit preference for human trustworthy faces in macaque monkeys

It has been shown that human judgements of trustworthiness are based on subtle processing of specific facial features. However, it is not known if this ability is a specifically human function, or whether it is shared among primates. Here we report that macaque monkeys (Macaca Mulatta and Macaca Fascicularis), like humans, display a preferential attention to trustworthiness-associated facial cues in computer-generated human faces. Monkeys looked significantly longer at faces categorized a priori as trustworthy compared to untrustworthy. In addition, spatial sequential analysis of monkeys’ initial saccades revealed an upward shift with attention moving to the eye region for trustworthy faces while no change was observed for the untrustworthy ones. Finally, we found significant correlations between facial width-to-height ratio– a morphometric feature that predicts trustworthiness’ judgments in humans – and looking time in both species. These findings suggest the presence of common mechanisms among primates for first impression of trustworthiness.

Humans infer the trustworthiness of others based on subtle facial features such as the facial width-to-height ratio, but it is not known whether other primates are sensitive to these cues. Here, the authors show that macaque monkeys prefer to look at human faces which appear trustworthy to humans.

Parent-offspring facial resemblance increases with age in rhesus macaques

Kin recognition is a key ability which facilitates the acquisition of inclusive fitness benefits and enables optimal outbreeding. In primates, phenotype matching is considered particularly important for the recognition of patrilineal relatives, as information on paternity is unlikely to be available via social familiarity. Phenotypic cues to both paternal and maternal relatedness exist in the facial features of humans and other primates. However, theoretical models suggest that in systems with uncertainty parentage it may be adaptive for offspring to conceal such cues when young, in order to avoid potential costs of being discriminated against by unrelated adults. Using experienced human raters, we demonstrate in a computer-based task that detection of parent-offspring resemblances in the faces of rhesus macaques (Macaca mulatta) increases significantly with offspring age. Moreover, this effect is specific to information about kinship, as raters were extremely successful at discriminating individuals even among the youngest animals. To our knowledge, this is the first evidence in non-humans for the age-dependent expression of visual cues used in kin recognition.

The effect of sampling rate and lowpass filters on saccades - A modeling approach

The study of eye movements has become popular in many fields of science. However, using the preprocessed output of an eye tracker without scrutiny can lead to low-quality or even erroneous data. For example, the sampling rate of the eye tracker influences saccadic peak velocity, while inadequate filters fail to suppress noise or introduce artifacts. Despite previously published guiding values, most filter choices still seem motivated by a trial-and-error approach, and a thorough analysis of filter effects is missing. Therefore, we developed a simple and easy-to-use saccade model that incorporates measured amplitude-velocity main sequences and produces saccades with a similar frequency content to real saccades. We also derived a velocity divergence measure to rate deviations between velocity profiles. In total, we simulated 155 saccades ranging from 0.5° to 60° and subjected them to different sampling rates, noise compositions, and various filter settings. The final goal was to compile a list with the best filter settings for each of these conditions. Replicating previous findings, we observed reduced peak velocities at lower sampling rates. However, this effect was highly non-linear over amplitudes and increasingly stronger for smaller saccades. Interpolating the data to a higher sampling rate significantly reduced this effect. We hope that our model and the velocity divergence measure will be used to provide a quickly accessible ground truth without the need for recording and manually labeling saccades. The comprehensive list of filters allows one to choose the correct filter for analyzing saccade data without resorting to trial-and-error methods.

Sex and rank affect how infant rhesus macaques look at faces

We investigated how differences in infant sex and mothers' dominance status affect infant rhesus macaques' (Macaca mulatta) interest in visually exploring emotional facial expressions. Thirty-eight infants were presented with animated avatars of macaque facial expressions during the first month of life. Sons of high-ranking mothers looked more at faces, especially the eye region, than sons of low-ranking mothers, but no difference in looking duration was found for daughters. Males looked significantly more at eyes than females, but this effect was reversed in infants who were reared without mothers in a primate nursery facility. In addition, in mother-infant interactions, mothers of sons were more likely to gaze at their infant's face compared to mothers of daughters. Combined with previous research indicating that rhesus macaque mothers interact differently with infants based on their own rank and infant's sex, these results support the view that social experiences shape early face preferences in rhesus macaques.

Crucial information for efficient face searching by humans and Japanese macaques

Humans can efficiently detect a face among non-face objects, but few studies of this ability have been conducted in animals. Here, in Japanese macaques and humans, we examined visual searching for a face and explored what factors contribute to efficient facial information processing. Subjects were asked to search for an odd target among the different numbers of distracters. Faces of the subjects' own species, the backs of the head of the subjects' own species, faces of the subjects' closely related species or race, and faces of species that are clearly different from the subjects' own species were used as the target. Both the macaques and humans detected a face of their own species more efficiently than a face from a clearly different species. Similar efficient detections were confirmed for the faces of the subjects' closely related species or race. These results suggest that conspecific faces and faces that share morphological similarity with conspecific faces can be detected efficiently among non-face objects by both humans and Japanese macaques. In another experiment, facial recognition efficiency was observed when the subjects searched for own-species faces that had lower-spatial-frequency components compared to faces with higher-spatial-frequency components. It seems reasonable that the ability to search efficiently for faces by using holistic face processing is derived from fundamental social cognition abilities that are broadly shared among species.

Preference for facial averageness: Evidence for a common mechanism in human and macaque infants

Human adults and infants show a preference for average faces, which could stem from a general processing mechanism and may be shared among primates. However, little is known about preference for facial averageness in monkeys. We used a comparative developmental approach and eye-tracking methodology to assess visual attention in human and macaque infants to faces naturally varying in their distance from a prototypical face. In Experiment 1, we examined the preference for faces relatively close to or far from the prototype in 12-month-old human infants with human adult female faces. Infants preferred faces closer to the average than faces farther from it. In Experiment 2, we measured the looking time of 3-month-old rhesus macaques (Macaca mulatta) viewing macaque faces varying in their distance from the prototype. Like human infants, macaque infants looked longer to faces closer to the average. In Experiments 3 and 4, both species were presented with unfamiliar categories of faces (i.e., macaque infants tested with adult macaque faces; human infants and adults tested with infant macaque faces) and showed no prototype preferences, suggesting that the prototypicality effect is experience-dependent. Overall, the findings suggest a common processing mechanism across species, leading to averageness preferences in primates.

Face Detection and the Development of Own-Species Bias in Infant Macaques

In visually complex environments, numerous items compete for attention. Infants may exhibit attentional efficiency-privileged detection, attention capture, and holding-for face-like stimuli. However, it remains unknown when these biases develop and what role, if any, experience plays in this emerging skill. Here, nursery-reared infant macaques' (Macaca mulatta; n = 10) attention to faces in 10-item arrays of nonfaces was measured using eye tracking. With limited face experience, 3-week-old monkeys were more likely to detect faces and looked longer at faces compared to nonfaces, suggesting a robust face detection system. By 3 months, after peer exposure, infants looked faster to conspecific faces but not heterospecific faces, suggesting an own-species bias in face attention capture, consistent with perceptual attunement.

Early Predictors of Impaired Social Functioning in Male Rhesus Macaques (Macaca mulatta)

Autism spectrum disorder (ASD) is characterized by social cognition impairments but its basic disease mechanisms remain poorly understood. Progress has been impeded by the absence of animal models that manifest behavioral phenotypes relevant to ASD. Rhesus monkeys are an ideal model organism to address this barrier to progress. Like humans, rhesus monkeys are highly social, possess complex social cognition abilities, and exhibit pronounced individual differences in social functioning. Moreover, we have previously shown that Low-Social (LS) vs. High-Social (HS) adult male monkeys exhibit lower social motivation and poorer social skills. It is not known, however, when these social deficits first emerge. The goals of this study were to test whether juvenile LS and HS monkeys differed as infants in their ability to process social information, and whether infant social abilities predicted later social classification (i.e., LS vs. HS), in order to facilitate earlier identification of monkeys at risk for poor social outcomes. Social classification was determined for N = 25 LS and N = 25 HS male monkeys that were 1-4 years of age. As part of a colony-wide assessment, these monkeys had previously undergone, as infants, tests of face recognition memory and the ability to respond appropriately to conspecific social signals. Monkeys later identified as LS vs. HS showed impairments in recognizing familiar vs. novel faces and in the species-typical adaptive ability to gaze avert to scenes of conspecific aggression. Additionally, multivariate logistic regression using infant social ability measures perfectly predicted later social classification of all N = 50 monkeys. These findings suggest that an early capacity to process important social information may account for differences in rhesus monkeys' motivation and competence to establish and maintain social relationships later in life. Further development of this model will facilitate identification of novel biological targets for intervention to improve social outcomes in at-risk young monkeys.

The Motivational Salience of Faces Is Related to Both Their Valence and Dominance

Both behavioral and neural measures of the motivational salience of faces are positively correlated with their physical attractiveness. Whether physical characteristics other than attractiveness contribute to the motivational salience of faces is not known, however. Research with male macaques recently showed that more dominant macaques’ faces hold greater motivational salience. Here we investigated whether dominance also contributes to the motivational salience of faces in human participants. Principal component analysis of third-party ratings of faces for multiple traits revealed two orthogonal components. The first component (“valence”) was highly correlated with rated trustworthiness and attractiveness. The second component (“dominance”) was highly correlated with rated dominance and aggressiveness. Importantly, both components were positively and independently related to the motivational salience of faces, as assessed from responses on a standard key-press task. These results show that at least two dissociable components underpin the motivational salience of faces in humans and present new evidence for similarities in how humans and non-human primates respond to facial cues of dominance.

Dogs Evaluate Threatening Facial Expressions by Their Biological Validity--Evidence from Gazing Patterns

Appropriate response to companions' emotional signals is important for all social creatures. The emotional expressions of humans and non-human animals have analogies in their form and function, suggesting shared evolutionary roots, but very little is known about how animals other than primates view and process facial expressions. In primates, threat-related facial expressions evoke exceptional viewing patterns compared with neutral or positive stimuli. Here, we explore if domestic dogs (Canis familiaris) have such an attentional bias toward threatening social stimuli and whether observed emotional expressions affect dogs' gaze fixation distribution among the facial features (eyes, midface and mouth). We recorded the voluntary eye gaze of 31 domestic dogs during viewing of facial photographs of humans and dogs with three emotional expressions (threatening, pleasant and neutral). We found that dogs' gaze fixations spread systematically among facial features. The distribution of fixations was altered by the seen expression, but eyes were the most probable targets of the first fixations and gathered longer looking durations than mouth regardless of the viewed expression. The examination of the inner facial features as a whole revealed more pronounced scanning differences among expressions. This suggests that dogs do not base their perception of facial expressions on the viewing of single structures, but the interpretation of the composition formed by eyes, midface and mouth. Dogs evaluated social threat rapidly and this evaluation led to attentional bias, which was dependent on the depicted species: threatening conspecifics' faces evoked heightened attention but threatening human faces instead an avoidance response. We propose that threatening signals carrying differential biological validity are processed via distinctive neurocognitive pathways. Both of these mechanisms may have an adaptive significance for domestic dogs. The findings provide a novel perspective on understanding the processing of emotional expressions and sensitivity to social threat in non-primates.

Judgments of Monkey's (Macaca mulatta) Facial Expressions by Humans: Does Housing Condition "Affect" Countenance?

The ability to interpret facial expressions of others is one of the more important abilities possessed by humans. However, is it possible for humans to accurately interpret the facial expressions of another species of primate, namely rhesus monkeys (Macaca mulatta)? We investigated this possibility by taking digital photos of four rhesus monkeys housed either singly or socially and allowing thirty-one participants to judge these photographs as representing either a happy, sad, or neutral monkey. Results indicated that the photographs of monkeys that were socially housed were more likely to be rated as happy or neutral than were photographs of singly housed monkeys. We suggest that these results imply important parallels between the perception of human and nonhuman primate facial expressions as well as introduce a potential new method for assessing nonhuman primate well-being.

Face in profile view reduces perceived facial expression intensity: an eye-tracking study

Recent studies measuring the facial expressions of emotion have focused primarily on the perception of frontal face images. As we frequently encounter expressive faces from different viewing angles, having a mechanism which allows invariant expression perception would be advantageous to our social interactions. Although a couple of studies have indicated comparable expression categorization accuracy across viewpoints, it is unknown how perceived expression intensity and associated gaze behaviour change across viewing angles. Differences could arise because diagnostic cues from local facial features for decoding expressions could vary with viewpoints. Here we manipulated orientation of faces (frontal, mid-profile, and profile view) displaying six common facial expressions of emotion, and measured participants' expression categorization accuracy, perceived expression intensity and associated gaze patterns. In comparison with frontal faces, profile faces slightly reduced identification rates for disgust and sad expressions, but significantly decreased perceived intensity for all tested expressions. Although quantitatively viewpoint had expression-specific influence on the proportion of fixations directed at local facial features, the qualitative gaze distribution within facial features (e.g., the eyes tended to attract the highest proportion of fixations, followed by the nose and then the mouth region) was independent of viewpoint and expression type. Our results suggest that the viewpoint-invariant facial expression processing is categorical perception, which could be linked to a viewpoint-invariant holistic gaze strategy for extracting expressive facial cues.

Face inversion decreased information about facial identity and expression in face-responsive neurons in macaque area TE

To investigate the effect of face inversion and thatcherization (eye inversion) on temporal processing stages of facial information, single neuron activities in the temporal cortex (area TE) of two rhesus monkeys were recorded. Test stimuli were colored pictures of monkey faces (four with four different expressions), human faces (three with four different expressions), and geometric shapes. Modifications were made in each face-picture, and its four variations were used as stimuli: upright original, inverted original, upright thatcherized, and inverted thatcherized faces. A total of 119 neurons responded to at least one of the upright original facial stimuli. A majority of the neurons (71%) showed activity modulations depending on upright and inverted presentations, and a lesser number of neurons (13%) showed activity modulations depending on original and thatcherized face conditions. In the case of face inversion, information about the fine category (facial identity and expression) decreased, whereas information about the global category (monkey vs human vs shape) was retained for both the original and thatcherized faces. Principal component analysis on the neuronal population responses revealed that the global categorization occurred regardless of the face inversion and that the inverted faces were represented near the upright faces in the principal component analysis space. By contrast, the face inversion decreased the ability to represent human facial identity and monkey facial expression. Thus, the neuronal population represented inverted faces as faces but failed to represent the identity and expression of the inverted faces, indicating that the neuronal representation in area TE cause the perceptual effect of face inversion.

Animal paradigms to assess cognition with translation to humans

Cognition is a complex brain function that represents processes such as learning and memory, attention, working memory, and executive functions amongst others. Impairments in cognition are prevalent in many neuropsychiatric and neurological disorders with few viable treatment options. The development of new therapies is challenging, and poor efficacy in clinical development continues to be one of the most consistent reasons compounds fail to advance, suggesting that traditional animal models are not predictive of human conditions and behavior. An effort to improve the construct validity of neuropsychological testing across species with the intent of facilitating therapeutic development has been strengthening over recent years. With an emphasis on understanding the underlying biology, optimizing the use of appropriate systems (e.g., transgenic animals) to model targeted disease states, and incorporating non-rodent species (e.g., non-human primates) that may enable a closer comparison to humans, an improvement in the translatability of the results will be possible. This chapter focuses on some promising translational cognitive paradigms for use in rodents, non-human primates, and humans.

Effect of distracting faces on visual selective attention in the monkey

In primates, visual stimuli with social and emotional content tend to attract attention. Attention might be captured through rapid, automatic, subcortical processing or guided by slower, more voluntary cortical processing. Here we examined whether irrelevant faces with varied emotional expressions interfere with a covert attention task in macaque monkeys. In the task, the monkeys monitored a target grating in the periphery for a subtle color change while ignoring distracters that included faces appearing elsewhere on the screen. The onset time of distracter faces before the target change, as well as their spatial proximity to the target, was varied from trial to trial. The presence of faces, especially faces with emotional expressions interfered with the task, indicating a competition for attentional resources between the task and the face stimuli. However, this interference was significant only when faces were presented for greater than 200 ms. Emotional faces also affected saccade velocity and reduced pupillary reflex. Our results indicate that the attraction of attention by emotional faces in the monkey takes a considerable amount of processing time, possibly involving cortical-subcortical interactions. Intranasal application of the hormone oxytocin ameliorated the interfering effects of faces. Together these results provide evidence for slow modulation of attention by emotional distracters, which likely involves oxytocinergic brain circuits.

Own-race and own-species advantages in face perception: a computational view

The frequency to which an organism is exposed to a particular type of face influences recognition performance. For example, Asians are better in individuating Asian than Caucasian faces, known as the own-race advantage. Similarly, humans in general are better in individuating human than monkey faces, known as the own-species advantage. It is an open question whether the underlying mechanisms causing these effects are similar. We hypothesize that these processes are governed by neural plasticity of the face discrimination system to retain optimal discrimination performance in its environment. Using common face features derived from a set of images from various face classes, we show that maximizing the feature variance between different individuals while ensuring minimal variance within individuals achieved good discrimination performances on own-class faces when selecting a subset of feature dimensions. Further, the selected subset of features does not necessarily lead to an optimal performance on the other class of faces. Thus, the face discrimination system continuously re-optimizes its space constraint face representation to optimize recognition performance on the current distribution of faces in its environment. This model can account for both, the own-race and own-species advantages. We name this approach Space Constraint Optimized Representational Embedding (SCORE).

Part-based and configural processing of owner's face in dogs

Dogs exhibit characteristic looking patterns when looking at human faces but little is known about what the underlying cognitive mechanisms are and how much these are influenced by individual experience. In Experiment 1, seven dogs were trained in a simultaneous discrimination procedure to assess whether they could discriminate a) the owner's face parts (eyes, nose or mouth) presented in isolation and b) whole faces where the same parts were covered. Dogs discriminated all the three parts of the owner's face presented in isolation, but needed fewer sessions to reach the learning criterion for the eyes than for both nose and mouth. Moreover, covering the eyes region significantly disrupted face discriminability compared to the whole face condition while such difference was not found when the nose or mouth was hidden. In Experiment 2, dogs were presented with manipulated images of the owner's face (inverted, blurred, scrambled, grey-scale) to test the relative contribution of part-based and configural processing in the discrimination of human faces. Furthermore, by comparing the dogs enrolled in the previous experiment and seven ‘naïve’ dogs we examined if the relative contribution of part-based and configural processing was affected by dogs' experience with the face stimuli. Naïve dogs discriminated the owner only when configural information was provided, whereas expert dogs could discriminate the owner also when part-based processing was necessary. The present study provides the first evidence that dogs can discriminate isolated internal features of a human face and corroborate previous reports of salience of the eyes region for human face processing. Although the reliance on part-perception may be increased by specific experience, our findings suggest that human face discrimination by dogs relies mainly on configural rather than on part-based elaboration.

The other-race and other-species effects in face perception - a subordinate-level analysis

The ability of face discrimination is modulated by the frequency of exposure to a category of faces. In other words, lower discrimination performance was measured for infrequently encountered faces as opposed to frequently encountered ones. This phenomenon has been described in the literature: the own-race advantage, a benefit in processing own-race as opposed to the other-race faces, and the own-species advantage, a benefit in processing the conspecific type of faces as opposed to the heterospecific type. So far, the exact parameters that drive either of these two effects are not fully understood. In the following we present a full assessment of data in human participants describing the discrimination performances across two races (Asian and Caucasian) as well as a range of non-human primate faces (chimpanzee, Rhesus macaque and marmoset). We measured reaction times of Asian participants performing a delayed matching-to-sample task, and correlated the results with similarity estimates of facial configuration and face parts. We found faster discrimination of own-race above other-race/species faces. Further, we found a strong reliance on configural information in upright own-species/-race faces and on individual face parts in all inverted face classes, supporting the assumption of specialized processing for the face class of most frequent exposure.

Neonatal imitation predicts how infants engage with faces

In human infants, neonatal imitation and preferences for eyes are both associated with later social and communicative skills, yet the relationship between these abilities remains unexplored. Here we investigated whether neonatal imitation predicts facial viewing patterns in infant rhesus macaques. We first assessed infant macaques for lipsmacking (a core affiliative gesture) and tongue protrusion imitation in the first week of life. When infants were 10-28 days old, we presented them with an animated macaque avatar displaying a still face followed by lipsmacking or tongue protrusion movements. Using eye tracking technology, we found that macaque infants generally looked equally at the eyes and mouth during gesture presentation, but only lipsmacking-imitators showed significantly more looking at the eyes of the neutral still face. These results suggest that neonatal imitation performance may be an early measure of social attention biases and might potentially facilitate the identification of infants at risk for atypical social development.

Character displacement of Cercopithecini primate visual signals

Animal visual signals have the potential to act as an isolating barrier to prevent interbreeding of populations through a role in species recognition. Within communities of competing species, species recognition signals are predicted to undergo character displacement, becoming more visually distinctive from each other, however this pattern has rarely been identified. Using computational face recognition algorithms to model primate face processing, we demonstrate that the face patterns of guenons (tribe: Cercopithecini) have evolved under selection to become more visually distinctive from those of other guenon species with whom they are sympatric. The relationship between the appearances of sympatric species suggests that distinguishing conspecifics from other guenon species has been a major driver of diversification in guenon face appearance. Visual signals that have undergone character displacement may have had an important role in the tribe’s radiation, keeping populations that became geographically separated reproductively isolated on secondary contact.

Baby schema in human and animal faces induces cuteness perception and gaze allocation in children

The baby schema concept was originally proposed as a set of infantile traits with high appeal for humans, subsequently shown to elicit caretaking behavior and to affect cuteness perception and attentional processes. However, it is unclear whether the response to the baby schema may be extended to the human-animal bond context. Moreover, questions remain as to whether the cute response is constant and persistent or whether it changes with development. In the present study we parametrically manipulated the baby schema in images of humans, dogs, and cats. We analyzed responses of 3-6 year-old children, using both explicit (i.e., cuteness ratings) and implicit (i.e., eye gaze patterns) measures. By means of eye-tracking, we assessed children's preferential attention to images varying only for the degree of baby schema and explored participants' fixation patterns during a cuteness task. For comparative purposes, cuteness ratings were also obtained in a sample of adults. Overall our results show that the response to an infantile facial configuration emerges early during development. In children, the baby schema affects both cuteness perception and gaze allocation to infantile stimuli and to specific facial features, an effect not simply limited to human faces. In line with previous research, results confirm human positive appraisal toward animals and inform both educational and therapeutic interventions involving pets, helping to minimize risk factors (e.g., dog bites).

Neural representation of face familiarity in an awake chimpanzee

Evaluating the familiarity of faces is critical for social animals as it is the basis of individual recognition. In the present study, we examined how face familiarity is reflected in neural activities in our closest living relative, the chimpanzee. Skin-surface event-related brain potentials (ERPs) were measured while a fully awake chimpanzee observed photographs of familiar and unfamiliar chimpanzee faces (Experiment 1) and human faces (Experiment 2). The ERPs evoked by chimpanzee faces differentiated unfamiliar individuals from familiar ones around midline areas centered on vertex sites at approximately 200 ms after the stimulus onset. In addition, the ERP response to the image of the subject's own face did not significantly diverge from those evoked by familiar chimpanzees, suggesting that the subject's brain at a minimum remembered the image of her own face. The ERPs evoked by human faces were not influenced by the familiarity of target individuals. These results indicate that chimpanzee neural representations are more sensitive to the familiarity of conspecific than allospecific faces.

How dogs scan familiar and inverted faces: an eye movement study

Faces play an important role in communication and identity recognition in social animals. Domestic dogs often respond to human facial cues, but their face processing is weakly understood. In this study, facial inversion effect (deficits in face processing when the image is turned upside down) and responses to personal familiarity were tested using eye movement tracking. A total of 23 pet dogs and eight kennel dogs were compared to establish the effects of life experiences on their scanning behavior. All dogs preferred conspecific faces and showed great interest in the eye area, suggesting that they perceived images representing faces. Dogs fixated at the upright faces as long as the inverted faces, but the eye area of upright faces gathered longer total duration and greater relative fixation duration than the eye area of inverted stimuli, regardless of the species (dog or human) shown in the image. Personally, familiar faces and eyes attracted more fixations than the strange ones, suggesting that dogs are likely to recognize conspecific and human faces in photographs. The results imply that face scanning in dogs is guided not only by the physical properties of images, but also by semantic factors. In conclusion, in a free-viewing task, dogs seem to target their fixations at naturally salient and familiar items. Facial images were generally more attractive for pet dogs than kennel dogs, but living environment did not affect conspecific preference or inversion and familiarity responses, suggesting that the basic mechanisms of face processing in dogs could be hardwired or might develop under limited exposure.

Observed touch on a non-human face is not remapped onto the human observer's own face

Visual remapping of touch (VRT) is a phenomenon in which seeing a human face being touched enhances detection of tactile stimuli on the observer's own face, especially when the observed face expresses fear. This study tested whether VRT would occur when seeing touch on monkey faces and whether it would be similarly modulated by facial expressions. Human participants detected near-threshold tactile stimulation on their own cheeks while watching fearful, happy, and neutral human or monkey faces being concurrently touched or merely approached by fingers. We predicted minimal VRT for neutral and happy monkey faces but greater VRT for fearful monkey faces. The results with human faces replicated previous findings, demonstrating stronger VRT for fearful expressions than for happy or neutral expressions. However, there was no VRT (i.e. no difference between accuracy in touch and no-touch trials) for any of the monkey faces, regardless of facial expression, suggesting that touch on a non-human face is not remapped onto the somatosensory system of the human observer.