Primate social attention: Species differences and effects of individual experience in humans, great apes, and macaques

Closed-loop microstimulations of the orbitofrontal cortex during real-life gaze interaction enhance dynamic social attention

Neurons from multiple prefrontal areas encode several key variables of social gaze interaction. To explore the causal roles of the primate prefrontal cortex in real-life gaze interaction, we applied weak closed-loop microstimulations that were precisely triggered by specific social gaze events. Microstimulations of the orbitofrontal cortex, but not the dorsomedial prefrontal cortex or the anterior cingulate cortex, enhanced momentary dynamic social attention in the spatial dimension by decreasing the distance of fixations relative to a partner's eyes and in the temporal dimension by reducing the inter-looking interval and the latency to reciprocate the other's directed gaze. By contrast, on a longer timescale, microstimulations of the dorsomedial prefrontal cortex modulated inter-individual gaze dynamics relative to one's own gaze positions. These findings demonstrate that multiple regions in the primate prefrontal cortex may serve as functionally accessible nodes in controlling different aspects of dynamic social attention and suggest their potential for a therapeutic brain interface.

Closed-loop microstimulations of the orbitofrontal cortex during real-life gaze interaction enhance dynamic social attention

The prefrontal cortex is extensively involved in social exchange. During dyadic gaze interaction, multiple prefrontal areas exhibit neuronal encoding of social gaze events and context-specific mutual eye contact, supported by a widespread neural mechanism of social gaze monitoring. To explore causal manipulation of real-life gaze interaction, we applied weak closed-loop microstimulations that were precisely triggered by specific social gaze events to three prefrontal areas in monkeys. Microstimulations of orbitofrontal cortex (OFC), but not dorsomedial prefrontal or anterior cingulate cortex, enhanced momentary dynamic social attention in the spatial dimension by decreasing distance of one's gaze fixations relative to partner monkey's eyes. In the temporal dimension, microstimulations of OFC reduced the inter-looking interval for attending to another agent and the latency to reciprocate other's directed gaze. These findings demonstrate that primate OFC serves as a functionally accessible node in controlling dynamic social attention and suggest its potential for a therapeutic brain interface.

Social attention during object engagement: toward a cross-species measure of preferential social orienting

BACKGROUND

A central challenge in preclinical research investigating the biology of autism spectrum disorder (ASD) is the translation of ASD-related social phenotypes across humans and animal models. Social orienting, an observable, evolutionarily conserved behavior, represents a promising cross-species ASD phenotype given that disrupted social orienting is an early-emerging ASD feature with evidence for predicting familial recurrence. Here, we adapt a competing-stimulus social orienting task from domesticated dogs to naturalistic play behavior in human toddlers and test whether this approach indexes decreased social orienting in ASD.

METHODS

Play behavior was coded from the Autism Diagnostic Observation Schedule (ADOS) in two samples of toddlers, each with and without ASD. Sample 1 (n = 16) consisted of community-ascertained research participants, while Sample 2 involved a prospective study of infants at a high or low familial liability for ASD (n = 67). Coding quantified the child's looks towards the experimenter and caregiver, a social stimulus, while playing with high-interest toys, a non-social stimulus. A competing-stimulus measure of "Social Attention During Object Engagement" (SADOE) was calculated by dividing the number of social looks by total time spent playing with toys. SADOE was compared based on ASD diagnosis and differing familial liability for ASD.

RESULTS

In both samples, toddlers with ASD exhibited significantly lower SADOE compared to toddlers without ASD, with large effect sizes (Hedges' g ≥ 0.92) driven by a lower frequency of child-initiated spontaneous looks. Among toddlers at high familial likelihood of ASD, toddlers with ASD showed lower SADOE than toddlers without ASD, while SADOE did not differ based on presence or absence of familial ASD risk alone. SADOE correlated negatively with ADOS social affect calibrated severity scores and positively with the Communication and Symbolic Behavior Scales social subscale. In a binary logistic regression model, SADOE alone correctly classified 74.1% of cases, which rose to 85.2% when combined with cognitive development.

CONCLUSIONS

This work suggests that a brief behavioral measure pitting a high-interest nonsocial stimulus against the innate draw of social partners can serve as a feasible cross-species measure of social orienting, with implications for genetically informative behavioral phenotyping of social deficits in ASD and other neurodevelopmental disorders.

Eye-tracking as a window into primate social cognition

Over the past decade, noninvasive, restraint-free eye-tracking research with primates has transformed our understanding of primate social cognition. The use of this technology with many primate species allows for the exploration and comparison of how these species attend to and understand social agents and interactions. The ability to compare and contrast the cognitive capacities of various primate species, including humans, provides insight into the evolutionary mechanisms and selective pressures that have likely shaped social cognition in similar and divergent ways across the primate order. In this review, we begin by discussing noninvasive behavioral methods used to measure primate gaze and attention before the introduction of noninvasive, restraint-free eye-tracking methodologies. Next, we focus on findings from recent eye-tracking research on primate social cognition, beginning with simple visual and search mechanisms. We then discuss the results that have built on this basic understanding of how primates view images and videos, exploring discrimination and knowledge of social agents, following social cues, tracking perspectives and predicting behavior, and the combination of eye-tracking and other behavioral and physiological methods. Finally, we discuss some future directions of noninvasive eye-tracking research on primate social cognition and current eye-tracking work-in-progress that builds on these previous studies, investigating underexplored socio-cognitive capacities and utilizing new methodologies.

Widespread implementations of interactive social gaze neurons in the primate prefrontal-amygdala networks

Social gaze interaction powerfully shapes interpersonal communication. However, compared with social perception, very little is known about the neuronal underpinnings of real-life social gaze interaction. Here, we studied a large number of neurons spanning four regions in primate prefrontal-amygdala networks and demonstrate robust single-cell foundations of interactive social gaze in the orbitofrontal, dorsomedial prefrontal, and anterior cingulate cortices, in addition to the amygdala. Many neurons in these areas exhibited high temporal heterogeneity for social discriminability, with a selectivity bias for looking at a conspecific compared with an object. Notably, a large proportion of neurons in each brain region parametrically tracked the gaze of self or other, providing substrates for social gaze monitoring. Furthermore, several neurons displayed selective encoding of mutual eye contact in an agent-specific manner. These findings provide evidence of widespread implementations of interactive social gaze neurons in the primate prefrontal-amygdala networks during social gaze interaction.

Human face and gaze perception is highly context specific and involves bottom-up and top-down neural processing

This review summarizes human perception and processing of face and gaze signals. Face and gaze signals are important means of non-verbal social communication. The review highlights that: (1) some evidence is available suggesting that the perception and processing of facial information starts in the prenatal period; (2) the perception and processing of face identity, expression and gaze direction is highly context specific, the effect of race and culture being a case in point. Culture affects by means of experiential shaping and social categorization the way in which information on face and gaze is collected and perceived; (3) face and gaze processing occurs in the so-called 'social brain'. Accumulating evidence suggests that the processing of facial identity, facial emotional expression and gaze involves two parallel and interacting pathways: a fast and crude subcortical route and a slower cortical pathway. The flow of information is bi-directional and includes bottom-up and top-down processing. The cortical networks particularly include the fusiform gyrus, superior temporal sulcus (STS), intraparietal sulcus, temporoparietal junction and medial prefrontal cortex.

The neuroscience of social feelings: mechanisms of adaptive social functioning

Social feelings have conceptual and empirical connections with affect and emotion. In this review, we discuss how they relate to cognition, emotion, behavior and well-being. We examine the functional neuroanatomy and neurobiology of social feelings and their role in adaptive social functioning. Existing neuroscience literature is reviewed to identify concepts, methods and challenges that might be addressed by social feelings research. Specific topic areas highlight the influence and modulation of social feelings on interpersonal affiliation, parent-child attachments, moral sentiments, interpersonal stressors, and emotional communication. Brain regions involved in social feelings were confirmed by meta-analysis using the Neurosynth platform for large-scale, automated synthesis of functional magnetic resonance imaging data. Words that relate specifically to social feelings were identfied as potential research variables. Topical inquiries into social media behaviors, loneliness, trauma, and social sensitivity, especially with recent physical distancing for guarding public and personal health, underscored the increasing importance of social feelings for affective and second person neuroscience research with implications for brain development, physical and mental health, and lifelong adaptive functioning.

The application of noninvasive, restraint-free eye-tracking methods for use with nonhuman primates

Over the past 50 years there has been a strong interest in applying eye-tracking techniques to study a myriad of questions related to human and nonhuman primate psychological processes. Eye movements and fixations can provide qualitative and quantitative insights into cognitive processes of nonverbal populations such as nonhuman primates, clarifying the evolutionary, physiological, and representational underpinnings of human cognition. While early attempts at nonhuman primate eye tracking were relatively crude, later, more sophisticated and sensitive techniques required invasive protocols and the use of restraint. In the past decade, technology has advanced to a point where noninvasive eye-tracking techniques, developed for use with human participants, can be applied for use with nonhuman primates in a restraint-free manner. Here we review the corpus of recent studies (N=32) that take such an approach. Despite the growing interest in eye-tracking research, there is still little consensus on "best practices," both in terms of deploying test protocols or reporting methods and results. Therefore, we look to advances made in the field of developmental psychology, as well as our own collective experiences using eye trackers with nonhuman primates, to highlight key elements that researchers should consider when designing noninvasive restraint-free eye-tracking research protocols for use with nonhuman primates. Beyond promoting best practices for research protocols, we also outline an ideal approach for reporting such research and highlight future directions for the field.

Sharing Experiences in Infancy: From Primary Intersubjectivity to Shared Intentionality

We contrast two theses that make different assumptions about the developmental onset of human-unique sociality. The primary intersubjectivity thesis (PIT) argues that humans relate to each other in distinct ways from the beginning of life, as is shown by newborns' participation in face-to-face encounters or "primary intersubjectivity." According to this thesis, humans' innate relational capacity is the seedbed from which all subsequent social-emotional and social-cognitive developments continuously emerge. The shared intentionality thesis (SIT) states that human-unique forms of interaction develop at 9-12 months of age, when infants put their heads together with others in acts of object-focused joint attention and simple collaborative activities. According to this thesis, human-unique cognition emerges rapidly with the advent of mind-reading capacities that evolved specifically for the purpose of coordination. In this paper, we first contrast the two theses and then sketch the outlines of an account that unifies their strengths. This unified account endorses the PIT's recognition of the fundamental importance of primary intersubjectivity. Any act of sharing experiences is founded on the communicative capacity that is already displayed by young infants in primary intersubjectivity. At the same time, we question the PIT's interpretation that dyadic encounters have the triadic structure of joint attention. Lastly, we draw on empirical work on the development of joint attention, imitation, and social referencing that serves as evidence that primary intersubjectivity continuously unfolds into the capacity for triadic joint attention.

Differences in the mutual eye gaze of bonobos (Pan paniscus) and chimpanzees (Pan troglodytes)

Eye gaze is widespread in nonhuman primate taxa and important for social cognition and communicative signaling. Bonobos and chimpanzees, two closely related primate species, differ in social organization, behavior, and cognition. Chimpanzees' eye gaze and gaze following has been studied extensively, whereas less is known about bonobos' eye gaze. To examine species differences using a more ecologically relevant measure than videos or pictures, the current study compared bonobo and chimpanzee mutual eye gaze with a human observer. A multivariate analysis of variance revealed significant species differences in frequency and total duration, but not bout length, of mutual eye gaze (p < .001). Specifically, bonobos engage in mutual eye gaze more frequently and for longer total duration than chimpanzees. These results are likely related to species differences in social behavior and temperament and are consistent with eye-tracking studies in which bonobos looked at the eye region of conspecifics (in pictures and videos) longer than chimpanzees. Future research should examine the relationship between mutual eye gaze and gaze following, as well as examine its genetic and neurological correlates. (PsycInfo Database Record (c) 2020 APA, all rights reserved).

Observing animals and humans: dogs target their gaze to the biological information in natural scenes

BACKGROUND

This study examines how dogs observe images of natural scenes containing living creatures (wild animals, dogs and humans) recorded with eye gaze tracking. Because dogs have had limited exposure to wild animals in their lives, we also consider the natural novelty of the wild animal images for the dogs.

METHODS

The eye gaze of dogs was recorded while they viewed natural images containing dogs, humans, and wild animals. Three categories of images were used: naturalistic landscape images containing single humans or animals, full body images containing a single human or an animal, and full body images containing a pair of humans or animals. The gazing behavior of two dog populations, family and kennel dogs, were compared.

RESULTS

As a main effect, dogs gazed at living creatures (object areas) longer than the background areas of the images; heads longer than bodies; heads longer than background areas; and bodies longer than background areas. Dogs gazed less at the object areas vs. the background in landscape images than in the other image categories. Both dog groups also gazed wild animal heads longer than human or dog heads in the images. When viewing single animal and human images, family dogs focused their gaze very prominently on the head areas, but in images containing a pair of animals or humans, they gazed more at the body than the head areas. In kennel dogs, the difference in gazing times of the head and body areas within single or paired images failed to reach significance.

DISCUSSION

Dogs focused their gaze on living creatures in all image categories, also detecting them in the natural landscape images. Generally, they also gazed at the biologically informative areas of the images, such as the head, which supports the importance of the head/face area for dogs in obtaining social information. The natural novelty of the species represented in the images as well as the image category affected the gazing behavior of dogs. Furthermore, differences in the gazing strategy between family and kennel dogs was obtained, suggesting an influence of different social living environments and life experiences.

Observing animals and humans: dogs target their gaze to the biological information in natural scenes

Background

This study examines how dogs observe images of natural scenes containing living creatures (wild animals, dogs and humans) recorded with eye gaze tracking. Because dogs have had limited exposure to wild animals in their lives, we also consider the natural novelty of the wild animal images for the dogs.

Methods

The eye gaze of dogs was recorded while they viewed natural images containing dogs, humans, and wild animals. Three categories of images were used: naturalistic landscape images containing single humans or animals, full body images containing a single human or an animal, and full body images containing a pair of humans or animals. The gazing behavior of two dog populations, family and kennel dogs, were compared.

Results

As a main effect, dogs gazed at living creatures (object areas) longer than the background areas of the images; heads longer than bodies; heads longer than background areas; and bodies longer than background areas. Dogs gazed less at the object areas vs. the background in landscape images than in the other image categories. Both dog groups also gazed wild animal heads longer than human or dog heads in the images. When viewing single animal and human images, family dogs focused their gaze very prominently on the head areas, but in images containing a pair of animals or humans, they gazed more at the body than the head areas. In kennel dogs, the difference in gazing times of the head and body areas within single or paired images failed to reach significance.

Discussion

Dogs focused their gaze on living creatures in all image categories, also detecting them in the natural landscape images. Generally, they also gazed at the biologically informative areas of the images, such as the head, which supports the importance of the head/face area for dogs in obtaining social information. The natural novelty of the species represented in the images as well as the image category affected the gazing behavior of dogs. Furthermore, differences in the gazing strategy between family and kennel dogs was obtained, suggesting an influence of different social living environments and life experiences.

Human and monkey infant attention to dynamic social and nonsocial stimuli

The present study explored behavioral norms for infant social attention in typically developing human and nonhuman primate infants. We examined the normative development of attention to dynamic social and nonsocial stimuli longitudinally in macaques (Macaca mulatta) at 1, 3, and 5 months of age (N = 75) and humans at 2, 4, 6, 8, and 13 months of age (N = 69) using eye tracking. All infants viewed concurrently played silent videos-one social video and one nonsocial video. Both macaque and human infants were faster to look to the social than the nonsocial stimulus, and both species grew faster to orient to the social stimulus with age. Further, macaque infants' social attention increased linearly from 1 to 5 months. In contrast, human infants displayed a nonlinear pattern of social interest, with initially greater attention to the social stimulus, followed by a period of greater interest in the nonsocial stimulus, and then a rise in social interest from 6 to 13 months. Overall, human infants looked longer than macaque infants, suggesting humans have more sustained attention in the first year of life. These findings highlight potential species similarities and differences, and reflect a first step in establishing baseline patterns of early social attention development.

The role of early social rearing, neurological, and genetic factors on individual differences in mutual eye gaze among captive chimpanzees

Mutual eye gaze plays an important role in primate social development and communication. In the current study, we examined the underlying experiential, genetic, and neuroanatomical basis of mutual eye gaze variation in adult captive chimpanzees. A multivariate analysis of variance revealed a significant rearing effect on bout length, with human-reared chimpanzees engaging in longer bouts of mutual gaze compared to mother-reared and wild-born individuals. Next, we utilized source-based morphometry (SBM) to examine gray matter covariation in magnetic resonance imaging scans and determine the relationship between the resulting gray matter covariation components and mutual eye gaze. One SBM component was negatively correlated with gaze duration (nucleus accumbens and anterior insular cortex), while two components were positively correlated with bout length (posterior cingulate cortex, inferior occipital cortex, middle temporal cortex, hippocampus, and the precentral sulcus). Finally, heritability analyses revealed mutual eye gaze to be modestly heritable and significant genetic correlations between bout length and two gray matter covariation components. This study reveals that non-genetic factors, and to a lesser extent, genetic factors appear to influence mutual eye gaze in adult chimpanzees, and is the first to report neuroanatomical correlates of mutual eye gaze variation in chimpanzees.

A review of research in primate sanctuaries

While non-human primate studies have long been conducted in laboratories, and more recently at zoological parks, sanctuaries are increasingly considered a viable setting for research. Accredited sanctuaries in non-range countries house thousands of primates formerly used as subjects of medical research, trained performers or personal pets. In range countries, however, sanctuaries typically house orphaned primates confiscated from illegal poaching and the bushmeat and pet trafficking trades. Although the primary mission of these sanctuaries is to rescue and rehabilitate residents, many of these organizations are increasingly willing to participate in non-invasive research. Notably, from a scientific standpoint, most sanctuaries provide potential advantages over traditional settings, such as large, naturalistic physical and social environments which may result in more relevant models of primates' free-ranging wild counterparts than other captive settings. As a result, an impressive scope of research in the fields of primate behaviour, cognition, veterinary science, genetics and physiology have been studied in sanctuaries. In this review, we examine the range and form of research that has been conducted at accredited sanctuaries around the world. We also describe the potential challenges of sanctuary-based work and the considerations that external researchers may face when deciding to collaborate with primate sanctuaries on their research projects.

Viewing heterospecific facial expressions: an eye-tracking study of human and monkey viewers

Common facial expressions of emotion have distinctive patterns of facial muscle movements that are culturally similar among humans, and perceiving these expressions is associated with stereotypical gaze allocation at local facial regions that are characteristic for each expression, such as eyes in angry faces. It is, however, unclear to what extent this 'universality' view can be extended to process heterospecific facial expressions, and how 'social learning' process contributes to heterospecific expression perception. In this eye-tracking study, we examined face-viewing gaze allocation of human (including dog owners and non-dog owners) and monkey observers while exploring expressive human, chimpanzee, monkey and dog faces (positive, neutral and negative expressions in human and dog faces; neutral and negative expressions in chimpanzee and monkey faces). Human observers showed species- and experience-dependent expression categorization accuracy. Furthermore, both human and monkey observers demonstrated different face-viewing gaze distributions which were also species dependent. Specifically, humans predominately attended at human eyes but animal mouth when judging facial expressions. Monkeys' gaze distributions in exploring human and monkey faces were qualitatively different from exploring chimpanzee and dog faces. Interestingly, the gaze behaviour of both human and monkey observers were further affected by their prior experience of the viewed species. It seems that facial expression processing is species dependent, and social learning may play a significant role in discriminating even rudimentary types of heterospecific expressions.

Non-invasive Eye Tracking Methods for New World and Old World Monkeys

Eye-tracking methods measure what humans and other animals visually attend to in the environment. In nonhuman primates, eye tracking can be used to test hypotheses about how primates process social information. This information can further our understanding of primate behavior as well as offer unique translational potential to explore causes of or treatments for altered social processing as seen in people with neurodevelopmental disorders such as autism spectrum disorder and schizophrenia. However, previous methods for collecting eye-tracking data in nonhuman primates required some form of head restraint, which limits the opportunities for research with respect to the number of or kinds of primates that can undergo an eye-tracking study. We developed a novel, noninvasive method for collecting eye tracking data that can be used both in animals that are difficult to restrain without sedation as well as animals that are of different ages and sizes as the box size can be adjusted. Using a transport box modified with a viewing window, we collected eye-tracking data in both New (Callicebus cupreus) and Old World monkeys (Macaca mulatta) across multiple developmental time points. These monkeys had the option to move around the box and avert their eyes from the screen, yet, they demonstrated a natural interest in viewing species-specific imagery with no previous habituation to the eye-tracking paradigm. Provided with opportunistic data from voluntary viewing of stimuli, we found that juveniles viewed stimuli more than other age groups, videos were viewed more than static photo imagery, and that monkeys increased their viewing time when presented with multiple eye tracking sessions. This noninvasive approach opens new opportunities to integrate eye-tracking studies into nonhuman primate research.

Visual preferences for direct-gaze faces in infant macaques (Macaca mulatta) with limited face exposure

From birth, human and nonhuman primates attend more to faces with direct gaze compared with averted gaze, and previous studies report that attention to the eyes is linked to the emergence of later social skills. Here, we explored whether early experiences influence attraction to eye contact in infant macaques by examining their attention to face pairs varying in their gaze direction across the first 13 weeks of life. Infants raised by human caretakers had limited conspecific interactions (nursery-reared; N = 16) and were compared to infants raised in rich social environments (mother-reared; N = 20). Both groups looked longer to faces and the eyes of direct compared to averted-gaze faces. Looking to all faces and eyes also increased with age. Nursery-reared infants did not display age-associated increases in attention to direct-gaze faces specifically, suggesting that, while there may be an initial preference for direct-gaze faces from birth, social experiences may support its early development.

Human ostensive signals do not enhance gaze following in chimpanzees, but do enhance object-oriented attention

The previous studies have shown that human infants and domestic dogs follow the gaze of a human agent only when the agent has addressed them ostensively-e.g., by making eye contact, or calling their name. This evidence is interpreted as showing that they expect ostensive signals to precede referential information. The present study tested chimpanzees, one of the closest relatives to humans, in a series of eye-tracking experiments using an experimental design adapted from these previous studies. In the ostension conditions, a human actor made eye contact, called the participant's name, and then looked at one of two objects. In the control conditions, a salient cue, which differed in each experiment (a colorful object, the actor's nodding, or an eating action), attracted participants' attention to the actor's face, and then the actor looked at the object. Overall, chimpanzees followed the actor's gaze to the cued object in both ostension and control conditions, and the ostensive signals did not enhance gaze following more than the control attention-getters. However, the ostensive signals enhanced subsequent attention to both target and distractor objects (but not to the actor's face) more strongly than the control attention-getters-especially in the chimpanzees who had a close relationship with human caregivers. We interpret this as showing that chimpanzees have a simple form of communicative expectations on the basis of ostensive signals, but unlike human infants and dogs, they do not subsequently use the experimenter's gaze to infer the intended referent. These results may reflect a limitation of non-domesticated species for interpreting humans' ostensive signals in inter-species communication.