What interests them in the pictures?--differences in eye-tracking between rhesus monkeys and humans

Friend or foe? Using eye-tracking technology to investigate the visual discrimination ability of giant pandas

The role that visual discriminative ability plays among giant pandas in social communication and individual discrimination has received less attention than olfactory and auditory modalities. Here, we used an eye-tracker technology to investigate pupil fixation patterns for 8 captive male giant pandas Ailuropoda melanoleuca. We paired images (N = 26) of conspecifics against: 1) sympatric predators (gray wolves and tigers), and non-threatening sympatric species (golden pheasant, golden snub-nosed monkey, takin, and red panda), 2) conspecifics with atypical fur coloration (albino and brown), and 3) zookeepers/non-zookeepers wearing either work uniform or plain clothing. For each session, we tracked the panda's pupil movements and measured pupil first fixation point (FFP), fixation latency, total fixation count (TFC), and duration (TFD) of attention to each image. Overall, pandas exhibited similar attention (FFPs and TFCs) to images of predators and non-threatening sympatric species. Images of golden pheasant, snub-nosed monkey, and tiger received less attention (TFD) than images of conspecifics, whereas images of takin and red panda received more attention, suggesting a greater alertness to habitat or food competitors than to potential predators. Pandas' TFCs were greater for images of black-white conspecifics than for albino or brown phenotypes, implying that familiar color elicited more interest. Pandas reacted differently to images of men versus women. For images of women only, pandas gave more attention (TFC) to familiar combinations (uniformed zookeepers and plain-clothed non-zookeepers), consistent with the familiarity hypothesis. That pandas can use visual perception to discriminate intra-specifically and inter-specifically, including details of human appearance, has applications for panda conservation and captive husbandry.

Pathways for Naturalistic Looking Behavior in Primate I: Behavioral Characteristics and Brainstem Circuits

Organisms control their visual worlds by moving their eyes, heads, and bodies. This control of "gaze" or "looking" is key to survival and intelligence, but our investigation of the underlying neural mechanisms in natural conditions is hindered by technical limitations. Recent advances have enabled measurement of both brain and behavior in freely moving animals in complex environments, expanding on historical head-fixed laboratory investigations. We juxtapose looking behavior as traditionally measured in the laboratory against looking behavior in naturalistic conditions, finding that behavior changes when animals are free to move or when stimuli have depth or sound. We specifically focus on the brainstem circuits driving gaze shifts and gaze stabilization. The overarching goal of this review is to reconcile historical understanding of the differential neural circuits for different "classes" of gaze shift with two inconvenient truths. (1) "classes" of gaze behavior are artificial. (2) The neural circuits historically identified to control each "class" of behavior do not operate in isolation during natural behavior. Instead, multiple pathways combine adaptively and non-linearly depending on individual experience. While the neural circuits for reflexive and voluntary gaze behaviors traverse somewhat independent brainstem and spinal cord circuits, both can be modulated by feedback, meaning that most gaze behaviors are learned rather than hardcoded. Despite this flexibility, there are broadly enumerable neural pathways commonly adopted among primate gaze systems. Parallel pathways which carry simultaneous evolutionary and homeostatic drives converge in superior colliculus, a layered midbrain structure which integrates and relays these volitional signals to brainstem gaze-control circuits.

An Easily Compatible Eye-tracking System for Freely-moving Small Animals

Measuring eye movement is a fundamental approach in cognitive science as it provides a variety of insightful parameters that reflect brain states such as visual attention and emotions. Combining eye-tracking with multimodal neural recordings or manipulation techniques is beneficial for understanding the neural substrates of cognitive function. Many commercially-available and custom-built systems have been widely applied to awake, head-fixed small animals. However, the existing eye-tracking systems used in freely-moving animals are still limited in terms of their compatibility with other devices and of the algorithm used to detect eye movements. Here, we report a novel system that integrates a general-purpose, easily compatible eye-tracking hardware with a robust eye feature-detection algorithm. With ultra-light hardware and a detachable design, the system allows for more implants to be added to the animal's exposed head and has a precise synchronization module to coordinate with other neural implants. Moreover, we systematically compared the performance of existing commonly-used pupil-detection approaches, and demonstrated that the proposed adaptive pupil feature-detection algorithm allows the analysis of more complex and dynamic eye-tracking data in free-moving animals. Synchronized eye-tracking and electroencephalogram recordings, as well as algorithm validation under five noise conditions, suggested that our system is flexibly adaptable and can be combined with a wide range of neural manipulation and recording technologies.

Perception of the Nose and Lower Face Before and After Orthognathic Surgery in Subjects with Dento-maxillofacial Deformities: An Eye-Tracking Study

BACKGROUND

Dento-maxillofacial deformities are often associated with nasal deviation, and patients often complain of nasal deviation after orthognathic surgery. This study aimed to quantitatively evaluate the facial visual attention given to dento-maxillofacial deformities accompanying nasal deviation from the perspective of patients and determine whether orthognathic surgery could alter this outcome.

METHODS

The scanning paths of 137 patients were recorded using an eye-tracking device; recordings were made while the patients viewed images of dento-maxillofacial deformities associated with various degrees of nasal deviation before or after orthognathic surgery. Visual attention focused on the lower face and nose was analyzed.

RESULTS

When viewing postoperative faces, the participants focused more visual attention on noses and less on the lower face than they did on preoperative faces. Interestingly, for preoperative faces, nasal deviation could significantly increase participants' visual attention to the lower face, and visual attention to noses was significantly increased when noses were deviated 12°, while for postoperative faces, a nasal deviation of 4° or more was associated with a significant increase in participants' visual attention to the nose.

CONCLUSIONS

Patients tended to focus their visual attention on the lower region of preoperative faces and ignored nose irregularities. Orthognathic surgery can alter visual attention, shifting it from the lower face to the nose, and a deviation of 4° or more could be a potential concern for patients. Clinicians must inform patients preoperatively about preexisting nasal deviations, which can guide surgical planning and help manage patient expectations.

LEVEL OF EVIDENCE IV

This journal requires that authors assign a level of evidence to each article. For a full description of these Evidence-Based Medicine ratings, please refer to the Table of Contents or the online Instructions to Authors www.springer.com/00266 .

Facial visual attention to menton deviation: An objective evaluation by laypeople

PURPOSE

This study aimed to quantitatively evaluate whether the severity of menton deviation (MD) influenced facial perceptions of laypeople. We also aimed to determine the effectiveness of surgery in normalizing the distribution of the facial visual attention of laypeople.

METHODS

The scanning paths of 177 laypeople were recorded using an eye tracking device while observing images of individuals without MD and pre- and post-treatment subjects with different degrees of MD. The fixation durations on the areas of interest (AOIs) in each group were compared and analysed.

RESULTS

When observing the images of non-MD subjects, the eyes were the focus of the most significant fixation (higher than the fixations on the nose and lower face). When the MD increased to 3°, attention on the lower face increased (p = 0.001) with decreased attention to the eyes (p = 0.0126). At an MD of 9°, attention to the lower face sharply increased, even more so than that to the eyes, with decreased attention to the nose (p = 0.0104). Compared with the findings for the post-treatment images, the laypeople who observed the pretreatment images focused longer on the lower face and less on the eyes and nose (p = 0.001, p = 0.0322 and p = 0.0023, respectively). The distribution of the fixation duration when observing the post-treatment images was similar to that when observing the images of the non-MD subjects.

CONCLUSIONS

Laypeople can perceive an MD of 3°, which causes changes in the distribution of visual attention, with attention focusing on the MD. When the deviation reaches 9°, it is very noticeable. Surgery can normalize the distribution of the facial visual attention of laypeople, as shown by the responses to the post-treatment images.

The application of noninvasive, restraint-free eye-tracking methods for use with nonhuman primates

Over the past 50 years there has been a strong interest in applying eye-tracking techniques to study a myriad of questions related to human and nonhuman primate psychological processes. Eye movements and fixations can provide qualitative and quantitative insights into cognitive processes of nonverbal populations such as nonhuman primates, clarifying the evolutionary, physiological, and representational underpinnings of human cognition. While early attempts at nonhuman primate eye tracking were relatively crude, later, more sophisticated and sensitive techniques required invasive protocols and the use of restraint. In the past decade, technology has advanced to a point where noninvasive eye-tracking techniques, developed for use with human participants, can be applied for use with nonhuman primates in a restraint-free manner. Here we review the corpus of recent studies (N=32) that take such an approach. Despite the growing interest in eye-tracking research, there is still little consensus on "best practices," both in terms of deploying test protocols or reporting methods and results. Therefore, we look to advances made in the field of developmental psychology, as well as our own collective experiences using eye trackers with nonhuman primates, to highlight key elements that researchers should consider when designing noninvasive restraint-free eye-tracking research protocols for use with nonhuman primates. Beyond promoting best practices for research protocols, we also outline an ideal approach for reporting such research and highlight future directions for the field.

Early developmental changes in visual social engagement in infant rhesus monkeys

Impairments in social interaction in Autism Spectrum Disorder (ASD) differ greatly across individuals and vary throughout an individual’s lifetime. Yet, an important marker of ASD in infancy is deviations in social-visual engagement, such as the reliably detectable early deviations in attention to the eyes or to biological movement (Klin et al., 2015). Given the critical nature of these early developmental periods, understanding its neurobehavioral underpinnings by means of a nonhuman primate model will be instrumental to understanding the pathophysiology of ASD. Like humans, rhesus macaques 1) develop in rich and complex social behaviors, 2) progressively develop social skills throughout infancy, and 3) have high similarities with humans in brain anatomy and cognitive functions (Machado and Bachevalier, 2003). In this study, male infant rhesus macaques living with their mothers in complex social groups were eye-tracked longitudinally from birth to 6 months while viewing full-faced videos of unfamiliar rhesus monkeys differing in age and sex. The results indicated a critical period for the refinement of social skills around 4–8 weeks of age in rhesus macaques. Specifically, infant monkeys’ fixation to the eyes shows an inflection in developmental trajectory, increasing from birth to 8 weeks, decreasing slowly to a trough between 14–18 weeks, before increasing again. These results parallel the developmental trajectory of social visual engagement published in human infants (Jones & Klin, 2013) and suggest the presence of a switch in the critical networks supporting these early developing social skills that is highly conserved between rhesus macaque and human infant development.

Contribution of the mandible position to the facial profile perception of a female facial profile: An eye-tracking study

INTRODUCTION

Studies concerning the visual attention of laypersons viewing the soft tissue facial profile of men and women with malocclusion are lacking. This study aimed to determine the visual attention to the facial profile of patients with different levels of mandibular protrusion and facial background attractiveness using an eye-tracking device.

METHODS

The scanning paths of 54 Chinese laypersons (50% female, 50% male, aged 18-23 years) were recorded by an eye-tracking device when they observed composite female facial profile images (n = 24), which were combinations of different degrees of mandibular protrusion (normal, slight, moderate, and severe) and different levels of facial background attractiveness (attractive, average, and unattractive). Dependent variables (fixation duration and first fixation time) were analyzed using repeated-measures factorial analysis of variance.

RESULTS

For normal mandibular profiles, the fixation duration of the eyes was significantly higher than that of other facial features (P <0.001). The lower face and nose received the least attention. As the degree of protrusion increased from slight to moderate, more attention was drawn to the lower face accompanied by less attention to eyes in the unattractive group (P <0.05). When protrusion degree increased from moderate to severe, attention shifted from nose to lower face significantly in the attractive group (P <0.05). Attention shift from eyes to lower face was also found in the average group when protrusion degree rose to moderate protrusion from normal profile (P <0.05). A significant interaction between facial attractiveness and mandibular protrusion was found in the lower face duration (P = 0.020). The threshold point (the point of mandibular protrusion degree that evoked attention to the lower face) of the attractive facial background was higher than that of the unattractive background. Once evoked, the effect of mandibular protrusion of the attractive group tended to be stronger than that of the unattractive group, though without statistical difference.

CONCLUSIONS

Eyes are the most salient area. The increasing degree of mandibular protrusion tends to draw attention to the lower face from other facial features. Background attractiveness can modify this behavior.

Monkeys preferentially process body information while viewing affective displays

Despite evolutionary claims about the function of facial behaviors across phylogeny, rarely are those hypotheses tested in a comparative context-that is, by evaluating how nonhuman animals process such behaviors. Further, while increasing evidence indicates that humans make meaning of faces by integrating contextual information, including that from the body, the extent to which nonhuman animals process contextual information during affective displays is unknown. In the present study, we evaluated the extent to which rhesus macaques (Macaca mulatta) process dynamic affective displays of conspecifics that included both facial and body behaviors. Contrary to hypotheses that they would preferentially attend to faces during affective displays, monkeys looked for longest, most frequently, and first at conspecifics' bodies rather than their heads. These findings indicate that macaques, like humans, attend to available contextual information during the processing of affective displays, and that the body may also be providing unique information about affective states. (PsycINFO Database Record

Differences in Looking at Own- and Other-Race Faces Are Subtle and Analysis-Dependent: An Account of Discrepant Reports

The Other-Race Effect (ORE) is the robust and well-established finding that people are generally poorer at facial recognition of individuals of another race than of their own race. Over the past four decades, much research has focused on the ORE because understanding this phenomenon is expected to elucidate fundamental face processing mechanisms and the influence of experience on such mechanisms. Several recent studies of the ORE in which the eye-movements of participants viewing own- and other-race faces were tracked have, however, reported highly conflicting results regarding the presence or absence of differential patterns of eye-movements to own- versus other-race faces. This discrepancy, of course, leads to conflicting theoretical interpretations of the perceptual basis for the ORE. Here we investigate fixation patterns to own- versus other-race (African and Chinese) faces for Caucasian participants using different analysis methods. While we detect statistically significant, though subtle, differences in fixation pattern using an Area of Interest (AOI) approach, we fail to detect significant differences when applying a spatial density map approach. Though there were no significant differences in the spatial density maps, the qualitative patterns matched the results from the AOI analyses reflecting how, in certain contexts, Area of Interest (AOI) analyses can be more sensitive in detecting the differential fixation patterns than spatial density analyses, due to spatial pooling of data with AOIs. AOI analyses, however, also come with the limitation of requiring a priori specification. These findings provide evidence that the conflicting reports in the prior literature may be at least partially accounted for by the differences in the statistical sensitivity associated with the different analysis methods employed across studies. Overall, our results suggest that detection of differences in eye-movement patterns can be analysis-dependent and rests on the assumptions inherent in the given analysis.