The Neurobiological Correlates of Gaze Perception in Healthy Individuals and Neurologic Patients

The ability to adaptively follow conspecific eye movements is crucial for establishing shared attention and survival. Indeed, in humans, interacting with the gaze direction of others causes the reflexive orienting of attention and the faster object detection of the signaled spatial location. The behavioral evidence of this phenomenon is called gaze-cueing. Although this effect can be conceived as automatic and reflexive, gaze-cueing is often susceptible to context. In fact, gaze-cueing was shown to interact with other factors that characterize facial stimulus, such as the kind of cue that induces attention orienting (i.e., gaze or non-symbolic cues) or the emotional expression conveyed by the gaze cues. Here, we address neuroimaging evidence, investigating the neural bases of gaze-cueing and the perception of gaze direction and how contextual factors interact with the gaze shift of attention. Evidence from neuroimaging, as well as the fields of non-invasive brain stimulation and neurologic patients, highlights the involvement of the amygdala and the superior temporal lobe (especially the superior temporal sulcus (STS)) in gaze perception. However, in this review, we also emphasized the discrepancies of the attempts to characterize the distinct functional roles of the regions in the processing of gaze. Finally, we conclude by presenting the notion of invariant representation and underline its value as a conceptual framework for the future characterization of the perceptual processing of gaze within the STS.

Social orienting in gaze leading: a mechanism for shared attention

Here, we report a novel social orienting response that occurs after viewing averted gaze. We show, in three experiments, that when a person looks from one location to an object, attention then shifts towards the face of an individual who has subsequently followed the person's gaze to that same object. That is, contrary to 'gaze following', attention instead orients in the opposite direction to observed gaze and towards the gazing face. The magnitude of attentional orienting towards a face that 'follows' the participant's gaze is also associated with self-reported autism-like traits. We propose that this gaze leading phenomenon implies the existence of a mechanism in the human social cognitive system for detecting when one's gaze has been followed, in order to establish 'shared attention' and maintain the ongoing interaction.

Eye Contact Is a Two-Way Street: Arousal Is Elicited by the Sending and Receiving of Eye Gaze Information

Research shows that arousal is significantly enhanced while participants make eye contact with a live person compared to viewing a picture of direct or averted gaze. Recent research has pointed toward the potential for social interaction as a possible driving force behind the arousal enhancement. That is, eye gaze is not only a signal perceived but also a signal sent out in order to communicate with others. This study aimed to test this by having dyads engage in eye contact and averted gaze naturally, while wearing sunglasses, and while blindfolded; such that the gaze signals were clear, degraded, and blocked, respectively. Autonomic nervous system arousal was measured via skin conductance response and level. The results showed that dyads exhibited the highest degree of arousal (increased skin conductance) while making eye contact (send/receive) compared to send-only or receive-only gaze trials; however, this was only the case if eye contact was clear. Once gaze information became degraded (by sunglasses or blindfold), arousal significantly decreased and was no longer modulated by the sending and receiving of gaze. Therefore, the arousal enhancement observed during eye contact is not only caused by receiving gaze signals (the focus of previous research) and should be more accurately attributed to the subtle interplay between sending and receiving gaze signals.

Perceptual integration of head and eye cues to gaze direction in schizophrenia

The perceptual mechanisms that underlie social experience in schizophrenia are increasingly becoming a target of empirical research. In the context of low-level vision, there is evidence for a reduction in the integration of sensory features in schizophrenia (e.g. increased thresholds for contour detection and motion coherence). In the context of higher-level vision, comparable differences in the integration of sensory features of the face could in theory impair the recognition of important social cues. Here we examine how the sense of where other people are looking relies upon the integration of eye-region cues and head-region cues. Adults with schizophrenia viewed face images designed to elicit the 'Wollaston illusion', a perceptual phenomenon in which the perceived gaze direction associated with a given pair of eyes is modulated by the surrounding sensory context. We performed computational modelling of these psychophysical data to quantify individual differences in the use of facial cues to gaze direction. We find that adults with schizophrenia exhibit a robust perceptual effect whereby their sense of other people's direction of gaze is strongly biased by sensory cues relating to head orientation in addition to eye region information. These results indicate that the visual integration of facial cues to gaze direction in schizophrenia is intact, helping to constrain theories of reduced integrative processing in higher-level and lower-level vision. In addition, robust gaze processing was evident in the tested participants despite reduced performance on a theory of mind task designed to assess higher-level social cognition.

Perceiving where another person is looking: the integration of head and body information in estimating another person's gaze

The process through which an observer allocates his/her attention based on the attention of another person is known as joint attention. To be able to do this, the observer effectively has to compute where the other person is looking. It has been shown that observers integrate information from the head and the eyes to determine the gaze of another person. Most studies have documented that observers show a bias called the overshoot effect when eyes and head are misaligned. That is, when the head is not oriented straight to the observer, perceived gaze direction is sometimes shifted in the direction opposite to the head turn. The present study addresses whether body information is also used as a cue to compute perceived gaze direction. In Experiment 1, we observed a similar overshoot effect in both behavioral and saccadic responses when manipulating body orientation. In Experiment 2, we explored whether the overshoot effect was due to observers assuming that the eyes are oriented further than the head when head and body orientation are misaligned. We removed horizontal eye information by presenting the stimulus from a side view. Head orientation was now manipulated in a vertical direction and the overshoot effect was replicated. In summary, this study shows that body orientation is indeed used as a cue to determine where another person is looking.

The Mona Lisa effect: neural correlates of centered and off-centered gaze

The Mona Lisa effect describes the phenomenon when the eyes of a portrait appear to look at the observer regardless of the observer's position. Recently, the metaphor of a cone of gaze has been proposed to describe the range of gaze directions within which a person feels looked at. The width of the gaze cone is about five degrees of visual angle to either side of a given gaze direction. We used functional magnetic resonance imaging to investigate how the brain regions involved in gaze direction discrimination would differ between centered and decentered presentation positions of a portrait exhibiting eye contact. Subjects observed a given portrait's eyes. By presenting portraits with varying gaze directions-eye contact (0°), gaze at the edge of the gaze cone (5°), and clearly averted gaze (10°), we revealed that brain response to gaze at the edge of the gaze cone was similar to that produced by eye contact and different from that produced by averted gaze. Right fusiform gyrus and right superior temporal sulcus showed stronger activation when the gaze was averted as compared to eye contact. Gaze sensitive areas, however, were not affected by the portrait's presentation location. In sum, although the brain clearly distinguishes averted from centered gaze, a substantial change of vantage point does not alter neural activity, thus providing a possible explanation why the feeling of eye contact is upheld even in decentered stimulus positions.

How wide is the cone of direct gaze?

The cone of direct gaze refers to the range of gaze deviations an observer accepts as looking directly at them. Previous experiments have calculated the width of the cone of direct gaze using the gaze deviations actually presented to the observer, however, there is considerable evidence that observers actually perceive gaze to be systematically more deviated than actually presented. Here, we examine the width of the cone of direct gaze in units of perceived gaze deviation. In doing so, we are able to disambiguate differences in width both within and between observers that are due to differences in their perception of gaze and due to differences in what observers consider to be looking at them. We suggest that this line of inquiry can offer further insight into the perception of gaze direction, and how this perception may differ in clinical populations.

Adaptive sensory coding of gaze direction in schizophrenia

Schizophrenia has been associated with differences in how the visual system processes sensory input. A fundamental mechanism that regulates sensory processing in the brain is gain control, whereby the responses of sensory neurons to a given stimulus are modulated in accordance with the spatial and temporal context. Some studies indicate an impairment of certain cortical gain control mechanisms in schizophrenia in low-level vision, reflected, for instance, in how the visual appearance of a stimulus is affected by the presence of other stimuli around it. In the present study, we investigated higher-level, social vision in schizophrenia, namely the perception of other people's direction of gaze (i.e. a type of face processing). Recent computational modelling work indicates that perceptual aftereffects-changes in perception that occur following repeated exposure to faces that display a specific direction of gaze-are indicative of two distinct forms of gain control involved in the coding of gaze direction across sensory neurons. We find that individuals with schizophrenia display strong perceptual aftereffects following repeated exposure to faces with averted gaze, and a modelling analysis indicates similarly robust gain control in the form of (i) short-term adjustment of channel sensitivities in response to the recent sensory history and (ii) divisive normalization of the encoded gaze direction. Together, this speaks to the typical coding of other people's direction of gaze in the visual system in schizophrenia, including flexible gain control, despite the social-cognitive impairments that can occur in this condition.

Task Dependent Effects of Head Orientation on Perceived Gaze Direction

The perception of gaze direction involves the integration of a number of sensory cues exterior to the eye-region. The orientation of the head is one such cue, which has an overall repulsive effect on the perceived direction of gaze. However, in a recent experiment, we found the measured effect of head orientation on perceived gaze direction differed within subjects, depending on whether a single- or two-interval task design was employed. This suggests a potential difference in the way the orientation of the head is integrated into the perception of gaze direction across tasks. Four experiments were conducted to investigate this difference. The first two experiments showed that the difference was not the result of some interaction between stimuli in the two-interval task, but rather, a difference between the types of judgment being made across tasks, where observers were making a directional (left/right) judgment in the single-interval task, and a non-directional (direct/indirect gaze) judgment in the two-interval task. A third experiment showed that this difference does not arise from observers utilizing a non-directional cue to direct gaze (the circularity of the pupil/iris) in making their non-directional judgments. The fourth experiment showed no substantial differences in the duration of evidence accumulation and processing between judgments, suggesting that observers are not integrating different sensory information across tasks. Together these experiments show that the sensory information from head orientation is flexibly weighted in the perception of gaze direction, and that the purpose of the observer, in sampling gaze information, can influence the consequent perception of gaze direction.

The Effect of Head Orientation on Perceived Gaze Direction: Revisiting Gibson and Pick (1963) and Cline (1967)

Two biases in perceived gaze direction have been observed when eye and head orientation are not aligned. An overshoot effect indicates that perceived gaze direction is shifted away from head orientation (i.e., a repulsive effect), whereas a towing effect indicates that perceived gaze direction falls in between head and eye orientation (i.e., an attraction effect). In the 60s, three influential papers have been published with respect to the effect of head orientation on perceived gaze direction (Gibson and Pick, 1963; Cline, 1967; Anstis et al., 1969). Throughout the years, the results of two of these (Gibson and Pick, 1963; Cline, 1967) have been interpreted differently by a number of authors. In this paper, we critically discuss potential sources of confusion that have led to differential interpretations of both studies. At first sight, the results of Cline (1967), despite having been a major topic of discussion, unambiguously seem to indicate a towing effect whereas Gibson and Pick’s (1963) results seem to be the most ambiguous, although they have never been questioned in the literature. To shed further light on this apparent inconsistency, we repeated the critical experiments reported in both studies. Our results indicate an overshoot effect in both studies.

What is social about social perception research?

A growing consensus in social cognitive neuroscience holds that large portions of the primate visual brain are dedicated to the processing of social information, i.e., to those aspects of stimuli that are usually encountered in social interactions such as others' facial expressions, actions, and symbols. Yet, studies of social perception have mostly employed simple pictorial representations of conspecifics. These stimuli are social only in the restricted sense that they physically resemble objects with which the observer would typically interact. In an equally important sense, however, these stimuli might be regarded as "non-social": the observer knows that they are viewing pictures and might therefore not attribute current mental states to the stimuli or might do so in a qualitatively different way than in a real social interaction. Recent studies have demonstrated the importance of such higher-order conceptualization of the stimulus for social perceptual processing. Here, we assess the similarity between the various types of stimuli used in the laboratory and object classes encountered in real social interactions. We distinguish two different levels at which experimental stimuli can match social stimuli as encountered in everyday social settings: (1) the extent to which a stimulus' physical properties resemble those typically encountered in social interactions and (2) the higher-level conceptualization of the stimulus as indicating another person's mental states. We illustrate the significance of this distinction for social perception research and report new empirical evidence further highlighting the importance of mental state attribution for perceptual processing. Finally, we discuss the potential of this approach to inform studies of clinical conditions such as autism.

Perceiving gaze from head and eye rotations: An integrative challenge for children and adults

Gaze is an emergent visual feature. A person's gaze direction is perceived not just based on the rotation of their eyes, but also their head. At least among adults, this integrative process appears to be flexible such that one feature can be weighted more heavily than the other depending on the circumstances. Yet it is unclear how this weighting might vary across individuals or across development. When children engage emergent gaze, do they prioritize cues from the head and eyes similarly to adults? Is the perception of gaze among individuals with autism spectrum disorder (ASD) emergent, or is it reliant on a single feature? Sixty adults (M = 29.86 years-of-age), thirty-seven typically developing children and adolescents (M = 9.3 years-of-age; range = 7-15), and eighteen children with ASD (M = 9.72 years-of-age; range = 7-15) viewed faces with leftward, rightward, or direct head rotations in conjunction with leftward or rightward pupil rotations, and then indicated whether the face was looking leftward or rightward. All individuals, across development and ASD status, used head rotation to infer gaze direction, albeit with some individual differences. However, the use of pupil rotation was heavily dependent on age. Finally, children with ASD used pupil rotation significantly less than typically developing (TD) children when inferring gaze direction, even after accounting for age. Our approach provides a novel framework for understanding individual and group differences in gaze as it is actually perceived-as an emergent feature. Furthermore, this study begins to address an important gap in ASD literature, taking the first look at emergent gaze perception in this population.

Sclera and Iris Color Interact to Influence Gaze Perception

The white sclera is important in facilitating gaze perception in humans. Iris color may likewise influence gaze perception but no previous studies have directly assessed its effect. We therefore examined how the interaction between sclera and iris color influences human gaze perception. We recorded the eye movements of human participants as they performed a visual search task with human faces exhibiting directed or averted gaze. The faces either exhibited light or dark irises. In addition, the faces had sclera that were depigmented (white) or pigmented (matched the color of the iris). We found that participants were quick and accurate in evaluating gaze regardless of iris color in faces with depigmented sclera. When the sclera were pigmented, participants were slower to evaluate the gaze of faces with both light and dark irises but these effects were most pronounced in the faces with dark irises. Furthermore, participants were generally less accurate in assessing faces with pigmented sclera when the irises were dark rather than light. Our results suggest that depigmented sclera are especially important for gaze perception in faces with dark irises. Because depigmented sclera likely evolved at a time when ancestral humans exhibited dark irises, the depigmented sclera may have been crucial for efficient and accurate gaze perception in ancestral humans.

The Role of Perspective Taking on Attention: A Review of the Special Issue on the Reflexive Attentional Shift Phenomenon

Attention is a process that alters how cognitive resources are allocated, and it allows individuals to efficiently process information at the attended location. The presence of visual or auditory cues in the environment can direct the focus of attention toward certain stimuli even if the cued stimuli are not the individual’s primary target. Samson et al. demonstrated that seeing another person in the scene (i.e., a person-like cue) caused a delay in responding to target stimuli not visible to that person: “alter-centric intrusion.” This phenomenon, they argue, is dependent upon the fact that the cue used resembled a person as opposed to a more generic directional indicator. The characteristics of the cue are the core of the debate of this special issue. Some maintain that the perceptual-directional characteristics of the cue are sufficient to generate the bias while others argue that the cuing is stronger when the cue has social characteristics (relates to what another individual can perceive). The research contained in this issue confirms that human attention is biased by the presence of a directional cue. We discuss and compare the different studies. The pattern that emerges seems to suggest that the social relevance of the cue is necessary in some contexts but not in others, depending on the cognitive demand of the experimental task. One possibility is that the social mechanisms are involved in perspective taking when the task is cognitively demanding, while they may not play a role in automatic attention allocation.

Socially Anxious Tendencies Affect Impressions of Others' Positive and Negative Emotional Gazes

Socially anxious tendencies have potential to become social anxiety disorder (SAD), which is characterized by fear of social situations associated with being evaluated or embarrassed by others. In particular, others’ gazes induce social anxiety. People with SAD have a negative interpretation bias toward ambiguous emotions in others’ faces; however, negative interpretation bias toward ambiguous emotions in others’ gazes has not been fully investigated. We used an impression judgment task to examine negative interpretation bias toward others’ gazes among people with socially anxious tendencies. We generated emotionally ambiguous gazes (positive, negative, and neutral) using a morphing technique with 10% steps (neutral, 10–100% negative, and 10–100% positive). Participants (all male) were asked to judge whether the stimulus was positive or negative. Each participant’s level of social anxiety was examined using the Japanese version of the Social Phobia Inventory (SPIN-J), which measures three symptom dimensions: fear, avoidance, and physiological arousal. To examine the influence of socially anxious tendencies in the impression judgment task, we calculated the point of subjective equality (PSE) using a two-step logistic curve fitted to individual participant’s responses. The negative emotional intensity of the PSE became lower as the fear score became higher (p < 0.05). This result suggests individuals with a high tendency toward social anxiety tend to interpret subtle negative emotional gazes as a negative emotion and regard these gazes as a threat.

Measuring sensitivity to eye gaze cues in naturalistic scenes: Presenting the eye gaze FoCuS database

OBJECTIVES

The ability to process information about eye gaze and its use for nonverbal communication is foundational to human social interactions. We developed and validated a database of stimuli that are optimized to investigate the perception and referential understanding of shifts in eye gaze.

METHODS

The 245 Gaze Perception stimuli are digital photographs that test the ability to estimate and interpret eye gaze trajectory. The 82 Gaze Following stimuli are digital videos that measure the ability to follow and interpret eye gaze shifts online. Both stimuli were designed for a 4-alternative forced choice paradigm (4AFC) in which the participant identifies the gazed-at object.

RESULTS

Each stimulus was validated by independent raters and only included if the endorsement of the correct item was ≥75%. Finally, we provided timestamps for 19 40-second video segments from adolescent-oriented entertainment movies that are matched on several factors. These segments involve social interactions with eye gaze shifts and can be used to measure visual social attention.

CONCLUSIONS

This database will be an excellent resource for researchers interested in studying the developmental, behavioral, and/or neural mechanisms supporting the perception and interpretation of eye gaze cues.

Gaze Cuing Effects in Peripheral Vision

When we see another person’s gaze, spatial attention shifts toward the gaze direction. Thus, a gaze perceiver can more quickly respond to a forthcoming target when it appears in a direction of a gaze giver than when it does not. This phenomenon is termed the gaze cuing effect. Previous studies have investigated the gaze cuing effect only in foveal vision; hence, it remains unclear whether the gaze cuing effect is induced when a face is presented in peripheral vision. This is an important issue because in our daily lives we communicate not only with people in front of us but also with those in our periphery. To tackle this question, we manipulated vertically aligned locations of a facial stimulus (i.e., a face stimulus appeared above or below the center fixation) and tested the extent to which a gaze cuing effect, conveyed by gaze shifts of another, is observed in the periphery. The facial stimulus was located 0, ±2.5, ±5.0, and ±7.5° of the visual angle from the center of the display, and a target was presented 5.6° to the left or right of the center of the display. In Experiment 1, when participants responded to the location of an abrupt onset of a target (i.e., localization task), we observed significant gaze cuing effects when a facial stimulus was located 0, ±2.5, and ±5.0°, but not ±7.5°. In Experiment 2, we replicated the findings in Experiment 1 if participants pressed a key only when a target appeared (i.e., detection task). In Experiment 3, we used adjusted sizes of facial images based on the cortical representations and manipulated eye directions of the facial images oriented toward the possible target locations; it resulted in enlarged effective field of view for gaze cuing effects. The study reveals that gaze cuing effects can appear even in peripheral vision and within a vertical distance of 5.0° of the visual angles, but the effective field of view is expanded when the facial image is adjusted based on the cortical representations, and eye gaze directly looks at the possible target locations.

Examining Gaze Cone Shape and Size

Another person's looking behavior is used by observers to judge gaze direction and fixation points. An important task in this context is the judgement of direct gaze, that is, the perception of being looked at. The cone of gaze can be defined as the range of fixation points that support direct gaze. The cone concept implies that this range lawfully increases with distance, but that the cone angle is constant. The present experiment tested the concept with a larger number and a more extended range of distances than previously done, and took care of possible directional errors. The gaze cone was found to be roughly linear, and stable between 1.6 m and 7.9 m - an almost perfect cone. The mean cone size subtended 5.2° in diameter when averaged over ascending and descending series. Measures differed, however, in ascending and descending series, consistent with a conservative bias. Also, the variability of judgements increased slightly with distance. Results are discussed considering whether cone size is actually smaller than often reported in the literature.

The gaze of a social monkey is perceptible to conspecifics and predators but not prey

Eye gaze is an important source of information for animals, implicated in communication, cooperation, hunting and antipredator behaviour. Gaze perception and its cognitive underpinnings are much studied in primates, but the specific features that are used to estimate gaze can be difficult to isolate behaviourally. We photographed 13 laboratory-housed tufted capuchin monkeys (Sapajus [Cebus] apella) to quantify chromatic and achromatic contrasts between their iris, pupil, sclera and skin. We used colour vision models to quantify the degree to which capuchin eye gaze is discriminable to capuchins, their predators and their prey. We found that capuchins, regardless of their colour vision phenotype, as well as their predators, were capable of effectively discriminating capuchin gaze across ecologically relevant distances. Their prey, in contrast, were not capable of discriminating capuchin gaze, even under relatively ideal conditions. These results suggest that specific features of primate eyes can influence gaze perception, both within and across species.

Spatial selectivity in adaptation to gaze direction

A person's focus of attention is conveyed by the direction of their eyes and face, providing a simple visual cue fundamental to social interaction. A growing body of research examines the visual mechanisms that encode the direction of another person's gaze as we observe them. Here we investigate the spatial receptive field properties of these mechanisms, by testing the spatial selectivity of sensory adaptation to gaze direction. Human observers were adapted to faces with averted gaze presented in one visual hemifield, then tested in their perception of gaze direction for faces presented in the same or opposite hemifield. Adaptation caused strong, repulsive perceptual aftereffects, but only for faces presented in the same hemifield as the adapter. This occurred even though adapting and test stimuli were in the same external location across saccades. Hence, there was clear evidence for retinotopic adaptation and a relative lack of either spatiotopic or spatially invariant adaptation. These results indicate that adaptable representations of gaze direction in the human visual system have retinotopic spatial receptive fields. This strategy of coding others' direction of gaze with positional specificity relative to one's own eye position may facilitate key functions of gaze perception, such as socially cued shifts in visual attention.

Social gaze cueing elicits facilitatory and inhibitory effects on movement execution when the model might act on an object

Social cues, such as eye gaze and pointing fingers, can increase the prioritisation of specific locations for cognitive processing. A previous study using a manual reaching task showed that, although both gaze and pointing cues altered target prioritisation (reaction times [RTs]), only pointing cues affected action execution (trajectory deviations). These differential effects of gaze and pointing cues on action execution could be because the gaze cue was conveyed through a disembodied head; hence, the model lacked the potential for a body part (i.e., hands) to interact with the target. In the present study, the image of a male gaze model, whose gaze direction coincided with two potential target locations, was centrally presented. The model either had his arms and hands extended underneath the potential target locations, indicating the potential to act on the targets (Experiment 1), or had his arms crossed in front of his chest, indicating the absence of potential to act (Experiment 2). Participants reached to a target that followed a nonpredictive gaze cue at one of three stimulus onset asynchronies. RTs and reach trajectories of the movements to cued and uncued targets were analysed. RTs showed a facilitation effect for both experiments, whereas trajectory analysis revealed facilitatory and inhibitory effects, but only in Experiment 1 when the model could potentially act on the targets. The results of this study suggested that when the gaze model had the potential to interact with the cued target location, the model's gaze affected not only target prioritisation but also movement execution.

Perceived Object Trajectory Is Influenced by Others' Tracking Movements

In social interactions, it is highly salient to us where other people are looking. The ability to recover this information is critical to typical social development, helping us to coordinate our attention and behavior with others and understand their intentions and mental states [1-3]. The depth and direction in which another individual is fixating are specified jointly by their head position, eye deviation, and binocular vergence [4, 5]. It is hereto unknown, however, whether this dynamic visual information about others' focus of attention affects how we ourselves see the world. Here we show that the perceived depth and movement of physical objects in our environment are influenced by others' tracking behavior. This effect occurred even in the presence of conflicting size cues to object location and generalized to the context of apparent motion displays [6] and judgments about causal interactions between moving objects [7]. Perceived object trajectory was modulated primarily by the object-level motion of the tracking agent (e.g., the head), with less-pronounced effects of eye motion and low-level motion. Interestingly, comparable perceptual effects were induced by non-face objects that displayed similar tracking behavior, indicating a mechanism of distal coupling between the motion of the target and an appropriately moving inducer. These results demonstrate that social information can have a fundamental effect on our vision, such that the visual reality constructed in each brain is determined in part by what others see.

Disrupted Eye Gaze Perception as a Biobehavioral Marker of Social Dysfunction: An RDoC Investigation

Social dysfunction is an intractable problem in a wide spectrum of psychiatric illnesses, undermining patients' capacities for employment, independent living, and maintaining meaningful relationships. Identifying common markers of social impairment across disorders and understanding their mechanisms are prerequisites to developing targeted neurobiological treatments that can be applied productively across diagnoses and illness stages to improve functional outcome. This project focuses on eye gaze perception, the ability to accurately and efficiently discriminate others' gaze direction, as a potential biomarker of social functioning that cuts across psychiatric diagnoses. This premise builds on both the monkey and human literatures showing gaze perception as a basic building block supporting higher-level social communication and social development, and reports of abnormal gaze perception in multiple psychiatric conditions accompanied by prominent social dysfunction (e.g., psychosis-spectrum disorders, autism-spectrum disorders, social phobia). A large sample (n = 225) of adolescent and young adult (age 14-30) psychiatric patients (regardless of diagnosis) with various degrees of impaired social functioning, and demographically-matched healthy controls (n = 75) will be recruited for this study. Participant's psychiatric phenotypes, cognition, social cognition, and community functioning will be dimensionally characterized. Eye gaze perception will be assessed using a psychophysical task, and two metrics (precision, self-referential bias) that respectively tap into gaze perception disturbances at the visual perceptual and interpretation levels, independent of general deficits, will be derived using hierarchical Bayesian modeling. A subset of the participants (150 psychiatric patients, 75 controls) will additionally undergo multimodal fMRI to determine the functional and structural brain network features of altered gaze perception. The specific aims of this project are three-fold: (1) Determine the generality of gaze perception disturbances in psychiatric patients with prominent social dysfunction; (2) Map behavioral indices of gaze perception disturbances to dimensions of psychiatric phenotypes and core functional domains; and (3) Identify the neural correlates of altered gaze perception in psychiatric patients with social dysfunction. Successfully completing these specific aims will identify the specific basic deficits, clinical profile, and underlying neural circuits associated with social dysfunction that can be used to guide targeted, personalized treatments, thus advancing NIMH's Strategic Objective 1 (describe neural circuits associated with mental illnesses and map the connectomes for mental illnesses) and Objective 3 (develop new treatments based on discoveries in neuroscience and behavioral science).

The modulation effect of cognition on mentalization in late-life depression: a study of gaze perception-a potential screening tool for high-risk group of late-life depression

Introduction

Impairment in mentalization is implicated in the development and maintenance of depression. Major depressive disorders showed significant impairment in social cognition and such impairment appears to be positively associated with the severity of depression. Self-referential gaze perception (SRGP), a measurement of mentalization, was predominantly measured in patients with psychosis but rarely examined in late-life depression (LLD).

Methods

To assess the effect of cognition on the interpretation bias of mentalization, 29 LLD patients and 29 healthy controls were asked to judge if various gaze directions were directed to self in SRGP.

Results

Patients with better cognition showed less unambiguous-SRGP bias than those with worse cognitive scores; this difference was not found in healthy controls. Global cognition and executive function contributed to the SRGP rate in patients.

Conclusion

The current study is the first study to explore the relationship between cognition and SRGP in the LLD population. Our study findings suggested that the cognitive function of LLD patients may contribute to the modulation of interpretation bias, which in turn underlie the role of SRGP bias. Greater SRGP bias in patients may reflect social cognition deterioration, impairing the social interaction and functioning of LLD patients. This highlights the need for early intervention and cognitive decline identification to facilitate better prognosis and treatment effectiveness; thus, further studies could navigate the potential of SRGP task as a screening tool for high-risk group of LLD likely to develop dementia.

Eccentric Gaze as a Possible Cause of "Zoom Fatigue"

BACKGROUND

The Covid-19 pandemic has led to a marked increase in the use of videoconferencing for social interaction. Many people report discomfort and disaffection with this modality, which has been labeled "Zoom Fatigue." Common videoconferencing hardware setups necessitate that if a user looks at the image of the person with whom they are in videoconference, they will not be looking directly at the camera and will appear to not be making direct eye contact. This study determined the minimum threshold of eccentric gaze in a videoconferencing setup above which subjects are perceived as not making direct eye contact by the majority of untrained observers.

METHODS

Image captures were made of four subjects successively fixating at small increments eccentric to a video camera, both vertically and horizontally ranging from 0.9 degrees to 19 degrees of eccentricity. The images were embedded in separate Powerpoint files for each subject. Each file was assessed by seven graders who indicated whether or not they felt the subject was looking directly at them in each slide.

RESULTS

The threshold for which 75% of the graders could detect that the subject was not looking at them ranged from only 2.7 degrees for horizontal eccentricity to 5.4 degrees for vertical eccentricity.

CONCLUSION

The hardware setups commonly used for videoconferencing result in persistent eccentric gaze of the participating individuals if they look at the image of the other participants. In theory, this could be a contributing cause of Zoom Fatigue.