The eyes have it: the neuroethology, function and evolution of social gaze

Is the precedence of social re-orienting only inherent to the initiators?

Previous researches have revealed that initiators preferentially re-orient their attention towards responders with whom they have established joint attention (JA). However, it remains unclear whether this precedence of social re-orienting is inherent to initiators or applies equally to responders, and whether this social re-orienting is modulated by the social contexts in which JA is achieved. To address these issues, the present study adopted a modified virtual-reality paradigm to manipulate social roles (initiator vs. responder), social behaviours (JA vs. Non-JA), and social contexts (intentional vs. incidental). Results indicated that people, whether as initiators or responders, exhibited a similar prioritisation pattern of social re-orienting, and this was independent of the social contexts in which JA was achieved, revealing that the prioritisation of social re-orienting is an inherent social attentional mechanism in humans. It should be noted, however, that the distinct social cognitive systems engaged when individuals switched roles between initiator and responder were only driven during intentional (Experiment 1) rather than incidental (Experiment 2) JA. These findings provide potential insights for understanding the shared attention system and the integrated framework of attentional and mentalising processes.

Leading through gaze: Enhanced social attention in high-rank members of a large-scale organization

Human attention is naturally directed where others are looking. Primate research indicates that this phenomenon is influenced by the social rank of the gazer. Whether this applies to human societies remains underexplored. Diverging from the typical approach based on transient social rank manipulations in convenience samples, we tested low- and high-rank individuals permanently working in a large-scale organization. Participants executed saccades toward positions matching or not the gaze direction of distractor faces varying in dominance level (low, neutral, and high). The analysis of saccadic reaction time revealed that high-rank participants were more interfered by face distractors, regardless of dominance. Our results suggest that an important feature of leadership is related to the fine-tuning of social attention. These findings not only contribute to understanding how hierarchical rank shapes social cognition but also have implications for organizational behavior and leadership training strategies.

Pupil size and iris brightness interact to affect prosocial behaviour and affective responses

Despite the tight link between the visibility of the iris and pupil, the perceived effects of these two have been studied largely in isolation. We demonstrate, across two experimental studies, that the effects of perceived pupil size are dependent on the visibility of the iris. In a first study, our participants donated more and had more positive impressions of portraits of non-human primates when these were manipulated to appear having larger pupils. Post-hoc inspection of our data suggested that the difference was greater for species with more conspicuous irises. In a second study, we concomitantly manipulated iris brightness and pupil size. Brighter irises and larger pupils elicited greater donations. Participants rated photographs with brighter irises as cuter, more attractive and friendlier, but only when they had dilated pupils. Our results have methodological implications for studies manipulating eye appearance, and help interpret results from previous studies.

Not to follow because of distrust: perceived trust modulates the gaze cueing effect

In social life, people spontaneously form stable trustworthiness impressions from faces. However, the precise role of extracting trustworthiness information remains unclear. This study aims to elucidate whether discerning facial trustworthiness influences social interactions. Specifically, it explores the gaze cueing effect (GCE), wherein individuals exhibit quicker responses to targets appearing in the direction of gaze compared to other locations. Given conflicting perspectives in existing literature regarding the potential modulation of trustworthiness on the GCE, two plausible hypotheses are proposed to explain divergent result patterns. The reflexive hypothesis posits that the GCE operates automatically. In contrast, the flexible hypothesis underscores the potential modulatory role of trustworthiness in the GCE. To provide a comprehensive understanding of whether trustworthiness modulates the GCE, we employed face stimuli incorporating trustworthiness information within Posner' s cue-target task. The findings of Experiment 1 revealed that the perception of trustworthiness indeed influenced the GCE. Specifically, when facial stimuli were perceived as trustworthy, they elicited a more pronounced GCE compared to untrustworthy stimuli. This modulation effect was replicated using a different stimulus set in Experiment 2. In Experiment 3, we employed the same stimuli as in Experiment 2, setting the trustworthiness information to baseline as a control experiment. The results demonstrated that the trustworthiness modulation effect disappeared, indicating its specificity to the trustworthiness attribute of the stimuli rather than other characteristics. Collectively, these findings lend support to the flexible hypothesis, highlighting that the extraction of trustworthiness information plays a pivotal role in modulating the GCE, consequently influencing social interactions.

Social face processing in chronic severe traumatic brain injury: Altered decoding of emotions and mental states but preserved gaze cueing of attention

The processing of social information transmitted by facial stimuli is altered in individuals with traumatic brain injury (TBI). This study investigated whether these alterations also affect the mechanisms underlying the orienting of visual attention in response to eye-gaze signals. TBI patients and a control group of healthy individuals matched on relevant criteria completed a spatial cueing task. In this task, a lateral visual target was presented along with a task-irrelevant face, with the gaze averted to the left or right. Arrows pointing towards the left or right were also used as non-social control stimuli. Social cognition abilities were further investigated through tests based on decoding emotional expressions and mental states conveyed by facial stimuli. The decoding of emotions and mental states was worse in the TBI group than in the control group. However, both groups demonstrated reliable and comparable orienting of attention to both eye-gaze and arrow stimuli. Despite impairments in certain aspects of social face processing among TBI patients, gaze cueing of attention appears to be preserved in this neuropsychological population.

Prioritization of social information processing: Eye gaze elicits earlier vMMN than arrows

Numerous research studies have demonstrated that eye gaze and arrows act as cues that automatically guide spatial attention. However, it remains uncertain whether the attention shifts triggered by these two types of stimuli vary in terms of automatic processing mechanisms. In our current investigation, we employed an equal probability paradigm to explore the likenesses and distinctions in the neural mechanisms of automatic processing for eye gaze and arrows in non-attentive conditions, using visual mismatch negative (vMMN) as an indicator of automatic processing. The sample size comprised 17 participants. The results indicated a significant interaction between time duration, stimulus material, and stimulus type. The findings demonstrated that both eye gaze and arrows were processed automatically, triggering an early vMMN, although with temporal variations. The vMMN for eye gaze occurred between 180 and 220 ms, whereas for arrows it ranged from 235 to 275 ms. Moreover, arrow stimuli produced a more pronounced vMMN amplitude. The earlier vMMN response to eye gaze compared with arrows implies the specificity and precedence of social information processing associated with eye gaze over the processing of nonsocial information with arrows. However, arrow could potentially elicit a stronger vMMN because of their heightened salience compared to the background, and the expansion of attention focusing might amplify the vMMN impact. This study offers insights into the similarities and differences in attention processing of social and non-social information under unattended conditions from the perspective of automatic processing.

Mentalistic attention orienting triggered by android eyes

The eyes play a special role in human communications. Previous psychological studies have reported reflexive attention orienting in response to another individual's eyes during live interactions. Although robots are expected to collaborate with humans in various social situations, it remains unclear whether robot eyes have the potential to trigger attention orienting similarly to human eyes, specifically based on mental attribution. We investigated this issue in a series of experiments using a live gaze-cueing paradigm with an android. In Experiment 1, the non-predictive cue was the eyes and head of an android placed in front of human participants. Light-emitting diodes in the periphery served as target signals. The reaction times (RTs) required to localize the valid cued targets were faster than those for invalid cued targets for both types of cues. In Experiment 2, the gaze direction of the android eyes changed before the peripheral target lights appeared with or without barriers that made the targets non-visible, such that the android did not attend to them. The RTs were faster for validly cued targets only when there were no barriers. In Experiment 3, the targets were changed from lights to sounds, which the android could attend to even in the presence of barriers. The RTs to the target sounds were faster with valid cues, irrespective of the presence of barriers. These results suggest that android eyes may automatically induce attention orienting in humans based on mental state attribution.

Interacting with autistic virtual characters: intrapersonal synchrony of nonverbal behavior affects participants' perception

Temporal coordination of communicative behavior is not only located between but also within interaction partners (e.g., gaze and gestures). This intrapersonal synchrony (IaPS) is assumed to constitute interpersonal alignment. Studies show systematic variations in IaPS in individuals with autism, which may affect the degree of interpersonal temporal coordination. In the current study, we reversed the approach and mapped the measured nonverbal behavior of interactants with and without ASD from a previous study onto virtual characters to study the effects of the differential IaPS on observers (N = 68), both with and without ASD (crossed design). During a communication task with both characters, who indicated targets with gaze and delayed pointing gestures, we measured response times, gaze behavior, and post hoc impression formation. Results show that character behavior indicative of ASD resulted in overall enlarged decoding times in observers and this effect was even pronounced in observers with ASD. A classification of observer's gaze types indicated differentiated decoding strategies. Whereas non-autistic observers presented with a rather consistent eyes-focused strategy associated with efficient and fast responses, observers with ASD presented with highly variable decoding strategies. In contrast to communication efficiency, impression formation was not influenced by IaPS. The results underline the importance of timing differences in both production and perception processes during multimodal nonverbal communication in interactants with and without ASD. In essence, the current findings locate the manifestation of reduced reciprocity in autism not merely in the person, but in the interactional dynamics of dyads.

Enhancing the Horse Grimace Scale (HGS): Proposed updates and anatomical descriptors for pain assessment

The use of grimace scales enables the clinical identification of changes in the facial expressions of animals caused by pain. The Horse Grimace Scale (HGS) is one such tool, comprising a pain coding system based on facial expressions and assessing six Facial Action Units (FAUs). Each FAU is accompanied by descriptions and anatomical details to assist the evaluator. However, the morphological descriptions for certain FAUs in the HGS are not sufficiently detailed, potentially hindering accurate interpretation. This study is an analytical investigation aimed at enhancing the morphoanatomical details in the HGS and providing raters with more comprehensive materials for pain evaluation in horses using this scale. To achieve this, detailed anatomical analyses were conducted using established references in veterinary anatomy. Initially, we propose substituting the term 'ear' with 'auricle' or 'pinna' and replacing 'area above the eye' with 'supraorbital region' for anatomical accuracy. Additionally, we introduce detailed morphoanatomical descriptions that identify specific landmarks, with the goal of ensuring more consistent application of the HGS and reducing interpretation variability. Furthermore, this study provides an explanation of the muscles involved in the investigated FAUs. These adjustments on the descriptions and evaluations remain unverified, however it is anticipated that the descriptive enhancements lead us to understand that higher interobserver reliability can be achieved for each of the FAUs.

The Impact of Cues on Joint Attention in Children with Autism Spectrum Disorder: An Eye-Tracking Study in Virtual Games

Joint attention (JA), a core deficit in children with autism spectrum disorder (ASD), is crucial for social interaction, emotional understanding, and cognitive development. This study aims to compare and analyze the eye-tracking data of ASD and typically developing children (TDC) during virtual games, exploring how different cue types affect JA performance in ASD children. A total of 31 TDC and 40 ASD children participated in the study. Using eye-tracking devices, we recorded the children's eye movements as they played virtual games, selecting the correct target based on cues provided by virtual characters. Our findings revealed that different cue types significantly impacted the game scores of ASD children but had no significant effect on TDC, highlighting a notable disparity between the two groups. ASD children showed a lower fixation frequency, irregular fixation paths, and increased attention to non-target objects compared to TDC. Interestingly, among the three cue types, ASD children exhibited a preference for the third type, leading to longer fixation on the region of interest and higher game scores. These results underscore the importance of cue selection in enhancing JA in ASD children. This study provides novel insights into the JA deficits in ASD children and offers a scientific basis for the development of targeted and individualized intervention programs.

Emotion-gaze interaction affects time-to-collision estimates, but not preferred interpersonal distance towards looming faces

Estimating the time until impending collision (time-to-collision, TTC) of approaching or looming individuals and maintaining a comfortable distance from others (interpersonal distance, IPD) are commonly required in daily life and contribute to survival and social goals. Despite accumulating evidence that facial expressions and gaze direction interactively influence face processing, it remains unclear how these facial features affect the spatiotemporal processing of looming faces. We examined whether facial expressions (fearful vs. neutral) and gaze direction (direct vs. averted) interact on the judgments of TTC and IPD for looming faces, based on the shared signal hypothesis that fear signals the existence of threats in the environment when coupled with averted gaze. Experiment 1 demonstrated that TTC estimates were reduced for fearful faces compared to neutral ones only when the concomitant gaze was averted. In Experiment 2, the emotion-gaze interaction was not observed in the IPD regulation, which is arguably sensitive to affective responses to faces. The results suggest that fearful-averted faces modulate the cognitive extrapolation process of looming motion by communicating environmental threats rather than by altering subjective fear or perceived emotional intensity of faces. The TTC-specific effect may reflect an enhanced defensive response to unseen threats implied by looming fearful-averted faces. Our findings provide insight into how the visual system processes facial features to ensure bodily safety and comfortable interpersonal communication in dynamic environments.

Cognitive Mechanisms of Aberrant Self-Referential Social Perception in Psychosis and Bipolar Disorder: Insights From Computational Modeling

BACKGROUND AND HYPOTHESIS

Individuals with schizophrenia (SZ) and bipolar disorder (BD) show disruptions in self-referential gaze perception-a social perceptual process related to symptoms and functioning. However, our current mechanistic understanding of these dysfunctions and relationships is imprecise.

STUDY DESIGN

The present study used mathematical modeling to uncover cognitive processes driving gaze perception abnormalities in SZ and BD, and how they relate to cognition, symptoms, and social functioning. We modeled the behavior of 28 SZ, 38 BD, and 34 controls (HC) in a self-referential gaze perception task using drift-diffusion models parameterized to index key cognitive components: drift rate (evidence accumulation efficiency), drift bias (perceptual bias), start point (expectation bias), threshold separation (response caution), and nondecision time (encoding/motor processes).

STUDY RESULTS

Results revealed that aberrant gaze perception in SZ and BD was driven by less efficient evidence accumulation, perceptual biases predisposing self-referential responses, and greater caution (SZ only). Across SZ and HC, poorer social functioning was related to greater expectation biases. Within SZ, perceptual and expectancy biases were associated with hallucination and delusion severity, respectively.

CONCLUSIONS

These findings indicate that diminished evidence accumulation and perceptual biases may underlie altered gaze perception in patients and that SZ may engage in compensatory cautiousness, sacrificing response speed to preserve accuracy. Moreover, biases at the belief and perceptual levels may relate to symptoms and functioning. Computational modeling can, therefore, be used to achieve a more nuanced, cognitive process-level understanding of the mechanisms of social cognitive difficulties, including gaze perception, in individuals with SZ and BD.

Neural populations in macaque anterior cingulate cortex encode social image identities

The anterior cingulate cortex gyrus (ACCg) has been implicated in prosocial behaviors and reasoning about social cues. While this indicates that ACCg is involved in social behavior, it remains unclear whether ACCg neurons also encode social information during goal-directed actions without social consequences. To address this, we assessed how social information is processed by ACCg neurons in a reward localization task. Here we show that neurons in the ACCg of female rhesus monkeys differentiate the identities of conspecifics in task images, even when identity was task-irrelevant. This was in contrast to the prearcuate cortex (PAC), which has not been strongly linked to social behavior, where neurons differentiated identities in both social and nonsocial images. Many neurons in the ACCg also categorically distinguished social from nonsocial trials, but this encoding was only slightly more common in ACCg compared to the PAC. Together, our results suggest that ACCg neurons are uniquely sensitive to social information that differentiates individuals, which may underlie its role in complex social reasoning.

Stimulating social interest: The translational value of basic investigations into frontal cortex function

Fan et al. use electrical stimulation during a novel social interaction paradigm to demonstrate a role for the orbitofrontal cortex in directing social attention. Their results shed new light on the basic functions of the orbitofrontal cortex and have translational value in understanding circuit modulation for psychiatric disorders.

Closed-loop microstimulations of the orbitofrontal cortex during real-life gaze interaction enhance dynamic social attention

Neurons from multiple prefrontal areas encode several key variables of social gaze interaction. To explore the causal roles of the primate prefrontal cortex in real-life gaze interaction, we applied weak closed-loop microstimulations that were precisely triggered by specific social gaze events. Microstimulations of the orbitofrontal cortex, but not the dorsomedial prefrontal cortex or the anterior cingulate cortex, enhanced momentary dynamic social attention in the spatial dimension by decreasing the distance of fixations relative to a partner's eyes and in the temporal dimension by reducing the inter-looking interval and the latency to reciprocate the other's directed gaze. By contrast, on a longer timescale, microstimulations of the dorsomedial prefrontal cortex modulated inter-individual gaze dynamics relative to one's own gaze positions. These findings demonstrate that multiple regions in the primate prefrontal cortex may serve as functionally accessible nodes in controlling different aspects of dynamic social attention and suggest their potential for a therapeutic brain interface.

Atypical and variable attention patterns reveal reduced contextual priors in children with autism spectrum disorder

Accumulating evidence suggests that individuals with autism spectrum disorder (ASD) show impairments in using contextual priors to predict others' actions and make intention inference. Yet less is known about whether and how children with ASD acquire contextual priors during action observation and how contextual priors relate to their action prediction and intention inference. To form proper contextual priors, individuals need to observe the social scenes in a reliable manner and focus on socially relevant information. By employing a data-driven scan path method and areas of interest (AOI)-based analysis, the current study investigated how contextual priors would relate to action prediction and intention understanding in 4-to-9-year-old children with ASD (N = 56) and typically developing (TD) children (N = 50) during free viewing of dynamic social scenes with different intentions. Results showed that children with ASD exhibited higher intra-subject variability when scanning social scenes and reduced attention to socially relevant areas. Moreover, children with high-level action prediction and intention understanding showed lower intra-subject variability and increased attention to socially relevant areas. These findings suggest that altered fixation patterns might restrain children with ASD from acquiring proper contextual priors, which has cascading downstream effects on their action prediction and intention understanding.

Unmasking social attention: The key distinction between social and non-social attention emerges in disengagement, not engagement

The debate surrounding whether social and non-social attention share the same mechanism has been contentious. While prior studies predominantly focused on engagement, we examined the potential disparity between social and non-social attention from both perspectives of engagement and disengagement, respectively. We developed a two-stage attention-shifting paradigm to capture both attention engagement and disengagement. Combining results from five eye-tracking experiments, we supported that the disengagement of social attention markedly outpaces that of non-social attention, while no significant discrepancy emerges in engagement. We uncovered that the faster disengagement of social attention came from its social nature by eliminating alternative explanations including broader fixation distribution width, reduced directional salience in the peripheral visual field, decreased cue-object categorical consistency, reduced perceived validity, and faster processing time. Our study supported that the distinction between social and non-social attention is rooted in attention disengagement, not engagement.

Cognitive Mechanisms of Aberrant Self-Referential Social Perception in Psychosis and Bipolar Disorder: Insights from Computational Modeling

Background and Hypothesis

Individuals with schizophrenia (SZ) and bipolar disorder (BD) show disruptions in self-referential gaze perception-a social perceptual process related to symptoms and functioning. However, our current mechanistic understanding of these dysfunctions and relationships is imprecise.

Study Design

The present study used mathematical modeling to uncover cognitive processes driving gaze perception abnormalities in SZ and BD, and how they relate to cognition, symptoms, and social functioning. We modeled the behavior of 28 SZ, 38 BD, and 34 controls (HC) in a self-referential gaze perception task using drift-diffusion models (DDM) parameterized to index key cognitive components: drift rate (evidence accumulation efficiency), drift bias (perceptual bias), start point (expectation bias), threshold separation (response caution), and non- decision time (encoding/motor processes).

Study Results

Results revealed that aberrant gaze perception in SZ and BD was driven by less efficient evidence accumulation, perceptual biases predisposing self-referential responses, and greater caution (SZ only). Across SZ and HC, poorer social functioning was related to greater expectation biases. Within SZ, perceptual and expectancy biases were associated with hallucination and delusion severity, respectively.

Conclusions

These findings indicate that diminished evidence accumulation and perceptual biases may underlie altered gaze perception in patients and that SZ may engage in compensatory cautiousness, sacrificing response speed to preserve accuracy. Moreover, biases at the belief and perceptual levels may relate to symptoms and functioning. Computational modeling can, therefore, be used to achieve a more nuanced, cognitive process-level understanding of the mechanisms of social cognitive difficulties, including gaze perception, in individuals with SZ and BD.

Enhancing emotional expression in cat-like robots: strategies for utilizing tail movements with human-like gazes

In recent years, there has been a significant growth in research on emotion expression in the field of human-robot interaction. In the process of human-robot interaction, the effect of the robot's emotional expression determines the user's experience and acceptance. Gaze is widely accepted as an important media to express emotions in human-human interaction. But it has been found that users have difficulty in effectively recognizing emotions such as happiness and anger expressed by animaloid robots that use eye contact individually. In addition, in real interaction, effective nonverbal expression includes not only eye contact but also physical expression. However, current animaloid social robots consider human-like eyes as the main emotion expression pathway, which results in a dysfunctional robot appearance and behavioral approach, affecting the quality of emotional expression. Based on retaining the effectiveness of eyes for emotional communication, we added a mechanical tail as a physical expression to enhance the robot's emotional expression in concert with the eyes. The results show that the collaboration between the mechanical tail and the bionic eye enhances emotional expression in all four emotions. Further more, we found that the mechanical tail can enhance the expression of specific emotions with different parameters. The above study is conducive to enhancing the robot's emotional expression ability in human-robot interaction and improving the user's interaction experience.

Unconscious and Conscious Gaze-Triggered Attentional Orienting: Distinguishing Innate and Acquired Components of Social Attention in Children and Adults with Autistic Traits and Autism Spectrum Disorders

Typically developing (TD) individuals can readily orient attention according to others' eye-gaze direction, an ability known as social attention, which involves both innate and acquired components. To distinguish between these two components, we used a critical flicker fusion technique to render gaze cues invisible to participants, thereby largely reducing influences from consciously acquired strategies. Results revealed that both visible and invisible gaze cues could trigger attentional orienting in TD adults (aged 20 to 30 years) and children (aged 6 to 12 years). Intriguingly, only the ability to involuntarily respond to invisible gaze cues was negatively correlated with autistic traits among all TD participants. This ability was substantially impaired in adults with autism spectrum disorder (ASD) and in children with high autistic traits. No such association or reduction was observed with visible gaze cues. These findings provide compelling evidence for the functional demarcation of conscious and unconscious gaze-triggered attentional orienting that emerges early in life and develops into adulthood, shedding new light on the differentiation of the innate and acquired aspects of social attention. Moreover, they contribute to a comprehensive understanding of social endophenotypes of ASD.

The combination operation of grouping and ensemble coding for structured biological motion crowds in working memory

Massive studies have explored biological motion (BM) crowds processing for their remarkable social significance, primarily focused on uniformly distributed ones. However, real-world BM crowds often exhibit hierarchical structures rather than uniform arrangements. How such structured BM crowds are processed remains a subject of inquiry. This study investigates the representation of structured BM crowds in working memory (WM), recognizing the pivotal role WM plays in our social interactions involving BM. We propose the group-based ensemble hypothesis and test it through a member identification task. Participants were required to discern whether a presented BM belonged to a prior memory display of eight BM, each with distinct walking directions. Drawing on prominent Gestalt principles as organizational cues, we constructed structured groups within BM crowds by applying proximity and similarity cues in Experiments 1 and 2, respectively. In Experiment 3, we deliberately weakened the visibility of stimuli structures by increasing the similarity between subsets, probing the robustness of results. Consistently, our findings indicate that BM aligned with the mean direction of the subsets was more likely to be recognized as part of the memory stimuli. This suggests that WM inherently organizes structured BM crowds into separate ensembles based on organizational cues. In essence, our results illuminate the simultaneous operation of grouping and ensemble encoding mechanisms for BM crowds within WM.

Individual differences in sociocognitive traits in semi-free-ranging rhesus monkeys (Macaca mulatta)

Characterizing individual differences in cognition is crucial for understanding the evolution of cognition as well as to test the biological consequences of different cognitive traits. Here, we harnessed the strengths of a uniquely large, naturally-living primate population at the Cayo Santiago Biological Field Station to characterized individual differences in rhesus monkey performance across two social cognitive tasks. A total of n = 204 semi-free-ranging adult rhesus monkeys participated in a data collection procedure, where we aimed to test individuals on both tasks at two time-points that were one year apart. In the socioemotional responses task, we assessed monkeys' attention to conspecific photographs with neutral versus negative emotional expressions. We found that monkeys showed overall declines in interest in conspecific photographs with age, but relative increases in attention to threat stimuli specifically, and further that these responses exhibited long-term stability across repeated testing. In the gaze following task we assessed monkeys' propensity to co-orient with an experimenter. Here, we found no evidence for age-related change in responses, and responses showed only limited repeatability over time. Finally, we found some evidence for common individual variation for performance across the tasks: monkeys that showed greater interest in conspecific photographs were more likely to follow a human's gaze. These results show how studies of comparative cognitive development and aging can provide insights into the evolution of cognition, and identify core primate social cognitive traits that may be related across and within individuals.

The who and the where: Attention to identities and locations in groups

While it is widely accepted that the single gaze of another person elicits shifts of attention, there is limited work on the effects of multiple gazes on attention, despite real-world social cues often occurring in groups. Further, less is known regarding the role of unequal reliability of varying social and nonsocial information on attention. We addressed these gaps by employing a variant of the gaze cueing paradigm, simultaneously presenting participants with three faces. Block-wise, we manipulated whether one face (Identity condition) or one location (Location condition) contained a gaze cue entirely predictive of target location; all other cues were uninformative. Across trials, we manipulated the number of valid cues (number of faces gazing at target). We examined whether these two types of information (Identity vs. Location) were learned at a similar rate by statistically modelling cueing effects by trial count. Preregistered analyses returned no evidence for an interaction between condition, number of valid faces, and presence of the predictive element, indicating type of information did not affect participants' ability to employ the predictive element to alter behaviour. Exploratory analyses demonstrated (i) response times (RT) decreased faster across trials for the Identity compared with Location condition, with greater decreases when the predictive element was present versus absent, (ii) RTs decreased across trials for the Location condition only when it was completed first, and (iii) social competence altered RTs across conditions and trial number. Our work demonstrates a nuanced relationship between cue utility, condition type, and social competence on group cueing.

Differential Effects of a Behavioral Treatment Probe on Social Gaze Behavior in Fragile X Syndrome and Non-Syndromic Autism Spectrum Disorder

The purpose of this study was to examine potential differences in social learning between individuals with fragile X syndrome (FXS), the leading known inherited cause of intellectual disability, and individuals with non-syndromic autism spectrum disorder (ASD). Thirty school-aged males with FXS and 26 age and symptom-matched males with non-syndromic ASD, were administered a behavioral treatment probe designed to improve levels of social gaze during interactions with others. The treatment probe was administered by a trained behavior therapist over two days in our laboratory and included reinforcement of social gaze in two alternating training conditions - looking while listening and looking while speaking. Prior to each session, children in each group were taught progressive muscle relaxation and breathing techniques to counteract potential increased hyperarousal. Measures included the rate of learning in each group during treatment, in addition to levels of social gaze and heart rate obtained during administration of a standardized social conversation task administered prior to and following the treatment probe. Results showed that learning rates obtained during administration of the treatment probe were significantly less steep and less variable for males with FXS compared to males with non-syndromic ASD. Significant improvements in social gaze were also observed for males with FXS during the social conversation task. There was no effect of the treatment probe on heart rate in either group. These data reveal important differences in social learning between the two groups and have implications for early interventions in the two conditions.

Bottlenose dolphins (Tursiops truncatus) display gaze alternation and referential communication in an impossible task

Gaze cues play a vital role in conveying critical information about objects and locations necessary for survival, such as food sources, predators, and the attentional states of conspecific and heterospecific individuals. During referential intentional communication, the continuous alternation of gaze between a communicative partner and a specific object or point of interest attracts the partner's attention towards the target. This behaviour is considered by many as essential for understanding intentions and is thought to involve mental planning. Here, we investigated the behavioural responses of seven bottlenose dolphins (Tursiops truncatus) that were given an impossible task in the presence of two experimenters (a 'commanding experimenter' and a 'non-commanding experimenter'), whose attentional state towards the dolphins varied. We found that the dolphins spontaneously displayed gaze alternation, specifically triadic referential pointing, only when the human commanding experimenter was facing them. However, they ceased to alternate their gaze between the impossible object and the commanding experimenter when the experimenter had their back turned. Notably, the dolphins' behaviour differed from general pointing and gaze, as their triadic sequence occurred within a narrow time window. These findings suggest that the dolphins were sensitive to human attentional cues and utilized their own gaze cue (pointing) as a salient signal to attract the attention of the commanding experimenter towards a specific location.

The reverse congruency effect elicited by eye-gaze as a function of attention-deficit/hyperactivity disorder symptoms

Individuals diagnosed with attention deficit/hyperactivity disorder (ADHD) have been found to have impairments in multiple aspects of social cognition, thus including the attentional processing of socially relevant stimuli such as eye-gaze. However, to date, it remains unclear whether only the social-specific but not the domain-general directional components, elicited by eye-gaze are affected by ADHD symptomatology. To address this issue, the present study aimed to investigate the impact of ADHD-like traits on the social-specific attentional processing of eye-gaze. To this purpose, we conducted an online experiment with a sample of 140 healthy undergraduate participants who completed two self-reported questionnaires designed to assess ADHD-like traits, and a social variant of an interference spatial task known to effectively isolate the social-specific component of eye-gaze. To make our research plan transparent, our hypotheses, together with the plans of analyses, were registered before data exploration. Results showed that while the social-specific component of eye-gaze was evident in the sample, no significant correlation was found between this component and the measured ADHD-like traits. These results appear to contradict the intuition that the attentional processing of the social-specific components of eye-gaze may be impaired by ADHD symptomatology. However, further research involving children and clinical populations is needed in order to clarify this matter.

Attentional Orienting and Disfluency-Related Memory Boost Are Intact in Adults With Moderate-Severe Traumatic Brain Injury

PURPOSE

Traumatic brain injury (TBI) is associated with a range of cognitive-communicative deficits that interfere with everyday communication and social interaction. Considerable effort has been directed at characterizing the nature and scope of cognitive-communication disorders in TBI, yet the underlying mechanisms of impairment are largely unspecified. The present research examines sensitivity to a common communicative cue, disfluency, and its impact on memory for spoken language in TBI.

METHOD

Fifty-three participants with moderate-severe TBI and 53 noninjured comparison participants listened to a series of sentences, some of which contained disfluencies. A subsequent memory test probed memory for critical words in the sentences.

RESULTS

Participants with TBI successfully remembered the spoken words (b = 1.57, p < .0001) at a similar level to noninjured comparison participants. Critically, participants with TBI also exhibited better recognition memory for words preceded by disfluency compared to words from fluent sentences (b = 0.57, p = .02).

CONCLUSIONS

These findings advance mechanistic accounts of cognitive-communication disorder by revealing that, when isolated for experimental study, individuals with moderate-severe TBI are sensitive to attentional orienting cues in speech and exhibit enhanced recognition of individual words preceded by disfluency. These results suggest that some aspects of cognitive-communication disorders may not emerge from an inability to perceive and use individual communication cues, but rather from disruptions in managing (i.e., attending, weighting, integrating) multiple cognitive, communicative, and social cues in complex and dynamic interactions. This hypothesis warrants further investigation.

Neural and affective responses to prolonged eye contact with parents in depressed and nondepressed adolescents

Eye contact improves mood, facilitates connectedness, and is assumed to strengthen the parent-child bond. Adolescent depression is linked to difficulties in social interactions, the parent-child bond included. Our goal was to elucidate adolescents' affective and neural responses to prolonged eye contact with one's parent in nondepressed adolescents (HC) and how these responses are affected in depressed adolescents. While in the scanner, 59 nondepressed and 19 depressed adolescents were asked to make eye contact with their parent, an unfamiliar peer, an unfamiliar adult, and themselves by using videos of prolonged direct and averted gaze, as an approximation of eye contact. After each trial, adolescents reported on their mood and feelings of connectedness, and eye movements and BOLD-responses were assessed. In HCs, eye contact boosted mood and feelings of connectedness and increased activity in inferior frontal gyrus (IFG), temporal pole, and superior frontal gyrus. Unlike HCs, eye contact did not boost the mood of depressed adolescents. While HCs reported increased mood and feelings of connectedness to the sight of their parent versus others, depressed adolescents did not. Depressed adolescents exhibited blunted overall IFG activity. These findings show that adolescents are particularly sensitive to eye contact and respond strongly to the sight of their parents. This sensitivity seems to be blunted in depressed adolescents. For clinical purposes, it is important to gain a better understanding of how the responsivity to eye contact in general and with their parents in particular, can be restored in adolescents with depression.

Perceived gaze dynamics in social interactions can alter (and even reverse) the perceived temporal order of events

Here's an all-too-familiar scenario: Person A is staring at person B, and then B turns toward A, and A immediately looks away (a phenomenon we call 'gaze deflection'). Beyond perceiving lower-level properties here - such as the timing of the eye/head turns - you can also readily perceive seemingly higher-level social dynamics: A got caught staring, and frantically looked away in embarrassment! It seems natural to assume that such social impressions are based on more fundamental representations of what happened when - but here we show that social gaze dynamics are unexpectedly powerful in that they can actually alter (and even reverse) the perceived temporal order of the underlying events. Across eight experiments, observers misperceived B as turning before A, when in fact they turned simultaneously - and even when B was turning after A. Additional controls confirmed that this illusion depends on visual processing (vs. being driven solely by higher-level interpretations), and that it is specific to the perception of social agents (vs. non-social objects). This demonstrates how social perception is tightly integrated into our perceptual experience of the world, and can have powerful consequences for one of the most basic properties that we can perceive: what happens when.

No effect of autistic traits on social attention: evidence based on single-cue and conflicting-cues scenarios

Individuals often use others' gaze and head directions to direct their attention. To investigate the influence of autistic traits on social attention, we conducted two experiments comparing groups with high and low autistic traits in single-cue (Experiment 1) and conflicting-cue (Experiment 2) scenarios. Our findings indicate that individuals responded more rapidly to the direction of a single social cue or the consensus of multiple cues. However, we did not observe significant differences in social attention between individuals with high and low autistic traits. Notably, as the stimulus onset asynchrony (SOA) increased, individuals with low autistic traits exhibited greater improvements in reaction speed compared to those with high autistic traits. This suggests that individuals with low autistic traits excel at leveraging temporal information to optimize their behavioral readiness over time, hinting at potential variations in cognitive flexibility related to autistic traits.

Sense of agency at a gaze-contingent display with jittery temporal delay

Introduction

Inconsistent jittery temporal delays between action and subsequent feedback, prevalent in network-based human-computer interaction (HCI), have been insufficiently explored, particularly regarding their impact on the sense of agency (SoA). This study investigates the SoA in the context of eye-gaze HCI under jittery delay conditions.

Methods

Participants performed a visual search for Chinese characters using a biresolutional gaze-contingent display, which displayed a high-resolution image in the central vision and a low-resolution in the periphery. We manipulated the delay between eye movements and display updates using a truncated normal distribution (μ to μ + 2 σ) with μ ranging from 0 to 400 ms and σ fixed at 50 ms. Playback of recorded gaze data provided a non-controllable condition.

Results

The study revealed that both reported authorship and controllability scores, as well as the fixation count per second, decreased as μ increased, aligning with trends observed under constant delay conditions. The subjective authorship weakened significantly at a μ of 94 ms. Notably, the comparison between jittery and constant delays indicated the minimum value (μ) of the distribution as a critical parameter influencing both authorship perception and visual search time efficiency.

Discussion

This finding underscores the importance of the shortest delay in modulating SoA. Further examining the relative distribution for fixation duration and saccade amplitude suggests an adaptation in action planning and attention distribution in response to delay. By providing a systematic examination of the statistical attributes of jittery delays that most significantly affect SoA, this research offers valuable implications for the design of efficient, delay-tolerant eye-gaze HCI, expanding our understanding of SoA in technologically mediated interactions. Moreover, our findings highlight the significance of considering both constant and variable delay impacts in HCI usability design, marking a novel contribution to the field.

Seeing without a Scene: Neurological Observations on the Origin and Function of the Dorsal Visual Stream

In all vertebrates, visual signals from each visual field project to the opposite midbrain tectum (called the superior colliculus in mammals). The tectum/colliculus computes visual salience to select targets for context-contingent visually guided behavior: a frog will orient toward a small, moving stimulus (insect prey) but away from a large, looming stimulus (a predator). In mammals, visual signals competing for behavioral salience are also transmitted to the visual cortex, where they are integrated with collicular signals and then projected via the dorsal visual stream to the parietal and frontal cortices. To control visually guided behavior, visual signals must be encoded in body-centered (egocentric) coordinates, and so visual signals must be integrated with information encoding eye position in the orbit-where the individual is looking. Eye position information is derived from copies of eye movement signals transmitted from the colliculus to the frontal and parietal cortices. In the intraparietal cortex of the dorsal stream, eye movement signals from the colliculus are used to predict the sensory consequences of action. These eye position signals are integrated with retinotopic visual signals to generate scaffolding for a visual scene that contains goal-relevant objects that are seen to have spatial relationships with each other and with the observer. Patients with degeneration of the superior colliculus, although they can see, behave as though they are blind. Bilateral damage to the intraparietal cortex of the dorsal stream causes the visual scene to disappear, leaving awareness of only one object that is lost in space. This tutorial considers what we have learned from patients with damage to the colliculus, or to the intraparietal cortex, about how the phylogenetically older midbrain and the newer mammalian dorsal cortical visual stream jointly coordinate the experience of a spatially and temporally coherent visual scene.

An unbiased method to partition diverse neuronal responses into functional ensembles reveals interpretable population dynamics during innate social behavior

In neuroscience, understanding how single-neuron firing contributes to distributed neural ensembles is crucial. Traditional methods of analysis have been limited to descriptions of whole population activity, or, when analyzing individual neurons, criteria for response categorization varied significantly across experiments. Current methods lack scalability for large datasets, fail to capture temporal changes and rely on parametric assumptions. There's a need for a robust, scalable, and non-parametric functional clustering approach to capture interpretable dynamics. To address this challenge, we developed a model-based, statistical framework for unsupervised clustering of multiple time series datasets that exhibit nonlinear dynamics into an a-priori-unknown number of parameterized ensembles called Functional Encoding Units (FEUs). FEU outperforms existing techniques in accuracy and benchmark scores. Here, we apply this FEU formalism to single-unit recordings collected during social behaviors in rodents and primates and demonstrate its hypothesis-generating and testing capacities. This novel pipeline serves as an analytic bridge, translating neural ensemble codes across model systems.

Is P3 amplitude associated with greater gaze distraction effect in schizotypy?

A recently proposed "Hyperfocusing hypothesis" suggests that schizotypy is associated with a more narrow but more intense way of allocating attention. The current study aims to test a vital prediction of this hypothesis in a social context, that schizotypy may be related to greater difficulty overcoming the distracting effects of gaze. This could cause a longer time to respond to targets that are invalidly cued by gaze. The current study tested this prediction in a modified Posner cueing paradigm by using P3 as an indicator for attentional resources. Seventy-four young healthy individuals with different levels of schizotypy were included, they were asked to detect the location of a target that was cued validly or invalidly by the gaze and head orientation. The results revealed that (a) schizotypy is associated with hyperfocusing on gaze direction, leading to greater difficulty overcoming the distracting effect of gaze. The higher the trait-schizotypy score, the more time needed to respond to targets that were invalidly cued by gaze (b) schizotypy is associated with reduced P3 which is directed by social communicative stimuli. The higher the trait-schizotypy score, the smaller the amplitude of P3 (c) the relationship between schizotypal traits and response times of the gaze-invalid condition is fully intermediated by P3. The findings of the current study suggest the P3 component may be a crucial neural mechanism underlying joint attention deficits in schizophrenia.

Children are sensitive to the number of sources when relying on gossip

Gossip allows children to effectively identify cooperative or trustworthy partners. However, the risk of being deceived must be faced because gossip may be false. One clue for determining gossip's veracity is the number of its sources since multiple informants spreading identical reputational information about others might imply that another's moral traits are viewed unanimously among members of a social group. We investigated whether 7-year-olds (N = 108) would trust gossip from multiple independent sources. In our study, they received multiple pieces of positive/negative reputational information about one agent and neutral information about another agent by gossip from either single or multiple informants. Then they allocated rewards to and chose rewards from the gossip targets. The 7-year-olds acted upon positive gossip from multiple informants and did not rely on positive gossip from a single informant. By contrast, they relied on negative gossip regardless of the number of informants. In either valence, however, they were more likely to allocate rewards based on gossip from multiple informants than a single informant. This result indicates they are sensitive to an objective index, specifically the number of sources, for judging the veracity of gossip.

Impaired recognition of interactive intentions in adults with autism spectrum disorder not attributable to differences in visual attention or coordination via eye contact and joint attention

Altered nonverbal communication patterns especially with regard to gaze interactions are commonly reported for persons with autism spectrum disorder (ASD). In this study we investigate and differentiate for the first time the interplay of attention allocation, the establishment of shared focus (eye contact and joint attention) and the recognition of intentions in gaze interactions in adults with ASD compared to control persons. Participants interacted via gaze with a virtual character (VC), who they believed was controlled by another person. Participants were instructed to ascertain whether their partner was trying to interact with them. In fact, the VC was fully algorithm-controlled and showed either interactive or non-interactive gaze behavior. Participants with ASD were specifically impaired in ascertaining whether their partner was trying to interact with them or not as compared to participants without ASD whereas neither the allocation of attention nor the ability to establish a shared focus were affected. Thus, perception and production of gaze cues seem preserved while the evaluation of gaze cues appeared to be impaired. An additional exploratory analysis suggests that especially the interpretation of contingencies between the interactants' actions are altered in ASD and should be investigated more closely.

Uncovering the cognitive mechanisms underlying the gaze cueing effect

The gaze cueing effect is the tendency for people to respond faster to targets appearing at locations gazed at by others, compared with locations gazed away from by others. The effect is robust, widely studied, and is an influential finding within social cognition. Formal evidence accumulation models provide the dominant theoretical account of the cognitive processes underlying speeded decision-making, but they have rarely been applied to social cognition research. In this study, using a combination of individual-level and hierarchical computational modelling techniques, we applied evidence accumulation models to gaze cueing data (three data sets total, N = 171, 139,001 trials) for the first time to assess the relative capacity that an attentional orienting mechanism and information processing mechanisms have for explaining the gaze cueing effect. We found that most participants were best described by the attentional orienting mechanism, such that response times were slower at gazed away from locations because they had to reorient to the target before they could process the cue. However, we found evidence for individual differences, whereby the models suggested that some gaze cueing effects were driven by a short allocation of information processing resources to the gazed at location, allowing for a brief period where orienting and processing could occur in parallel. There was exceptionally little evidence to suggest any sustained reallocation of information processing resources neither at the group nor individual level. We discuss how this individual variability might represent credible individual differences in the cognitive mechanisms that subserve behaviourally observed gaze cueing effects.

Depressive symptoms and visual attention to others' eyes in healthy individuals

BACKGROUND

Eye contact is a fundamental part of social interaction. In clinical studies, it has been observed that patients suffering from depression make less eye contact during interviews than healthy individuals, which could be a factor contributing to their social functioning impairments. Similarly, results from mood induction studies with healthy persons indicate that attention to the eyes diminishes as a function of sad mood. The present screen-based eye-tracking study examined whether depressive symptoms in healthy individuals are associated with reduced visual attention to other persons' direct gaze during free viewing.

METHODS

Gaze behavior of 44 individuals with depressive symptoms and 49 individuals with no depressive symptoms was analyzed in a free viewing task. Grouping was based on the Beck Depression Inventory using the cut-off proposed by Hautzinger et al. (2006). Participants saw pairs of faces with direct gaze showing emotional or neutral expressions. One-half of the face pairs was shown without face masks, whereas the other half was presented with face masks. Participants' dwell times and first fixation durations were analyzed.

RESULTS

In case of unmasked facial expressions, participants with depressive symptoms looked shorter at the eyes compared to individuals without symptoms across all expression conditions. No group difference in first fixation duration on the eyes of masked and unmasked faces was observed. Individuals with depressive symptoms dwelled longer on the mouth region of unmasked faces. For masked faces, no significant group differences in dwell time on the eyes were found. Moreover, when specifically examining dwell time on the eyes of faces with an emotional expression there were also no significant differences between groups. Overall, participants gazed significantly longer at the eyes in masked compared to unmasked faces.

CONCLUSIONS

For faces without mask, our results suggest that depressiveness in healthy individuals goes along with less visual attention to other persons' eyes but not with less visual attention to others' faces. When factors come into play that generally amplify the attention directed to the eyes such as face masks or emotions then no relationship between depressiveness and visual attention to the eyes can be established.

Reversing the reversed congruency effect: directional salience overrides social significance in a spatial Stroop task

In a spatial Stroop task, eye-gaze targets produce a reversed congruency effect (RCE) with faster responses when gaze direction and location are incongruent than congruent. On the other hand, non-social directional targets (e.g., arrows) elicit a spatial Stroop effect (SSE). The present study examined whether other social stimuli, such as head orientation, trigger the RCE. Participants judged the target direction of the head or the gaze while ignoring its location. While the gaze target replicated the RCE, the head target produced the SSE. Moreover, the head target facilitated the overall responses relative to the gaze target. These results suggest that the head, a salient directional feature, overrides the social significance. The RCE may be specific to gaze stimuli, not to social stimuli in general. The head and gaze information differentially affect our attentional mechanisms and enable us to bring about smooth social interactions.

Visuo-frontal interactions during social learning in freely moving macaques

Social interactions represent a ubiquitous aspect of our everyday life that we acquire by interpreting and responding to visual cues from conspecifics1. However, despite the general acceptance of this view, how visual information is used to guide the decision to cooperate is unknown. Here, we wirelessly recorded the spiking activity of populations of neurons in the visual and prefrontal cortex in conjunction with wireless recordings of oculomotor events while freely moving macaques engaged in social cooperation. As animals learned to cooperate, visual and executive areas refined the representation of social variables, such as the conspecific or reward, by distributing socially relevant information among neurons in each area. Decoding population activity showed that viewing social cues influences the decision to cooperate. Learning social events increased coordinated spiking between visual and prefrontal cortical neurons, which was associated with improved accuracy of neural populations to encode social cues and the decision to cooperate. These results indicate that the visual-frontal cortical network prioritizes relevant sensory information to facilitate learning social interactions while freely moving macaques interact in a naturalistic environment.

The role of visual and auditory information in social event segmentation

Humans organise their social worlds into social and nonsocial events. Social event segmentation refers to the ability to parse the environmental content into social and nonsocial events or units. Here, we investigated the role that perceptual information from visual and auditory modalities, in isolation and in conjunction, played in social event segmentation. Participants viewed a video clip depicting an interaction between two actors and marked the boundaries of social and nonsocial events. Depending on the condition, the clip at first contained only auditory or only visual information. Then, the clip was shown containing both auditory and visual information. Higher overall group consensus and response consistency in parsing the clip was found for social segmentation and when both auditory and visual information was available. Presenting the clip in the visual domain only benefitted group agreement in social segmentation while the inclusion of auditory information (under the audiovisual condition) also improved response consistency in nonsocial segmentation. Thus, social segmentation utilises information from the visual modality, with the auditory cues contributing under ambiguous or uncertain conditions and during segmentation of nonsocial content.

Sharing and Receiving Eye-Contact Predicts Mate Choice After a 5-Minute Conversation: Evidence from a Speed-Dating Study

In popular narratives, the first date with a potential mate often centers on their gaze as embodiment of interest and attraction. However, evidence is still lacking on the role of eye-contact as a potent signal in human social interaction in the context of dating. In addition, behavioral mechanisms of mate selection are not well understood. In the present study, we therefore examined mutual eye-contact and its influence on mate choice by applying dual mobile eye-tracking during naturalistic speed-dates. A total of 30 male and 30 female subjects attended four speed-dates each (N = 240). Subjects were more likely to choose those dating partners with whom they shared more eye-contact with. In addition, perceived attractiveness played an important role for mate choice. Interestingly, receiving but not giving eye-contact also predicted individual mate choice. Eye-contact thus acts as an important signal of romantic attraction when encountering a dating partner.

More Than Meets the Eyes: Bringing Attention to the Eyes Increases First Impressions of Warmth and Competence

The present research examined how face masks alter first impressions of warmth and competence for different racial groups. Participants were randomly assigned to view photographs of White, Black, and Asian targets with or without masks. Across four separate studies (total N = 1,012), masked targets were rated significantly higher in warmth and competence compared with unmasked targets, regardless of their race. However, Asian targets benefited the least from being seen masked compared with Black or White targets. Studies 3 and 4 demonstrate how the positive effect of masks is likely due to these clothing garments re-directing attention toward the eyes of the wearer. Participants viewing faces cropped to the eyes (Study 3), or instructed to gaze into the eyes of faces (Study 4), rated these targets similarly to masked targets, and higher than unmasked targets. Neither political affiliation, belief in mask effectiveness, nor explicit racial prejudice moderated any hypothesized effects.

Integrating Social Cognition Into Domain-General Control: Interactive Activation and Competition for the Control of Action (ICON)

Social cognition differs from general cognition in its focus on understanding, perceiving, and interpreting social information. However, we argue that the significance of domain-general processes for controlling cognition has been historically undervalued in social cognition and social neuroscience research. We suggest much of social cognition can be characterized as specialized feature representations supported by domain-general cognitive control systems. To test this proposal, we develop a comprehensive working model, based on an interactive activation and competition architecture and applied to the control of action. As such, we label the model "ICON" (interactive activation and competition model for the control of action). We used the ICON model to simulate human performance across various laboratory tasks. Our simulations emphasize that many laboratory-based social tasks do not require socially specific control systems, such as those that are argued to rely on neural networks associated with theory-of-mind. Moreover, our model clarifies that perceived disruptions in social cognition, even in what appears to be disruption to the control of social cognition, can stem from deficits in social representation instead. We advocate for a "default stance" in social cognition, where control is usually general, but representation is specific. This study underscores the importance of integrating social cognition within the broader realm of domain-general control processing, offering a unified perspective on task processing.

Category-Selective Representation of Relationships in the Visual Cortex

Understanding social interaction requires processing social agents and their relationships. The latest results show that much of this process is visually solved: visual areas can represent multiple people encoding emergent information about their interaction that is not explained by the response to the individuals alone. A neural signature of this process is an increased response in visual areas, to face-to-face (seemingly interacting) people, relative to people presented as unrelated (back-to-back). This effect highlighted a network of visual areas for representing relational information. How is this network organized? Using functional MRI, we measured the brain activity of healthy female and male humans (N = 42), in response to images of two faces or two (head-blurred) bodies, facing toward or away from each other. Taking the facing > non-facing effect as a signature of relation perception, we found that relations between faces and between bodies were coded in distinct areas, mirroring the categorical representation of faces and bodies in the visual cortex. Additional analyses suggest the existence of a third network encoding relations between (nonsocial) objects. Finally, a separate occipitotemporal network showed the generalization of relational information across body, face, and nonsocial object dyads (multivariate pattern classification analysis), revealing shared properties of relations across categories. In sum, beyond single entities, the visual cortex encodes the relations that bind multiple entities into relationships; it does so in a category-selective fashion, thus respecting a general organizing principle of representation in high-level vision. Visual areas encoding visual relational information can reveal the processing of emergent properties of social (and nonsocial) interaction, which trigger inferential processes.

The semantics of gaze in person perception: a novel qualitative-quantitative approach

Interpreting gaze behavior is essential in evaluating interaction partners, yet the 'semantics of gaze' in dynamic interactions are still poorly understood. We aimed to comprehensively investigate effects of gaze behavior patterns in different conversation contexts, using a two-step, qualitative-quantitative procedure. Participants watched video clips of single persons listening to autobiographic narrations by another (invisible) person. The listener's gaze behavior was manipulated in terms of gaze direction, frequency and direction of gaze shifts, and blink frequency; emotional context was manipulated through the valence of the narration (neutral/negative). In Experiment 1 (qualitative-exploratory), participants freely described which states and traits they attributed to the listener in each condition, allowing us to identify relevant aspects of person perception and to construct distinct rating scales that were implemented in Experiment 2 (quantitative-confirmatory). Results revealed systematic and differential meanings ascribed to the listener's gaze behavior. For example, rapid blinking and fast gaze shifts were rated more negatively (e.g., restless and unnatural) than slower gaze behavior; downward gaze was evaluated more favorably (e.g., empathetic) than other gaze aversion types, especially in the emotionally negative context. Overall, our study contributes to a more systematic understanding of flexible gaze semantics in social interaction.

A frontopolar-temporal circuit determines the impact of social information in macaque decision making

When choosing, primates are guided not only by personal experience of objects but also by social information such as others' attitudes toward the objects. Crucially, both sources of information-personal and socially derived-vary in reliability. To choose optimally, one must sometimes override choice guidance by personal experience and follow social cues instead, and sometimes one must do the opposite. The dorsomedial frontopolar cortex (dmFPC) tracks reliability of social information and determines whether it will be attended to guide behavior. To do this, dmFPC activity enters specific patterns of interaction with a region in the mid-superior temporal sulcus (mSTS). Reversible disruption of dmFPC activity with transcranial ultrasound stimulation (TUS) led macaques to fail to be guided by social information when it was reliable but to be more likely to use it when it was unreliable. By contrast, mSTS disruption uniformly downregulated the impact of social information on behavior.

Age Differences in Gaze Following: Older Adults Follow Gaze More than Younger Adults When free-viewing Scenes

Previous research investigated age differences in gaze following with an attentional cueing paradigm where participants view a face with averted gaze, and then respond to a target appearing in a location congruent or incongruent with the gaze cue. However, this paradigm is far removed from the way we use gaze cues in everyday settings. Here we recorded the eye movements of younger and older adults while they freely viewed naturalistic scenes where a person looked at an object or location. Older adults were more likely to fixate and made more fixations to the gazed-at location, compared to younger adults. Our findings suggest that, contrary to what was observed in the traditional gaze-cueing paradigm, in a non-constrained task that uses contextualized stimuli older adults follow gaze as much as or even more than younger adults.

Closed-loop microstimulations of the orbitofrontal cortex during real-life gaze interaction enhance dynamic social attention

The prefrontal cortex is extensively involved in social exchange. During dyadic gaze interaction, multiple prefrontal areas exhibit neuronal encoding of social gaze events and context-specific mutual eye contact, supported by a widespread neural mechanism of social gaze monitoring. To explore causal manipulation of real-life gaze interaction, we applied weak closed-loop microstimulations that were precisely triggered by specific social gaze events to three prefrontal areas in monkeys. Microstimulations of orbitofrontal cortex (OFC), but not dorsomedial prefrontal or anterior cingulate cortex, enhanced momentary dynamic social attention in the spatial dimension by decreasing distance of one's gaze fixations relative to partner monkey's eyes. In the temporal dimension, microstimulations of OFC reduced the inter-looking interval for attending to another agent and the latency to reciprocate other's directed gaze. These findings demonstrate that primate OFC serves as a functionally accessible node in controlling dynamic social attention and suggest its potential for a therapeutic brain interface.

Looking into troubled waters: Childhood emotional maltreatment modulates neural responses to prolonged gazing into one's own, but not others', eyes

One of the most prevalent nonverbal, social phenomena known to automatically elicit self- and other-referential processes is eye contact. By its negative effects on the perception of social safety and views about the self and others, childhood emotional maltreatment (CEM) may fundamentally affect these processes. To investigate whether the socioaffective consequences of CEM may become visible in response to (prolonged) eye gaze, 79 adult participants (mean [M]age = 49.87, standard deviation [SD]age = 4.62) viewed videos with direct and averted gaze of an unfamiliar other and themselves while we recorded self-reported mood, eye movements using eye-tracking, and markers of neural activity using fMRI. Participants who reported higher levels of CEM exhibited increased activity in ventromedial prefrontal cortex to one's own, but not to others', direct gaze. Furthermore, in contrast to those who reported fewer of such experiences, they did not report a better mood in response to a direct gaze of self and others, despite equivalent amounts of time spent looking into their own and other peoples' eyes. The fact that CEM is associated with enhanced neural activation in a brain area that is crucially involved in self-referential processing (i.e., vmPFC) in response to one's own direct gaze is in line with the chronic negative impact of CEM on a person's self-views. Interventions that directly focus on targeting maladaptive self-views elicited during eye gaze to self may be clinically useful.