Gazing at me: the importance of social meaning in understanding direct-gaze cues

Eye contact boosts the reflexive component of overt gaze following

Establishing eye contact with an individual can subsequently lead to a stronger gaze-mediated orienting effect. However, studies exploring this phenomenon have, so far, only assessed manual responses and focused on covert attention - namely, without eye movements. Here, in two experiments, we explored for the first time whether eye contact can also impact on overt attention in an oculomotor task. This approach has two main advantages, in that it relies on more sensitive, online measures of attention allocation and it better mimics real life settings. Participants performed leftwards and rightwards eye movements in response to a central cue. Furthermore, a task-irrelevant central face established - or not - eye contact with the participant, and then averted its gaze either leftwards or rightwards. Hence, eye movement direction was either congruent or incongruent with that of the gaze stimulus. In both experiments, a gaze following behaviour emerged - specifically, smaller saccadic latencies and a greater accuracy emerged on congruent than on incongruent trials - but its magnitude was not modulated by eye contact. However, in Experiment 2 - in which the different eye contact conditions were presented intermixed rather than blocked, thus making eye contact contextually salient - eye contact led to an overall decrement of saccadic latencies and enhanced the reflexive component of gaze following. Taken together, these results provide novel evidence indicating that eye contact can impact on both eye movements programming and overt gaze following mechanisms, at least when eye contact is made contextually salient.

Perspective taking as virtual navigation? Perceptual simulation of what others see reflects their location in space but not their gaze

Other peoples' (imagined) visual perspectives are represented perceptually in a similar way to our own, and can drive bottom-up processes in the same way as own perceptual input (Ward, Ganis, & Bach, 2019). Here we test directly whether visual perspective taking is driven by where another person is looking, or whether these perceptual simulations represent their position in space more generally. Across two experiments, we asked participants to identify whether alphanumeric characters, presented at one of eight possible orientations away from upright, were presented normally, or in their mirror-inverted form (e.g. "R" vs. "Я"). In some scenes, a person would appear sitting to the left or the right of the participant. We manipulated either between-trials (Experiment 1) or between-subjects (Experiment 2), the gaze-direction of the inserted person, such that they either (1) looked towards the to-be-judged item, (2) averted their gaze away from the participant, or (3) gazed out towards the participant (Exp. 2 only). In the absence of another person, we replicated the well-established mental rotation effect, where recognition of items becomes slower the more items are oriented away from upright (e.g. Shepard and Meltzer, 1971). Crucially, in both experiments and in all conditions, this response pattern changed when another person was inserted into the scene. People spontaneously took the perspective of the other person and made faster judgements about the presented items in their presence if the characters were oriented towards upright to them. The gaze direction of this other person did not influence these effects. We propose that visual perspective taking is therefore a general spatial-navigational ability, allowing us to calculate more easily how a scene would (in principle) look from another position in space, and that such calculations reflect the spatial location of another person, but not their gaze.

Implying social interaction and its influence on gaze behavior to the eyes

Researchers have increasingly focused on how the potential for social interaction modulates basic processes of visual attention and gaze behavior. In this study, we investigated why people may experience social interaction and what factors contributed to their subjective experience. We furthermore investigated whether implying social interaction modulated gaze behavior to people’s faces, specifically the eyes. To imply the potential for interaction, participants received either one of two instructions: 1) they would be presented with a person via a ‘live’ video-feed, or 2) they would be presented with a pre-recorded video clip of a person. Prior to the presentation, a confederate walked into a separate room to suggest to participants that (s)he was being positioned behind a webcam. In fact, all participants were presented with a pre-recorded clip. During the presentation, we measured participants’ gaze behavior with an eye tracker, and after the presentation, participants were asked whether they believed that the confederate was ‘live’ or not, and, why they thought so. Participants varied greatly in their judgements about whether the confederate was ‘live’ or not. Analyses of gaze behavior revealed that a large subset of participants who received the live-instruction gazed less at the eyes of confederates compared with participants who received the pre-recorded-instruction. However, for both the live-instruction group and the pre-recorded instruction group, another subset of participants gazed predominantly at the eyes. The current findings may contribute to the development of experimental designs aimed to capture the interactive aspects of social cognition and visual attention.

Distinguishing Social From Private Intentions Through the Passive Observation of Gaze Cues

Observing others’ gaze is most informative during social encounters between humans: We can learn about potentially salient objects in the shared environment, infer others’ mental states and detect their communicative intentions. We almost automatically follow the gaze of others in order to check the relevance of the target of the other’s attention. This phenomenon called gaze cueing can be conceptualized as a triadic interaction involving a gaze initiator, a gaze follower and a gaze target, i.e., an object or person of interest in the environment. Gaze cueing can occur as “gaze pointing” with a communicative or “social” intention by the initiator, telling the observer that she/he is meant to follow, or as an incidental event, in which the observer follows spontaneously without any intention of the observed person. Here, we investigate which gaze cues let an observer ascribe a social intention to the observed person’s gaze and whether and to which degree previous eye contact in combination with an object fixation contributes to this ascription. We varied the orientation of the starting position of gaze toward the observer and the orientation of the end position of a lateral gaze shift. In two experiments participants had to infer from the gaze behavior either mere approach (“the person looked at me”) vs. a social (“the person wanted to show me something”) or a social vs. a private motivation (“the person was interested in something”). Participants differentially attributed either approach behavior, a social, or a private intention to the agent solely based on the passive observation of the two specific gaze cues of start and end position. While for the attribution of privately motivated behavior, participants relied solely on the end position of the gaze shift, the social interpretation of the observed behavior depended additionally upon initial eye contact. Implications of these results for future social gaze and social cognition research in general are discussed.

Visual search strategies in a shared zone in pedestrians with and without intellectual disability

People with intellectual disability (ID) may find shared zones troublesome to negotiate because of the lack of the traditional clearly defined rules and boundaries. With the built environment identified as a barrier to active travel and community access, it is vital to explore how pedestrians with ID navigate shared zones to ensure that this group is not placed in harm's way or discouraged from active travel because of the implications of shared zones. This study investigated the visual strategies of 19 adults with ID and 21 controls who wore head mounted eye trackers in a Shared Zone and at a zebra crossing (as a contrast traffic environment). In total 4750 valid fixations were analysed. Participants with ID fixated on traffic relevant objects at a rate of 68 percent of the control participants. Furthermore, the males with ID were 9(4.4-18.7) times more likely to fixate on non-traffic relevant objects compared with traffic relevant objects, much higher odds than that of females with ID 1.8(0.4-1.7). Zebra crossings appeared to act as a cue, drawing pedestrians' visual attention to the traffic environment, with both groups more likely to look at traffic relevant objects on/at the zebra crossing (66%: 34%). Future implementation of shared zones needs to be carefully considered in relation to the safety of road users with ID and their capacity to identify and assess salient environmental information.

Eye contact effects on social preference and face recognition in normal ageing and in Alzheimer's disease

Perceiving a direct gaze (i.e. another individual's gaze directed to the observer leading to eye contact) influences positively a wide range of cognitive processes. In particular, direct gaze perception is known to stimulate memory for other's faces and to increase their likeability. Alzheimer's disease (AD) results in social withdrawal and cognitive decline. However, patients show preserved eye contact behaviours until the middle stage of the disease. The eye contact effects could be preserved in AD and be used to compensate for cognitive and social deficits. Yet, it is unknown whether these effects are preserved in normal ageing. The aim of this study was to address whether the positive effects of eye contact on memory for faces and likeability of others are preserved in healthy older adults and in patients with early to mild AD. Nineteen AD patients, 20 older adults and 20 young adults participated in our study. Participants were first presented with faces displaying either direct or averted gaze and rated each face's degree of likeability. They were then asked to identify the faces they had previously seen during a surprise recognition test. Results showed that the effect of eye contact on other's likeability was preserved in normal ageing and in AD. By contrast, an effect of eye contact on memory for faces seems to emerge only in young participants, suggesting that this effect declines with ageing. Interestingly, however, AD patients show a positive correlation between ratings of likeability and recognition scores, suggesting that they implicitly allocated their encoding resources to most likeable faces. These results open a new way for a "compensating" therapy in AD.

Joint attention facilitates observed gaze direction discrimination

Efficiently judging where someone else is looking is important for social interactions, allowing us a window into their mental state by establishing joint attention. Previous work has shown that judging the gaze direction of a non-foveally presented face is facilitated when the eyes of that face are directed towards the centre of the scene. This finding has been interpreted as an example of the human bias for misattributing observed ambiguous gaze signals as self-directed eye-contact. To test this interpretation against an alternative hypothesis that the facilitation is instead driven by the establishment of joint attention, we conducted two experiments in which we varied the participants' fixation location. In both experiments, we replicated the previous finding of facilitated gaze discrimination when the participants fixated centrally. However, this facilitation was abolished when participants fixated peripheral fixation crosses (Experiment 1) and reversed when participants fixated peripheral images of real-world objects (Experiment 2). Based on these data, we propose that the facilitation effect is consistent with the interpretation that gaze discrimination is facilitated when joint attention is established. This finding therefore extends previous work showing that engaging in joint attention facilitates a range of social cognitive processes.

Seeing eye-to-eye: Social gaze interactions influence gaze direction identification

We tested whether gaze direction identification of individual faces can be modulated by prior social gaze encounters. In two experiments, participants first completed a joint-gaze learning task using a saccade/antisaccade paradigm. Participants would encounter some ‘joint-gaze faces’ that would consistently look at the participants saccade goal before participants looked there (Experiment 1) or would follow the participants gaze to the target (Experiment 2). ‘Non-joint-gaze faces’ would consistently look in the opposite direction. Participants then completed a second task in which they judged the gaze direction of the faces they had previously encountered. Participants were less likely to erroneously report faces with slightly deviated gaze as looking directly at them if the face had previously never engaged in joint gaze with them. However, this bias was only present when those faces had looked first (Experiment 1) and not when the faces looked after participants (Experiment 2). Comparing these data with gaze identification responses of a control group that did not complete any joint-gaze learning phase revealed that the difference in gaze identification in Experiment 1 is likely driven by a lowering of direct gaze bias in response to non-joint-gaze faces. Thus, previous joint-gaze experiences can affect gaze direction judgements at an identity-specific level. However, this modulation may rely on the socio-cognitive information available from viewing other’s initiation behaviours, especially when they fail to engage in social contact.

Object's symmetry alters spatial perspective-taking processes

Spatial perspective-taking (SPT) refers to one's ability to identify or understand the location of a target relative to another viewpoint, which could be specified by a human-like agent or a reference object (e.g., a chair). Previous studies have shown that SPT is characterized by different processes depending on whether one is required to make a left/right or front/behind judgment. An object's shape, however, may also account for the different processes, as previous studies typically used reference objects that were left-right symmetrical and front-back asymmetrical (e.g., human figures, dolls, or chairs), thus confounding effects of judgment direction and effects of objects' shape. To address this issue, we manipulated objects' shape (symmetrical or asymmetrical about front-back or left-right) independently of judgment direction (i.e., left/right or front/behind) and compared participants' efficacy of such judgments. Our results showed that egocentric transformations were used more frequently for judgments orthogonal to the object's symmetry plane than for judgments orthogonal to the object's asymmetry plane, whereas the inverse was true for mental scanning. Notably, these tendencies were observed regardless of whether the judgment was about left/right or front/behind. Nonetheless, egocentric transformations were found to be more difficult to apply to the front/behind judgments than to the left/right judgments. We also found that this difficulty was alleviated by rich imagination. Furthermore, we found that participants tended to erroneously perceive a front-back symmetrical human-like object as facing them, even when it was actually facing away from them (facing bias). This in turn forced the participants to conduct unnecessary egocentric transformations. Overall, our findings demonstrated that objects' symmetry dramatically influenced SPT processes.

Perceived Gaze Direction Differentially Affects Discrimination of Facial Emotion, Attention, and Gender - An ERP Study

The perception of eye-gaze is thought to be a key component of our everyday social interactions. While the neural correlates of direct and averted gaze processing have been investigated, there is little consensus about how these gaze directions may be processed differently as a function of the task being performed. In a within-subject design, we examined how perception of direct and averted gaze affected performance on tasks requiring participants to use directly available facial cues to infer the individuals' emotional state (emotion discrimination), direction of attention (attention discrimination) and gender (gender discrimination). Neural activity was recorded throughout the three tasks using EEG, and ERPs time-locked to face onset were analyzed. Participants were most accurate at discriminating emotions with direct gaze faces, but most accurate at discriminating attention with averted gaze faces, while gender discrimination was not affected by gaze direction. At the neural level, direct and averted gaze elicited different patterns of activation depending on the task over frontal sites, from approximately 220-290 ms. More positive amplitudes were seen for direct than averted gaze in the emotion discrimination task. In contrast, more positive amplitudes were seen for averted gaze than for direct gaze in the gender discrimination task. These findings are among the first direct evidence that perceived gaze direction modulates neural activity differently depending on task demands, and that at the behavioral level, specific gaze directions functionally overlap with emotion and attention discrimination, precursors to more elaborated theory of mind processes.

Shared neural representations of syntax during online dyadic communication

When people communicate, they come to see the world in a similar way to each other by aligning their mental representations at such levels as syntax. Syntax is an essential feature of human language that distinguishes humans from other non-human animals. However, whether and how communicators share neural representations of syntax is not well understood. Here we addressed this issue by measuring the brain activity of both communicators in a series of dyadic communication contexts, by using functional near-infrared spectroscopy (fNIRS)-based hyperscanning. Two communicators alternatively spoke sentences either with the same or with different syntactic structures. Results showed a significantly higher-level increase of interpersonal neural synchronization (INS) at right posterior superior temporal cortex when communicators produced the same syntactic structures as each other compared to when they produced different syntactic structures. These increases of INS correlated significantly with communication quality. Our findings provide initial evidence for shared neural representations of syntax between communicators.

Spontaneous eye-movements in neutral and emotional gaze-cuing: An eye-tracking investigation

Our attention is spontaneously oriented in the direction where others are looking. This attention shift manifests as faster responses to peripheral targets when they are gazed at by a central face instead of gazed away from, and this effect is even more pronounced when the face expresses an emotion. This so called gaze-cuing effect, and its enhancement by emotion, is thought to reflect covert attention orienting. However, eye movements are typically not monitored in gaze-cuing paradigms, yet free viewing and saccadic reaction time research suggests individuals commonly and quickly look at gazed-at locations. Furthermore, in dynamic gaze-cuing studies, emotional faces differ from neutral faces in their affective content but also in their apparent facial motion, both of which could affect participants' eye-movements. We investigated the contribution of overt orienting to the gaze-cuing effect by monitoring eye-movements during emotional and neutral gaze-cuing trials. We found that eye-movements were infrequent, and when they occurred, they were directed toward the target, not toward the gazed-at location. Removing trials with eye-movements did not affect gaze-cuing much, confirming it reflects a covert attention process. However, participants were more likely to move their eyes during neutral trials, which lacked perceived face movement, than during emotion trials or neutral movement trials. Including these eye-movement contaminated trials in our analysis resulted in an impaired ability to detect the gaze-cuing variations with emotion. In contrast, removing trials with eye-movements, or including a neutral movement control such as a neutral tongue protrusion, revealed more subtle emotional modulation of gaze-cuing.

A Review of Functional and Structural Neurobiology of the Action Observation Network in Autism Spectrum Disorder and Developmental Coordination Disorder

Recent research has reported motor impairment similarities between children with developmental coordination disorder (DCD) and a subgroup of individuals with autism spectrum disorder (ASD). However, there is a debate as to whether DCD is a co-occurring diagnosis in individuals with ASD and motor impairments (ASDd), or if motor impairments in ASD are distinct from DCD. However, the etiology of motor impairments is not well understood in either disorder. Clarifying comorbidities in ASD is important to determine different etiopathological phenotyping clusters in ASD and to understand the variety of genetic and environmental factors that contribute to the disorder. Furthermore, this distinction has important therapeutic relevance. Here we explore the current neuroimaging findings in ASD and DCD and discusses possible neural mechanisms that underlie similarities and differences between the disorders.

Attention to the face is characterised by a difficult to inhibit first fixation to the eyes

The eyes are preferentially attended over other facial features and recent evidence suggests this bias is difficult to suppress. To further examine the automatic and volitional nature of this bias for eye information, we used a novel prompting face recognition paradigm in 41 adults and measured the location of their first fixations, overall dwell time and behavioural responses. First, patterns of eye gaze were measured during a free-viewing forced choice face recognition paradigm. Second, the task was repeated but with prompts to look to either the eyes or the mouth. Participants showed significantly more first fixations to the eyes than mouth, both when prompted to look at the eyes and when prompted to look at the mouth. The pattern of looking to the eyes when prompted was indistinguishable from the unprompted condition in which participants were free to look where they chose. Notably, the dwell time data demonstrated that the eye bias did not persist over the entire presentation period. Our results suggest a difficult-to-inhibit bias to initially orient to the eyes, which is superseded by volitional, top-down control of eye gaze. Further, the amount of looking to the eyes is at a maximum level spontaneously and cannot be enhanced by explicit instructions.

On the role of eye contact in gaze cueing

Most experimental protocols examining joint attention with the gaze cueing paradigm are "observational" and "offline", thereby not involving social interaction. We examined whether within a naturalistic online interaction, real-time eye contact influences the gaze cueing effect (GCE). We embedded gaze cueing in an interactive protocol with the iCub humanoid robot. This has the advantage of ecological validity combined with excellent experimental control. Critically, before averting the gaze, iCub either established eye contact or not, a manipulation enabled by an algorithm detecting position of the human eyes. For non-predictive gaze cueing procedure (Experiment 1), only the eye contact condition elicited GCE, while for counter-predictive procedure (Experiment 2), only the condition with no eye contact induced GCE. These results reveal an interactive effect of strategic (gaze validity) and social (eye contact) top-down components on the reflexive orienting of attention induced by gaze cues. More generally, we propose that naturalistic protocols with an embodied presence of an agent can cast a new light on mechanisms of social cognition.

Task Dependent Effects of Head Orientation on Perceived Gaze Direction

The perception of gaze direction involves the integration of a number of sensory cues exterior to the eye-region. The orientation of the head is one such cue, which has an overall repulsive effect on the perceived direction of gaze. However, in a recent experiment, we found the measured effect of head orientation on perceived gaze direction differed within subjects, depending on whether a single- or two-interval task design was employed. This suggests a potential difference in the way the orientation of the head is integrated into the perception of gaze direction across tasks. Four experiments were conducted to investigate this difference. The first two experiments showed that the difference was not the result of some interaction between stimuli in the two-interval task, but rather, a difference between the types of judgment being made across tasks, where observers were making a directional (left/right) judgment in the single-interval task, and a non-directional (direct/indirect gaze) judgment in the two-interval task. A third experiment showed that this difference does not arise from observers utilizing a non-directional cue to direct gaze (the circularity of the pupil/iris) in making their non-directional judgments. The fourth experiment showed no substantial differences in the duration of evidence accumulation and processing between judgments, suggesting that observers are not integrating different sensory information across tasks. Together these experiments show that the sensory information from head orientation is flexibly weighted in the perception of gaze direction, and that the purpose of the observer, in sampling gaze information, can influence the consequent perception of gaze direction.

Theta resting EEG in TPJ/pSTS is associated with individual differences in the feeling of being looked at

Direct eye gaze is a powerful stimulus in social interactions, yet people vary considerably in the range of gaze lines that they accept as being direct (cone of direct gaze, CoDG). Here, we searched for a possible neural trait marker of these individual differences. We measured the width of the CoDG in 137 healthy participants and related their individual CoDG to their neural baseline activation as measured with resting electroencephalogram. Using a source-localization technique, we found that resting theta current density in the left temporo-parietal junction (TPJ) and adjacent posterior superior temporal sulcus (pSTS) was associated with the width of CoDG. Our findings suggest that the higher the baseline cortical activation in the left TPJ/pSTS, the wider the CoDG and thus the more liberal the individuals’ judgments were in deciding whether a looker stimulus was making eye contact or not. This is a first demonstration of the neural signatures underlying individual differences in the feeling of being looked at.

Can Monetary Reward Modulate Social Attention?

Selective visual attention is a primary cognitive function, which allows the selection of the most relevant stimuli in the environment by prioritizing their processing. Several studies showed that this process can be influenced by both social signals, such as gaze direction (i.e., the Gaze Cueing Effect, GCE) and by the motivational valence of gratifying stimuli, such as monetary rewards. The aim of this study was to explore whether GCE could be modulated by a monetary reward. To this end, we created an experiment in which participants performed a gaze cuing task before and after an implicit learning task aiming to induce an association between gaze direction and monetary reward (experimental condition), or after a perceptual task (control condition). Statistical analyses were conducted following both a frequentist and a Bayesian approach. Results supported previous findings showing the presence of the GCE, i.e., faster responses in congruent trials when the target appeared in the gazed-at location. Interestingly, our results did not reveal significant differences among the conditions. Therefore, contrary to what was reported by previous attentional orienting studies with non-social stimuli, monetary reward does not seem to be able to modulate (or interfere with) the orienting of attention mediated by gaze direction as measured by the GCE. Taken together our results suggest that social signals such as gaze direction have a greater impact than monetary reward in orienting selective attention.

Comparing Attention to Socially-Relevant Stimuli in Autism Spectrum Disorder and Developmental Coordination Disorder

Difficulties with social interaction have been reported in both children with an autism spectrum disorder (ASD) and children with developmental coordination disorder (DCD), although these disorders have very different diagnostic characteristics. To date, assessment of social skills in a DCD population has been limited to paper-based assessment or parent report. The present study employed eye tracking methodology to examine how children attend to socially-relevant stimuli, comparing 28 children with DCD, 28 children with ASD and 26 typically-developing (TD) age-matched controls (aged 7-10). Eye movements were recorded while children viewed 30 images, half of which were classed as 'Individual' (one person in the scene, direct gaze) and the other half were 'Social' (more naturalistic scenes showing an interaction). Children with ASD spent significantly less time looking at the face/eye regions in the images than TD children, but children with DCD performed between the ASD and TD groups in this respect. Children with DCD demonstrated a reduced tendency to follow gaze, in comparison to the ASD group. Our findings confirm that social atypicalities are present in both ASD and to a lesser extent DCD, but follow a different pattern. Future research would benefit from considering the developmental nature of the observed findings and their implications for support.

Look at Me: Early Gaze Engagement Enhances Corticospinal Excitability During Action Observation

Direct gaze is a powerful social cue able to capture the onlooker’s attention. Beside gaze, head and limb movements as well can provide relevant sources of information for social interaction. This study investigated the joint role of direct gaze and hand gestures on onlookers corticospinal excitability (CE). In two experiments we manipulated the temporal and spatial aspects of observed gaze and hand behavior to assess their role in affecting motor preparation. To do this, transcranial magnetic stimulation (TMS) on the primary motor cortex (M1) coupled with electromyography (EMG) recording was used in two experiments. In the crucial manipulation, we showed to participants four video clips of an actor who initially displayed eye contact while starting a social request gesture, and then completed the action while directing his gaze toward a salient object for the interaction. This way, the observed gaze potentially expressed the intention to interact. Eye tracking data confirmed that gaze manipulation was effective in drawing observers’ attention to the actor’s hand gesture. In the attempt to reveal possible time-locked modulations, we tracked CE at the onset and offset of the request gesture. Neurophysiological results showed an early CE modulation when the actor was about to start the request gesture looking straight to the participants, compared to when his gaze was averted from the gesture. This effect was time-locked to the kinematics of the actor’s arm movement. Overall, data from the two experiments seem to indicate that the joint contribution of direct gaze and precocious kinematic information, gained while a request gesture is on the verge of beginning, increases the subjective experience of involvement and allows observers to prepare for an appropriate social interaction. On the contrary, the separation of gaze cues and body kinematics can have adverse effects on social motor preparation. CE is highly susceptible to biological cues, such as averted gaze, which is able to automatically capture and divert observer’s attention. This point to the existence of heuristics based on early action and gaze cues that would allow observers to interact appropriately.

How wide is the cone of direct gaze?

The cone of direct gaze refers to the range of gaze deviations an observer accepts as looking directly at them. Previous experiments have calculated the width of the cone of direct gaze using the gaze deviations actually presented to the observer, however, there is considerable evidence that observers actually perceive gaze to be systematically more deviated than actually presented. Here, we examine the width of the cone of direct gaze in units of perceived gaze deviation. In doing so, we are able to disambiguate differences in width both within and between observers that are due to differences in their perception of gaze and due to differences in what observers consider to be looking at them. We suggest that this line of inquiry can offer further insight into the perception of gaze direction, and how this perception may differ in clinical populations.

Communicative intent modulates production and comprehension of actions and gestures: A Kinect study

Actions may be used to directly act on the world around us, or as a means of communication. Effective communication requires the addressee to recognize the act as being communicative. Humans are sensitive to ostensive communicative cues, such as direct eye gaze (Csibra & Gergely, 2009). However, there may be additional cues present in the action or gesture itself. Here we investigate features that characterize the initiation of a communicative interaction in both production and comprehension. We asked 40 participants to perform 31 pairs of object-directed actions and representational gestures in more- or less- communicative contexts. Data were collected using motion capture technology for kinematics and video recording for eye-gaze. With these data, we focused on two issues. First, if and how actions and gestures are systematically modulated when performed in a communicative context. Second, if observers exploit such kinematic information to classify an act as communicative. Our study showed that during production the communicative context modulates space-time dimensions of kinematics and elicits an increase in addressee-directed eye-gaze. Naïve participants detected communicative intent in actions and gestures preferentially using eye-gaze information, only utilizing kinematic information when eye-gaze was unavailable. Our study highlights the general communicative modulation of action and gesture kinematics during production but also shows that addressees only exploit this modulation to recognize communicative intention in the absence of eye-gaze. We discuss these findings in terms of distinctive but potentially overlapping functions of addressee directed eye-gaze and kinematic modulations within the wider context of human communication and learning.

How attention gates social interactions

Social interactions are at the core of social life. However, humans selectively choose their exchange partners and do not engage in all available opportunities for social encounters. In this review, we argue that attentional systems play an important role in guiding the selection of social interactions. Supported by both classic and emerging literature, we identify and characterize the three core processes-perception, interpretation, and evaluation-that interact with attentional systems to modulate selective responses to social environments. Perceptual processes facilitate attentional prioritization of social cues. Interpretative processes link attention with understanding of cues' social meanings and agents' mental states. Evaluative processes determine the perceived value of the source of social information. The interplay between attention and these three routes of processing places attention in a powerful role to manage the selection of the vast amount of social information that individuals encounter on a daily basis and, in turn, gate the selection of social interactions.

Neural mechanisms of eye contact when listening to another person talking

Eye contact occurs frequently and voluntarily during face-to-face verbal communication. However, the neural mechanisms underlying eye contact when it is accompanied by spoken language remain unexplored to date. Here we used a novel approach, fixation-based event-related functional magnetic resonance imaging (fMRI), to simulate the listener making eye contact with a speaker during verbal communication. Participants’ eye movements and fMRI data were recorded simultaneously while they were freely viewing a pre-recorded speaker talking. The eye tracking data were then used to define events for the fMRI analyses. The results showed that eye contact in contrast to mouth fixation involved visual cortical areas (cuneus, calcarine sulcus), brain regions related to theory of mind/intentionality processing (temporoparietal junction, posterior superior temporal sulcus, medial prefrontal cortex) and the dorsolateral prefrontal cortex. In addition, increased effective connectivity was found between these regions for eye contact in contrast to mouth fixations. The results provide first evidence for neural mechanisms underlying eye contact when watching and listening to another person talking. The network we found might be well suited for processing the intentions of communication partners during eye contact in verbal communication.

STORMy Interactions: Gaze and the Modulation of Mimicry in Adults on the Autism Spectrum

Mimicry involves unconsciously imitating the actions of others and is a powerful and ubiquitous behavior in social interactions. There has been a long debate over whether mimicry is abnormal in people with autism spectrum conditions (ASC) and what the causes of any differences might be. Wang and Hamilton's (2012) social top-down response modulation (STORM) model proposed that people with ASC can and do mimic but, unlike neurotypical participants, fail to modulate their mimicry according to the social context. This study used an established mimicry paradigm to test this hypothesis. In neurotypical participants, direct gaze specifically enhanced congruent hand actions as previously found; in the ASC sample, direct gaze led to faster reaction times in both congruent and incongruent movements. This result shows that mimicry is intact in ASC, but is not socially modulated by gaze, as predicted by STORM.

Audience effects: what can they tell us about social neuroscience, theory of mind and autism?

An audience effect arises when a person’s behaviour changes because they believe someone else is watching them. Though these effects have been known about for over 110 years, the cognitive mechanisms of the audience effect and how it might vary across different populations and cultures remains unclear. In this review, we examine the hypothesis that the audience effect draws on implicit mentalising abilities. Behavioural and neuroimaging data from a number of tasks are consistent with this hypothesis. We further review data suggest that how people respond to audiences may vary over development, personality factors, cultural background and clinical diagnosis including autism and anxiety disorder. Overall, understanding and exploring the audience effect may contribute to our models of social interaction, including reputation management and mentalising.

Understanding self and others: from origins to disorders

In order to interpret and engage with the social world, individuals must understand how they relate to others. Self-other understanding forms the backbone of social cognition and is a central concept explored by research into basic processes such as action perception and empathy, as well as research on more sophisticated social behaviours such as cooperation and intergroup interaction. This theme issue integrates the latest research into self-other understanding from evolutionary biology, anthropology, psychology, neuroscience and psychiatry. By gathering perspectives from a diverse range of disciplines, the contributions showcase ways in which research in these areas both informs and is informed by approaches spanning the biological and social sciences, thus deepening our understanding of how we relate to others in a social world.

From shared to distinct self-other representations in empathy: evidence from neurotypical function and socio-cognitive disorders

Neuroscientific research has identified two fundamental components of empathy: shared emotional representations between self and other, and self-other distinction. The concept of shared representations suggests that during empathy, we co-represent another person's affect by engaging brain and bodily functions underpinning the first-hand experience of the emotion we are empathizing with. This possible grounding of empathy in our own emotional experiences explains the necessity for self-other distinction, which is the capacity to correctly distinguish between our own affective representations and those related to the other. In spite of the importance of these two components in empathy, several aspects still remain controversial. This paper addresses some of them and focuses on (i) the distinction between shared activations versus representations, raising the question what shared representations entail in terms of the underlying neural mechanisms, (ii) the possible mechanisms behind self-other distinction in the cognitive and the affective domains, and whether they have distinct neural underpinnings and (iii) the consequences associated with a selective impairment of one of the two components, thereby addressing their importance in mental disorders such as autism spectrum disorders, psychopathy and alexithymia.