Gaze cueing of attention: visual attention, social cognition, and individual differences

Unmasking social attention: The key distinction between social and non-social attention emerges in disengagement, not engagement

The debate surrounding whether social and non-social attention share the same mechanism has been contentious. While prior studies predominantly focused on engagement, we examined the potential disparity between social and non-social attention from both perspectives of engagement and disengagement, respectively. We developed a two-stage attention-shifting paradigm to capture both attention engagement and disengagement. Combining results from five eye-tracking experiments, we supported that the disengagement of social attention markedly outpaces that of non-social attention, while no significant discrepancy emerges in engagement. We uncovered that the faster disengagement of social attention came from its social nature by eliminating alternative explanations including broader fixation distribution width, reduced directional salience in the peripheral visual field, decreased cue-object categorical consistency, reduced perceived validity, and faster processing time. Our study supported that the distinction between social and non-social attention is rooted in attention disengagement, not engagement.

The bigger your pupils, the better my comprehension: an ERP study of how pupil size and gaze of the speaker affect syntactic processing

Gaze direction and pupil dilation play a critical role in communication and social interaction due to their ability to redirect and capture our attention and their relevance for emotional information. The present study aimed to explore whether the pupil size and gaze direction of the speaker affect language comprehension. Participants listened to sentences that could be correct or contain a syntactic anomaly, while the static face of a speaker was manipulated in terms of gaze direction (direct, averted) and pupil size (mydriasis, miosis). Left anterior negativity (LAN) and P600 linguistic event-related potential components were observed in response to syntactic anomalies across all conditions. The speaker's gaze did not impact syntactic comprehension. However, the amplitude of the LAN component for mydriasis (dilated pupil) was larger than for miosis (constricted pupil) condition. Larger pupils are generally associated with care, trust, interest, and attention, which might facilitate syntactic processing at early automatic stages. The result also supports the permeable and context-dependent nature of syntax. Previous studies also support an automatic nature of syntax (fast and efficient), which combined with the permeability to relevant sources of communicative information, such as pupil size and emotions, is highly adaptive for language comprehension and social interaction.

Unconscious and Conscious Gaze-Triggered Attentional Orienting: Distinguishing Innate and Acquired Components of Social Attention in Children and Adults with Autistic Traits and Autism Spectrum Disorders

Typically developing (TD) individuals can readily orient attention according to others' eye-gaze direction, an ability known as social attention, which involves both innate and acquired components. To distinguish between these two components, we used a critical flicker fusion technique to render gaze cues invisible to participants, thereby largely reducing influences from consciously acquired strategies. Results revealed that both visible and invisible gaze cues could trigger attentional orienting in TD adults (aged 20 to 30 years) and children (aged 6 to 12 years). Intriguingly, only the ability to involuntarily respond to invisible gaze cues was negatively correlated with autistic traits among all TD participants. This ability was substantially impaired in adults with autism spectrum disorder (ASD) and in children with high autistic traits. No such association or reduction was observed with visible gaze cues. These findings provide compelling evidence for the functional demarcation of conscious and unconscious gaze-triggered attentional orienting that emerges early in life and develops into adulthood, shedding new light on the differentiation of the innate and acquired aspects of social attention. Moreover, they contribute to a comprehensive understanding of social endophenotypes of ASD.

Not to follow because of distrust: perceived trust modulates the gaze cueing effect

In social life, people spontaneously form stable trustworthiness impressions from faces. However, the precise role of extracting trustworthiness information remains unclear. This study aims to elucidate whether discerning facial trustworthiness influences social interactions. Specifically, it explores the gaze cueing effect (GCE), wherein individuals exhibit quicker responses to targets appearing in the direction of gaze compared to other locations. Given conflicting perspectives in existing literature regarding the potential modulation of trustworthiness on the GCE, two plausible hypotheses are proposed to explain divergent result patterns. The reflexive hypothesis posits that the GCE operates automatically. In contrast, the flexible hypothesis underscores the potential modulatory role of trustworthiness in the GCE. To provide a comprehensive understanding of whether trustworthiness modulates the GCE, we employed face stimuli incorporating trustworthiness information within Posner' s cue-target task. The findings of Experiment 1 revealed that the perception of trustworthiness indeed influenced the GCE. Specifically, when facial stimuli were perceived as trustworthy, they elicited a more pronounced GCE compared to untrustworthy stimuli. This modulation effect was replicated using a different stimulus set in Experiment 2. In Experiment 3, we employed the same stimuli as in Experiment 2, setting the trustworthiness information to baseline as a control experiment. The results demonstrated that the trustworthiness modulation effect disappeared, indicating its specificity to the trustworthiness attribute of the stimuli rather than other characteristics. Collectively, these findings lend support to the flexible hypothesis, highlighting that the extraction of trustworthiness information plays a pivotal role in modulating the GCE, consequently influencing social interactions.

Investigating the impact of schizophrenia traits on attention: the role of the theta band in a modified Posner cueing paradigm

Joint attention is an indispensable tool for daily communication. Abnormalities in joint attention may be a key reason underlying social impairment in schizophrenia spectrum disorders. In this study, we aimed to explore the attentional orientation mechanism related to schizotypal traits in a social situation. Here, we employed a Posner cueing paradigm with social attentional cues. Subjects needed to detect the location of a target that is cued by gaze and head orientation. The power in the theta frequency band was used to examine the attentional process in the schizophrenia spectrum. There were four main findings. First, a significant association was found between schizotypal traits and attention orientation in response to invalid gaze cues. Second, individuals with schizotypal traits exhibited significant activation of neural oscillations and synchrony in the theta band, which correlated with their schizotypal tendencies. Third, neural oscillations and synchrony demonstrated a synergistic effect during social tasks, particularly when processing gaze cues. Finally, the relationship between schizotypal traits and attention orientation was mediated by neural oscillations and synchrony in the theta frequency band. These findings deepen our understanding of the impact of theta activity in schizotypal traits on joint attention and offer new insights for future intervention strategies.

Social context and drug cues modulate inhibitory control in cocaine addiction: involvement of the STN evidenced through functional MRI

Addictions often develop in a social context, although the influence of social factors did not receive much attention in the neuroscience of addiction. Recent animal studies suggest that peer presence can reduce cocaine intake, an influence potentially mediated, among others, by the subthalamic nucleus (STN). However, there is to date no neurobiological study investigating this mediation in humans. This study investigated the impact of social context and drug cues on brain correlates of inhibitory control in individuals with and without cocaine use disorder (CUD) using functional Magnetic Resonance Imaging (fMRI). Seventeen CUD participants and 17 healthy controls (HC) performed a novel fMRI "Social" Stop-Signal Task (SSST) in the presence or absence of an observer while being exposed to cocaine-related (vs. neutral) cues eliciting craving in drug users. The results showed that CUD participants, while slower at stopping with neutral cues, recovered control level stopping abilities with cocaine cues, while HC did not show any difference. During inhibition (Stop Correct vs Stop Incorrect), activity in the right STN, right inferior frontal gyrus (IFG), and bilateral orbitofrontal cortex (OFC) varied according to the type of cue. Notably, the presence of an observer reversed this effect in most areas for CUD participants. These findings highlight the impact of social context and drug cues on inhibitory control in CUD and the mediation of these effects by the right STN and bilateral OFC, emphasizing the importance of considering the social context in addiction research. They also comfort the STN as a potential addiction treatment target.

The ownership memory self-reference effect shifts recognition criterion but not recognition sensitivity

Information referenced to the self is retrieved more accurately than information referenced to others, known as the memory self-reference effect. It is unclear, however, whether social context (identity of the other) or task factors alter decision-making processes. In a virtual object allocation task, female participants sorted objects into their own or another's (stranger or mother) basket based on a colour cue. Subsequently, they performed a recognition memory task in which they first indicated whether each object was old or new, and then whether it had been allocated to themselves or to the other. We obtained owner-specific hit rates and false-alarm rates and applied signal detection theory to derive separate recognition sensitivity (d') and recognition criterion parameters (c) for self- and other-owned objects. While there was no clear evidence of a recognition self-reference effect, or a change in sensitivity, participants adopted a more conservative recognition criterion for self- compared with other-owned objects, and particularly when the other-referent was the participant's mother compared with the stranger. Moreover, when discriminating whether the originally presented objects were self- or other-owned, participants were biased toward ascribing ownership to the 'other'. We speculate that these findings reflect ownership-based changes in decisional processing during the recognition memory self-reference paradigm.

Attentional Orienting and Disfluency-Related Memory Boost Are Intact in Adults With Moderate-Severe Traumatic Brain Injury

PURPOSE

Traumatic brain injury (TBI) is associated with a range of cognitive-communicative deficits that interfere with everyday communication and social interaction. Considerable effort has been directed at characterizing the nature and scope of cognitive-communication disorders in TBI, yet the underlying mechanisms of impairment are largely unspecified. The present research examines sensitivity to a common communicative cue, disfluency, and its impact on memory for spoken language in TBI.

METHOD

Fifty-three participants with moderate-severe TBI and 53 noninjured comparison participants listened to a series of sentences, some of which contained disfluencies. A subsequent memory test probed memory for critical words in the sentences.

RESULTS

Participants with TBI successfully remembered the spoken words (b = 1.57, p < .0001) at a similar level to noninjured comparison participants. Critically, participants with TBI also exhibited better recognition memory for words preceded by disfluency compared to words from fluent sentences (b = 0.57, p = .02).

CONCLUSIONS

These findings advance mechanistic accounts of cognitive-communication disorder by revealing that, when isolated for experimental study, individuals with moderate-severe TBI are sensitive to attentional orienting cues in speech and exhibit enhanced recognition of individual words preceded by disfluency. These results suggest that some aspects of cognitive-communication disorders may not emerge from an inability to perceive and use individual communication cues, but rather from disruptions in managing (i.e., attending, weighting, integrating) multiple cognitive, communicative, and social cues in complex and dynamic interactions. This hypothesis warrants further investigation.

Social excluder's face reduces gaze-triggered attention orienting

Social ostracism, a negative affective experience in interpersonal interactions, is thought to modulate the gaze-cueing effect (GCE). However, it is unclear whether the impact of social exclusion on the GCE is related to the identity of the cueing face. Therefore, the present study employed a two-phase paradigm to address this issue. In the first phase, two groups of participants were instructed to complete a Cyberball game with two virtual avatars to establish a binding relationship between a specific face's identity and the emotions of social exclusion or inclusion. In the second phase, these two virtual avatars (exclusion faces/inclusion faces) and two new faces (control faces) were used as cueing faces in the gaze-cueing task. The results found that, for the exclusion group, the magnitudes of the GCEs for the exclusion and exclusion-control faces were similar in the 200 ms stimulus onset asynchrony (SOA) condition, while the exclusion face's GCE was significantly smaller than that of the exclusion-control face in the 700 ms SOA condition. In contrast, for the inclusion group, the GCEs for inclusion and inclusion-control faces in both the 200 ms SOA and 700 ms SOA conditions did not significantly differ. This study reveals that the effect of social exclusion on the GCE is related to the identity of the cueing face, with individuals more reluctant to follow the gaze direction of excluder and shift their attention and provides experimental evidence that the perception of higher social relations can exert a top-down impact on the processing of social spatial cues.

Covert and overt automatic imitation are correlated

Most theoretical accounts of imitation assume that covert and overt measures of automatic imitation tap into the same underlying construct. Despite this widespread assumption, it is not well supported by empirical evidence. In fact, the only study investigating the relation between covert and overt automatic imitation failed to find a correlation between them (Genschow et al., 2017, PLOS ONE, 12[9], Article e0183784). However, because overt and covert imitation were measured using two very different tasks, and because the measure of overt imitation was found to be unreliable, it is still not clear whether a correlation between both measures exists. Here, we address this question by reanalyzing the results of a previous virtual reality study in which automatic imitation was indexed with an overt and covert measure of gaze following, both obtained within one and the same task (Cracco et al., 2022, IScience, Article 104891). The results show that, in this situation, both types of imitation do correlate. As such, our results provide support for the idea that overt and covert measures of automatic imitation measure the same underlying construct.

Perceived gaze dynamics in social interactions can alter (and even reverse) the perceived temporal order of events

Here's an all-too-familiar scenario: Person A is staring at person B, and then B turns toward A, and A immediately looks away (a phenomenon we call 'gaze deflection'). Beyond perceiving lower-level properties here - such as the timing of the eye/head turns - you can also readily perceive seemingly higher-level social dynamics: A got caught staring, and frantically looked away in embarrassment! It seems natural to assume that such social impressions are based on more fundamental representations of what happened when - but here we show that social gaze dynamics are unexpectedly powerful in that they can actually alter (and even reverse) the perceived temporal order of the underlying events. Across eight experiments, observers misperceived B as turning before A, when in fact they turned simultaneously - and even when B was turning after A. Additional controls confirmed that this illusion depends on visual processing (vs. being driven solely by higher-level interpretations), and that it is specific to the perception of social agents (vs. non-social objects). This demonstrates how social perception is tightly integrated into our perceptual experience of the world, and can have powerful consequences for one of the most basic properties that we can perceive: what happens when.

Psychopathy and gaze cueing

BACKGROUND AND OBJECTIVES

Psychopathic traits - and especially callous affective features - have been linked to altered processing of others' emotional expressions, and to reduced attention to the eyes. Despite the importance of gaze cueing (i.e., the tendency to orient attention toward where someone else is looking) for social functioning, few studies have investigated relationships between psychopathic traits and gaze cueing, and whether facial emotional expression influence these relationships, obtaining mixed results. To address this gap, the present study aimed to evaluate associations between psychopathic traits and gaze cueing for emotional and neutral expressions.

METHODS

65 non-clinical male participants (Mage = 27.3 years) completed two self-report measures of psychopathy and performed laboratory tasks to assess gaze-cueing for emotional vs. neutral faces and an arrow-cueing task as a comparison.

RESULTS

Linear mixed models showed no significant associations of emotional (versus neutral) expressions, or psychopathy trait dimensions, with either gaze cueing or arrow cueing.

LIMITATIONS

Reliance on a convenience sample of non-clinical men, assessed with self-reports measures of psychopathy, and using static emotional stimuli limit the generalizability of our findings.

CONCLUSIONS

Findings suggest that psychopathic traits are not associated with individual differences in following others' gaze to direct attention, and that there was no advantage for affective relative to neutral expressions.

Infant sensorimotor decoupling from 4 to 9 months of age: Individual differences and contingencies with maternal actions

Triadic interactions, wherein infants coordinate attention between caregivers and objects of shared focus, are believed to facilitate infant learning, and emerge around 9-12 months of age (Carpenter et al., 1998). Sensorimotor decoupling, wherein infants look at one percept while manipulating another, or use each hand for different actions, was hypothesized (de Barbaro et al., 2016) to contribute to triadic skills by allowing infants to smoothly shift attention between objects and social partners. We explored the development of Hand-Hand (H-H) and Gaze-Hand (G-H) decoupling in 38 infants at 4, 6, and 9 months. We also tested contingencies between maternal behaviors and infant decoupling: i.e., whether decoupling events followed maternal object-directed actions. Both overall and contingent infant decoupling increased from 4 to 9 months. Decoupling rates (both G-H and H-H) predicted variance in infants' fine and gross motor scores. Contingent G-H decoupling at 6 months predicted BSID-III communication scores at 18 months. Thus the development of infant sensorimotor skills, including decoupling, allows infants to smoothly shift attention and participate in triadic interactions.

Intact gesture cueing of attention but attenuated sensitivity to peripheral social targets in autistic children: An eye-tracking and pupillometric study

BACKGROUND

Altered automatic attention cueing has been reported in autistic children. Yet less is known about how autistic children would respond when the social cue that directs attention occurs in an implied social interaction.

METHODS

By using eye-tracking, the current study examined orienting responses to a socially-relevant target or a nonsocial target cued by a goal-directed social gesture in autistic children. Saccadic reaction time and pupillary responses were employed to measure gaze behavior and physiological arousal of autistic children.

RESULTS

Both groups of children showed reflexive orienting to the target regardless of its sociality, whereas typically developing (TD) children exhibited faster gaze shift than autistic children when the target was a social stimulus. An increased pupil dilation was observed in autistic children in response to stimuli relative to TD children. Further, autistic children showed larger baseline pupil response.

CONCLUSIONS

Autistic children show attenuated sensitivity to social targets and atypical pupil responses, which may be due to the dysfunction of locus coeruleus (LC) - norepinephrine (NE) system.

No effect of autistic traits on social attention: evidence based on single-cue and conflicting-cues scenarios

Individuals often use others' gaze and head directions to direct their attention. To investigate the influence of autistic traits on social attention, we conducted two experiments comparing groups with high and low autistic traits in single-cue (Experiment 1) and conflicting-cue (Experiment 2) scenarios. Our findings indicate that individuals responded more rapidly to the direction of a single social cue or the consensus of multiple cues. However, we did not observe significant differences in social attention between individuals with high and low autistic traits. Notably, as the stimulus onset asynchrony (SOA) increased, individuals with low autistic traits exhibited greater improvements in reaction speed compared to those with high autistic traits. This suggests that individuals with low autistic traits excel at leveraging temporal information to optimize their behavioral readiness over time, hinting at potential variations in cognitive flexibility related to autistic traits.

Social Communication in Young Children With Sex Chromosome Trisomy (XXY, XXX, XYY): A Study With Eye Tracking and Heart Rate Measures

OBJECTIVE

Children with sex chromosome trisomy (SCT) have an increased risk for suboptimal development. Difficulties with language are frequently reported, start from a very young age, and encompass various domains. This cross-sectional study examined social orientation with eye tracking and physiological arousal responses to gain more knowledge on how children perceive and respond to communicative bids and evaluated the associations between social orientation and language outcomes, concurrently and 1 year later.

METHOD

In total, 107 children with SCT (33 XXX, 50 XXY, and 24 XYY) and 102 controls (58 girls and 44 boys) aged between 1 and 7 years were included. Assessments took place in the USA and Western Europe. A communicative bids eye tracking paradigm, physiological arousal measures, and receptive and expressive language outcomes were used.

RESULTS

Compared to controls, children with SCT showed reduced attention to the face and eyes of the on-screen interaction partner and reduced physiological arousal sensitivity in response to direct versus averted gaze. In addition, social orientation to the mouth was related to concurrent receptive and expressive language abilities in 1-year-old children with SCT.

CONCLUSIONS

Children with SCT may experience difficulties with social communication that extend past the well-recognized risk for early language delays. These difficulties may underlie social-behavioral problems that have been described in the SCT population and are an important target for early monitoring and support.

Gaze Orienting in the Social World: An Exploration of the Role Played by Caregiving Vocal and Tactile Behaviors in Infants with Visual Impairment and in Sighted Controls

Infant attention is a cognitive function that underlines sensory-motor integration processes at the interface between the baby and the surrounding physical and socio-relational environment, mainly with the caregivers. The investigation of the role of non-visual inputs (i.e., vocal and tactile) provided by the caregivers in shaping infants' attention in the context of visual impairment is relevant from both a theoretical and clinical point of view. This study investigated the social attention (i.e., gaze orientation) skills in a group of visually impaired (VI) and age-matched sighted controls (SCs) between 9 and 12 months of age. Moreover, the role of VI severity and maternal vocalizations and touch in shaping the social attention were investigated. Overall, 45 infants and their mothers participated in a video-recorded 4 min interaction procedure, including a play and a still-face episode. The infants' gaze orientation (i.e., mother-directed, object-directed, or unfocused) and the types of maternal vocalizations and touch (i.e., socio-cognitive, affective) were micro-analytically coded. Maternal vocalizations and touch were found to influence gaze orientation differently in VI infants compared SCs. Moreover, the group comparisons during the play episode showed that controls were predominantly oriented to the mothers, while VI infants were less socially oriented. Visual impairment severity did not emerge as linked with social attention. These findings contribute to our understanding of socio-cognitive developmental trajectories in VI infants and highlight the need for tailored interventions to promote optimal outcomes for VI populations.

Grandiose narcissism associates with higher cognitive performance under stress through more efficient attention distribution: An eye-tracking study

Narcissism is a part of the Dark Triad that consists also of the traits of Machiavellianism and psychopathy. Two main types of narcissism exist: grandiose and vulnerable narcissism. Being a Dark Triad trait, narcissism is typically associated with negative outcomes. However, recent research suggests that at least the grandiose type may be linked (directly or indirectly) to positive outcomes including lower levels of psychopathology, higher school grades in adolescents, deeper and more strategic learning in university students and higher cognitive performance in experimental settings. The current pre-registered, quasi-experimental study implemented eye-tracking to assess whether grandiose narcissism indirectly predicts cognitive performance through wider distribution of attention on the Raven's Progressive Matrices task. Fifty-four adults completed measures of the Dark Triad, self-esteem and psychopathology. Eight months to one year later, participants completed the Raven's, while their eye-movements were monitored during high stress conditions. When controlling for previous levels of psychopathology, grandiose narcissism predicted higher Raven's scores indirectly, through increased variability in the number of fixations across trials. These findings suggest that grandiose narcissism predicts higher cognitive performance, at least in experimental settings, and call for further research to understand the implications of this seemingly dark trait for performance across various settings.

I prefer what you can see: The role of visual perspective-taking on the gaze-liking effect

Individuals' gaze on an object usually leads others to prefer that object, which is called the gaze-liking effect. However, it is still unclear whether this effect is driven by social factors (i.e., visual perspective-taking) or the domain-general processing (i.e., attention cueing). This research explored the mechanism of the gaze-liking effect by manipulating the objects' visibility to an avatar in six online one-shot experiments. The results showed that participants' affective evaluation for the object was modulated by the avatar's visual perspective. Specifically, the visible object to the avatar received a higher rating of liking degree. However, when the avatar was replaced with a non-social stimulus, the experimental effect was absent. Furthermore, the gaze-liking effect was robust while controlling for confounding factors such as the distance between the object and the avatar or type of stimuli. These findings provided convincing evidence that the gaze-liking effect involves a process of the other's visual experience and is not merely a by-product of the gaze-cueing effect.

Impaired recognition of interactive intentions in adults with autism spectrum disorder not attributable to differences in visual attention or coordination via eye contact and joint attention

Altered nonverbal communication patterns especially with regard to gaze interactions are commonly reported for persons with autism spectrum disorder (ASD). In this study we investigate and differentiate for the first time the interplay of attention allocation, the establishment of shared focus (eye contact and joint attention) and the recognition of intentions in gaze interactions in adults with ASD compared to control persons. Participants interacted via gaze with a virtual character (VC), who they believed was controlled by another person. Participants were instructed to ascertain whether their partner was trying to interact with them. In fact, the VC was fully algorithm-controlled and showed either interactive or non-interactive gaze behavior. Participants with ASD were specifically impaired in ascertaining whether their partner was trying to interact with them or not as compared to participants without ASD whereas neither the allocation of attention nor the ability to establish a shared focus were affected. Thus, perception and production of gaze cues seem preserved while the evaluation of gaze cues appeared to be impaired. An additional exploratory analysis suggests that especially the interpretation of contingencies between the interactants' actions are altered in ASD and should be investigated more closely.

The infant-doctor relationship: an examination of infants' distress reactions in the presence of a doctor

Fear of doctors is a common source of distress among infants; however, the underlying sources of this distress are unknown. To investigate the doctor-infant relationship, the behaviors of 61 healthy infants (176-617 days old) were observed in a simulated examination room. Their behaviors and electrocardiograms were recorded. Two groups of infants were analyzed: those who cried and those who did not. When an experimenter dressed in the doctor's attire entered the room, all 9 infants who were crying (14.8% of all infants) stopped crying, all infants gazed at the experimenter, and their mean heart rate (HR) decreased. After the auscultation started, 29.5% of all infants cried, and the HRs of infants who cried were higher than those of infants who did not cry. During the auscultation, 80.0% of infants who cried averted from the experimenter, while 34.4% of infants who did not cry. Within 5 s of gazing at the stethoscope, the number of infants who cried increased from 3 to 12, and their mean HR also increased. Our findings suggest that the fear of doctors is not due to the appearance of doctors but rather to specific actions performed by doctors, such as auscultation. Infants may regard a doctor's appearance as a source of interest. Furthermore, a stethoscope is a possible trigger for infants' crying. These behavioral observations suggest the potential for patient-centered care for infants.

The integration of head and body cues during the perception of social interactions

Humans spend a large proportion of time participating in social interactions. The ability to accurately detect and respond to human interactions is vital for social functioning, from early childhood through to older adulthood. This detection ability arguably relies on integrating sensory information from the interactants. Within the visual modality, directional information from a person's eyes, head, and body are integrated to inform where another person is looking and who they are interacting with. To date, social cue integration research has focused largely on the perception of isolated individuals. Across two experiments, we investigated whether observers integrate body information with head information when determining whether two people are interacting, and manipulated frame of reference (one of the interactants facing observer vs. facing away from observer) and the eye-region visibility of the interactant. Results demonstrate that individuals integrate information from the body with head information when perceiving dyadic interactions, and that integration is influenced by the frame of reference and visibility of the eye-region. Interestingly, self-reported autistics traits were associated with a stronger influence of body information on interaction perception, but only when the eye-region was visible. This study investigated the recognition of dyadic interactions using whole-body stimuli while manipulating eye visibility and frame of reference, and provides crucial insights into social cue integration, as well as how autistic traits affect cue integration, during perception of social interactions.

Uncovering the cognitive mechanisms underlying the gaze cueing effect

The gaze cueing effect is the tendency for people to respond faster to targets appearing at locations gazed at by others, compared with locations gazed away from by others. The effect is robust, widely studied, and is an influential finding within social cognition. Formal evidence accumulation models provide the dominant theoretical account of the cognitive processes underlying speeded decision-making, but they have rarely been applied to social cognition research. In this study, using a combination of individual-level and hierarchical computational modelling techniques, we applied evidence accumulation models to gaze cueing data (three data sets total, N = 171, 139,001 trials) for the first time to assess the relative capacity that an attentional orienting mechanism and information processing mechanisms have for explaining the gaze cueing effect. We found that most participants were best described by the attentional orienting mechanism, such that response times were slower at gazed away from locations because they had to reorient to the target before they could process the cue. However, we found evidence for individual differences, whereby the models suggested that some gaze cueing effects were driven by a short allocation of information processing resources to the gazed at location, allowing for a brief period where orienting and processing could occur in parallel. There was exceptionally little evidence to suggest any sustained reallocation of information processing resources neither at the group nor individual level. We discuss how this individual variability might represent credible individual differences in the cognitive mechanisms that subserve behaviourally observed gaze cueing effects.

TAT-HUM: Trajectory analysis toolkit for human movements in Python

Human movement trajectories can reveal useful insights regarding the underlying mechanisms of human behaviors. Extracting information from movement trajectories, however, can be challenging because of their complex and dynamic nature. The current paper presents a Python toolkit developed to help users analyze and extract meaningful information from the trajectories of discrete rapid aiming movements executed by humans. This toolkit uses various open-source Python libraries, such as NumPy and SciPy, and offers a collection of common functionalities to analyze movement trajectory data. To ensure flexibility and ease of use, the toolkit offers two approaches: an automated approach that processes raw data and generates relevant measures automatically, and a manual approach that allows users to selectively use different functions based on their specific needs. A behavioral experiment based on the spatial cueing paradigm was conducted to illustrate how one can use this toolkit in practice. Readers are encouraged to access the publicly available data and relevant analysis scripts as an opportunity to learn about kinematic analysis for human movements.

Eyes meet, hands greet: The art of timing in social interactions

Shaking hands is a fundamental form of social interaction. The current study used high-definition cameras during a university graduation ceremony to examine the temporal sequencing of eye contact and shaking hands. Analyses revealed that mutual gaze always preceded shaking hands. A follow up investigation manipulated gaze when shaking hands, and found that participants take significantly longer to accept a handshake when an outstretched hand precedes eye contact. These findings demonstrate that the timing between a person's gaze and their offer to shake hands is critical to how their action is interpreted.

Attentional cueing: Gaze is harder to override than arrows

Gaze is an important and potent social cue to direct others' attention towards specific locations. However, in many situations, directional symbols, like arrows, fulfill a similar purpose. Motivated by the overarching question how artificial systems can effectively communicate directional information, we conducted two cueing experiments. In both experiments, participants were asked to identify peripheral targets appearing on the screen and respond to them as quickly as possible by a button press. Prior to the appearance of the target, a cue was presented in the center of the screen. In Experiment 1, cues were either faces or arrows that gazed or pointed in one direction, but were non-predictive of the target location. Consistent with earlier studies, we found a reaction time benefit for the side the arrow or the gaze was directed to. Extending beyond earlier research, we found that this effect was indistinguishable between the vertical and the horizontal axis and between faces and arrows. In Experiment 2, we used 100% "counter-predictive" cues; that is, the target always occurred on the side opposite to the direction of gaze or arrow. With cues without inherent directional meaning (color), we controlled for general learning effects. Despite the close quantitative match between non-predictive gaze and non-predictive arrow cues observed in Experiment 1, the reaction-time benefit for counter-predictive arrows over neutral cues is more robust than the corresponding benefit for counter-predictive gaze. This suggests that-if matched for efficacy towards their inherent direction-gaze cues are harder to override or reinterpret than arrows. This difference can be of practical relevance, for example, when designing cues in the context of human-machine interaction.

Methods matter: Exploring how expectations influence common actions

Behavior in controlled laboratory studies is not always representative of what people do in daily life. This has prompted a recent shift toward conducting studies in natural settings. We wondered whether expectations raised by how the task is presented should also be considered. To find out, we studied gaze when walking down and up a staircase. Gaze was often directed at steps before stepping on them, but most participants did not look at every step. Importantly, participants fixated more steps and looked around less when asked to navigate the staircase than when navigating the same staircase but asked to walk outside. Presumably, expecting the staircase to be important made participants direct their gaze at more steps, despite the identical requirements when on the staircase. This illustrates that behavior can be influenced by expectations, such as expectations resulting from task instructions, even when studies are conducted in natural settings.

What can evidence accumulation modelling tell us about human social cognition?

Evidence accumulation models are a series of computational models that provide an account for speeded decision-making. These models have been used extensively within the cognitive psychology literature to great success, allowing inferences to be drawn about the psychological processes that underlie cognition that are sometimes not available in a traditional analysis of accuracy or reaction time (RT). Despite this, there have been only a few applications of these models within the domain of social cognition. In this article, we explore several ways in which the study of human social information processing would benefit from application of evidence accumulation modelling. We begin first with a brief overview of the evidence accumulation modelling framework and their past success within the domain of cognitive psychology. We then highlight five ways in which social cognitive research would benefit from an evidence accumulation approach. This includes (1) greater specification of assumptions, (2) unambiguous comparisons across blocked task conditions, (3) quantifying and comparing the magnitude of effects in standardised measures, (4) a novel approach for studying individual differences, and (5) improved reproducibility and accessibility. These points are illustrated using examples from the domain of social attention. Finally, we outline several methodological and practical considerations, which should help researchers use evidence accumulation models productively. Ultimately, it will be seen that evidence accumulation modelling offers a well-developed, accessible, and commonly understood framework that can reveal inferences about cognition that may otherwise be out of reach in a traditional analysis of accuracy and RT. This approach, therefore, has the potential to substantially revise our understanding of social cognition.

TANGO: A reliable, open-source, browser-based task to assess individual differences in gaze understanding in 3 to 5-year-old children and adults

Traditional measures of social cognition used in developmental research often lack satisfactory psychometric properties and are not designed to capture variation between individuals. Here, we present the TANGO (Task for Assessing iNdividual differences in Gaze understanding-Open); a brief (approx. 5-10min), reliable, open-source task to quantify individual differences in the understanding of gaze cues. Localizing the attentional focus of an agent is crucial in inferring their mental states, building common ground, and thus, supporting cooperation. Our interactive browser-based task works across devices and enables in-person and remote testing. The implemented spatial layout allows for discrete and continuous measures of participants' click imprecision and is easily adaptable to different study requirements. Our task measures inter-individual differences in a child (N = 387) and an adult (N = 236) sample. Our two study versions and data collection modes yield comparable results that show substantial developmental gains: the older children are, the more accurately they locate the target. High internal consistency and test-retest reliability estimates underline that the captured variation is systematic. Associations with social-environmental factors and language skills speak to the validity of the task. This work shows a promising way forward in studying individual differences in social cognition and will help us explore the structure and development of our core social-cognitive processes in greater detail.

The pictorial set of Emotional Social Interactive Scenarios between Chinese Adults (ESISCA): Development and validation

Affective picture databases with a single facial expression or body posture in one image have been widely applied to investigate emotion. However, to date, there was no standardized database containing the stimuli which involve multiple emotional signals in social interactive scenarios. The current study thus developed a pictorial set comprising 274 images depicting two Chinese adults' interactive scenarios conveying emotions of happiness, anger, sadness, fear, disgust, and neutral. The data of the valence and arousal ratings of the scenes and the emotional categories of the scenes and the faces in the images were provided in the present study. Analyses of the data collected from 70 undergraduate students suggested high reliabilities of the valence and arousal ratings of the scenes and high judgmental agreements in categorizing the scene and facial emotions. The findings suggested that the present dataset is well constructed and could be useful for future studies to investigate the emotion recognition or empathy in social interactions in both healthy and clinical (e.g., ASD) populations.

The influence of another's actions and presence on perspective taking

The ability to take each other's visuospatial perspective has been linked to people's capacity to perceive another's action possibilities and to predict their actions. Research has also shown that visuospatial perspective taking is supported by one's own mental own-body transformation. However, how these two processes of action perception and visuospatial perspective taking might interact remains largely unknown. By introducing seven angular disparities between participants and the model in the stimuli pictures across "Action" and "No Action" conditions, we investigated whether the observation of a goal-directed action facilitates perspective taking and whether this facilitation depends on the level of mental own-body transformation required to take perspective. The results showed that action observation facilitated performance independently of the level of mental-own body transformation. The processes behind this facilitation could involve anatomical mapping that is independent of the congruency between the participants' and the model's perspectives. Further, we replicated previous research findings, showing that participants were more accurate and faster when taking the perspective of a person compared to an inanimate object (a chair). The strongest facilitation effects were seen at the highest angular disparities between participants and the model in the stimuli pictures. Together, these findings enhance our knowledge of the mechanisms behind visuospatial perspective taking.

Perceiving social gaze produces the reversed congruency effect

Numerous studies have shown that the gaze of others produces a special attentional process, such as the eye contact effect or joint attention. This study investigated the attentional process triggered by various types of gaze stimuli (i.e., human, cat, fish, koala, and robot gaze). A total of 300 university students participated in five experiments. They performed a spatial Stroop task in which five types of gaze stimuli were presented as targets. Participants were asked to judge the direction of the target (left or right) irrespective of its location (left or right). The results showed that the social gaze targets (i.e., human and cat gaze) produced a reversed congruency effect. In contrast to the social gaze targets, the non-social gaze (i.e., fish and robot) target did not produce the reversed congruency effect (Experiments 2, 2B, 3, and 4). These results suggest that attention to the gaze of socially communicable beings (i.e., humans and cats) is responsible for the reversed congruency effect. Our findings support the notion that the theory of mind or social interaction plays an important role in producing specific attentional processes in response to gaze stimuli.

Social gaze cueing elicits facilitatory and inhibitory effects on movement execution when the model might act on an object

Social cues, such as eye gaze and pointing fingers, can increase the prioritisation of specific locations for cognitive processing. A previous study using a manual reaching task showed that, although both gaze and pointing cues altered target prioritisation (reaction times [RTs]), only pointing cues affected action execution (trajectory deviations). These differential effects of gaze and pointing cues on action execution could be because the gaze cue was conveyed through a disembodied head; hence, the model lacked the potential for a body part (i.e., hands) to interact with the target. In the present study, the image of a male gaze model, whose gaze direction coincided with two potential target locations, was centrally presented. The model either had his arms and hands extended underneath the potential target locations, indicating the potential to act on the targets (Experiment 1), or had his arms crossed in front of his chest, indicating the absence of potential to act (Experiment 2). Participants reached to a target that followed a nonpredictive gaze cue at one of three stimulus onset asynchronies. RTs and reach trajectories of the movements to cued and uncued targets were analysed. RTs showed a facilitation effect for both experiments, whereas trajectory analysis revealed facilitatory and inhibitory effects, but only in Experiment 1 when the model could potentially act on the targets. The results of this study suggested that when the gaze model had the potential to interact with the cued target location, the model's gaze affected not only target prioritisation but also movement execution.

The semantics of gaze in person perception: a novel qualitative-quantitative approach

Interpreting gaze behavior is essential in evaluating interaction partners, yet the 'semantics of gaze' in dynamic interactions are still poorly understood. We aimed to comprehensively investigate effects of gaze behavior patterns in different conversation contexts, using a two-step, qualitative-quantitative procedure. Participants watched video clips of single persons listening to autobiographic narrations by another (invisible) person. The listener's gaze behavior was manipulated in terms of gaze direction, frequency and direction of gaze shifts, and blink frequency; emotional context was manipulated through the valence of the narration (neutral/negative). In Experiment 1 (qualitative-exploratory), participants freely described which states and traits they attributed to the listener in each condition, allowing us to identify relevant aspects of person perception and to construct distinct rating scales that were implemented in Experiment 2 (quantitative-confirmatory). Results revealed systematic and differential meanings ascribed to the listener's gaze behavior. For example, rapid blinking and fast gaze shifts were rated more negatively (e.g., restless and unnatural) than slower gaze behavior; downward gaze was evaluated more favorably (e.g., empathetic) than other gaze aversion types, especially in the emotionally negative context. Overall, our study contributes to a more systematic understanding of flexible gaze semantics in social interaction.

Allocation of Space-Based Attention is Guided by Efficient Comprehension of Spatial Direction

Spatial navigation is supported by visual cues (e.g., scenes, schemas like arrows, and words) that must be comprehended quickly to facilitate effective transit. People comprehend spatial directions faster from schemas and words than scenes. We hypothesize that this occurs because schemas and words efficiently engage space-based attention, allowing for less costly computations. Here, participants completed a spatial cueing paradigm, and we calculated cue validity effects - how much faster participants responded to validly than invalidly cued locations - for each cue format. We pre-registered Experiment 1 and found significant cue validity effects with schemas and words, but not scenes, suggesting space-based attention was allocated more efficiently with schemas and words than scenes. In Experiment 2, we explicitly instructed participants to interpret the scenes from an egocentric perspective and found that this instruction manipulation still did not result in a significant cue validity effect with scenes. In Experiment 3, we investigated whether the differential effects between conditions were due to costly computations to extract spatial direction and found that increasing cue duration had no influence. In Experiment 4, significant cue validity effects were observed for orthogonal but not non-orthogonal spatial directions, suggesting space-based attention was allocated more efficiently when the spatial direction precisely matched the target location. These findings confirm our hypothesis that efficient allocation of space-based attention is guided by faster spatial direction comprehension. Altogether, this work suggests that schemas and words may be more effective supports than scenes for navigation performance in the real-world.

The Medusa effect: a registered replication report of Will, Merritt, Jenkins and Kingstone (2021)

Will et al.'s (2021 Proc. Natl Acad. Sci. USA 118, e2106640118 (doi:10.1073/pnas.2106640118)) found the Medusa effect, which refers to the tendency that people evaluate a 'person in picture' more mindful than a 'person in picture of a picture'. The present study tried to directly replicate the Experiments 2 and 5 of Will et al.'s (2021), to examine the reliability, validity and generalization of the Medusa effect, as well as its effect on prosocial behaviour. We used the same stimuli and methodology as the original research, but recruited participants in Japan with a larger sample size (N = 1387 in total) as a registered report. In our two replication experiments, we again found that pictures with lower levels of abstraction (L1) were perceived to convey more mind and lead to higher levels of prosocial behaviour, successfully replicating the original findings. The results of the present study suggested the high reproducibility and generalizability of the Medusa effect. Pre-registered Stage 1 protocol: https://osf.io/xj46z (date of in-principle acceptance: 9 February 2023).

Age Differences in Gaze Following: Older Adults Follow Gaze More than Younger Adults When free-viewing Scenes

Previous research investigated age differences in gaze following with an attentional cueing paradigm where participants view a face with averted gaze, and then respond to a target appearing in a location congruent or incongruent with the gaze cue. However, this paradigm is far removed from the way we use gaze cues in everyday settings. Here we recorded the eye movements of younger and older adults while they freely viewed naturalistic scenes where a person looked at an object or location. Older adults were more likely to fixate and made more fixations to the gazed-at location, compared to younger adults. Our findings suggest that, contrary to what was observed in the traditional gaze-cueing paradigm, in a non-constrained task that uses contextualized stimuli older adults follow gaze as much as or even more than younger adults.

Flexible Cultural Learning Through Action Coordination

The cultural transmission of technical know-how has proven vital to the success of our species. The broad diversity of learning contexts and social configurations, as well as the various kinds of coordinated interactions they involve, speaks to our capacity to flexibly adapt to and succeed in transmitting vital knowledge in various learning contexts. Although often recognized by ethnographers, the flexibility of cultural learning has so far received little attention in terms of cognitive mechanisms. We argue that a key feature of the flexibility of cultural learning is that both the models and learners recruit cognitive mechanisms of action coordination to modulate their behavior contingently on the behavior of their partner, generating a process of mutual adaptation supporting the successful transmission of technical skills in diverse and fluctuating learning environments. We propose that the study of cultural learning would benefit from the experimental methods, results, and insights of joint-action research and, complementarily, that the field of joint-action research could expand its scope by integrating a learning and cultural dimension. Bringing these two fields of research together promises to enrich our understanding of cultural learning, its contextual flexibility, and joint action coordination.

Development and validation of an Arabic language eye-tracking paradigm for the early screening and diagnosis of autism spectrum disorders in Qatar

Abnormal eye gaze is a hallmark characteristic of autism spectrum disorder (ASD). The primary aim of the present research was to develop an Arabic version of an objective measure of ASD, the "autism index" (AI), based on eye gaze tracking to social and nonsocial stimuli validated initially in the United States. The initial phase of this study included the translation of English language eye-tracking stimuli into stimuli appropriate for an Arabic-speaking culture. During the second phase, we tested it on a total of 144 children with ASD, and 96 controls. The AI had excellent internal consistency and test-retest reliability. Moreover, the AI showed good differentiation of ASD from control cases (AUC = 0.730, SE = 0.035). The AI was significantly positively correlated with SCQ total raw scores (r = 0.46, p < 0.001). ADOS-2 scores were only available in the ASD group and did not show a significant relationship with AI scores (r = 0.10, p = 0.348), likely due to the restricted range. The AI, when implemented using Arabic-translated stimuli in a Qatari sample, showed good diagnostic differentiation and a strong correlation with parent-reported ASD symptoms. Thus, the AI appears to have cross-cultural validity and may be useful as a diagnostic aide to inform clinical judgment and track ASD symptom levels as part of the evaluation process.

Evidence for the adaptive parsing of non-communicative eye movements during joint attention interactions

During social interactions, the ability to detect and respond to gaze-based joint attention bids often involves the evaluation of non-communicative eye movements. However, very little is known about how much humans are able to track and parse spatial information from these non-communicative eye movements over time, and the extent to which this influences joint attention outcomes. This was investigated in the current study using an interactive computer-based joint attention game. Using a fully within-subjects design, we specifically examined whether participants were quicker to respond to communicative joint attention bids that followed predictive, as opposed to random or no, non-communicative gaze behaviour. Our results suggest that in complex, dynamic tasks, people adaptively use and dismiss non-communicative gaze information depending on whether it informs the locus of an upcoming joint attention bid. We also went further to examine the extent to which this ability to track dynamic spatial information was specific to processing gaze information. This was achieved by comparing performance to a closely matched non-social task where eye gaze cues were replaced with dynamic arrow stimuli. Whilst we found that people are also able to track and use dynamic non-social information from arrows, there was clear evidence for a relative advantage for tracking gaze cues during social interactions. The implications of these findings for social neuroscience and autism research are discussed.

Neural basis of social attention: common and distinct mechanisms for social and nonsocial orienting stimuli

Social and nonsocial directional stimuli (such as gaze and arrows, respectively) share their ability to trigger attentional processes, although the issue of whether social stimuli generate other additional (and unique) attentional effects is still under debate. In this study, we used the spatial interference paradigm to explore, using functional magnetic resonance imaging, shared and dissociable brain activations produced by gaze and arrows. Results showed a common set of regions (right parieto-temporo-occipital) similarly involved in conflict resolution for gaze and arrows stimuli, which showed stronger co-activation for incongruent than congruent trials. The frontal eye field showed stronger functional connectivity with occipital regions for congruent as compared with incongruent trials, and this effect was enhanced for gaze as compared with arrow stimuli in the right hemisphere. Moreover, spatial interference produced by incongruent (as compared with congruent) arrows was associated with increased functional coupling between the right frontal eye field and a set of regions in the left hemisphere. This result was not observed for incongruent (as compared with congruent) gaze stimuli. The right frontal eye field also showed greater coupling with left temporo-occipital regions for those conditions in which larger conflict was observed (arrow incongruent vs. gaze incongruent trials, and gaze congruent vs. arrow congruent trials). These findings support the view that social and nonsocial stimuli share some attentional mechanisms, while at the same time highlighting other differential effects. Highlights Attentional orienting triggered by social (gaze) and nonsocial (arrow) cues is comparable. When social and nonsocial stimuli are used as targets, qualitatively different behavioral effects are observed. This study explores the neural bases of shared and dissociable neural mechanisms for social and nonsocial stimuli. Shared mechanisms were found in the functional coupling between right parieto-temporo-occipital regions. Dissociable mechanisms were found in the functional coupling between right frontal eye field and ipsilateral and contralateral occipito-temporal regions.

The Time Course of Information Processing During Eye Direction Perception

Gaze directed at the observer (direct gaze) is a highly salient social signal. Despite the existence of a preferential orientation toward direct gaze, none of the studies carried out so far seem to have explicitly studied the time course of information processing during gaze direction judgment. In an eye direction judgment task, participants were presented with a sketch of a face. A temporal asynchrony was introduced between the presentation of the eyes and that of the rest of the face. Indeed, the face could be presented before the eyes, the eyes could be presented before the face, or the face and the eyes could be presented simultaneously. In a second time, the face direction was also manipulated. The results suggest that the time course of information processing during eye direction judgment follows a continuum that makes it possible to perceive the eyes first and then to use the facial context to judge the direction of gaze. Furthermore, the congruency between the direction of gaze and that of the face confirms this observation. Although these results are discussed in the light of existing theories about the mechanisms underlying gaze processing, our data provide new information suggesting that, despite their power to capture attention, the eyes probably have to stand out from a more general spatial configuration (i.e., the face) in order for their direction to be adequately processed.

Foot cues can elicit covert orienting of attention

Humans tend to orient their attentional resources towards the same location indicated by spatial signals coming from the others, such as pointing fingers, head turns, or eye-gaze. Here, two experiments investigated whether an attentional orienting response can be elicited even by foot cues. Participants were asked to localize a peripheral target while a task-irrelevant picture of a naked human foot, oriented leftward or rightward, was presented on the centre of the screen. The foot appeared in a neutral posture (i.e., standing upright) or an action-oriented posture (i.e., walking/running). In Experiment 1, neutral and action-oriented feet were presented in two distinct blocks, while in Experiment 2 they were presented intermixed. The results showed that the action-oriented foot, but not the neutral one, elicited an orienting response, though this only emerged in Experiment 2. This work suggests that attentional shifts can be induced by action-oriented foot cues, as long as these stimuli are made contextually salient.

Gaze-Triggered Communicative Intention Compresses Perceived Temporal Duration

Eye gaze communicates a person's attentional state and intentions toward objects. Here we demonstrate that this important social signal has the potential to distort time perception of gazed-at objects (N = 70 adults). By using a novel gaze-associated learning paradigm combined with the time-discrimination task, we showed that objects previously associated with others' eye gaze were perceived as significantly shorter in duration than the nonassociated counterparts. The time-compression effect cannot be attributed to general attention allocation because it disappeared when objects were associated with nonsocial attention cues (i.e., arrows). Critically, this effect correlated with observers' autistic traits and vanished when the gazing agent's line of sight was blocked by barriers, reflecting the key role of intention processing triggered by gaze in modulating time perception. Our findings support the existence of a special mechanism tuned to social cues, which can shape our perception of the outer world in time domains.

Social attention patterns of autistic and non-autistic adults when viewing real versus reel people

LAY ABSTRACT

Early research shows that autistic adults do not attend to faces as much as non-autistic adults. However, some recent studies where autistic people are placed in scenarios with real people reveal that they attend to faces as much as non-autistic people. This study compares attention to faces in two situations. In one, autistic and non-autistic adults watched a pre-recorded video. In the other, they watched what they thought were two people in a room in the same building, via a life webcam, when in fact exactly the same video in two situations. We report the results of 32 autistic adults and 33 non-autistic adults. The results showed that autistic adults do not differ in any way from non-autistic adults when they watched what they believed was people interacting in real time. However, when they thought they were watching a video, non-autistic participants showed higher levels of attention to faces than non-autistic participants. We conclude that attention to social stimuli is the result of a combination of two processes. One innate, which seems to be different in autism, and one that is influenced by social norms, which works in the same way in autistic adults without learning disabilities. The results suggest that social attention is not as different in autism as first thought. Specifically, the study contributes to dispel long-standing deficit models regarding social attention in autism as it points to subtle differences in the use of social norms rather than impairments.

Predicting the attention of others

As social animals, people are highly sensitive to the attention of others. Seeing someone else gaze at an object automatically draws one's own attention to that object. Monitoring the attention of others aids in reconstructing their emotions, beliefs, and intentions and may play a crucial role in social alignment. Recently, however, it has been suggested that the human brain constructs a predictive model of other people's attention that is far more involved than a moment-by-moment monitoring of gaze direction. The hypothesized model learns the statistical patterns in other people's attention and extrapolates how attention is likely to move. Here, we tested the hypothesis of a predictive model of attention. Subjects saw movies of attention displayed as a bright spot shifting around a scene. Subjects were able to correctly distinguish natural attention sequences (based on eye tracking of prior participants) from altered sequences (e.g., played backward or in a scrambled order). Even when the attention spot moved around a blank background, subjects could distinguish natural from scrambled sequences, suggesting a sensitivity to the spatial-temporal statistics of attention. Subjects also showed an ability to recognize the attention patterns of different individuals. These results suggest that people possess a sophisticated model of the normal statistics of attention and can identify deviations from the model. Monitoring attention is therefore more than simply registering where someone else's eyes are pointing. It involves predictive modeling, which may contribute to our remarkable social ability to predict the mind states and behavior of others.

Decreased frontal lobe complexity in left-behind children during joint attention: a fNIRS study with multivariable and multiscale sample entropy analysis

Human brain development is shaped by experiences, especially during preschool, the critical period for cognitive and socioemotional development. This study employed the functional Near-Infrared Spectroscopy technique to explore the neural differences between left-behind children (LBC) and non-left-behind children (NLBC) on joint attention. Through collecting brain image data of 50 children (26 boys, aged 65.08 ± 6.28 months) and conducting multivariable and multiscale sample entropy (MMSE) analysis, the present study found that: (i) LBC showed lower brain complexity than NLBC in right prefrontal cortex; (ii) all participants demonstrated higher brain complexity in responding to joint attention conditions, compared to initiating joint attention ones; (iii) their brain complexity during joint attention was negatively associated with their emotional abilities. The findings advance our understanding of early brain development in LBC by providing evidence for the neural process characteristics of joint attention. Implications for early intervention to promote their brain development are also addressed.

Attentional switch to memory: An early and critical phase of the cognitive cascade allowing autobiographical memory retrieval

Remembering and mentally reliving yesterday's lunch is a typical example of episodic autobiographical memory retrieval. In the present review, we reappraised the complex cascade of cognitive processes involved in memory retrieval, by highlighting one particular phase that has received little interest so far: attentional switch to memory (ASM). As attention cannot be simultaneously directed toward external stimuli and internal memories, there has to be an attentional switch from the external to the internal world in order to initiate memory retrieval. We formulated hypotheses and developed hypothetical models of both the cognitive and brain processes that accompany ASM. We suggest that gaze aversion could serve as an objective temporal marker of the point at which people switch their attention to memory, and highlight several fields (neuropsychology, neuroscience, social cognition, comparative psychology) in which ASM markers could be essential. Our review thus provides a new framework for understanding the early stages of autobiographical memory retrieval.

Machine learning for distinguishing saudi children with and without autism via eye-tracking data

BACKGROUND

Despite the prevalence of Autism Spectrum Disorder (ASD) globally, there's a knowledge gap pertaining to autism in Arabic nations. Recognizing the need for validated biomarkers for ASD, our study leverages eye-tracking technology to understand gaze patterns associated with ASD, focusing on joint attention (JA) and atypical gaze patterns during face perception. While previous studies typically evaluate a single eye-tracking metric, our research combines multiple metrics to capture the multidimensional nature of autism, focusing on dwell times on eyes, left facial side, and joint attention.

METHODS

We recorded data from 104 participants (41 neurotypical, mean age: 8.21 ± 4.12 years; 63 with ASD, mean age 8 ± 3.89 years). The data collection consisted of a series of visual stimuli of cartoon faces of humans and animals, presented to the participants in a controlled environment. During each stimulus, the eye movements of the participants were recorded and analyzed, extracting metrics such as time to first fixation and dwell time. We then used these data to train a number of machine learning classification algorithms, to determine if these biomarkers can be used to diagnose ASD.

RESULTS

We found no significant difference in eye-dwell time between autistic and control groups on human or animal eyes. However, autistic individuals focused less on the left side of both human and animal faces, indicating reduced left visual field (LVF) bias. They also showed slower response times and shorter dwell times on congruent objects during joint attention (JA) tasks, indicating diminished reflexive joint attention. No significant difference was found in time spent on incongruent objects during JA tasks. These results suggest potential eye-tracking biomarkers for autism. The best-performing algorithm was the random forest one, which achieved accuracy = 0.76 ± 0.08, precision = 0.78 ± 0.13, recall = 0.84 ± 0.07, and F1 = 0.80 ± 0.09.

CONCLUSIONS

Although the autism group displayed notable differences in reflexive joint attention and left visual field bias, the dwell time on eyes was not significantly different. Nevertheless, the machine algorithm model trained on these data proved effective at diagnosing ASD, showing the potential of these biomarkers. Our study shows promising results and opens up potential for further exploration in this under-researched geographical context.

Neuropragmatics: A scientometric review

Neuropragmatics investigates brain functions and neural activities responsible for pragmatic language abilities, often impaired in disorders such as hemisphere damage, autism, schizophrenia, and neurodegenerative disorders. This study examined the development of neuropragmatics and existing neuroimaging evidence using bibliometric and scientometric indicators, analyzing 4,247 documents published between 1967 and 2022 with CiteSpace and VOSviewer. Our cluster analysis revealed key themes. 1) Language comprehension loss due to brain injury: Studies exploring the impact of brain injuries on language comprehension and underlying neural mechanisms. 2) Right hemisphere damage and pragmatic language skills: Research focusing on the relationship between right hemisphere damage and pragmatic language abilities, investigating impairments in social language use and potential neural correlates. 3) Traumatic brain injury and social communication assessment: Research on traumatic brain injury effects on social communication skills, using various assessment tools to evaluate communication effectiveness in social situations. These clusters provide valuable insights into the neuropragmatics field and serve as a framework for future investigations. By building upon existing knowledge, researchers can improve our understanding of brain functions, language behavior, and enhance rehabilitation for individuals with pragmatic language impairments.