Spontaneous visual perspective-taking with constant attention cue: A modified dot-perspective task paradigm

It has been argued that humans can employ mentalizing implicitly and automatically, even with others' visual experiences. In terms of visual perspective-taking (i.e., inferring another's visual experience), the Dot Perspective Task has been considered to provide evidence for this hypothesis. People were found to respond slower when their visual experience was inconsistent with others' (referred to as the consistency effect). However, the specific underlying cognitive process of the consistency effect has been a topic of intense debate, i.e., whether the consistency effect represents a process of social cognition such as mentalizing. Here, we introduce a modified version of the Dot Perspective Task, in which all the targets appear at the position where the avatar is gazing, while some of the targets are invisible to the avatar due to a barrier that may block the avatar's line of sight. Therefore, the effect of perspective-taking and attention-cueing can be better disassociated in the modified paradigm. The results of Experiment 1 illustrated a significant consistency effect, which was further confirmed in Experiment 2. More importantly, the consistency effect was absent in Experiment 3, where the avatar sat with his back to the participants. These findings imply that the consistency effect reflects the automatic computation of others' visual information, and rule out the attention-cueing account of the consistency effect.

Manipulating avatar age and gender in level-2 visual perspective taking

Visual perspective taking (VPT) represents how the world appears from another person's position. The age, group status and emotional displays of the other person have been shown to affect task performance, but tasks often confound social and spatial outcome measures by embedding perspective taking in explicitly social contexts or theory-of-mind reasoning. Furthermore, while previous research has suggested that visual perspective taking may be impacted by avatar characteristics, it is unknown whether this is driven by general group processing or a specific deficit in mentalizing about outgroups, for example, children. Therefore, using a minimally social task (i.e., the task was not communicative, and acknowledging the "mind" of the avatar was not necessitated), we examined whether avatar age and avatar gender affect performance on simpler (low angular disparity) and more effortful, embodied (high angular disparity) perspective judgments. Ninety-two participants represented the visuospatial perspectives of a boy, girl, man, or woman who were presented at various angular disparities. A target object was placed in front of the avatar and participants responded to the orientation of the object from the avatar's position. The findings suggest that social features of visuospatial perspective taking (VSPT) are processed separately from the fundamental spatial computations. Further, Level-2 VSPT appears to be affected by general group categorization (e.g., age and gender) rather than a deficit in mentalizing about a specific outgroup (e.g., children).

Both the domain-general and the mentalising processes affect visual perspective taking

People's attention cannot help being affected by what others are looking at. The dot-perspective task has been often employed to investigate this visual attentional shift. In this task, participants are presented with virtual scenes with a cue facing some targets and must judge how many targets are visible from their own or the cue perspective. Typically, this task shows an interference pattern: Participants record slower reaction times (RTs) and more errors when the cue is facing away from the targets. Interestingly, this occurs also when participants take their own perspective. Two accounts contend the explanation of this interference. The mentalising account focuses on the social relevance of the cue, while the domain-general account focuses on the directional features of the cue. To investigate the relative contribution of the two accounts, we developed a Social_Only cue, a cue having only social features and compared its effects with a Social+Directional cue, which had both social and directional features. Results show that while the Social+Directional cue generates the typical interference pattern, the Social_Only cue does not generate interference in the RTs, only in the error rate. We advance an integration between the mentalising and the domain-general accounts. We suggest that the dot-perspective task requires two processes: an orienting process, elicited by the directional features of the cue and measured by the RTs, and a decisional process elicited by the social features of the cue and measured also by the error rate.

Demonstrative systems: From linguistic typology to social cognition

This study explores the connection between language and social cognition by empirically testing different typological analyses of various demonstrative systems. Linguistic typology classifies demonstrative systems as distance-oriented or person-oriented, depending on whether they indicate the location of a referent relative only to the speaker, or to both the speaker and the listener. From the perspective of social cognition, speakers of languages with person-oriented systems must monitor their listener's spatial location in order to accurately use their demonstratives, while speakers of languages with distance-oriented systems can use demonstratives from their own, egocentric perspective. Resolving an ongoing controversy around the nature of the Spanish demonstrative system, the results of Experiment 1 confirmed that this demonstrative system is person oriented, while the English system is distance oriented. Experiment 2 revealed that not all three-way demonstrative systems are person oriented, with Japanese speakers showing sensitivity to the listener's spatial location, while Turkish speakers did not show such an effect in their demonstrative choice. In Experiment 3, Catalan-Spanish bilinguals showed sensitivity to listener position in their choice of the Spanish distal form, but not in their choice of the medial form. These results were interpreted as a transfer effect from Catalan, which revealed analogous results to English. Experiment 4 investigated the use of demonstratives to redirect a listener's attention to the intended referent, which is a universal function of demonstratives that also hinges on social cognition. Japanese and Spanish speakers chose between their proximal and distal demonstratives flexibly, depending on whether the listener was looking closer or further from the referent, whereas Turkish speakers chose their medial form for attention correction. In conclusion, the results of this study support the view that investigating how speakers of different languages jointly use language and social cognition in communication has the potential to unravel the deep connection between these two fundamentally human capacities.

The self-consistency effect seen on the Dot Perspective Task is a product of domain-general attention cueing, not automatic perspective taking

It has been proposed that humans automatically compute the visual perspective of others. Evidence for this view comes from the Dot Perspective Task. In this task, participants view a room in which a human actor is depicted, looking either leftwards or rightwards. Dots can appear on either the left wall of the room, the right wall, or both. At the start of each trial, participants are shown a number. Their speeded task is to decide whether the number of dots visible matches the number shown. On consistent trials the participant and the actor can see the same number of dots. On inconsistent trials, the participant and the actor can see a different number of dots. Participants respond faster on consistent trials than on inconsistent trials. This self-consistency effect is cited as evidence that participants compute the visual perspective of others automatically, even when it impedes their task performance. According to a rival interpretation, however, this effect is a product of attention cueing: slower responding on inconsistent trials simply reflects the fact that participants' attention is directed away from some or all of the to-be-counted dots. The present study sought to test these rival accounts. We find that desk fans, a class of inanimate object known to cue attention, also produce the self-consistency effect. Moreover, people who are more susceptible to the effect induced by fans tend to be more susceptible to the effect induced by human actors. These findings suggest that the self-consistency effect is a product of attention cueing.

EXPRESS: Is Implicit Level-2 Visual perspective taking embodied? Spontaneous perceptual simulation of others' perspectives is not impaired by motor restriction

Visual perspective taking may rely on the ability to mentally rotate one's own body into that of another. Here we test whether participants' ability to make active body movements plays a causal role in visual perspective taking. We utilized our recent task that measures whether participants spontaneously represent another's visual perspective in a (quasi-)perceptual format that can drive own perceptual decision making. Participants reported whether alphanumeric characters, presented in different orientations, are shown in their normal or mirror-inverted form (e.g., "R" vs. "Я"). Between trials, we manipulated whether another person was sitting either left or right of the character and whether participants' movement was restricted with a chin rest or they could move freely. As in our previous research, participants spontaneously took the visual perspective of the other person, recognizing rotated letters more rapidly when they appeared upright to the other person in the scene, compared to when they faced away from that person, and these effects increased with age but were (weakly) negatively related to Schizotypy and not to autistic traits or social skills. Restricting participants' ability to make active body movements did not influence these effects. The results therefore rule out that active physical movement plays a causal role in computing another's visual perspective, either to create alignment between own and other's perspective or to trigger perspective-taking processes. The postural adjustments people sometimes make when making judgements from another's perspective may instead be a bodily consequence of mentally transforming one's actual to an imagined position in space.

Effects of non-invasive brain stimulation on visual perspective taking: A meta-analytic study

Visual perspective taking (VPT) is a critical ability required by complex social interaction. Non-invasive brain stimulation (NIBS) has been increasingly used to examine the causal relationship between brain activity and VPT, yet with heterogeneous results. In the current study, we conducted two meta-analyses to examine the effects of NIBS of the right temporoparietal junction (rTPJ) or dorsomedial prefrontal cortex (dmPFC) on VPT, respectively. We performed a comprehensive literature search to identify qualified studies and computed the standardized effect size (ES) for each combination of VPT level (Level-1: visibility judgment; Level-2: mental rotation) and perspective (self and other). Thirteen studies (rTPJ: 12 studies, 23 ESs; dmPFC: 4 studies, 14 ESs) were included in the meta-analyses. Random-effects models were used to generate the overall effects. Subgroup analyses for distinct VPT conditions were also performed. We found that rTPJ stimulation significantly improved participants' visibility judgment from the allocentric perspective, whereas its effects on other VPT conditions are negligible. Stimulation of dmPFC appeared to influence Level-1 performance from the egocentric perspective, although this finding was only based on a small number of studies. Notably, contrary to some theoretical models, we did not find strong evidence that these regions are involved in Level-2 VPT with a higher requirement of mental rotation. These findings not only advance our understanding of the causal roles of the rTPJ and dmPFC in VPT, but also reveal that the efficacy of NIBS on VPT is relatively small. Additionally, researchers should also be cautious about the potential publication bias and selective reporting.

No evidence for automatic response activation with target onset in the avatar-compatibility task

When people take the perspective of an avatar and perform a stimulus-response compatibility task, they generally show the same compatibility effects that are expected from the avatar's position instead of their own. In this study, we investigated if these effects are caused by automatic response activation, a concept featured in dual-route models of stimulus-response compatibility. In two experiments we asked 24 participants each to perform a compatibility task from an avatar's point of view. We introduced a delay between the presentation of the target and the avatar in half of the trials so that the participants had to wait until the avatar appeared to select the correct response. Because the automatic response activation is known to decay quickly, its influence is eliminated in this condition. In contrast to the prediction by the automatic response activation account, we observed a larger compatibility effect in the delayed condition with orthogonal (Experiment 1) and parallel (Experiment 2) stimulus-response pairings. Additionally, distributional analyses of the compatibility effects did not support the automaticity predictions. We conclude that these results call into question the role of automatic response activation for spatial compatibility in general and perspective-based compatibility effects in particular.

Inferring hidden objects from still and communicative onlookers at 8, 14, and 36 months of age

The current study investigated across five eye-tracking experiments children's developing skill of adopting others' referential perspective (Level 1 perspective taking) and to what extent it involves automatic processes or requires ostensive communicative cues. Three age groups (8-, 14-, and 36-month-olds) were tested on their expectation of an object appearing behind one of two peripheral occluders. A centrally presented person in profile either provided an ostensive communicative pointing cue or sat still, oriented to one of the two occluders. The 14-month-olds anticipated the hidden object when the onlooker had communicatively pointed to the location, as revealed by faster target detection in congruent trials (latency effect) and longer dwell times to the empty side in incongruent trials (violation-of-expectation effect). This was not the case when a still person was only oriented to one side. Adding emotional expressions to the still person (Experiment 2) did not help to produce the effects. However, at 36 months of age (Experiment 3), children showed both effects for the still person. The 8-month-olds did not show the violation-of-expectation effect for communicative pointing (Experiment 4) or for a matched abbreviated reach (Experiment 5b), showing it only for a complete reach behind the occluder (Experiment 5a), although they were faster to detect the congruent object in Experiment 4 and 5a. Findings reveal that automatic perspective taking develops after communicative perspective taking and that communicative perspective taking is a developmental outcome of the first year of life. The developmental pattern suggests a continuous social construction process of perspective-taking skills.

Exploring neurophysiological markers of visual perspective taking: Methodological considerations

RATIONALE

For visual perspective taking (VPT) using the avatar task, examinations of neural processes using event related potentials (ERP) indicate a distinction between an early posterior perspective calculation process (P3) and a later frontal process (LFSW) managing perspective conflict. While it is unknown if these neural processes are affected in clinical populations, it is unclear if the avatar task can be applied to this group, due to the long duration and sensitivity to data loss. Thus, we performed a methodological study of the avatar task, testing the feasibility of a shortened experimental paradigm.

OBJECTIVE

To investigate whether previously reported behavioural and ERP effects in the avatar task can also be seen if analysing all trials (matching/non-matching) jointly, and whether they remain robust if only a subset of the data is analysed.

METHOD

Healthy individuals (n = 20) completed the avatar task with ERP measurement. ERP components (P3, LFSW) and behavioural data were investigated by A) comparing use of only matching trials (n = 384) versus all trials (n = 768), and B) examining if reduced duration of assessment, by analysing only a subset of the data, impacts ERP findings.

RESULTS

We observed minimal differences when analysing data from only matching trial types compared to all trial types. Further, ERP amplitudes and latency findings were replicated when analysing only a subset of the data.

CONCLUSIONS

The duration of the avatar task can be reduced to avoid long testing times, thus making it better suited for use in clinical populations.

Perspective taking as virtual navigation? Perceptual simulation of what others see reflects their location in space but not their gaze

Other peoples' (imagined) visual perspectives are represented perceptually in a similar way to our own, and can drive bottom-up processes in the same way as own perceptual input (Ward, Ganis, & Bach, 2019). Here we test directly whether visual perspective taking is driven by where another person is looking, or whether these perceptual simulations represent their position in space more generally. Across two experiments, we asked participants to identify whether alphanumeric characters, presented at one of eight possible orientations away from upright, were presented normally, or in their mirror-inverted form (e.g. "R" vs. "Я"). In some scenes, a person would appear sitting to the left or the right of the participant. We manipulated either between-trials (Experiment 1) or between-subjects (Experiment 2), the gaze-direction of the inserted person, such that they either (1) looked towards the to-be-judged item, (2) averted their gaze away from the participant, or (3) gazed out towards the participant (Exp. 2 only). In the absence of another person, we replicated the well-established mental rotation effect, where recognition of items becomes slower the more items are oriented away from upright (e.g. Shepard and Meltzer, 1971). Crucially, in both experiments and in all conditions, this response pattern changed when another person was inserted into the scene. People spontaneously took the perspective of the other person and made faster judgements about the presented items in their presence if the characters were oriented towards upright to them. The gaze direction of this other person did not influence these effects. We propose that visual perspective taking is therefore a general spatial-navigational ability, allowing us to calculate more easily how a scene would (in principle) look from another position in space, and that such calculations reflect the spatial location of another person, but not their gaze.

Lack of implicit visual perspective taking in adult males with autism spectrum disorders

BACKGROUND

Some theorists have suggested that the ability of visual perspective-taking (VPT) constitutes a rudimentary process of social cognition, and as such, the ability of VPT in people with autism spectrum disorder (ASD) has been the focus of intensive research.

AIM

The present study investigated whether adult males with ASD show signs of implicit VPT in first-level VPT tasks, in which participants were required to judge whether a target object can be seen from another's perspective, even when they are not explicitly required to take another's perspective.

METHODS AND PROCEDURES

We examined whether the information from another's visual perspective interferes with visual processing from the participant's own perspective ("altercentric interference") using the reaction time as the main performance indicator in adult males with or without ASD. Eye movement patterns during VPT were analyzed for some participants.

OUTCOMES AND RESULTS

The results revealed signs of altercentric interference in neurotypical adults, but not in adult males with ASD.

CONCLUSIONS AND IMPLICATIONS

The results indicate the possibility that people with ASD may rely on a different strategy than neurotypical adults in completing a first-level VPT task.

Common and unique effects of HD-tDCS to the social brain across cultural groups

Cultural background influences social cognition, however no study has examined brain stimulation differences attributable to cultural background. 104 young adults [52 South-East Asian Singaporeans (SEA); 52 Caucasian Australians (CA)] received anodal high-definition transcranial direct current stimulation (HD-tDCS) to the dorsomedial prefrontal cortex (dmPFC) or the right temporoparietal junction (rTPJ). Participants completed tasks with varying demands on self-other processing including visual perspective taking (VPT)and episodic memory with self and other encoding. At baseline, SEA showed greater self-other integration than CA in the level one (line-of-sight) VPT task as indexed by greater interference from the alternate perspective. Anodal HD-tDCS to the dmPFC resulted in the CA performing closer to the SEA during egocentric perspective judgements. Baseline performance on level two (embodied rotation) VPT task and the self-reference effect (SRE) in episodic memory was comparable between the two groups. In the combined sample, HD-tDCS to the rTPJ decreased the interference from the egocentric perspective during level two VPT and dmPFC HD-tDCS removed the SRE in episodic memory. Stimulation effects were comparable when baseline performance was comparable. When baseline performance differed, stimulation differences were identified. Therefore, social cognitive differences due to cultural background are an important consideration in social brain stimulation studies.

Modulation of behavioral and brain responses to visual perspective taking by social rejection: Evidence from electrophysiology

Visual perspective taking (VPT) is crucial for reasoning about other people's mental states. To explore the modulation of behavioral and neural responses to visual perspective taking by social rejection, we firstly manipulated rejection using get-acquainted oral communication and a two-person visual perspective task, then explored how the experience of social rejection affected the behavioral and neural responses during the follow-up classical one-person visual perspective task. The subjective rating and behavior results showed that social rejection increased individuals' negative affect level and feelings of need-threat, decreased self-regulation and impulsive control. The event-related potentials (ERP) and standardized low resolution brain electromagnetic tomography (sLORETA) results mainly showed that the increased parietal late slow wave (LSW) showed greater activities in SPL and rTPJ after social rejection. Moreover, compared with making judgments from self-perspective, making judgments from other-perspective yielded later TP450 and greater late frontal wave (LFW). In addition, the left LFW of socially rejected group showed more positive amplitude for other-inconsistent condition than that for other-consistent condition. These results suggested that social rejection might decrease impulsive control behaviorally, as well as increase neural processing of perspective taking, including visual-spatial perspective taking (indexed by the LSW), calculating of the self and other perspectives (indexed by the TP450), and processing of others' visual perspectives (indexed by the LFW). Our findings provide powerful evidence on neural mechanism underlying how social rejection modulates visual perspective taking, and support the model of social monitoring system, in that socially rejected individuals motivate to attend more carefully to social cues, such as other people's perspective.

Dissociating processes underlying level-1 visual perspective taking in adults

Although reasoning about other people's mental states has typically been thought to require effortful deliberation, evidence from indirect measures suggests that people may implicitly track others' perspectives, spontaneously calculating what they see and know. We used a process-dissociation approach to investigate the unique contributions of automatic and controlled processes to level-1 visual perspective taking in adults. In Experiment 1, imposing time pressure reduced the ability to exert control over one's responses, but it left automatic processing of a target's perspective unchanged. In Experiment 2, automatic processing of a target's perspective was greater when the target was a human avatar versus a non-social entity, whereas controlled processing was relatively unaffected by the specific target. Our findings highlight the utility of a process-dissociation approach for increasing theoretical precision and generating new questions about the nature of perspective taking.

Eye tracking reveals the cost of switching between self and other perspectives in a visual perspective-taking task

Previous studies have shown that while people can rapidly and accurately compute their own and other people's visual perspectives, they experience difficulty ignoring the irrelevant perspective when the two perspectives differ. We used the "avatar" perspective-taking task to examine the mechanisms that underlie these egocentric (i.e., interference from their own perspective) and altercentric (i.e., interference from the other person's perspective) tendencies. Participants were eye-tracked as they verified the number of discs in a visual scene according to either their own or an on-screen avatar's perspective. Crucially in some trials the two perspectives were inconsistent (i.e., each saw a different number of discs), while in others they were consistent. To examine the effect of perspective switching, performance was compared for trials that were preceded with the same versus a different perspective cue. We found that altercentric interference can be reduced or eliminated when participants stick with their own perspective across consecutive trials. Our eye-tracking analyses revealed distinct fixation patterns for self and other perspective taking, suggesting that consistency effects in this paradigm are driven by implicit mentalizing of what others can see, and not automatic directional cues from the avatar.

The behavioral urgency of objects approaching your avatar

The behavioral-urgency hypothesis (Franconeri & Simons, Psychological Science, 19, 686-692, 2003) states that dynamic visual properties capture human visual attention if they signal the need for immediate action. The seminal example is the potential collision of a looming object with one's body. However, humans are also capable of identifying with entities outside one's own body. Here we report evidence that behavioral urgency transfers to an avatar in a simple 2-D computer game. By controlling the avatar, the participant responded to shape changes of the target in a visual search task. Simultaneously, and completely irrelevant to the task, one of the objects on screen could move. Responses were overall fastest when the target happened to be the moving object and was on a collision course with the avatar, as compared to when the moving target just passed by the avatar or moved away from it. The effects on search efficiency were less consistent, except that search was more efficient overall whenever a target moved. Moreover, response speeding was frequently accompanied by an increase in errors, consistent with recent evidence that the urgency of looming is at least to a large extent expressed in response processes rather than in perceptual selection of the looming object. Thus, a general version of the behavioral-urgency hypothesis also holds for external entities with which the observer can identify.

Inclined to see it your way: Do altercentric intrusion effects in visual perspective taking reflect an intrinsically social process?

It has been suggested that some aspects of mental state understanding recruit a rudimentary, but fast and efficient, processing system, demonstrated by the obligatory slowing down of judgements about what the self can see when this is incongruent with what another can see. We tested the social nature of this system by investigating to what extent these altercentric intrusions are elicited under conditions that differed in their social relevance and, further, how these related to self-reported social perspective taking and empathy. In Experiment 1, adult participants were asked to make "self" or "other" perspective-taking judgements during congruent ("self" and "other" can see the same items) or incongruent conditions ("self" and "other" cannot see the same items) in conditions that were social (i.e., involving a social agent), semisocial (an arrow), or nonsocial (a dual-coloured block). Reaction time indices of altercentric intrusion effects were present across all conditions, but were significantly stronger for the social than for the less social conditions. Self-reported perspective taking and empathy correlated with altercentric intrusion effects in the social condition only. In Experiment 2, the significant correlations for the social condition were replicated, but this time with gaze duration indices of altercentric intrusion effects. Findings are discussed with regard to the degree to which this rudimentary system is socially specialized and how it is linked to more conceptual understanding.