The role of attention in a joint-action effect

Attention allocation in complementary joint action: How joint goals affect spatial orienting

When acting jointly, individuals often attend and respond to the same object or spatial location in complementary ways (e.g., when passing a mug, one person grasps its handle with a precision grip; the other receives it with a whole-hand grip). At the same time, the spatial relation between individuals' actions affects attentional orienting: one is slower to attend and respond to locations another person previously acted upon than to alternate locations ("social inhibition of return", social IOR). Achieving joint goals (e.g., passing a mug), however, often requires complementary return responses to a co-actor's previous location. This raises the question of whether attentional orienting, and hence the social IOR, is affected by the (joint) goal our actions are directed at. The present study addresses this question. Participants responded to cued locations on a computer screen, taking turns with a virtual co-actor. They pursued either an individual goal or performed complementary actions with the co-actor, in pursuit of a joint goal. Four experiments showed that the social IOR was significantly modulated when participant and co-actor pursued a joint goal. This suggests that attentional orienting is affected not only by the spatial but also by the social relation between two agents' actions. Our findings thus extend research on interpersonal perception-action effects, showing that the way another agent's perceived action shapes our own depends on whether we share a joint goal with that agent.

Biological motion elicits between-person Inhibition of Return in temporal and spatial movement parameters

The present study was designed to gain a deeper understanding of the processing of biological motion stimuli. To this end, we investigated if the inhibition of return (IoR) effect emerges in initiation times and trajectories of pointing movements to targets in left and right space where the preceding cues were pointing movement of a human model or a dot with the same biological motion. Targets were randomly presented in the same or opposite side from the direction of the motion cue. It was hypothesised that the visuomotor system should resonate with the biological motion of a dot, but that the human model should exaggerate the effect. Thus, the human model should trigger stronger attention shifts compared with the dot model and lead to more robust IoR effects in both spatial (movement) and temporal parameters of the observer's pointing responses. Initiation times and the spatial parameters (angle of the hand trajectory) of the pointing movements were analysed. Results indicate that facilitation and IoR effects triggered by human and dot stimuli did not differ. Based on these findings, it seems that the crucial feature of motion cues that generate shifts in attention is biological motion, rather than human appearance per se.

The role of transients in action observation

A large number of studies have now described the various ways in which the observation of another person's dynamic movement can influence the speed with which the observer is able to prepare a motor action themselves. The typical results are most often explained with reference to theories that link perception and action. Such theories argue that the cognitive structures associated with each share common representations. Consequently, action preparation and action observation are often said to be functionally equivalent. However, the dominance of these theories in explaining action observation effects has masked the potential contribution from processes associated with the detection of low-level "transients" resulting from observing a body movement, such as motion and sound. In the present review, we describe work undertaken in one particular action observation phenomenon ("social inhibition of return") and show that the transient account provides the best explanation of the effect. We argue that future work should consider attention capture and orienting as a potential contributing factor to action observation effects more broadly.

Attribution of vision and knowledge in 'spontaneous perspective taking'

Theory of mind is a ubiquitous notion that permeates many aspects of social cognition. A recent application has been in the context of 'spontaneous perspective taking' in which responses to target stimuli are facilitated if a human agent, present in a display, sees the same stimuli as an experimental participant. In the present work, we replicated results from a paradigm purporting to show such perspective taking in which participants tend to judge an ambiguous number from the position of an agent. We find, however (in Experiment 1) that this effect still occurs even when the agent cannot see the number due to an occluding object. This, therefore, does not support the perspective-taking hypothesis. An alternative explanation to the theory of mind account is posited in which the agent acts as a reference point that cues the observer to view the critical stimuli from that position and in the direction to which the agent faces. We test this hypothesis in Experiments 2 and 3, and show that non-human reference points can generate perspective-taking-like data. Overall, these results do not support the theory of mind account of previous studies.

Visual attention and action: How cueing, direct mapping, and social interactions drive orienting

Despite considerable interest in both action perception and social attention over the last 2 decades, there has been surprisingly little investigation concerning how the manual actions of other humans orient visual attention. The present review draws together studies that have measured the orienting of attention, following observation of another's goal-directed action. Our review proposes that, in line with the literature on eye gaze, action is a particularly strong orienting cue for the visual system. However, we additionally suggest that action may orient visual attention using mechanisms, which gaze direction does not (i.e., neural direct mapping and corepresentation). Finally, we review the implications of these gaze-independent mechanisms for the study of attention to action. We suggest that our understanding of attention to action may benefit from being studied in the context of joint action paradigms, where the role of higher level action goals and social factors can be investigated.

"Two Minds Don't Blink Alike": The Attentional Blink Does Not Occur in a Joint Context

Typically, when two individuals perform a task together, each partner monitors the other partners' responses and goals to ensure that the task is completed efficiently. This monitoring is thought to involve a co-representation of the joint goals and task, as well as a simulation of the partners' performance. Evidence for such "co-representation" of goals and task, and "simulation" of responses has come from numerous visual attention studies in which two participants complete different components of the same task. In the present research, an adaptation of the attentional blink task was used to determine if co-representation could exert an influence over the associated attentional mechanisms. Participants completed a rapid serial visual presentation task in which they first identified a target letter (T1) and then detected the presence of the letter X (T2) presented one to seven letters after T1. In the individual condition, the participant identified T1 and then detected T2. In the joint condition, one participant identified T1 and the other participant detected T2. Across two experiments, an attentional blink (decreased accuracy in detecting T2 when presented three letters after T1) was observed in the individual condition, but not in joint conditions. A joint attentional blink may not emerge because the co-representation mechanisms that enable joint action exert a stronger influence at information processing stages that do not overlap with those that lead to the attentional blink.

Pointing out mechanisms underlying joint action

Recent studies have shown that spatial and feature-based attention can contribute to inducing a spatial compatibility effect in both the standard Simon task and the joint Simon task. Less work generally has been devoted to investigating how attention modulates spatial compatibility effects. In the present study, we aimed to explore whether indirectly manipulating the degree of attention necessary to respond to a compatible or an incompatible stimulus can modulate the spatial compatibility effect in a joint Simon task and elicit a compatibility effect in the individual go-no-go Simon task. To this end, we biased spatial attention to the compatible stimulus by asking participants to perform a pointing response always toward the compatible side, regardless of the stimulus location. Crucially, reaction times-recorded at gesture onset-showed a compatibility effect pattern in the individual condition and an additional modulation in the joint condition. These results show that the spatial attention intrinsic to action planning can affect both individual and joint Simon tasks.

Dynamics of Social Interaction: Kinematic Analysis of a Joint Action

Non-verbal social interaction between humans requires accurate understanding of the others’ actions. The cognitivist approach suggests that successful interaction depends on the creation of a shared representation of the task, where the pairing of perceptive and motor systems of partners allows inclusion of the other’s goal into the overarching representation. Activity of the Mirror Neurons System (MNS) is thought to be a crucial mechanism linking two individuals during a joint action through action observation. The construction of a shared representation of an interaction (i.e., joint action) depends upon sensorimotor cognitive processes that modulate the ability to adapt in time and space. We attempted to detect individuals’ behavioral/kinematic change resulting in a global amelioration of performance for both subjects when a common representation of the action is built using a repetitive joint action. We asked pairs of subjects to carry out a simple task where one puts a base in the middle of a table and the other places a parallelepiped fitting into the base, the crucial manipulation being that participants switched roles during the experiment. We aimed to show that a full comprehension of a joint action is not an automatic process. We found that, before switching the interactional role, the participant initially placing the base orientated it in a way that led to an uncomfortable action for participants placing the parallelepiped. However, after switching roles, the action’s kinematics by the participant who places the base changed in order to facilitate the action of the other. More precisely, our data shows significant modulation of the base angle in order to ease the completion of the joint action, highlighting the fact that a shared knowledge of the complete action facilitates the generation of a common representation. This evidence suggests the ability to establish an efficient shared representation of a joint action benefits from physically taking our partner’s perspective because simply observing the actions of others may not be enough.

A role of goals for social inhibition of return?

The social inhibition of return (sIOR) effect refers to the finding that response initiation times are longer if a movement is executed to a location where another person has responded to just before. Previous studies have examined the influence of the goal of the action on sIOR. In these studies, however, the movement endpoint and to-be-attained goal (e.g., touching/pressing a response key) were at the same spatial location. In the present two experiments, we disentangled movement endpoint and goal's identity and locations by means of introducing action effects that followed directly from a movement. Similar methods were previously shown powerful enough to clearly show the importance of action goals for other phenomena—a finding consistent with effect-based theories of action control, such as the ideomotor theory. The results of the present study revealed that sIOR was shaped by the movement endpoint location, not the goal's identity or location. That is, in both experiments, an sIOR effect was observed, but the magnitude of the sIOR effect was not modulated by repetitions/switches of goals or their locations. Thus, results indicate that goals play a negligible role in the emergence of the sIOR and, consequently, highlight the importance of action observation for the emergence of the sIOR effect.

Neural correlates of verbal joint action: ERPs reveal common perception and action systems in a shared-Stroop task

Recent social-cognitive research suggests that the anticipation of co-actors' actions influences people's mental representations. However, the precise nature of such representations is still unclear. In this study we investigated verbal joint representations in a delayed Stroop paradigm, where each participant responded to one color after a short delay. Participants either performed the task as a single actor (single-action, Experiment 1), or they performed it together (joint-action, Experiment 2). We investigated effects of co-actors' actions on the ERP components associated with perceptual conflict (Go N2) and response selection (P3b). Compared to single-action, joint-action reduced the N2 amplitude congruency effect when participants had to respond (Go trials), indicating that representing a co-actor's utterance helped to dissociate action codes and attenuated perceptual conflict for the responding participant. Yet, on NoGo trials the centro-parietal P3 (P3b) component amplitude increased for joint-action, suggesting that participants mapped the stimuli onto the co-actor's upcoming response as if it were their own response. We conclude that people represent others' utterances similarly to the way they represent their own utterances, and that shared perception-action codes for self and others can sometimes reduce, rather than enhance, perceptual conflict.

The Medial Frontal Cortex Mediates Self-Other Discrimination in the Joint Simon Task

Abstract. Interacting with other individuals confronts cognitive control systems with the problem of how to distinguish between self-generated (internally triggered) and other-generated (externally triggered) action events. Recent neuroscience studies identified two core brain regions, the anterior medial frontal cortex (aMFC) and the right temporo-parietal junction (rTPJ), to be potentially involved in resolving this problem either by enhancing self-generated versus other-generated event representations (via aMFC) and/or by inhibiting event representations that are externally triggered (via rTPJ). Using transcranial direct current stimulation (tDCS), we investigated the role of the aMFC and the rTPJ for the online control of self-generated versus other-generated event representations in a joint Simon task. In two experimental sessions, participants received anodal, cathodal, or sham tDCS (1 mA intensity applied for 20 min), while performing an auditory joint Simon task. In addition to a general performance enhancement during cathodal (inhibitory) and anodal (excitatory) stimulation with increased practice, we found a significantly increased joint Simon effect (JSE) during cathodal stimulation of the aMFC (Experiment 1), as compared to sham stimulation. No modulation of the JSE was found during stimulation of the rTPJ (Experiment 2). By enhancing self-generated event representations the aMFC seems to be crucially involved in resolving the self-other discrimination problem in the joint Simon task.