Covert motor activity on NoGo trials in a task sharing paradigm: evidence from the lateralized readiness potential

Motor cortex activation during visuomotor transformations: evoked potentials during overt and imagined movements

Despite the prevalence of visuomotor transformations in our motor skills, their mechanisms remain incompletely understood, especially when imagery actions are considered such as mentally picking up a cup or pressing a button. Here, we used a stimulus-response task to directly compare the visuomotor transformation underlying overt and imagined button presses. Electroencephalographic activity was recorded while participants responded to highlights of the target button while ignoring the second, non-target button. Movement-related potentials (MRPs) and event-related desynchronization occurred for both overt movements and motor imagery (MI), with responses present even for non-target stimuli. Consistent with the activity accumulation model where visual stimuli are evaluated and transformed into the eventual motor response, the timing of MRPs matched the response time on individual trials. Activity-accumulation patterns were observed for MI, as well. Yet, unlike overt movements, MI-related MRPs were not lateralized, which appears to be a neural marker for the distinction between generating a mental image and transforming it into an overt action. Top-down response strategies governing this hemispheric specificity should be accounted for in future research on MI, including basic studies and medical practice.

Joint Simon effect in movement trajectories

In joint action literature it is often assumed that acting together is driven by pervasive and automatic process of co-representation, that is, representing the co-actor's part of the task in addition to one's own. Much of this research employs joint stimulus-response compatibility tasks varying the stimuli employed or the physical and social relations between participants. In this study we test the robustness of co-representation effects by focusing instead on variation in response modality. Specifically, we implement a mouse-tracking version of a Joint Simon Task in which participants respond by producing continuous movements with a computer mouse rather than pushing discrete buttons. We have three key findings. First, in a replication of an earlier study we show that in a classical individual Simon Task movement trajectories show greater curvature on incongruent trials, paralleling longer response times. Second, this effect largely disappears in a Go-NoGo Simon Task, in which participants respond to only one of the cues and refrain from responding to the other. Third, contrary to previous studies that use button pressing responses, we observe no overall effect in the joint variants of the task. However, we also detect a notable diversity in movement strategies adopted by the participants, with some participants showing the effect on the individual level. Our study casts doubt on the pervasiveness of co-representation, highlights the usefulness of mouse-tracking methodology and emphasizes the need for looking at individual variation in task performance.

Neural responses to natural visual motion are spatially selective across the visual field, with selectivity differing across brain areas and task

It is well established that neural responses to visual stimuli are enhanced at select locations in the visual field. Although spatial selectivity and the effects of spatial attention are well understood for discrete tasks (e.g. visual cueing), little is known for naturalistic experience that involves continuous dynamic visual stimuli (e.g. driving). Here, we assess the strength of neural responses across the visual space during a kart‐race game. Given the varying relevance of visual location in this task, we hypothesized that the strength of neural responses to movement will vary across the visual field, and it would differ between active play and passive viewing. To test this, we measure the correlation strength of scalp‐evoked potentials with optical flow magnitude at individual locations on the screen. We find that neural responses are strongly correlated at task‐relevant locations in visual space, extending beyond the focus of overt attention. Although the driver's gaze is directed upon the heading direction at the centre of the screen, neural responses were robust at the peripheral areas (e.g. roads and surrounding buildings). Importantly, neural responses to visual movement are broadly distributed across the scalp, with visual spatial selectivity differing across electrode locations. Moreover, during active gameplay, neural responses are enhanced at select locations in the visual space. Conventionally, spatial selectivity of neural response has been interpreted as an attentional gain mechanism. In the present study, the data suggest that different brain areas focus attention on different portions of the visual field that are task‐relevant, beyond the focus of overt attention.

The role of transients in action observation

A large number of studies have now described the various ways in which the observation of another person's dynamic movement can influence the speed with which the observer is able to prepare a motor action themselves. The typical results are most often explained with reference to theories that link perception and action. Such theories argue that the cognitive structures associated with each share common representations. Consequently, action preparation and action observation are often said to be functionally equivalent. However, the dominance of these theories in explaining action observation effects has masked the potential contribution from processes associated with the detection of low-level "transients" resulting from observing a body movement, such as motion and sound. In the present review, we describe work undertaken in one particular action observation phenomenon ("social inhibition of return") and show that the transient account provides the best explanation of the effect. We argue that future work should consider attention capture and orienting as a potential contributing factor to action observation effects more broadly.

Pointing movements and visuo-spatial working memory in a joint setting: the role of motor inhibition

Previous studies have shown that, under specific conditions, arrays that have been pointed at encoding are recognized better than passively viewed ones. According to one interpretation, the superior recognition of pointed-to arrays can be explained by the motor inhibition of passively viewed arrays. The present study sought to determine whether a similar motor inhibition can be induced also when the participants observed a co-actor perform the pointing movements. Participants were presented with two spatial arrays, one of which was encoded via observation only (the no-move array), while the other was encoded with pointing movements (the move array); movements were performed either by the participant or by the experimenter. Experiment 1 replicated the advantage of self-pointed arrays over passively viewed arrays. Experiment 2 showed that, when participants passively observed the pointing movements performed by the experimenter, move arrays were recognized no better than no-move arrays. Finally, Experiment 3 demonstrated that, in a joint-action condition in which participants alternated with the experimenter in making pointing movements, the advantage of experimenter-pointed arrays over passively viewed arrays was significant and similar in size to the advantage produced by self-performed movements. Importantly, a series of cross-experiment comparisons indicated that the higher recognition of both self- and experimenter-pointed arrays in Experiment 3 could be explained by the motor inhibition of no-move arrays. We propose that, in a joint condition, the pointing movements performed by the experimenter were represented in the same functional way as self-performed movements and that this produced the motor inhibition of passively viewed arrays.

Lost in the Rhythm: Effects of Rhythm on Subsequent Interpersonal Coordination

Music is a natural human expression present in all cultures, but the functions it serves are still debated. Previous research indicates that rhythm, an essential feature of music, can enhance coordination of movement and increase social bonding. However, the prolonged effects of rhythm have not yet been investigated. In this study, pairs of participants were exposed to one of three kinds of auditory stimuli (rhythmic, arrhythmic, or white-noise) and subsequently engaged in five trials of a joint-action task demanding interpersonal coordination. We show that when compared with the other two stimuli, exposure to the rhythmic beat reduced the practice effect in task performance. Analysis of the behavioral data suggests that this reduction results from more temporally coupled motor movements over successive trials and that shared exposure to rhythm facilitates interpersonal motor coupling, which in this context serves to impede the attainment of necessary dynamic coordination. We propose that rhythm has the potential to enhance interpersonal motor coupling, which might serve as a mechanism behind its facilitation of positive social attitudes.

Attention Allocation and Task Representation during Joint Action Planning

We investigated whether people take into account an interaction partner's attentional focus and whether they represent in advance their partner's part of the task when planning to engage in a synchronous joint action. The experiment involved two participants planning and performing joint actions (i.e., synchronously lifting and clinking glasses), unimanual individual actions (i.e., lifting and moving a glass as if clinking with another person), and bimanual individual actions. EEG was recorded from one of the participants. We employed a choice reaction paradigm where a visual cue indicated the type of action to be planned, followed 1.5 sec later by a visual go stimulus, prompting the participants to act. We studied attention allocation processes by examining two lateralized EEG components, namely the anterior directing attention negativity and the late directing attention positivity. Action planning processes were examined using the late contingent negative variation and the movement-related potential. The results show that early stages of joint action planning involve dividing attention between locations in space relevant for one's own part of the joint action and locations relevant for one's partner's part of the joint action. At later stages of joint action planning, participants represented in advance their partner's upcoming action in addition to their own action, although not at an effector-specific level. Our study provides electrophysiological evidence supporting the operation of attention sharing processes and predictive self/other action representation during the planning phase of a synchronous joint task.

The StartReact effect on self-initiated movements

Preparation of the motor system for movement execution involves an increase in excitability of motor pathways. In a reaction time task paradigm, a startling auditory stimulus (SAS) delivered together with the imperative signal (IS) shortens reaction time significantly. In self-generated tasks we considered that an appropriately timed SAS would have similar effects. Eight subjects performed a ballistic wrist extension in two blocks: reaction, in which they responded to a visual IS, and action, in which they moved when they wished within a predetermined time window. In 20-25% of the trials, a SAS was applied. We recorded electromyographic activity of wrist extension and wrist movement kinematic variables. No effects of SAS were observed in action trials when movement was performed before or long after SAS application. However, a cluster of action trials was observed within 200 ms after SAS. These trials showed larger EMG bursts, shorter movement time, shorter time to peak velocity, and higher peak velocity than other action trials (P < 0.001 for all), with no difference from Reaction trials containing SAS. The results show that SAS influences the execution of self-generated human actions as it does with preprogrammed reaction time tasks during the assumed building up of preparatory activity before execution of the willed motor action.

How neurons make meaning: brain mechanisms for embodied and abstract-symbolic semantics

How brain structures and neuronal circuits mechanistically underpin symbolic meaning has recently been elucidated by neuroimaging, neuropsychological, and neurocomputational research. Modality-specific 'embodied' mechanisms anchored in sensorimotor systems appear to be relevant, as are 'disembodied' mechanisms in multimodal areas. In this paper, four semantic mechanisms are proposed and spelt out at the level of neuronal circuits: referential semantics, which establishes links between symbols and the objects and actions they are used to speak about; combinatorial semantics, which enables the learning of symbolic meaning from context; emotional-affective semantics, which establishes links between signs and internal states of the body; and abstraction mechanisms for generalizing over a range of instances of semantic meaning. Referential, combinatorial, emotional-affective, and abstract semantics are complementary mechanisms, each necessary for processing meaning in mind and brain.

The role of prediction in social neuroscience

Research has shown that the brain is constantly making predictions about future events. Theories of prediction in perception, action and learning suggest that the brain serves to reduce the discrepancies between expectation and actual experience, i.e., by reducing the prediction error. Forward models of action and perception propose the generation of a predictive internal representation of the expected sensory outcome, which is matched to the actual sensory feedback. Shared neural representations have been found when experiencing one's own and observing other's actions, rewards, errors, and emotions such as fear and pain. These general principles of the “predictive brain” are well established and have already begun to be applied to social aspects of cognition. The application and relevance of these predictive principles to social cognition are discussed in this article. Evidence is presented to argue that simple non-social cognitive processes can be extended to explain complex cognitive processes required for social interaction, with common neural activity seen for both social and non-social cognitions. A number of studies are included which demonstrate that bottom-up sensory input and top-down expectancies can be modulated by social information. The concept of competing social forward models and a partially distinct category of social prediction errors are introduced. The evolutionary implications of a “social predictive brain” are also mentioned, along with the implications on psychopathology. The review presents a number of testable hypotheses and novel comparisons that aim to stimulate further discussion and integration between currently disparate fields of research, with regard to computational models, behavioral and neurophysiological data. This promotes a relatively new platform for inquiry in social neuroscience with implications in social learning, theory of mind, empathy, the evolution of the social brain, and potential strategies for treating social cognitive deficits.