Prediction of external events with our motor system: towards a new framework

The Psychophysiology of Action: A Multidisciplinary Endeavor for Integrating Action and Cognition

There is a vast amount of literature concerning the integration of action and cognition. Although this broad research area is of great interest for many disciplines like sports, psychology and cognitive neuroscience, only a few attempts tried to bring together different perspectives so far. Our goal is to provide a perspective to spark a debate across theoretical borders and integration of different disciplines via psychophysiology. In order to boost advances in this research field it is not only necessary to become aware of the different areas that are relevant but also to consider methodological aspects and challenges. We briefly describe the most relevant theoretical accounts to the question of how internal and external information processes or factors interact and, based on this, argue that research programs should consider the three dimensions: (a) dynamics of movements; (b) multivariate measures and; (c) dynamic statistical parameters. Only with an extended perspective on theoretical and methodological accounts, one would be able to integrate the dynamics of actions into theoretical advances.

Get a grip: individual variations in grip strength are a marker of brain health

Demonstrations that grip strength has predictive power in relation to a range of health conditions-even when these are assessed decades later-has motivated claims that hand-grip dynamometry has the potential to serve as a "vital sign" for middle-aged and older adults. Central to this belief has been the assumption that grip strength is a simple measure of physical performance that provides a marker of muscle status in general, and sarcopenia in particular. It is now evident that while differences in grip strength between individuals are influenced by musculoskeletal factors, "lifespan" changes in grip strength within individuals are exquisitely sensitive to integrity of neural systems that mediate the control of coordinated movement. The close and pervasive relationships between age-related declines in maximum grip strength and expressions of cognitive dysfunction can therefore be understood in terms of the convergent functional and structural mediation of cognitive and motor processes by the human brain. In the context of aging, maximum grip strength is a discriminating measure of neurological function and brain health.

Neural Mechanisms With Respect to Different Paradigms and Relevant Regulatory Factors in Empathy for Pain

Empathy for pain is thought to activate the affective-motivational components of the pain matrix, which includes the anterior insula and middle and anterior cingulate cortices, as indicated by functional magnetic resonance imaging and other methodologies. Activity in this core neural network reflects the affective experience that activates our responses to pain and lays the neural foundation for our understanding of our own emotions and those of others. Furthermore, although picture-based paradigms can activate somatosensory components of directly experienced pain, cue-based paradigms cannot. In addition to this difference, the two paradigms evoke other distinct neuronal responses. Although the automatic “perception-action” model has long been the dominant theory for pain empathy, a “bottom-up, top-down” mechanism seems to be more comprehensive and persuasive. Indeed, a variety of factors can regulate the intensity of empathy for pain through “top-down” processes. In this paper, we integrate and generalize knowledge regarding pain empathy and introduce the findings from recent studies. We also present ideas for future research into the neural mechanisms underlying pain empathy.

Motor cognition in patients treated with subthalamic nucleus deep brain stimulation: Limits of compensatory overactivity in Parkinson's disease

Recent fMRI findings revealed that impairment in a serial prediction task in patients suffering from Parkinson's disease (PD) results from hypoactivity of the SMA. Furthermore, hyperactivity of the lateral premotor cortex sustained performance after withdrawal of medication. To further explore these findings, we here examined the impact of deep brain stimulation of the subthalamic nucleus on the activity of the putamen and premotor areas while performing the serial prediction task. To this end, we measured eight male PD patients ON and OFF deep brain stimulation and eight healthy age-matched male controls using [¹⁵O] water positron emission tomography to measure regional cerebral blood flow. As expected, PD patients showed poorer performance than healthy controls while performance did not differ between OFF and ON stimulation. Hypoactivity of the putamen and hyperactivity of the left lateral premotor cortex was found in patients compared to controls. Lateral premotor hyperactivity further increased OFF compared to ON stimulation and was positively related to task performance. These results confirm that the motor loop's dysfunction has impact on cognitive processes (here: prediction of serial stimuli) in PD. Extending prior data regarding the role of the lateral premotor cortex in cognitive compensation, our results indicate that lateral premotor cortex hyperactivity, while beneficial in moderate levels of impairment, might fail to preserve performance in more severe stages of the motor loop's degeneration.

Action Semantics at the Bottom of the Brain: Insights From Dysplastic Cerebellar Gangliocytoma

Recent embodied cognition research shows that access to action verbs in shallow-processing tasks becomes selectively compromised upon atrophy of the cerebellum, a critical motor region. Here we assessed whether cerebellar damage also disturbs explicit semantic processing of action pictures and its integration with ongoing motor responses. We evaluated a cognitively preserved 33-year-old man with severe dysplastic cerebellar gangliocytoma (Lhermitte-Duclos disease), encompassing most of the right cerebellum and the posterior part of the left cerebellum. The patient and eight healthy controls completed two semantic association tasks (involving pictures of objects and actions, respectively) that required motor responses. Accuracy results via Crawford’s modified t-tests revealed that the patient was selectively impaired in action association. Moreover, reaction-time analysis through Crawford’s Revised Standardized Difference Test showed that, while processing of action concepts involved slower manual responses in controls, no such effect was observed in the patient, suggesting that motor-semantic integration dynamics may be compromised following cerebellar damage. Notably, a Bayesian Test for a Deficit allowing for Covariates revealed that these patterns remained after covarying for executive performance, indicating that they were not secondary to extra-linguistic impairments. Taken together, our results extend incipient findings on the embodied functions of the cerebellum, offering unprecedented evidence of its crucial role in processing non-verbal action meanings and integrating them with concomitant movements. These findings illuminate the relatively unexplored semantic functions of this region while calling for extensions of motor cognition models.

Timing Deficits in ADHD: Insights From the Neuroscience of Musical Rhythm

Everyday human behavior relies upon extraordinary feats of coordination within the brain. In this perspective paper, we argue that the rich temporal structure of music provides an informative context in which to investigate how the brain coordinates its complex activities in time, and how that coordination can be disrupted. We bring insights from the neuroscience of musical rhythm to considerations of timing deficits in Attention Deficit/Hyperactivity Disorder (ADHD), highlighting the significant overlap between neural systems involved in processing musical rhythm and those implicated in ADHD. We suggest that timing deficits warrant closer investigation since they could lead to the identification of potentially informative phenotypes, tied to neurobiological and genetic factors. Our novel interdisciplinary approach builds upon recent trends in both fields of research: in the neuroscience of rhythm, an increasingly nuanced understanding of the specific contributions of neural systems to rhythm processing, and in ADHD, an increasing focus on differentiating phenotypes and identifying distinct etiological pathways associated with the disorder. Finally, we consider the impact of musical experience on rhythm processing and the potential value of musical rhythm in therapeutic interventions.

Beta oscillatory power modulation reflects the predictability of pitch change

Humans process highly dynamic auditory information in real time, and regularities in stimuli such as speech and music can aid such processing by allowing sensory predictions for upcoming events. Auditory sequences contain information about both the identity of sounds (what) and their timing (when they occur). Temporal prediction in isochronous sequences is reflected in neural oscillatory power modulation in the beta band (∼20 Hz). Specifically, power decreases (desynchronization) after tone onset and then increases (resynchronization) to reach a maximum around the expected time of the next tone. The current study investigates whether the predictability of the pitch of a tone (what) is also reflected in beta power modulation. We presented two isochronous auditory oddball sequences, each with 20% of tones at a deviant pitch. In one sequence the deviant tones occurred regularly every fifth tone (predictably), but in the other sequence they occurred pseudorandomly (unpredictably). We recorded the electroencephalogram (EEG) while participants listened passively to these sequences. The results showed that auditory beta power desynchronization was larger prior to a predictable than an unpredictable pitch change. A single-trial correlation analysis using linear mixed-effect (LME) models further showed that the deeper the pre-deviant beta desynchronization depth, the smaller the event-related P3a amplitude following the deviant, and this effect only occurred when the pitch change was predictable. Given that P3a is associated with attentional response to prediction error, larger beta desynchronization depth indicates better prediction of an upcoming deviant pitch. Thus, these findings suggest that beta oscillations reflect predictions for what in additional to when during dynamic auditory information processing.

Theta oscillations mediate pre-activation of highly expected word initial phonemes

Prediction has been proposed to be a fundamental neurocognitive mechanism. However, its role in language comprehension is currently under debate. In this magnetoencephalography study we aimed to find evidence of word-form phonological pre-activation and to characterize the oscillatory mechanisms supporting this. Participants were presented firstly with a picture of an object, and then, after a delay (fixed or variable), they heard the corresponding word. Target words could contain a phoneme substitution, and participants’ task was to detect mispronunciations. Word-initial phonemes were either fricatives or plosives, generating two experimental conditions (expect-fricative and expect-plosive). In the pre-word interval, significant differences (α = 0.05) emerged between conditions both for fixed and variable delays. Source reconstruction of this effect showed a brain-wide network involving several frequency bands, including bilateral superior temporal areas commonly associated with phonological processing, in a theta range. These results show that phonological representations supported by the theta band may be active before word onset, even under temporal uncertainty. However, in the evoked response just prior to the word, differences between conditions were apparent under variable- but not fixed-delays. This suggests that additional top-down mechanisms sensitive to phonological form may be recruited when there is uncertainty in the signal.

Sensorimotor Network Crucial for Inferring Amusement from Smiles

Understanding whether another's smile reflects authentic amusement is a key challenge in social life, yet, the neural bases of this ability have been largely unexplored. Here, we combined transcranial magnetic stimulation (TMS) with a novel empathic accuracy (EA) task to test whether sensorimotor and mentalizing networks are critical for understanding another's amusement. Participants were presented with dynamic displays of smiles and explicitly requested to infer whether the smiling individual was feeling authentic amusement or not. TMS over sensorimotor regions representing the face (i.e., in the inferior frontal gyrus (IFG) and ventral primary somatosensory cortex (SI)), disrupted the ability to infer amusement authenticity from observed smiles. The same stimulation did not affect performance on a nonsocial task requiring participants to track the smiling expression but not to infer amusement. Neither TMS over prefrontal and temporo-parietal areas supporting mentalizing, nor peripheral control stimulations, affected performance on either task. Thus, motor and somatosensory circuits for controlling and sensing facial movements are causally essential for inferring amusement from another's smile. These findings highlight the functional relevance of IFG and SI to amusement understanding and suggest that EA abilities may be grounded in sensorimotor networks for moving and feeling the body.

Imagined and Executed Actions in the Human Motor System: Testing Neural Similarity Between Execution and Imagery of Actions with a Multivariate Approach

Simulation theory proposes motor imagery (MI) to be a simulation based on representations also used for motor execution (ME). Nonetheless, it is unclear how far they use the same neural code. We use multivariate pattern analysis (MVPA) and representational similarity analysis (RSA) to describe the neural representations associated with MI and ME within the frontoparietal motor network. During functional magnetic resonance imaging scanning, 20 volunteers imagined or executed 3 different types of right-hand actions. Results of MVPA showed that these actions as well as their modality (MI or ME) could be decoded significantly above chance from the spatial patterns of BOLD signals in premotor and posterior parietal cortices. This was also true for cross-modal decoding. Furthermore, representational dissimilarity matrices of frontal and parietal areas showed that MI and ME representations formed separate clusters, but that the representational organization of action types within these clusters was identical. For most ROIs, this pattern of results best fits with a model that assumes a low-to-moderate degree of similarity between the neural patterns associated with MI and ME. Thus, neural representations of MI and ME are neither the same nor totally distinct but exhibit a similar structural geometry with respect to different types of action.

Is auditory perceptual timing a core deficit of developmental coordination disorder?

Time is an essential dimension for perceiving and processing auditory events, and for planning and producing motor behaviors. Developmental coordination disorder (DCD) is a neurodevelopmental disorder affecting 5-6% of children that is characterized by deficits in motor skills. Studies show that children with DCD have motor timing and sensorimotor timing deficits. We suggest that auditory perceptual timing deficits may also be core characteristics of DCD. This idea is consistent with evidence from several domains, (1) motor-related brain regions are often involved in auditory timing process; (2) DCD has high comorbidity with dyslexia and attention deficit hyperactivity, which are known to be associated with auditory timing deficits; (3) a few studies report deficits in auditory-motor timing among children with DCD; and (4) our preliminary behavioral and neuroimaging results show that children with DCD at age 6 and 7 have deficits in auditory time discrimination compared to typically developing children. We propose directions for investigating auditory perceptual timing processing in DCD that use various behavioral and neuroimaging approaches. From a clinical perspective, research findings can potentially benefit our understanding of the etiology of DCD, identify early biomarkers of DCD, and can be used to develop evidence-based interventions for DCD involving auditory-motor training.

TMS Over the Cerebellum Interferes with Short-term Memory of Visual Sequences

Growing evidence suggests that the cerebellum is not only involved in motor functions, but it significantly contributes to sensory and cognitive processing as well. In particular, it has been hypothesized that the cerebellum identifies recurrent serial events and recognizes their violations. Here we used transcranial magnetic stimulation (TMS) to shed light on the role of the cerebellum in short-term memory of visual sequences. In two experiments, we found that TMS over the right cerebellar hemisphere impaired participants' ability to recognize the correct order of appearance of geometrical stimuli varying in shape and/or size. In turn, cerebellar TMS did not affect recognition of highly familiar short sequences of letters or numbers. Overall, our data suggest that the cerebellum is involved in memorizing the order in which (concatenated) stimuli appear, this process being important for sequence learning.

Real-Time Prediction of Observed Action Requires Integrity of the Dorsal Premotor Cortex: Evidence From Repetitive Transcranial Magnetic Stimulation

Studying brain mechanisms underlying the prediction of observed action, the dorsal premotor cortex (PMd) has been suggested a key area. The present study probed this notion using repetitive transcranial magnetic stimulation (rTMS) to test whether interference in this area would affect the accuracy in predicting the time course of object directed actions performed with the right hand. Young and healthy participants observed actions in short videos. These were briefly occluded from view for 600 ms and resumed immediately afterwards. The task was to continue the action mentally and to indicate after each occlusion, whether the action was resumed at the right moment (condition in-time) or shifted. In a first run, single-pulse transcranial magnetic stimulation (sTMS) was delivered over the left primary hand-area during occlusion. In the second run, rTMS over the left PMd was applied during occlusion in half of the participants [experimental group (EG)]. The control group (CG) received sham-rTMS over the same area. Under rTMS, the EG predicted less trials correctly than in the sTMS run. Sham-rTMS in the CG had no effects on prediction. The interference in PMd interacted with the type of manipulation applied to the action’s time course occasionally during occlusion. The performance decrease of the EG was most pronounced in conditions in which the continuations after occlusions were too late in the action’s course. The present results extend earlier findings suggesting that real-time action prediction requires the integrity of the PMd. Different functional roles of this area are discussed. Alternative interpretations consider either simulation of specific motor programming functions or the involvement of a feature-unspecific predictor.

Auditory prediction cues motor preparation in the absence of movements

There is increasing evidence for integrated representation of sensory and motor information in the brain, and that seeing or hearing action-related stimuli may automatically cue the movements required to respond to or produce them. In this study we tested whether anticipation of tones in a known melody automatically activates corresponding motor representations in a predictive way, in preparation for potential upcoming movements. Therefore, we trained 20 non-musicians (8 men, 12 women) to play a simple melody. Then, while they passively listened to the learned or unlearned melodies, we applied single pulse transcranial magnetic stimulation (TMS) over M1 to measure motor evoked potentials from the associated finger muscle either preceding or following the onset of individual tones. Our results show that listening to the learned melody increased corticospinal excitability for specific finger muscles before tone onset. This demonstrates that predictable auditory information can activate motor representations in an anticipatory muscle-specific manner, even in the absence of intention to move. This suggests that the motor system is involved in the prediction of sensory events, likely based on auditory-parietal-prefrontal feedforward/feedback loops that automatically prepare predictable sound-related actions independent of actual execution and the associated auditory feedback. Overall, we propose that multimodal forward models of upcoming sounds and actions support motor preparation, facilitate error detection and correction, and guide perception.

Perceptually relevant speech tracking in auditory and motor cortex reflects distinct linguistic features

During online speech processing, our brain tracks the acoustic fluctuations in speech at different timescales. Previous research has focused on generic timescales (for example, delta or theta bands) that are assumed to map onto linguistic features such as prosody or syllables. However, given the high intersubject variability in speaking patterns, such a generic association between the timescales of brain activity and speech properties can be ambiguous. Here, we analyse speech tracking in source-localised magnetoencephalographic data by directly focusing on timescales extracted from statistical regularities in our speech material. This revealed widespread significant tracking at the timescales of phrases (0.6–1.3 Hz), words (1.8–3 Hz), syllables (2.8–4.8 Hz), and phonemes (8–12.4 Hz). Importantly, when examining its perceptual relevance, we found stronger tracking for correctly comprehended trials in the left premotor (PM) cortex at the phrasal scale as well as in left middle temporal cortex at the word scale. Control analyses using generic bands confirmed that these effects were specific to the speech regularities in our stimuli. Furthermore, we found that the phase at the phrasal timescale coupled to power at beta frequency (13–30 Hz) in motor areas. This cross-frequency coupling presumably reflects top-down temporal prediction in ongoing speech perception. Together, our results reveal specific functional and perceptually relevant roles of distinct tracking and cross-frequency processes along the auditory–motor pathway.

How we comprehend speech—and how the brain encodes information from a continuous speech stream—is of interest for neuroscience, linguistics, and research on language disorders. Previous work that examined dynamic brain activity has addressed the issue of comprehension only indirectly, by contrasting intelligible speech with unintelligible speech or baseline activity. Recent work, however, suggests that brain areas can show similar stimulus-driven activity but differently contribute to perception or comprehension. To directly address the perceptual relevance of dynamic brain activity for speech encoding, we used a straightforward, single-trial comprehension measure. Furthermore, previous work has been vague regarding the analysed timescales. We therefore base our analysis directly on the timescales of phrases, words, syllables, and phonemes of our speech stimuli. By incorporating these two conceptual innovations, we demonstrate that different areas of the brain track acoustic information at the time-scales of words and phrases. Moreover, our results suggest that the motor cortex uses a cross-frequency coupling mechanism to predict the timing of phrases in ongoing speech. Our findings suggest spatially and temporally distinct brain mechanisms that directly shape our comprehension.

Sensitivity to perception level differentiates two subnetworks within the mirror neuron system

Mirror neurons are a subset of brain cells that discharge during action execution and passive observation of similar actions. An open question concerns the functional role of their ability to match observed and executed actions. Since understanding of goals requires conscious perception of actions, we expect that mirror neurons potentially involved in action goal coding, will be modulated by changes in action perception level. Here, we manipulated perception level of action videos depicting short hand movements and measured the corresponding fMRI BOLD responses in mirror regions. Our results show that activity levels within a network of regions, including the sensorimotor cortex, primary motor cortex, dorsal premotor cortex and posterior superior temporal sulcus, are sensitive to changes in action perception level, whereas activity levels in the inferior frontal gyrus, ventral premotor cortex, supplementary motor area and superior parietal lobule are invariant to such changes. In addition, this parcellation to two sub-networks manifest as smaller functional distances within each group of regions during task and resting state. Our results point to functional differences between regions within the mirror neurons system which may have implications with respect to their possible role in action understanding.

Association of grey matter changes with stability and flexibility of prediction in akinetic-rigid Parkinson's disease

Parkinson's disease (PD), which is caused by degeneration of dopaminergic neurons in the midbrain, results in a heterogeneous clinical picture including cognitive decline. Since the phasic signal of dopamine neurons is proposed to guide learning by signifying mismatches between subjects' expectations and external events, we here investigated whether akinetic-rigid PD patients without mild cognitive impairment exhibit difficulties in dealing with either relevant (requiring flexibility) or irrelevant (requiring stability) prediction errors. Following our previous study on flexibility and stability in prediction (Trempler et al. J Cogn Neurosci 29(2):298-309, 2017), we then assessed whether deficits would correspond with specific structural alterations in dopaminergic regions as well as in inferior frontal cortex, medial prefrontal cortex, and the hippocampus. Twenty-one healthy controls and twenty-one akinetic-rigid PD patients on and off medication performed a task which required to serially predict upcoming items. Switches between predictable sequences had to be indicated via button press, whereas sequence omissions had to be ignored. Independent of the disease, midbrain volume was related to a general response bias to unexpected events, whereas right putamen volume correlated with the ability to discriminate between relevant and irrelevant prediction errors. However, patients compared with healthy participants showed deficits in stabilisation against irrelevant prediction errors, associated with thickness of right inferior frontal gyrus and left medial prefrontal cortex. Flexible updating due to relevant prediction errors was also affected in patients compared with controls and associated with right hippocampus volume. Dopaminergic medication influenced behavioural performance across, but not within the patients. Our exploratory study warrants further research on deficient prediction error processing and its structural correlates as a core of cognitive symptoms occurring already in early stages of the disease.

Taking two to tango: fMRI analysis of improvised joint action with physical contact

Many forms of joint action involve physical coupling between the participants, such as when moving a sofa together or dancing a tango. We report the results of a novel two-person functional MRI study in which trained couple dancers engaged in bimanual contact with an experimenter standing next to the bore of the magnet, and in which the two alternated between being the leader and the follower of joint improvised movements. Leading showed a general pattern of self-orientation, being associated with brain areas involved in motor planning, navigation, sequencing, action monitoring, and error correction. In contrast, following showed a far more sensory, externally-oriented pattern, revealing areas involved in somatosensation, proprioception, motion tracking, social cognition, and outcome monitoring. We also had participants perform a "mutual" condition in which the movement patterns were pre-learned and the roles were symmetric, thereby minimizing any tendency toward either leading or following. The mutual condition showed greater activity in brain areas involved in mentalizing and social reward than did leading or following. Finally, the analysis of improvisation revealed the dual importance of motor-planning and working-memory areas. We discuss these results in terms of theories of both joint action and improvisation.

Categorization for Faces and Tools-Two Classes of Objects Shaped by Different Experience-Differs in Processing Timing, Brain Areas Involved, and Repetition Effects

The brain mechanisms that integrate the separate features of sensory input into a meaningful percept depend upon the prior experience of interaction with the object and differ between categories of objects. Recent studies using representational similarity analysis (RSA) have characterized either the spatial patterns of brain activity for different categories of objects or described how category structure in neuronal representations emerges in time, but never simultaneously. Here we applied a novel, region-based, multivariate pattern classification approach in combination with RSA to magnetoencephalography data to extract activity associated with qualitatively distinct processing stages of visual perception. We asked participants to name what they see whilst viewing bitonal visual stimuli of two categories predominantly shaped by either value-dependent or sensorimotor experience, namely faces and tools, and meaningless images. We aimed to disambiguate the spatiotemporal patterns of brain activity between the meaningful categories and determine which differences in their processing were attributable to either perceptual categorization per se, or later-stage mentalizing-related processes. We have extracted three stages of cortical activity corresponding to low-level processing, category-specific feature binding, and supra-categorical processing. All face-specific spatiotemporal patterns were associated with bilateral activation of ventral occipito-temporal areas during the feature binding stage at 140–170 ms. The tool-specific activity was found both within the categorization stage and in a later period not thought to be associated with binding processes. The tool-specific binding-related activity was detected within a 210–220 ms window and was located to the intraparietal sulcus of the left hemisphere. Brain activity common for both meaningful categories started at 250 ms and included widely distributed assemblies within parietal, temporal, and prefrontal regions. Furthermore, we hypothesized and tested whether activity within face and tool-specific binding-related patterns would demonstrate oppositely acting effects following procedural perceptual learning. We found that activity in the ventral, face-specific network increased following the stimuli repetition. In contrast, tool processing in the dorsal network adapted by reducing its activity over the repetition period. Altogether, we have demonstrated that activity associated with visual processing of faces and tools during the categorization stage differ in processing timing, brain areas involved, and in their dynamics underlying stimuli learning.

Infants' Motor Proficiency and Statistical Learning for Actions

Prior research has shown that infants learn statistical regularities in action sequences better than they learn non-action event sequences. This is consistent with current theories claiming that the same mechanism guides action observation and action execution. The current eye-tracking study tested the prediction, based on these theories, that infants' ability to learn statistical regularities in action sequences is modulated by their own motor abilities. Eight- to eleven-month-old infants observed an action sequence containing two deterministic action pairs (i.e., action A always followed by action B) embedded within an otherwise random sequence. One pair was performed with a whole-hand grasp. The second pair was performed with a pincer grasp, a fine motor skill that emerges around 9 months of age. Infants were then categorized into groups according to which grasp was dominant in their motor repertoire. Predictive looks to correct upcoming actions during the deterministic pairs were analyzed to measure whether infants learned and anticipated the sequence regularities. Findings indicate that infants learned the statistical regularities: across motor groups, they made more correct than incorrect predictive fixations to upcoming actions. Overall, learning was not significantly modulated by their dominant grasping abilities. However, infants with a dominant pincer grasp showed an earlier increase in correct predictions for the pincer grasp pair and not the whole-hand grasp. Likewise, infants with a dominant whole-hand grasp showed an early increase in correct predictions for the pair performed with a whole-hand grasp, and not the pincer grasp. Together, these findings suggest that infants' ability to learn action sequences is facilitated when the observed action matches their own action repertoire. However, findings cannot be explained entirely by motor accounts, as infants also learned the actions less congruent with their own abilities. Findings are discussed in terms of the interplay between the motor system and additional non-motor resources during the acquisition of new motor skills in infancy.

Non-linear Relationship between BOLD Activation and Amplitude of Beta Oscillations in the Supplementary Motor Area during Rhythmic Finger Tapping and Internal Timing

Functional imaging studies using BOLD contrasts have consistently reported activation of the supplementary motor area (SMA) both during motor and internal timing tasks. Opposing findings, however, have been shown for the modulation of beta oscillations in the SMA. While movement suppresses beta oscillations in the SMA, motor and non-motor tasks that rely on internal timing increase the amplitude of beta oscillations in the SMA. These independent observations suggest that the relationship between beta oscillations and BOLD activation is more complex than previously thought. Here we set out to investigate this rapport by examining beta oscillations in the SMA during movement with varying degrees of internal timing demands. In a simultaneous EEG-fMRI experiment, 20 healthy right-handed subjects performed an auditory-paced finger-tapping task. Internal timing was operationalized by including conditions with taps on every fourth auditory beat, which necessitates generation of a slow internal rhythm, while tapping to every auditory beat reflected simple auditory-motor synchronization. In the SMA, BOLD activity increased and power in both the low and the high beta band decreased expectedly during each condition compared to baseline. Internal timing was associated with a reduced desynchronization of low beta oscillations compared to conditions without internal timing demands. In parallel with this relative beta power increase, internal timing activated the SMA more strongly in terms of BOLD. This documents a task-dependent non-linear relationship between BOLD and beta-oscillations in the SMA. We discuss different roles of beta synchronization and desynchronization in active processing within the same cortical region.

High-resolution language mapping of Broca's region with transcranial magnetic stimulation

Broca's region, corresponding roughly to cytoarchitectonic areas 44 and 45 in the inferior frontal cortex, holds a multifunctional role in language processing, as shown, e.g., by functional imaging data. Neuro-navigated transcranial magnetic stimulation (TMS) enables complementary non-invasive mapping of cortical functions with high spatial resolution. Here, we report on detailed TMS language mapping of Broca's region in 12 healthy participants. The test protocol with an object naming task was adapted for high-resolution and semi-quantitative mapping of TMS-induced effects on speech and language performance. Hierarchical cluster analysis of normalized ratings of error frequency and severity revealed a clear focus of TMS impact at dorso-posterior target sites, close to the inferior frontal junction. Adjacent clusters of moderate and slightly affected stimulation sites yielded a posterosuperior-to-anteroinferior gradient of TMS susceptibility. Our findings indicate that the part of Broca's region most susceptible to TMS-induced language inhibition in object naming is located in the dorsal area 44.

Motor expertise facilitates the accuracy of state extrapolation in perception

Predicting the behavior of objects in the environment is an important requirement to overcome latencies in the sensorimotor system and realize precise actions in rapid situations. Internal forward models that were acquired during motor training might not only be used for efficiently controlling fast motor behavior but also to facilitate extrapolation performance in purely perceptual tasks. In this study, we investigated whether preceding virtual cart-pole balancing training facilitates the ability to extrapolate the virtual pole motion. Specifically, subjects had to report the expected pole orientation after an occlusion of the pole of 900ms duration. We compared a group of 10 subjects, proficient in performing the virtual cart-pole balancing task, to 10 naïve subjects without motor experience in cart-pole balancing task. Our results demonstrate that preceding motor training increases the accuracy of pole movement extrapolation, although extrapolation is not trained explicitly. Additionally, we modelled subjects' behaviors and show that the difference in extrapolation performance can be explained by individual differences in the accuracy of internal forward models. When subjects are provided with feedback about the true orientation of the pole after the occlusion in a second phase of the experiment, both groups improve rapidly. The results indicate that the perceptual capability to extrapolate the state of the cart-pole system accurately is implicitly trained during motor learning. We discuss these results in the context of shared representations and action-perception transfer.

Motor origin of temporal predictions in auditory attention

In behavior, action and perception are inherently interdependent. However, the actual mechanistic contributions of the motor system to sensory processing are unknown. We present neurophysiological evidence that the motor system is involved in predictive timing, a brain function that aligns temporal fluctuations of attention with the timing of events in a task-relevant stream, thus facilitating sensory selection and optimizing behavior. In a magnetoencephalography experiment involving auditory temporal attention, participants had to disentangle two streams of sound on the unique basis of endogenous temporal cues. We show that temporal predictions are encoded by interdependent delta and beta neural oscillations originating from the left sensorimotor cortex, and directed toward auditory regions. We also found that overt rhythmic movements improved the quality of temporal predictions and sharpened the temporal selection of relevant auditory information. This latter behavioral and functional benefit was associated with increased signaling of temporal predictions in right-lateralized frontoparietal associative regions. In sum, this study points at a covert form of auditory active sensing. Our results emphasize the key role of motor brain areas in providing contextual temporal information to sensory regions, driving perceptual and behavioral selection.

Action-skilled observation: Issues for the study of sport expertise and the brain

With a growing body of research devoted to uncovering regions of the brain implicated in action observation following various action-related experiences, including sport, we ask what we know from this research, and what we still need to know, as it pertains to sport and the brain. To do this, we review and integrate knowledge garnered from developmental work, short-term motor learning studies, and most significantly sport athletes across varying skill levels. We consider various neurophysiological methods, including TMS, fMRI, and EEG, which have been used to help uncover brain regions involved in action-skilled observation. We are particularly interested in how these processes are related to action prediction and the detection of deceptive actions among athlete groups. This research is considered within broad theoretical frameworks related to action-simulation and prediction, although our main focus is on the brain regions that have been implicated in skilled action observation and the implications of this research for knowledge and further study of sport expertise.

Mental imagery of gravitational motion

There is considerable evidence that gravitational acceleration is taken into account in the interaction with falling targets through an internal model of Earth gravity. Here we asked whether this internal model is accessed also when target motion is imagined rather than real. In the main experiments, naïve participants grasped an imaginary ball, threw it against the ceiling, and caught it on rebound. In different blocks of trials, they had to imagine that the ball moved under terrestrial gravity (1g condition) or under microgravity (0g) as during a space flight. We measured the speed and timing of the throwing and catching actions, and plotted ball flight duration versus throwing speed. Best-fitting duration-speed curves estimate the laws of ball motion implicit in the participant's performance. Surprisingly, we found duration-speed curves compatible with 0g for both the imaginary 0g condition and the imaginary 1g condition, despite the familiarity with Earth gravity effects and the added realism of performing the throwing and catching actions. In a control experiment, naïve participants were asked to throw the imaginary ball vertically upwards at different heights, without hitting the ceiling, and to catch it on its way down. All participants overestimated ball flight durations relative to the durations predicted by the effects of Earth gravity. Overall, the results indicate that mental imagery of motion does not have access to the internal model of Earth gravity, but resorts to a simulation of visual motion. Because visual processing of accelerating/decelerating motion is poor, visual imagery of motion at constant speed or slowly varying speed appears to be the preferred mode to perform the tasks.

Recombinant Enaction: Manipulatives Generate New Procedures in the Imagination, by Extending and Recombining Action Spaces

Manipulation of physical models such as tangrams and tiles is a popular approach to teaching early mathematics concepts. This pedagogical approach is extended by new computational media, where mathematical entities such as equations and vectors can be virtually manipulated. The cognitive and neural mechanisms supporting such manipulation-based learning-particularly how actions generate new internal structures that support problem-solving-are not understood. We develop a model of the way manipulations generate internal traces embedding actions, and how these action-traces recombine during problem-solving. This model is based on a study of two groups of sixth-grade students solving area problems. Before problem-solving, one group manipulated a tangram, the other group answered a descriptive test. Eye-movement trajectories during problem-solving were different between the groups. A second study showed that this difference required the tangram's geometrical structure, just manipulation was not enough. We propose a theoretical model accounting for these results, and discuss its implications.

10-Month-Old Infants Are Sensitive to the Time Course of Perceived Actions: Eye-Tracking and EEG Evidence

Research has shown that infants are able to track a moving target efficiently - even if it is transiently occluded from sight. This basic ability allows prediction of when and where events happen in everyday life. Yet, it is unclear whether, and how, infants internally represent the time course of ongoing movements to derive predictions. In this study, 10-month-old crawlers observed the video of a same-aged crawling baby that was transiently occluded and reappeared in either a temporally continuous or non-continuous manner (i.e., delayed by 500 ms vs. forwarded by 500 ms relative to the real-time movement). Eye movement and rhythmic neural brain activity (EEG) were measured simultaneously. Eye movement analyses showed that infants were sensitive to slight temporal shifts in movement continuation after occlusion. Furthermore, brain activity associated with sensorimotor processing differed between observation of continuous and non-continuous movements. Early sensitivity to an action's timing may hence be explained within the internal real-time simulation account of action observation. Overall, the results support the hypothesis that 10-month-old infants are well prepared for internal representation of the time course of observed movements that are within the infants' current motor repertoire.

Theta oscillations locked to intended actions rhythmically modulate perception

Ongoing brain oscillations are known to influence perception, and to be reset by exogenous stimulations. Voluntary action is also accompanied by prominent rhythmic activity, and recent behavioral evidence suggests that this might be coupled with perception. Here, we reveal the neurophysiological underpinnings of this sensorimotor coupling in humans. We link the trial-by-trial dynamics of EEG oscillatory activity during movement preparation to the corresponding dynamics in perception, for two unrelated visual and motor tasks. The phase of theta oscillations (~4 Hz) predicts perceptual performance, even >1 s before movement. Moreover, theta oscillations are phase-locked to the onset of the movement. Remarkably, the alignment of theta phase and its perceptual relevance unfold with similar non-monotonic profiles, suggesting their relatedness. The present work shows that perception and movement initiation are automatically synchronized since the early stages of motor planning through neuronal oscillatory activity in the theta range.

Corticospinal excitability during the processing of handwritten and typed words and non-words

A number of studies have suggested that perception of actions is accompanied by motor simulation of those actions. To further explore this proposal, we applied Transcranial magnetic stimulation (TMS) to the left primary motor cortex during the observation of handwritten and typed language stimuli, including words and non-word consonant clusters. We recorded motor-evoked potentials (MEPs) from the right first dorsal interosseous (FDI) muscle to measure cortico-spinal excitability during written text perception. We observed a facilitation in MEPs for handwritten stimuli, regardless of whether the stimuli were words or non-words, suggesting potential motor simulation during observation. We did not observe a similar facilitation for the typed stimuli, suggesting that motor simulation was not occurring during observation of typed text. By demonstrating potential simulation of written language text during observation, these findings add to a growing literature suggesting that the motor system plays a strong role in the perception of written language.

Temporal expectancies driven by self- and externally generated rhythms

The dynamic attending theory proposes that rhythms entrain periodic fluctuations of attention which modulate the gain of sensory input. However, temporal expectancies can also be driven by the mere passage of time (foreperiod effect). It is currently unknown how these two types of temporal expectancy relate to each other, i.e. whether they work in parallel and have distinguishable neural signatures. The current research addresses this issue. Participants either tapped a 1Hz rhythm (active task) or were passively presented with the same rhythm using tactile stimulators (passive task). Based on this rhythm an auditory target was then presented early, in synchrony, or late. Behavioural results were in line with the dynamic attending theory as RTs were faster for in- compared to out-of-synchrony targets. Electrophysiological results suggested self-generated and externally induced rhythms to entrain neural oscillations in the delta frequency band. Auditory ERPs showed evidence of two distinct temporal expectancy processes. Both tasks demonstrated a pattern which followed a linear foreperiod effect. In the active task, however, we also observed an ERP effect consistent with the dynamic attending theory. This study shows that temporal expectancies generated by a rhythm and expectancy generated by the mere passage of time can work in parallel and sheds light on how these mechanisms are implemented in the brain.

Implied motion language can influence visual spatial memory

How do language and vision interact? Specifically, what impact can language have on visual processing, especially related to spatial memory? What are typically considered errors in visual processing, such as remembering the location of an object to be farther along its motion trajectory than it actually is, can be explained as perceptual achievements that are driven by our ability to anticipate future events. In two experiments, we tested whether the prior presentation of motion language influences visual spatial memory in ways that afford greater perceptual prediction. Experiment 1 showed that motion language influenced judgments for the spatial memory of an object beyond the known effects of implied motion present in the image itself. Experiment 2 replicated this finding. Our findings support a theory of perception as prediction.

Grouping and Segregation of Sensory Events by Actions in Temporal Audio-Visual Recalibration

Perception in multi-sensory environments involves both grouping and segregation of events across sensory modalities. Temporal coincidence between events is considered a strong cue to resolve multisensory perception. However, differences in physical transmission and neural processing times amongst modalities complicate this picture. This is illustrated by cross-modal recalibration, whereby adaptation to audio-visual asynchrony produces shifts in perceived simultaneity. Here, we examined whether voluntary actions might serve as a temporal anchor to cross-modal recalibration in time. Participants were tested on an audio-visual simultaneity judgment task after an adaptation phase where they had to synchronize voluntary actions with audio-visual pairs presented at a fixed asynchrony (vision leading or vision lagging). Our analysis focused on the magnitude of cross-modal recalibration to the adapted audio-visual asynchrony as a function of the nature of the actions during adaptation, putatively fostering cross-modal grouping or, segregation. We found larger temporal adjustments when actions promoted grouping than segregation of sensory events. However, a control experiment suggested that additional factors, such as attention to planning/execution of actions, could have an impact on recalibration effects. Contrary to the view that cross-modal temporal organization is mainly driven by external factors related to the stimulus or environment, our findings add supporting evidence for the idea that perceptual adjustments strongly depend on the observer's inner states induced by motor and cognitive demands.

Neural mechanisms of rhythm-based temporal prediction: Delta phase-locking reflects temporal predictability but not rhythmic entrainment

Predicting the timing of upcoming events enables efficient resource allocation and action preparation. Rhythmic streams, such as music, speech, and biological motion, constitute a pervasive source for temporal predictions. Widely accepted entrainment theories postulate that rhythm-based predictions are mediated by synchronizing low-frequency neural oscillations to the rhythm, as indicated by increased phase concentration (PC) of low-frequency neural activity for rhythmic compared to random streams. However, we show here that PC enhancement in scalp recordings is not specific to rhythms but is observed to the same extent in less periodic streams if they enable memory-based prediction. This is inconsistent with the predictions of a computational entrainment model of stronger PC for rhythmic streams. Anticipatory change in alpha activity and facilitation of electroencephalogram (EEG) manifestations of response selection are also comparable between rhythm- and memory-based predictions. However, rhythmic sequences uniquely result in obligatory depression of preparation-related premotor brain activity when an on-beat event is omitted, even when it is strategically beneficial to maintain preparation, leading to larger behavioral costs for violation of prediction. Thus, while our findings undermine the validity of PC as a sign of rhythmic entrainment, they constitute the first electrophysiological dissociation, to our knowledge, between mechanisms of rhythmic predictions and of memory-based predictions: the former obligatorily lead to resonance-like preparation patterns (that are in line with entrainment), while the latter allow flexible resource allocation in time regardless of periodicity in the input. Taken together, they delineate the neural mechanisms of three distinct modes of preparation: continuous vigilance, interval-timing-based prediction and rhythm-based prediction.

Critical Motor Involvement in Prediction of Human and Non-biological Motion Trajectories

OBJECTIVES

Adaptive interaction with the environment requires the ability to predict both human and non-biological motion trajectories. Prior accounts of the neurocognitive basis for prediction of these two motion classes may generally be divided into those that posit that non-biological motion trajectories are predicted using the same motor planning and/or simulation mechanisms used for human actions, and those that posit distinct mechanisms for each. Using brain lesion patients and healthy controls, this study examined critical neural substrates and behavioral correlates of human and non-biological motion prediction.

METHODS

Twenty-seven left hemisphere stroke patients and 13 neurologically intact controls performed a visual occlusion task requiring prediction of pantomimed tool use, real tool use, and non-biological motion videos. Patients were also assessed with measures of motor strength and speed, praxis, and action recognition.

RESULTS

Prediction impairment for both human and non-biological motion was associated with limb apraxia and, weakly, with the severity of motor production deficits, but not with action recognition ability. Furthermore, impairment for human and non-biological motion prediction was equivalently associated with lesions in the left inferior parietal cortex, left dorsal frontal cortex, and the left insula.

CONCLUSIONS

These data suggest that motor planning mechanisms associated with specific loci in the sensorimotor network are critical for prediction of spatiotemporal trajectory information characteristic of both human and non-biological motions. (JINS, 2017, 23, 171-184).

Toddlers' action prediction: Statistical learning of continuous action sequences

The current eye-tracking study investigated whether toddlers use statistical information to make anticipatory eye movements while observing continuous action sequences. In two conditions, 19-month-old participants watched either a person performing an action sequence (Agent condition) or a self-propelled visual event sequence (Ghost condition). Both sequences featured a statistical structure in which certain action pairs occurred with deterministic transitional probabilities. Toddlers learned the transitional probabilities between the action steps of the deterministic action pairs and made predictive fixations to the location of the next action in the Agent condition but not in the Ghost condition. These findings suggest that young toddlers gain unique information from the statistical structure contained within action sequences and are able to successfully predict upcoming action steps based on this acquired knowledge. Furthermore, predictive gaze behavior was correlated with reproduction of sequential actions following exposure to statistical regularities. This study extends previous developmental work by showing that statistical learning can guide the emergence of anticipatory eye movements during observation of continuous action sequences.

The hearing ear is always found close to the speaking tongue: Review of the role of the motor system in speech perception

Does "the motor system" play "a role" in speech perception? If so, where, how, and when? We conducted a systematic review that addresses these questions using both qualitative and quantitative methods. The qualitative review of behavioural, computational modelling, non-human animal, brain damage/disorder, electrical stimulation/recording, and neuroimaging research suggests that distributed brain regions involved in producing speech play specific, dynamic, and contextually determined roles in speech perception. The quantitative review employed region and network based neuroimaging meta-analyses and a novel text mining method to describe relative contributions of nodes in distributed brain networks. Supporting the qualitative review, results show a specific functional correspondence between regions involved in non-linguistic movement of the articulators, covertly and overtly producing speech, and the perception of both nonword and word sounds. This distributed set of cortical and subcortical speech production regions are ubiquitously active and form multiple networks whose topologies dynamically change with listening context. Results are inconsistent with motor and acoustic only models of speech perception and classical and contemporary dual-stream models of the organization of language and the brain. Instead, results are more consistent with complex network models in which multiple speech production related networks and subnetworks dynamically self-organize to constrain interpretation of indeterminant acoustic patterns as listening context requires.

Actively but not passively synchronized motor activity amplifies predictive timing

Previous studies have shown that the effect of temporal predictability of presented stimuli on attention allocation is enhanced by auditory-motor synchronization (AMS). The present P300 event-related potential study (N=20) investigated whether this enhancement depends on the process of actively synchronizing one's motor output with the acoustic input or whether a passive state of auditory-motor synchrony elicits the same effect. Participants silently counted frequency deviants in sequences of pure tones either during a physically inactive control condition or while pedaling on a cycling ergometer. Tones were presented either at fixed or variable intervals. In addition to the pedaling conditions with fixed or variable stimulation, there was a third condition in which stimuli were adaptively presented in sync with the participants' spontaneous pedaling. We replicated the P300 enhancement for fixed versus variable stimulation and the amplification of this effect by AMS. Synchronization performance correlated positively with P300 amplitude in the fixed stimulation condition. Most interestingly, P300 amplitude was significantly reduced for the passive synchronization condition by adaptive stimulus presentation as compared to the fixed stimulation condition. For the first time we thus provide evidence that it is not the passive state of (even perfect) auditory-motor synchrony that facilitates attention allocation during AMS but rather the active process of synchronizing one's movements with external stimuli.

Predictive action tracking without motor experience in 8-month-old infants

•

Can infants predictively track the kinematics of actions outside their motor repertoire?

•

Pre-walking infants predictively tracked upright, but not inverted stepping actions.

•

Sensorimotor cortex was activated more when infants observed upright stepping actions.

•

Motor experience is not necessary for predictive tracking of action kinematics.

A popular idea in cognitive neuroscience is that to predict others’ actions, observers need to map those actions onto their own motor repertoire. If this is true, infants with a relatively limited motor repertoire should be unable to predict actions with which they have no previous motor experience. We investigated this idea by presenting pre-walking infants with videos of upright and inverted stepping actions that were briefly occluded from view, followed by either a correct (time-coherent) or an incorrect (time-incoherent) continuation of the action (Experiment 1). Pre-walking infants looked significantly longer to the still frame after the incorrect compared to the correct continuations of the upright, but not the inverted stepping actions. This demonstrates that motor experience is not necessary for predictive tracking of action kinematics. In a follow-up study (Experiment 2), we investigated sensorimotor cortex activation as a neural indication of predictive action tracking in another group of pre-walking infants. Infants showed significantly more sensorimotor cortex activation during the occlusion of the upright stepping actions that the infants in Experiment 1 could predictively track, than during the occlusion of the inverted stepping actions that the infants in Experiment 1 could not predictively track. Taken together, these findings are inconsistent with the idea that motor experience is necessary for the predictive tracking of action kinematics, and suggest that infants may be able to use their extensive experience with observing others’ actions to generate real-time action predictions.

Frontostriatal Contribution to the Interplay of Flexibility and Stability in Serial Prediction

Surprising events may be relevant or irrelevant for behavior, requiring either flexible adjustment or stabilization of our model of the world and according response strategies. Cognitive flexibility and stability in response to environmental demands have been described as separable cognitive states, associated with activity of striatal and lateral prefrontal regions, respectively. It so far remains unclear, however, whether these two states act in an antagonistic fashion and which neural mechanisms mediate the selection of respective responses, on the one hand, and a transition between these states, on the other. In this study, we tested whether the functional dichotomy between striatal and prefrontal activity applies for the separate functions of updating (in response to changes in the environment, i.e., switches) and shielding (in response to chance occurrences of events violating expectations, i.e., drifts) of current predictions. We measured brain activity using fMRI while 20 healthy participants performed a task that required to serially predict upcoming items. Switches between predictable sequences had to be indicated via button press while sequence omissions (drifts) had to be ignored. We further varied the probability of switches and drifts to assess the neural network supporting the transition between flexible and stable cognitive states as a function of recent performance history in response to environmental demands. Flexible switching between models was associated with activation in medial pFC (BA 9 and BA 10), whereas stable maintenance of the internal model corresponded to activation in the lateral pFC (BA 6 and inferior frontal gyrus). Our findings extend previous studies on the interplay of flexibility and stability, suggesting that different prefrontal regions are activated by different types of prediction errors, dependent on their behavioral requirements. Furthermore, we found that striatal activation in response to switches and drifts was modulated by participants' successful behavior toward these events, suggesting the striatum to be responsible for response selections following unpredicted stimuli. Finally, we observed that the dopaminergic midbrain modulates the transition between different cognitive states, thresholded by participants' individual performance history in response to temporal environmental demands.

Behavioral and TMS Markers of Action Observation Might Reflect Distinct Neuronal Processes

Transcranial magnetic stimulation (TMS) studies have shown that observing an action induces muscle-specific changes in corticospinal excitability. From a signal detection theory standpoint, this pattern can be related to sensitivity, which here would measure the capacity to distinguish between two action observation conditions. In parallel to these TMS studies, action observation has also been linked to behavioral effects such as motor priming and interference. It has been hypothesized that behavioral markers of action observation could be related to TMS markers and thus represent a potentially cost-effective mean of assessing the functioning of the action-perception system. However, very few studies have looked at possible relationships between these two measures. The aim of this study was to investigate if individual differences in sensitivity to action observation could be related to the behavioral motor priming and interference effects produced by action observation. To this end, 14 healthy participants observed index and little finger movements during a TMS task and a stimulus-response compatibility task. Index muscle displayed sensitivity to action observation, and action observation resulted in significant motor priming+interference, while no significant effect was observed for the little finger in both task. Nevertheless, our results indicate that the sensitivity measured in TMS was not related to the behavioral changes measured in the stimulus-response compatibility task. Contrary to a widespread assumption, the current results indicate that individual differences in physiological and behavioral markers of action observation may be unrelated. This could have important impacts on the potential use of behavioral markers in place of more costly physiological markers of action observation in clinical settings.

Hearing, feeling or seeing a beat recruits a supramodal network in the auditory dorsal stream

Hearing a beat recruits a wide neural network that involves the auditory cortex and motor planning regions. Perceiving a beat can potentially be achieved via vision or even touch, but it is currently not clear whether a common neural network underlies beat processing. Here, we used functional magnetic resonance imaging (fMRI) to test to what extent the neural network involved in beat processing is supramodal, that is, is the same in the different sensory modalities. Brain activity changes in 27 healthy volunteers were monitored while they were attending to the same rhythmic sequences (with and without a beat) in audition, vision and the vibrotactile modality. We found a common neural network for beat detection in the three modalities that involved parts of the auditory dorsal pathway. Within this network, only the putamen and the supplementary motor area (SMA) showed specificity to the beat, while the brain activity in the putamen covariated with the beat detection speed. These results highlighted the implication of the auditory dorsal stream in beat detection, confirmed the important role played by the putamen in beat detection and indicated that the neural network for beat detection is mostly supramodal. This constitutes a new example of convergence of the same functional attributes into one centralized representation in the brain.