Dissociating visual and motor directional selectivity using visuomotor adaptation

Modulation of dorsal premotor cortex differentially influences visuomotor adaptation in young and older adults

The communication between dorsal premotor cortex (PMd) and primary motor cortex (M1) is important for visuomotor adaptation, but it is unclear how this relationship changes with advancing age. The present study recruited 21 young and 23 older participants for two experimental sessions during which intermittent theta burst stimulation (iTBS) or sham was applied over PMd. We assessed the effects of PMd iTBS on M1 excitability using motor evoked potentials (MEP) recorded from right first dorsal interosseous when single-pulse transcranial magnetic stimulation (TMS) was applied with posterior-anterior (PA) or anterior-posterior (AP) currents; and adaptation by quantifying error recorded during a visuomotor adaptation task (VAT). PMd iTBS potentiated PA (P < 0.0001) and AP (P < 0.0001) MEP amplitude in both young and older adults. PMd iTBS increased error in young adults during adaptation (P = 0.026), but had no effect in older adults (P = 0.388). Although PMd iTBS potentiated M1 excitability in both young and older adults, the intervention attenuated visuomotor adaptation specifically in young adults.

Associative white matter tracts selectively predict sensorimotor learning

Human learning varies greatly among individuals and is related to the microstructure of major white matter tracts in several learning domains, yet the impact of the existing microstructure of white matter tracts on future learning outcomes remains unclear. We employed a machine-learning model selection framework to evaluate whether existing microstructure might predict individual differences in learning a sensorimotor task, and further, if the mapping between tract microstructure and learning was selective for learning outcomes. We used diffusion tractography to measure the mean fractional anisotropy (FA) of white matter tracts in 60 adult participants who then practiced drawing a set of 40 unfamiliar symbols repeatedly using a digital writing tablet. We measured drawing learning as the slope of draw duration over the practice session and measured visual recognition learning for the symbols using an old/new 2-AFC task. Results demonstrated that tract microstructure selectively predicted learning outcomes, with left hemisphere pArc and SLF3 tracts predicting drawing learning and the left hemisphere MDLFspl predicting visual recognition learning. These results were replicated using repeat, held-out data and supported with complementary analyses. Results suggest that individual differences in the microstructure of human white matter tracts may be selectively related to future learning outcomes.

A lateralized motor network in order to understand adaptation to visuomotor rotation

Objective.The functional asymmetry between the two brain hemispheres in language and spatial processing is well documented. However, a description of difference in control between the two hemispheres in motor function is not well established. Our primary objective in this study was to examine the distribution of control in the motor hierarchy and its variation across hemispheres.Approach.We developed a computation model termed the bilateral control network and implemented the same in a neural network framework to be used to replicate certain experimental results. The network consists of a simple arm model capable of making movements in 2D space and a motor hierarchy with separate elements coding target location, estimated position of arm, direction, and distance to be moved by the arm, and the motor command sent to the arm. The main assumption made here is the division of direction and distance coding between the two hemispheres with distance coded in the non-dominant and direction coded in the dominant hemisphere.Main results.With this assumption, the network was able to show main results observed in visuomotor adaptation studies. Importantly it showed decrease in error exhibited by the untrained arm while the other arm underwent training compared to the corresponding naïve arm's performance-transfer of motor learning from trained to the untrained arm. It also showed how this varied depending on the performance variable used-with distance as the measure, the non-dominant arm showed transfer and with direction, dominant arm showed transfer.Significance.Our results indicate the possibility of shared control between the two hemispheres. If indeed found true, this result could have major significance in motor rehabilitation as treatment strategies will need to be designed in order to account for this and can no longer be confined to the arm contralateral to the affected hemisphere.

Prediction error in implicit adaptation during visually- and memory-guided reaching tasks

Human movements are adjusted by motor adaptation in order to maintain their accuracy. There are two systems in motor adaptation, referred to as explicit or implicit adaptation. It has been suggested that the implicit adaptation is based on the prediction error and has been used in a number of motor adaptation studies. This study aimed to examine the effect of visual memory on prediction error in implicit visuomotor adaptation by comparing visually- and memory-guided reaching tasks. The visually-guided task is thought to be implicit learning based on prediction error, whereas the memory-guided task requires more cognitive processes. We observed the adaptation to visuomotor rotation feedback that is gradually rotated. We found that the adaptation and retention rates were higher in the visually-guided task than in the memory-guided task. Furthermore, the delta-band power obtained by electroencephalography (EEG) in the visually-guided task was increased immediately following the visual feedback, which indicates that the prediction error was larger in the visually-guided task. Our results show that the visuomotor adaptation is enhanced in the visually-guided task because the prediction error, which contributes update of the internal model, was more reliable than in the memory-guided task. Therefore, we suggest that the processing of the prediction error is affected by the task-type, which in turn affects the rate of the visuomotor adaptation.

Effector-independent Representations Guide Sequential Target Selection Biases in Action

Previous work shows that automatic attention biases toward recently selected target features transfer across action and perception and even across different effectors such as the eyes and hands on a trial-by-trial basis. Although these findings suggest a common neural representation of selection history across effectors, the extent to which information about recently selected target features is encoded in overlapping versus distinct brain regions is unknown. Using fMRI and a priming of pop-out task where participants selected unpredictable, uniquely colored targets among homogeneous distractors via reach or saccade, we show that color priming is driven by shared, effector-independent underlying representations of recent selection history. Consistent with previous work, we found that the intraparietal sulcus (IPS) was commonly activated on trials where target colors were switched relative to those where the colors were repeated; however, the dorsal anterior insula exhibited effector-specific activation related to color priming. Via multivoxel cross-classification analyses, we further demonstrate that fine-grained patterns of activity in both IPS and the medial temporal lobe encode information about selection history in an effector-independent manner, such that ROI-specific models trained on activity patterns during reach selection could predict whether a color was repeated or switched on the current trial during saccade selection and vice versa. Remarkably, model generalization performance in IPS and medial temporal lobe also tracked individual differences in behavioral priming sensitivity across both types of action. These results represent a first step to clarify the neural substrates of experience-driven selection biases in contexts that require the coordination of multiple actions.

Neural representations for multi-context visuomotor adaptation and the impact of common representation on multi-task performance: a multivariate decoding approach

The human brain's remarkable motor adaptability stems from the formation of context representations and the use of a common context representation (e.g., an invariant task structure across task contexts) derived from structural learning. However, direct evaluation of context representations and structural learning in sensorimotor tasks remains limited. This study aimed to rigorously distinguish neural representations of visual, movement, and context levels crucial for multi-context visuomotor adaptation and investigate the association between representation commonality across task contexts and adaptation performance using multivariate decoding analysis with fMRI data. Here, we focused on three distinct task contexts, two of which share a rotation structure (i.e., visuomotor rotation contexts with -90° and +90° rotations, in which the mouse cursor's movement was rotated 90 degrees counterclockwise and clockwise relative to the hand-movement direction, respectively) and the remaining one does not (i.e., mirror-reversal context where the horizontal movement of the computer mouse was inverted). This study found that visual representations (i.e., visual direction) were decoded in the occipital area, while movement representations (i.e., hand-movement direction) were decoded across various visuomotor-related regions. These findings are consistent with prior research and the widely recognized roles of those areas. Task-context representations (i.e., either -90° rotation, +90° rotation, or mirror-reversal) were also distinguishable in various brain regions. Notably, these regions largely overlapped with those encoding visual and movement representations. This overlap suggests a potential intricate dependency of encoding visual and movement directions on the context information. Moreover, we discovered that higher task performance is associated with task-context representation commonality, as evidenced by negative correlations between task performance and task-context-decoding accuracy in various brain regions, potentially supporting structural learning. Importantly, despite limited similarities between tasks (e.g., rotation and mirror-reversal contexts), such association was still observed, suggesting an efficient mechanism in the brain that extracts commonalities from different task contexts (such as visuomotor rotations or mirror-reversal) at multiple structural levels, from high-level abstractions to lower-level details. In summary, while illuminating the intricate interplay between visuomotor processing and context information, our study highlights the efficiency of learning mechanisms, thereby paving the way for future exploration of the brain's versatile motor ability.

Writing letters in two graphic systems: Behavioral and neural correlates in Latin-Arabic biscripters

Biscriptuality is the ability to read and write using two scripts. Despite the increasing number of biscripters, this phenomenon remains poorly understood. Here, we focused on investigating graphomotor processing in French-Arabic biscripters. We chose the French and Arabic alphabets because they have comparable visuospatial complexity and linguistic features, but differ dramatically in their graphomotor characteristics. In a first experiment we describe the graphomotor features of the two alphabets and showed that while Arabic and Latin letters are produced with the same velocity and fluency, Arabic letters require more pen lifts, contain more right-to-left strokes and clockwise curves, and take longer to write than Latin letters. These results suggest that Arabic and Latin letters are produced via different motor patterns. In a second experiment we used functional magnetic resonance imaging to ask whether writing the two scripts relies upon partially distinct or fully overlapping neural networks, and whether the elements of the previously described handwriting network are recruited to the same extent by the two scripts. We found that both scripts engaged the so-called "writing network", but that within the network, Arabic letters recruited the left superior parietal lobule (SPL) and the left primary motor cortex (M1) more strongly than Latin letters. Both regions have previously been identified as holding scale-invariant representations of letter trajectories. Arabic and Latin letters also activated distinct regions that do not belong to the writing network. Complementary analyses indicate that the differences observed between scripts at the neural level could be driven by the specific graphomotor features of each script. Overall, our results indicate that particular features of the practiced scripts can lead to different motor organization at both the behavioral and brain levels in biscripters.

EEG responses induced by cerebellar TMS at rest and during visuomotor adaptation

BACKGROUND

Connections between the cerebellum and the cortex play a critical role in learning and executing complex behaviours. Dual-coil transcranial magnetic stimulation (TMS) can be used non-invasively to probe connectivity changes between the lateral cerebellum and motor cortex (M1) using the motor evoked potential as an outcome measure (cerebellar-brain inhibition, CBI). However, it gives no information about cerebellar connections to other parts of cortex.

OBJECTIVES

We used electroencephalography (EEG) to investigate whether it was possible to detect activity evoked in any areas of cortex by single-pulse TMS of the cerebellum (cerebellar TMS evoked potentials, cbTEPs). A second experiment tested if these responses were influenced by the performance of a cerebellar-dependent motor learning paradigm.

METHODS

In the first series of experiments, TMS was applied over either the right or left cerebellar cortex, and scalp EEG was recorded simultaneously. Control conditions that mimicked auditory and somatosensory inputs associated with cerebellar TMS were included to identify responses due to non-cerebellar sensory stimulation. We conducted a follow-up experiment that evaluated whether cbTEPs are behaviourally sensitive by assessing individuals before and after learning a visuomotor reach adaptation task.

RESULTS

A TMS pulse over the lateral cerebellum evoked EEG responses that could be distinguished from those caused by auditory and sensory artefacts. Significant positive (P80) and negative peaks (N110) over the contralateral frontal cerebral area were identified with a mirrored scalp distribution after left vs. right cerebellar stimulation. The P80 and N110 peaks were replicated in the cerebellar motor learning experiment and changed amplitude at different stages of learning. The change in amplitude of the P80 peak was associated with the degree of learning that individuals retained following adaptation. Due to overlap with sensory responses, the N110 should be interpreted with caution.

CONCLUSIONS

Cerebral potentials evoked by TMS of the lateral cerebellum provide a neurophysiological probe of cerebellar function that complements the existing CBI method. They may provide novel insight into mechanisms of visuomotor adaptation and other cognitive processes.

Associative white matter tracts selectively predict sensorimotor learning

Human learning is a complex phenomenon that varies greatly among individuals and is related to the microstructure of major white matter tracts in several learning domains, yet the impact of the existing myelination of white matter tracts on future learning outcomes remains unclear. We employed a machine-learning model selection framework to evaluate whether existing microstructure might predict individual differences in the potential for learning a sensorimotor task, and further, if the mapping between the microstructure of major white matter tracts and learning was selective for learning outcomes. We used diffusion tractography to measure the mean fractional anisotropy (FA) of white matter tracts in 60 adult participants who then underwent training and subsequent testing to evaluate learning. During training, participants practiced drawing a set of 40 novel symbols repeatedly using a digital writing tablet. We measured drawing learning as the slope of draw duration over the practice session and visual recognition learning as the performance accuracy in an old/new 2-AFC recognition task. Results demonstrated that the microstructure of major white matter tracts selectively predicted learning outcomes, with left hemisphere pArc and SLF 3 tracts predicting drawing learning and the left hemisphere MDLFspl predicting visual recognition learning. These results were replicated in a repeat, held-out data set and supported with complementary analyses. Overall, results suggest that individual differences in the microstructure of human white matter tracts may be selectively related to future learning outcomes and open avenues of inquiry concerning the impact of existing tract myelination in the potential for learning.

Significance statement

A selective mapping between tract microstructure and future learning has been demonstrated in the murine model and, to our knowledge, has not yet been demonstrated in humans. We employed a data-driven approach that identified only two tracts, the two most posterior segments of the arcuate fasciculus in the left hemisphere, to predict learning a sensorimotor task (drawing symbols) and this prediction model did not transfer to other learning outcomes (visual symbol recognition). Results suggest that individual differences in learning may be selectively related to the tissue properties of major white matter tracts in the human brain.

A Preliminary Investigation into the Neural Correlates of Knee Loading during a Change of Direction Task in Individuals after Anterior Cruciate Ligament Reconstruction

Background

Central nervous system (CNS) function after ACLR, quantified by the blood oxygen level dependent (BOLD) response, is altered in regions of sensory function during knee movement after ACLR. However, it is unknown how this altered neural response may manifest in knee loading and response to sensory perturbations during sport specific movements.

Purpose

To investigate the relationship among CNS function and lower extremity kinetics, under multiple visual conditions, during 180° change of direction task in individuals with a history of ACLR.

Methods

Eight participants, 39.3 ± 37.1 months after primary, left ACLR performed repetitive active knee flexion and extension of their involved knee during fMRI scanning. Participants separately performed 3D motion capture analysis of a 180° change of direction task under full vision (FV) and stroboscopic vision (SV) conditions. A neural correlate analysis was performed to associate BOLD signal to knee loading of the left lower extremity.

Results

Involved limb peak internal knee extension moment (pKEM) was significantly lower in the SV condition (1.89 ± 0.37 N*m/Kg) compared to the FV condition (2.0 ± 0.34 N*m/Kg) (p = .018). Involved limb pKEM during the SV condition was positively correlated with BOLD signal in the contralateral precuneus and superior parietal lobe (Voxels: 53; p = .017; z-stat max: 6.47; MNI peak: 6, -50, 66).

Conclusion

There is a positive association between involved limb pKEM in the SV condition and BOLD response in areas of visual-sensory integration. Activation of contralateral precuneus and superior parietal lobe brain regions may be a strategy to maintain joint loading when vision is perturbed.

Level of Evidence

Level 3.

Enhanced cognitive performance after multiple adaptations to visuomotor transformations

Several studies reported that adaptation to a visuomotor transformation correlates with the performance in cognitive performance tests. However, it is unclear whether there is a causal relationship between sensorimotor adaptation and cognitive performance. The present study examined whether repeated adaptations to double steps and rotated feedback increase cognitive performance assessed by neuropsychological tests in a pre-post design. The participants of the intervention group adapted in 24 sessions their hand movements to visuomotor transformations with increasing size. Pre-post changes were significantly larger in the intervention group than in a control group without training. This result suggests a causal relationship between sensorimotor adaptation training and cognitive performance.

Using EEG to study sensorimotor adaptation

Sensorimotor adaptation, or the capacity to flexibly adapt movements to changes in the body or the environment, is crucial to our ability to move efficiently in a dynamic world. The field of sensorimotor adaptation is replete with rigorous behavioural and computational methods, which support strong conceptual frameworks. An increasing number of studies have combined these methods with electroencephalography (EEG) to unveil insights into the neural mechanisms of adaptation. We review these studies: discussing EEG markers of adaptation in the frequency and the temporal domain, EEG predictors for successful adaptation and how EEG can be used to unmask latent processes resulting from adaptation, such as the modulation of spatial attention. With its high temporal resolution, EEG can be further exploited to deepen our understanding of sensorimotor adaptation.

Anterograde interference emerges along a gradient as a function of task similarity: A behavioural study

Anterograde interference emerges when two opposite (B → A) or identical tasks (A → A) are learned in close temporal succession, suggesting that interference cannot be fully accounted for by competing memories. Informed by neurobiological evidence, this work tested the hypothesis that interference depends upon the degree of overlap between the neural networks involved in the learning of two tasks. In a fully within‐subject and counterbalanced design, participants (n = 24) took part in two learning sessions where the putative overlap between learning‐specific neural networks was behaviourally manipulated across four conditions by modifying reach direction and the effector used during gradual visuomotor adaptation. The results showed that anterograde interference emerged regardless of memory competition—that is, to a similar extent in the B → A and A → A conditions—and along a gradient as a function of the tasks' similarity. Specifically, learning under similar reaching conditions generated more anterograde interference than learning under dissimilar reaching conditions, suggesting that putatively overlapping neural networks are required to generate interference. Overall, these results indicate that competing memories are not the sole contributor to anterograde interference and suggest that overlapping neural networks between two learning sessions are required to trigger interference. One discussed possibility is that initial learning modifies the properties of its neural networks to constrain further plasticity induction and learning capabilities, therefore causing anterograde interference in a network‐dependent manner. One implication is that learning‐specific neural networks must be maximally dissociated to minimize the interfering influences of previous learning on subsequent learning.

Protracted Neural Development of Dorsal Motor Systems During Handwriting and the Relation to Early Literacy Skills

Handwriting is a complex visual-motor skill that affects early reading development. A large body of work has demonstrated that handwriting is supported by a widespread neural system comprising ventral-temporal, parietal, and frontal motor regions in adults. Recent work has demonstrated that this neural system is largely established by 8 years of age, suggesting that the development of this system occurs in young children who are still learning to read and write. We made use of a novel MRI-compatible writing tablet that allowed us to measure brain activation in 5-8-year-old children during handwriting. We compared activation during handwriting in children and adults to provide information concerning the developmental trajectory of the neural system that supports handwriting. We found that parietal and frontal motor involvement during handwriting in children is different from adults, suggesting that the neural system that supports handwriting changes over the course of development. Furthermore, we found that parietal and frontal motor activation correlated with a literacy composite score in our child sample, suggesting that the individual differences in the dorsal response during handwriting are related to individual differences in emerging literacy skills. Our results suggest that components of the widespread neural system supporting handwriting develop at different rates and provide insight into the mechanisms underlying the contributions of handwriting to early literacy development.

Aging Effect on Visuomotor Adaptation: Mediated by Cognitive Decline

The question of whether and how aging affects humans’ visuomotor adaptation remains controversial. This study investigates how the effect of aging on visuomotor adaptation is related to age-related cognitive declines. We compared the performance of 100 older people (age: 55–82 years) and 20 young adults (age: 18–27 years) on a visuomotor adaptation task and three cognition tasks. A decline in visuomotor adaptation of older people was well observed. However, this decline was not strongly correlated with chronological age increase but was associated to the age-related declines of cognitive functions and speed of motor planning. We then constructed a structural mediation model in which the declined cognitive resources mediated the effect of age increase on the decline in visuomotor adaptation. The data from the present study was well-explained by the mediation model. These findings indicate that the aging effect on visuomotor adaptation mainly reflects the age-related decline of cognitive functions, which results in insufficient explicit processing on visual perturbation during visuomotor control.

Playing the piano with a robotic third thumb: assessing constraints of human augmentation

Contemporary robotics gives us mechatronic capabilities for augmenting human bodies with extra limbs. However, how our motor control capabilities pose limits on such augmentation is an open question. We developed a Supernumerary Robotic 3rd Thumbs (SR3T) with two degrees-of-freedom controlled by the user’s body to endow them with an extra contralateral thumb on the hand. We demonstrate that a pianist can learn to play the piano with 11 fingers within an hour. We then evaluate 6 naïve and 6 experienced piano players in their prior motor coordination and their capability in piano playing with the robotic augmentation. We show that individuals’ augmented performance with the SR3T could be explained by our new custom motor coordination assessment, the Human Augmentation Motor Coordination Assessment (HAMCA) performed pre-augmentation. Our work demonstrates how supernumerary robotics can augment humans in skilled tasks and that individual differences in their augmentation capability are explainable by their individual motor coordination abilities.

Acoustic stimulation increases implicit adaptation in sensorimotor adaptation

Sensorimotor adaptation is an important part of our ability to perform novel motor tasks (i.e., learning of motor skills). Efforts to improve adaptation in healthy and clinical patients using non-invasive brain stimulation methods have been hindered by inter-individual and intra-individual variability in brain susceptibility to stimulation. Here, we explore unpredictable loud acoustic stimulation as an alternative method of modulating brain excitability to improve sensorimotor adaptation. In two experiments, participants moved a cursor towards targets, and adapted to a 30º rotation of cursor feedback, either with or without unpredictable acoustic stimulation. Acoustic stimulation improved initial adaptation to sensory prediction errors in Study 1, and improved overnight retention of adaptation in Study 2. Unpredictable loud acoustic stimulation might thus be a potent method of modulating sensorimotor adaptation in healthy adults.

Mini-review: The Role of the Cerebellum in Visuomotor Adaptation

The incredible capability of the brain to quickly alter performance in response to ever-changing environment is rooted in the process of adaptation. The core aspect of adaptation is to fit an existing motor program to altered conditions. Adaptation to a visuomotor rotation or an external force has been well established as tools to study the mechanisms underlying sensorimotor adaptation. In this mini-review, we summarize recent findings from the field of visuomotor adaptation. We focus on the idea that the cerebellum plays a central role in the process of visuomotor adaptation and that interactions with cortical structures, in particular, the premotor cortex and the parietal cortex, may be crucial for this process. To this end, we cover a range of methodologies used in the literature that link cerebellar functions and visuomotor adaptation; behavioral studies in cerebellar lesion patients, neuroimaging and non-invasive stimulation approaches. The mini-review is organized as follows: first, we provide evidence that sensory prediction errors (SPE) in visuomotor adaptation rely on the cerebellum based on behavioral studies in cerebellar patients. Second, we summarize structural and functional imaging studies that provide insight into spatial localization as well as visuomotor adaptation dynamics in the cerebellum. Third, we discuss premotor — cerebellar interactions and how these may underlie visuomotor adaptation. And finally, we provide evidence from transcranial direct current and magnetic stimulation studies that link cerebellar activity, beyond correlational relationships, to visuomotor adaptation .

Embodied virtual reality for the study of real-world motor learning

Motor-learning literature focuses on simple laboratory-tasks due to their controlled manner and the ease to apply manipulations to induce learning and adaptation. Recently, we introduced a billiards paradigm and demonstrated the feasibility of real-world-neuroscience using wearables for naturalistic full-body motion-tracking and mobile-brain-imaging. Here we developed an embodied virtual-reality (VR) environment to our real-world billiards paradigm, which allows to control the visual feedback for this complex real-world task, while maintaining sense of embodiment. The setup was validated by comparing real-world ball trajectories with the trajectories of the virtual balls, calculated by the physics engine. We then ran our short-term motor learning protocol in the embodied VR. Subjects played billiard shots when they held the physical cue and hit a physical ball on the table while seeing it all in VR. We found comparable short-term motor learning trends in the embodied VR to those we previously reported in the physical real-world task. Embodied VR can be used for learning real-world tasks in a highly controlled environment which enables applying visual manipulations, common in laboratory-tasks and rehabilitation, to a real-world full-body task. Embodied VR enables to manipulate feedback and apply perturbations to isolate and assess interactions between specific motor-learning components, thus enabling addressing the current questions of motor-learning in real-world tasks. Such a setup can potentially be used for rehabilitation, where VR is gaining popularity but the transfer to the real-world is currently limited, presumably, due to the lack of embodiment.

Motor learning in real-world pool billiards

The neurobehavioral mechanisms of human motor-control and learning evolved in free behaving, real-life settings, yet this is studied mostly in reductionistic lab-based experiments. Here we take a step towards a more real-world motor neuroscience using wearables for naturalistic full-body motion-tracking and the sports of pool billiards to frame a real-world skill learning experiment. First, we asked if well-known features of motor learning in lab-based experiments generalize to a real-world task. We found similarities in many features such as multiple learning rates, and the relationship between task-related variability and motor learning. Our data-driven approach reveals the structure and complexity of movement, variability, and motor learning, enabling an in-depth understanding of the structure of motor learning in three ways: First, while expecting most of the movement learning is done by the cue-wielding arm, we find that motor learning affects the whole body, changing motor-control from head to toe. Second, during learning, all subjects decreased their movement variability and their variability in the outcome. Subjects who were initially more variable were also more variable after learning. Lastly, when screening the link across subjects between initial variability in individual joints and learning, we found that only the initial variability in the right forearm supination shows a significant correlation to the subjects' learning rates. This is in-line with the relationship between learning and variability: while learning leads to an overall reduction in movement variability, only initial variability in specific task-relevant dimensions can facilitate faster learning.

Visual experiences during letter production contribute to the development of the neural systems supporting letter perception

Letter production through handwriting creates visual experiences that may be important for the development of visual letter perception. We sought to better understand the neural responses to different visual percepts created during handwriting at different levels of experience. Three groups of participants, younger children, older children, and adults, ranging in age from 4.5 to 22 years old, were presented with dynamic and static presentations of their own handwritten letters, static presentations of an age-matched control's handwritten letters, and typeface letters during fMRI. First, data from each group were analyzed through a series of contrasts designed to highlight neural systems that were most sensitive to each visual experience in each age group. We found that younger children recruited ventral-temporal cortex during perception and this response was associated with the variability present in handwritten forms. Older children and adults also recruited ventral-temporal cortex; this response, however, was significant for typed letter forms but not variability. The adult response to typed letters was more distributed than in the children, including ventral-temporal, parietal, and frontal motor cortices. The adult response was also significant for one's own handwritten letters in left parietal cortex. Second, we compared responses among age groups. Compared to older children, younger children demonstrated a greater fusiform response associated with handwritten form variability. When compared to adults, younger children demonstrated a greater response to this variability in left parietal cortex. Our results suggest that the visual perception of the variability present in handwritten forms that occurs during handwriting may contribute to developmental changes in the neural systems that support letter perception.

Ecological validity of experimental set-up affects parietal involvement during letter production

Studies of symbol production using fMRI often use techniques that introduce an artificial pairing between motor production and visual perception. These techniques allow participants to see their own output by recording their pen trajectories using a touchscreen-only tablet and displaying these productions on a mirror placed above their head. We recently developed an MR-safe writing tablet with video display that allows participants to see their own hand and their own productions while producing symbols in real time on the surface where they are producing them-allowing for more ecologically valid fMRI studies of production. We conducted a study to determine whether the participation of posterior parietal cortex during symbol production was affected by the pairing of motor production and visual feedback associated with the two types of tablets. We performed ROI analyses in intraparietal sulcus while adult participants produced letters to dictation using either a touchscreen-only tablet (no visual guidance of the hand) (n = 14) or using a touchscreen-and-video-display tablet (visual guidance of the hand) (n = 14). We found that left posterior intraparietal sulcus was more active during production with the touchscreen-only tablet than during production with the touchscreen-and-video-display tablet. These results suggest that posterior parietal involvement during production tasks is associated with the somewhat artificial visual-motor pairing that is introduced by the techniques used in some studies of symbol production.

Mechanistic determinants of effector-independent motor memory encoding

Coordinated, purposeful movements learned with one effector generalize to another effector, a finding that has important implications for tool use, sports, performing arts, and rehabilitation. This occurs because the motor memory acquired through learning comprises representations that are effector-independent. Despite knowing this for decades, the neural mechanisms and substrates that are causally associated with the encoding of effector-independent motor memories remain poorly understood. Here we exploit intereffector generalization, the behavioral signature of effector-independent representations, to address this crucial gap. We first show in healthy human participants that postlearning generalization across effectors is principally predicted by the level of an implicit mechanism that evolves gradually during learning to produce a temporally stable memory. We then demonstrate that interfering with left but not right posterior parietal cortex (PPC) using high-definition cathodal transcranial direct current stimulation impedes learning mediated by this mechanism, thus potentially preventing the encoding of effector-independent memory components. We confirm this in our final experiment in which we show that disrupting left PPC but not primary motor cortex after learning has been allowed to occur blocks intereffector generalization. Collectively, our results reveal the key mechanism that encodes an effector-independent memory trace and uncover a central role for the PPC in its representation. The encoding of such motor memory components outside primary sensorimotor regions likely underlies a parsimonious neural organization that enables more efficient movement planning in the brain, independent of the effector used to act.

A Revised Computational Neuroanatomy for Motor Control

We discuss a new framework for understanding the structure of motor control. Our approach integrates existing models of motor control with the reality of hierarchical cortical processing and the parallel segregated loops that characterize cortical-subcortical connections. We also incorporate the recent claim that cortex functions via predictive representation and optimal information utilization. Our framework assumes that each cortical area engaged in motor control generates a predictive model of a different aspect of motor behavior. In maintaining these predictive models, each area interacts with a different part of the cerebellum and BG. These subcortical areas are thus engaged in domain-appropriate system identification and optimization. This refocuses the question of division of function among different cortical areas. What are the different aspects of motor behavior that are predictively modeled? We suggest that one fundamental division is between modeling of task and body whereas another is the model of state and action. Thus, we propose that the posterior parietal cortex, somatosensory cortex, premotor cortex, and motor cortex represent task state, body state, task action, and body action, respectively. In the second part of this review, we demonstrate how this division of labor can better account for many recent findings of movement encoding, especially in the premotor and posterior parietal cortices.

Task Errors Drive Memories That Improve Sensorimotor Adaptation

Traditional views of sensorimotor adaptation (i.e., adaptation of movements to perturbed sensory feedback) emphasize the role of automatic, implicit correction of sensory prediction errors. However, latent memories formed during sensorimotor adaptation, manifest as improved relearning (e.g., savings), have recently been attributed to strategic corrections of task errors (failures to achieve task goals). To dissociate contributions of task errors and sensory prediction errors to latent sensorimotor memories, we perturbed target locations to remove or enforce task errors during learning and/or test, with male/female human participants. Adaptation improved after learning in all conditions where participants were permitted to correct task errors, and did not improve whenever we prevented correction of task errors. Thus, previous correction of task errors was both necessary and sufficient to improve adaptation. In contrast, a history of sensory prediction errors was neither sufficient nor obligatory for improved adaptation. Limiting movement preparation time showed that the latent memories driven by learning to correct task errors take at least two forms: a time-consuming but flexible component, and a rapidly expressible, inflexible component. The results provide strong support for the idea that movement corrections driven by a failure to successfully achieve movement goals underpin motor memories that manifest as savings. Such persistent memories are not exclusively mediated by time-consuming strategic processes but also comprise a rapidly expressible but inflexible component. The distinct characteristics of these putative processes suggest dissociable underlying mechanisms, and imply that identification of the neural basis for adaptation and savings will require methods that allow such dissociations.SIGNIFICANCE STATEMENT Latent motor memories formed during sensorimotor adaptation manifest as improved adaptation when sensorimotor perturbations are reencountered. Conflicting theories suggest that this "savings" is underpinned by different mechanisms, including a memory of successful actions, a memory of errors, or an aiming strategy to correct task errors. Here we show that learning to correct task errors is sufficient to show improved subsequent adaptation with respect to naive performance, even when tested in the absence of task errors. In contrast, a history of sensory prediction errors is neither sufficient nor obligatory for improved adaptation. Finally, we show that latent sensorimotor memories driven by task errors comprise at least two distinct components: a time-consuming, flexible component, and a rapidly expressible, inflexible component.

Hierarchical Action Encoding Within the Human Brain

Humans are able to interact with objects with extreme flexibility. To achieve this ability, the brain does not only control specific muscular patterns, but it also needs to represent the abstract goal of an action, irrespective of its implementation. It is debated, however, how abstract action goals are implemented in the brain. To address this question, we used multivariate pattern analysis of functional magnetic resonance imaging data. Human participants performed grasping actions (precision grip, whole hand grip) with two different wrist orientations (canonical, rotated), using either the left or right hand. This design permitted to investigate a hierarchical organization consisting of three levels of abstraction: 1) “concrete action” encoding; 2) “effector-dependent goal” encoding (invariant to wrist orientation); and 3) “effector-independent goal” encoding (invariant to effector and wrist orientation). We found that motor cortices hosted joint encoding of concrete actions and of effector-dependent goals, while the parietal lobe housed a convergence of all three representations, comprising action goals within and across effectors. The left lateral occipito-temporal cortex showed effector-independent goal encoding, but no convergence across the three levels of representation. Our results support a hierarchical organization of action encoding, shedding light on the neural substrates supporting the extraordinary flexibility of human hand behavior.

Divisively Normalized Integration of Multisensory Error Information Develops Motor Memories Specific to Vision and Proprioception

Both visual and proprioceptive information contribute to the accuracy of limb movement, but the mechanism of integration of these different modality signals for movement control and learning remains controversial. We aimed to elucidate the mechanism of multisensory integration for motor adaptation by evaluating single-trial adaptation (i.e., aftereffect) induced by visual and proprioceptive perturbations while male and female human participants performed reaching movements. The force-channel method was used to precisely impose several combinations of visual and proprioceptive perturbations (i.e., error), including an instance when the directions of perturbation in both stimuli opposed each another. In the subsequent probe force-channel trial, the lateral force against the channel was quantified as the aftereffect to clarify the mechanism by which the motor adaptation system corrects movement in the event of visual and proprioceptive errors. We observed that the aftereffects had complex dependence on the visual and proprioceptive errors. Although this pattern could not be explained by previously proposed computational models based on the reliability of sensory information, we found that it could be reasonably explained by a mechanism known as divisive normalization, which was the reported mechanism underlying the integration of multisensory signals in neurons. Furthermore, we discovered evidence that the motor memory for each sensory modality developed separately in accordance with a divisive normalization mechanism and that the outputs of both memories were integrated. These results provide a novel view of the utilization and integration of different sensory modality signals in motor adaptation.SIGNIFICANCE STATEMENT The mechanism of utilization of multimodal sensory information by the motor control system to perform limb movements with accuracy is a fundamental question. However, the mechanism of integration of these different sensory modalities for movement control and learning remains highly debatable. Herein, we demonstrate that multisensory integration in the motor learning system can be reasonably explained by divisive normalization, a canonical computation, ubiquitously observed in the brain (Carandini and Heeger, 2011). Moreover, we provide evidence of a novel idea that integration does not occur at the sensory information processing level, but at the motor execution level, after the motor memory for each sensory modality is separately created.

Eye Movements during Visuomotor Adaptation Represent Only Part of the Explicit Learning

Visuomotor rotations are learned through a combination of explicit strategy and implicit recalibration. However, measuring the relative contribution of each remains a challenge and the possibility of multiple explicit and implicit components complicates the issue. Recent interest has focused on the possibility that eye movements reflects explicit strategy. Here we compared eye movements during adaptation to two accepted measures of explicit learning: verbal report and the exclusion test. We found that while reporting, all subjects showed a match among all three measures. However, when subjects did not report their intention, the eye movements of some subjects suggested less explicit adaptation than what was measured in an exclusion test. Interestingly, subjects whose eye movements did match their exclusion could be clustered into the following two subgroups: fully implicit learners showing no evidence of explicit adaptation and explicit learners with little implicit adaptation. Subjects showing a mix of both explicit and implicit adaptation were also those where eye movements showed less explicit adaptation than did exclusion. Thus, our results support the idea of multiple components of explicit learning as only part of the explicit learning is reflected in the eye movements. Individual subjects may use explicit components that are reflected in the eyes or those that are not or some mixture of the two. Analysis of reaction times suggests that the explicit components reflected in the eye movements involve longer reaction times. This component, according to recent literature, may be related to mental rotation.

Visuomotor perturbation in a continuous circle tracing task: novel approach for quantifying motor adaptation

The study of motor adaptation certainly has advanced greatly through the years and helped to shed light on the mechanisms of motor learning. Most paradigms used to study adaptation employ a discrete approach, where people adapt in successive attempts. Continuous tasks on the other hand, while known to possess different characteristics than discrete ones, have received little attention regarding the study motor adaptation. In this paper, we test for adaptation using a continuous circle tracing task with a visuomotor gain perturbation. To examine the feasibility of this task, 45 normal subjects divided into 3 groups were tested for adaptation, aftereffects, and generalization. All subjects exhibited a gradual adaptation when faced with a perturbation as well as opposite aftereffects once the perturbation was removed. Aftereffects tended to persist unless veridical feedback was given. The task generalized well both in size and in space. We believe that this task, by being continuous, could allow for a thorough investigation of visuomotor adaptation to gain perturbations in particular, and perhaps be expanded to other types of adaptations as well, especially when used alongside discrete tasks.

Involvement of human left frontoparietal cortices in neural processes associated with task-switching between two sequences of skilled finger movements

In this study, we demonstrate the involvement of left frontoparietal cortices in neural processes for task-switching between skilled movements. Functional magnetic resonance imaging was conducted while thirty-two right-handed healthy participants performed two sequential finger-movement tasks with their left hands. One group (n = 16) trained these tasks through random-practice (tasks were either switched or repeated trial by trial) on one day and blocked-practice (successive intensive practice of each task) on the next day, while the remaining participants practiced in the reverse order. On the first day, performance of both tasks improved in all participants, suggesting that the two skilful tasks can be learned in both practice schedules. However, during the random-practice, the performance in the switched trials initially deteriorated and gradually approached to that in the repeated trials as the practice proceeded. The left (mainly inferior) frontoparietal cortices showed greater preparatory activity for the switched trials compared with the repeated trials in a left-hemispheric dominant manner, and the left intraparietal activity decreased as the performance of the switched trials improved. The results indicate that neural processes for task-switching are associated with the greater preparatory activity in the left inferior frontoparietal cortices, and the efficient switching may proceed concomitantly with the left intraparietal activity reduction.

Allocentric representations for target memory and reaching in human cortex

The use of allocentric cues for movement guidance is complex because it involves the integration of visual targets and independent landmarks and the conversion of this information into egocentric commands for action. Here, we focus on the mechanisms for encoding reach targets relative to visual landmarks in humans. First, we consider the behavioral results suggesting that both of these cues influence target memory, but are then transformed-at the first opportunity-into egocentric commands for action. We then consider the cortical mechanisms for these behaviors. We discuss different allocentric versus egocentric mechanisms for coding of target directional selectivity in memory (inferior temporal gyrus versus superior occipital gyrus) and distinguish these mechanisms from parieto-frontal activation for planning egocentric direction of actual reach movements. Then, we consider where and how the former allocentric representations of remembered reach targets are converted into the latter egocentric plans. In particular, our recent neuroimaging study suggests that four areas in the parietal and frontal cortex (right precuneus, bilateral dorsal premotor cortex, and right presupplementary area) participate in this allo-to-ego conversion. Finally, we provide a functional overview describing how and why egocentric and landmark-centered representations are segregated early in the visual system, but then reintegrated in the parieto-frontal cortex for action.

Functional plasticity of the ipsilateral primary sensorimotor cortex in an elite long jumper with below-knee amputation

Functional plasticity of the sensorimotor cortex occurs following motor practice, as well as after limb amputation. However, the joint effect of limb amputation and intensive, long-term motor practice on cortical plasticity remains unclear. Here, we recorded brain activity during unilateral contraction of the hip, knee, and ankle joint muscles from a long jump Paralympic gold medalist with a unilateral below-knee amputation (Amputee Long Jumper, ALJ). He used the amputated leg with a prosthesis for take-off. Under similar conditions to the ALJ, we also recorded brain activity from healthy long jumpers (HLJ) and non-athletes with a below-knee amputation. During a rhythmic isometric contraction of knee extensor muscles with the take-off/prosthetic leg, the ALJ activated not only the contralateral primary sensorimotor cortex (M1/S1), but also the ipsilateral M1/S1. In addition, this ipsilateral M1/S1 activation was significantly greater than that seen in the HLJ. However, we did not find any significant differences between the ALJ and HLJ in M1/S1 activation during knee muscle contraction in the non-take-off/intact leg, nor during hip muscle contraction on either side. Region of interest analysis revealed that the ALJ exhibited a greater difference in M1/S1 activity and activated areas ipsilateral to the movement side between the take-off/prosthetic and non-take-off/intact legs during knee muscle contraction compared with the other two groups. However, difference in activity in M1/S1 contralateral to the movement side did not differ across groups. These results suggest that a combination of below-knee amputation and intensive, prolonged long jump training using a prosthesis (i.e. fine knee joint control) induced an expansion of the functional representation of the take-off/prosthetic leg in the ipsilateral M1/S1 in a muscle-specific manner. These results provide novel insights into the potential for substantial cortical plasticity with an extensive motor rehabilitation program.

•

A Paralympic gold medalist with a unilateral below-knee amputation was recruited.

•

Brain activity during hip, knee, and ankle movements was recorded.

•

Brain activity was compared with healthy athletes and non-athletes with amputation.

•

Greater ipsilateral M1/S1 activity during knee movement was observed in the medalist.

•

Intensive motor practice and limb amputation would induce drastic neural plasticity.

Eye movements do not play an important role in the adaptation of hand tracking to a visuomotor rotation

Adapting hand movements to changes in our body or the environment is essential for skilled motor behavior. Although eye movements are known to assist hand movement control, how eye movements might contribute to the adaptation of hand movements remains largely unexplored. To determine to what extent eye movements contribute to visuomotor adaptation of hand tracking, participants were asked to track a visual target that followed an unpredictable trajectory with a cursor using a joystick. During blocks of trials, participants were either allowed to look wherever they liked or required to fixate a cross at the center of the screen. Eye movements were tracked to ensure gaze fixation as well as to examine free gaze behavior. The cursor initially responded normally to the joystick, but after several trials, the direction in which it responded was rotated by 90°. Although fixating the eyes had a detrimental influence on hand tracking performance, participants exhibited a rather similar time course of adaptation to rotated visual feedback in the gaze-fixed and gaze-free conditions. More importantly, there was extensive transfer of adaptation between the gaze-fixed and gaze-free conditions. We conclude that although eye movements are relevant for the online control of hand tracking, they do not play an important role in the visuomotor adaptation of such tracking. These results suggest that participants do not adapt by changing the mapping between eye and hand movements, but rather by changing the mapping between hand movements and the cursor’s motion independently of eye movements.

NEW & NOTEWORTHY Eye movements assist hand movements in everyday activities, but their contribution to visuomotor adaptation remains largely unknown. We compared adaptation of hand tracking under free gaze and fixed gaze. Although our results confirm that following the target with the eyes increases the accuracy of hand movements, they unexpectedly demonstrate that gaze fixation does not hinder adaptation. These results suggest that eye movements have distinct contributions for online control and visuomotor adaptation of hand movements.

A rapid visuomotor response on the human upper limb is selectively influenced by implicit motor learning

How do humans learn to adapt their motor actions to achieve task success? Recent behavioral and patient studies have challenged the classic notion that motor learning arises solely from the errors produced during a task, suggesting instead that explicit cognitive strategies can act in concert with the implicit, error-based, motor learning component. In this study, we show that the earliest wave of directionally tuned neuromuscular activity that begins within ~100 ms of peripheral visual stimulus onset is selectively influenced by the implicit component of motor learning. In contrast, the voluntary neuromuscular activity associated with reach initiation, which evolves ~100-200 ms later, is influenced by both the implicit and explicit components of motor learning. The selective influence of the implicit, but not explicit, component of motor learning on the directional tuning of the earliest cascade of neuromuscular activity supports the notion that these components of motor learning can differentially influence descending motor pathways. NEW & NOTEWORTHY Motor learning can be driven both by an implicit error-based component and an explicit strategic component, but the influence of these components on the descending pathways that contribute to motor control is unknown. In this study, we show that the implicit component selectively influences a reflexive circuit that rapidly generates a visuomotor response on the human upper limb. Our results show that the substrates mediating implicit and explicit motor learning exert distinct influences on descending motor pathways.

An Analysis of the Brain Systems Involved with Producing Letters by Hand

Complex visual-motor behaviors dominate human-environment interactions. Letter production, writing individual letters by hand, is an example of a complex visual-motor behavior composed of numerous behavioral components, including the required motor movements and the percepts that those motor movements create. By manipulating and isolating components of letter production, we provide experimental evidence that this complex visual-motor behavior is supported by a widespread neural system that is composed of smaller subsystems related to different sensorimotor components. Adult participants hand-printed letters with and without "ink" on an MR-safe digital writing tablet, perceived static and dynamic representations of their own handwritten letters, and perceived typeface letters during fMRI scanning. Our results can be summarized by three main findings: (1) Frontoparietal systems were associated with the motor component of letter production, whereas temporo-parietal systems were more associated with the visual component. (2) The more anterior regions of the left intraparietal sulcus were more associated with the motor component, whereas the more posterior regions were more associated with the visual component, with an area of visual-motor overlap in the posterior intraparietal sulcus. (3) The left posterior intraparietal sulcus and right fusiform gyrus responded similarly to both visual and motor components, and both regions also responded more during the perception of one's own handwritten letters compared with perceiving typed letters. These findings suggest that the neural systems recruited during complex visual-motor behaviors are composed of a set of interrelated sensorimotor subsystems that support the full behavior in different ways and, furthermore, that some of these subsystems can be rerecruited during passive perception in the absence of the full visual-motor behavior.

How does human motor cortex regulate vocal pitch in singers?

Vocal pitch is used as an important communicative device by humans, as found in the melodic dimension of both speech and song. Vocal pitch is determined by the degree of tension in the vocal folds of the larynx, which itself is influenced by complex and nonlinear interactions among the laryngeal muscles. The relationship between these muscles and vocal pitch has been described by a mathematical model in the form of a set of 'control rules'. We searched for the biological implementation of these control rules in the larynx motor cortex of the human brain. We scanned choral singers with functional magnetic resonance imaging as they produced discrete pitches at four different levels across their vocal range. While the locations of the larynx motor activations varied across singers, the activation peaks for the four pitch levels were highly consistent within each individual singer. This result was corroborated using multi-voxel pattern analysis, which demonstrated an absence of patterned activations differentiating any pairing of pitch levels. The complex and nonlinear relationships between the multiple laryngeal muscles that control vocal pitch may obscure the neural encoding of vocal pitch in the brain.

Dynamics of directional tuning and reference frames in humans: A high-density EEG study

Recent developments in EEG recording and signal processing have made it possible to record in an unconstrained, natural movement task, therefore EEG provides a promising approach to understanding the neural mechanisms of upper-limb reaching control. This study specifically addressed how EEG dynamics in the time domain encoded finger movement directions (directional tuning) and posture dependence (movement reference frames) by applying representational similarity analysis. High-density EEG covering the entire scalp was recorded while participants performed eight-directional, center-out reaching movements, thereby allowing us to explore directional selectivity of EEG sources over the brain beyond somatosensory areas. A majority of the source processes exhibited statistically significant directional tuning during peri-movement periods. In addition, directional tuning curves shifted systematically when the shoulder angle was rotated to perform the task within a more laterally positioned workspace, the degree of tuning curve rotation falling between that predicted by models assuming extrinsic and shoulder-based reference frames. We conclude that temporal dynamics of neural mechanisms for motor control can be studied noninvasively in humans using high-density EEG and that directional sensitivity of motor and non-motor processing is not limited within the sensorimotor areas but extends to the whole brain areas.

Diverse coordinate frames on sensorimotor areas in visuomotor transformation

The visuomotor transformation during a goal-directed movement may involve a coordinate transformation from visual 'extrinsic' to muscle-like 'intrinsic' coordinate frames, which might be processed via a multilayer network architecture composed of neural basis functions. This theory suggests that the postural change during a goal-directed movement task alters activity patterns of the neurons in the intermediate layer of the visuomotor transformation that recieves both visual and proprioceptive inputs, and thus influence the multi-voxel pattern of the blood oxygenation level dependent signal. Using a recently developed multi-voxel pattern decoding method, we found extrinsic, intrinsic and intermediate coordinate frames along the visuomotor cortical pathways during a visuomotor control task. The presented results support the hypothesis that, in human, the extrinsic coordinate frame was transformed to the muscle-like frame over the dorsal pathway from the posterior parietal cortex and the dorsal premotor cortex to the primary motor cortex.

Individual Movement Variability Magnitudes Are Explained by Cortical Neural Variability

Humans exhibit considerable motor variability even across trivial reaching movements. This variability can be separated into specific kinematic components such as extent and direction that are thought to be governed by distinct neural processes. Here, we report that individual subjects (males and females) exhibit different magnitudes of kinematic variability, which are consistent (within individual) across movements to different targets and regardless of which arm (right or left) was used to perform the movements. Simultaneous fMRI recordings revealed that the same subjects also exhibited different magnitudes of fMRI variability across movements in a variety of motor system areas. These fMRI variability magnitudes were also consistent across movements to different targets when performed with either arm. Cortical fMRI variability in the posterior-parietal cortex of individual subjects explained their movement-extent variability. This relationship was apparent only in posterior-parietal cortex and not in other motor system areas, thereby suggesting that individuals with more variable movement preparation exhibit larger kinematic variability. We therefore propose that neural and kinematic variability are reliable and interrelated individual characteristics that may predispose individual subjects to exhibit distinct motor capabilities.SIGNIFICANCE STATEMENT Neural activity and movement kinematics are remarkably variable. Although intertrial variability is rarely studied, here, we demonstrate that individual human subjects exhibit distinct magnitudes of neural and kinematic variability that are reproducible across movements to different targets and when performing these movements with either arm. Furthermore, when examining the relationship between cortical variability and movement variability, we find that cortical fMRI variability in parietal cortex of individual subjects explained their movement extent variability. This enabled us to explain why some subjects performed more variable movements than others based on their cortical variability magnitudes.

Neural, physiological, and behavioral correlates of visuomotor cognitive load

Visuomotor ability is quite crucial for everyday functioning, particularly in driving and sports. While there is accumulating evidence regarding neural correlates of visuomotor transformation, less is known about the brain regions that accommodate visuomotor mapping under different cognitive demands. We concurrently measured cortical activity and pupillary response, using functional near infrared spectroscopy (fNIRS) and eye-tracking glasses, to examine the neural systems linked to pupil dilation under varying cognitive demands. Twenty-three healthy adults performed two sessions of a navigation task, in which the cognitive load was manipulated by either reversing the visuomotor mapping or increasing the speed of the moving object. We identified a region in the right superior parietal lobule that responded to both types of visuomotor load and its activity was associated with larger pupillary response and better performance in the task. Our multimodal analyses suggest that activity in this region arises from the need for increased attentional effort and alertness for visuomotor control and is an ideal candidate for objective measurement of visuomotor cognitive load. Our data extend previous findings connecting changes in pupil diameter to neural activity under varying cognitive demand and have important implications for examining brain-behavior associations in real-world tasks such as driving and sports.

Effector-Invariant Movement Encoding in the Human Motor System

Ipsilateral motor areas of cerebral cortex are active during arm movements and even reliably predict movement direction. Is coding similar during ipsilateral and contralateral movements? If so, is it in extrinsic (world-centered) or intrinsic (joint-configuration) coordinates? We addressed these questions by examining the similarity of multivoxel fMRI patterns in visuomotor cortical regions during unilateral reaching movements with both arms. The results of three complementary analyses revealed that fMRI response patterns were similar across right and left arm movements to identical targets (extrinsic coordinates) in visual cortices, and across movements with equivalent joint-angles (intrinsic coordinates) in motor cortices. We interpret this as evidence for the existence of distributed neural populations in multiple motor system areas that encode ipsilateral and contralateral movements in a similar manner: according to their intrinsic/joint coordinates.SIGNIFICANCE STATEMENT Cortical motor control exhibits clear lateralization: each hemisphere controls the motor output of the contralateral body. Nevertheless, neural populations in ipsilateral areas across the visuomotor hierarchy are active during unilateral movements. We show that fMRI response patterns in the motor cortices are similar for both arms if the movement direction is mirror-reversed across the midline. This suggests that in both ipsilateral and contralateral motor cortices, neural populations have effector-invariant coding of movements in intrinsic coordinates. This not only affects our understanding of motor control, it may serve in the development of brain machine interfaces that also use ipsilateral neural activity.

Differential Recruitment of Parietal Cortex during Spatial and Non-spatial Reach Planning

The planning of goal-directed arm reaching movements is associated with activity in the dorsal parieto-frontal cortex, within which multiple regions subserve the integration of arm- and target-related sensory signals to encode a motor goal. Surprisingly, many of these regions show sustained activity during reach preparation even when target location is not specified, i.e., when a motor goal cannot be unambiguously formed. The functional role of these non-spatial preparatory signals remains unresolved. Here this process was investigated in humans by comparing reach preparatory activity in the presence or absence of information regarding upcoming target location. In order to isolate the processes specific to reaching and to control for visuospatial attentional factors, the reaching task was contrasted to a finger movement task. Functional MRI and electroencephalography (EEG) were used to characterize the spatio-temporal pattern of reach-related activity in the parieto-frontal cortex. Reach planning with advance knowledge of target location induced robust blood oxygenated level dependent and EEG responses across parietal and premotor regions contralateral to the reaching arm. In contrast, reach preparation without knowledge of target location was associated with a significant BOLD response bilaterally in the parietal cortex. Furthermore, EEG alpha- and beta-band activity was restricted to parietal scalp sites, the magnitude of the latter being correlated with reach reaction times. These results suggest an intermediate stage of sensorimotor transformations in bilateral parietal cortex when target location is not specified.

Decoding Movement Goals from the Fronto-Parietal Reach Network

During reach planning, fronto-parietal brain areas need to transform sensory information into a motor code. It is debated whether these areas maintain a sensory representation of the visual cue or a motor representation of the upcoming movement goal. Here, we present results from a delayed pro-/anti-reach task which allowed for dissociating the position of the visual cue from the reach goal. In this task, the visual cue was combined with a context rule (pro vs. anti) to infer the movement goal. Different levels of movement goal specification during the delay were obtained by presenting the context rule either before the delay together with the visual cue (specified movement goal) or after the delay (underspecified movement goal). By applying functional magnetic resonance imaging (fMRI) multivoxel pattern analysis (MVPA), we demonstrate movement goal encoding in the left dorsal premotor cortex (PMd) and bilateral superior parietal lobule (SPL) when the reach goal is specified. This suggests that fronto-parietal reach regions (PRRs) maintain a prospective motor code during reach planning. When the reach goal is underspecified, only area PMd but not SPL represents the visual cue position indicating an incomplete state of sensorimotor integration. Moreover, this result suggests a potential role of PMd in movement goal selection.

Neural pattern similarity between contra- and ipsilateral movements in high-frequency band of human electrocorticograms

The cortical motor areas are activated not only during contralateral limb movements but also during ipsilateral limb movements. Although these ipsilateral activities have been observed in several brain imaging studies, their functional role is poorly understood. Due to its high temporal resolution and low susceptibility to artifacts from body movements, the electrocorticogram (ECoG) is an advantageous measurement method for assessing the human brain function of motor behaviors. Here, we demonstrate that contra- and ipsilateral movements share a similarity in the high-frequency band of human ECoG signals. The ECoG signals were measured from the unilateral sensorimotor cortex while patients conducted self-paced movements of different body parts, contra- or ipsilateral to the measurement side. The movement categories (wrist, shoulder, or ankle) of ipsilateral movements were decoded as accurately as those of contralateral movements from spatial patterns of the high-frequency band of the precentral motor area (the primary motor and premotor areas). The decoder, trained in the high-frequency band of ipsilateral movements generalized to contralateral movements, and vice versa, confirmed that the activity patterns related to ipsilateral limb movements were similar to contralateral ones in the precentral motor area. Our results suggest that the high-frequency band activity patterns of ipsilateral and contralateral movements might be functionally coupled to control limbs, even during unilateral movements.

Microstructural properties of premotor pathways predict visuomotor performance in chronic stroke

Microstructural properties of the corticospinal tract (CST) descending from the motor cortex predict strength and motor skill in the chronic phase after stroke. Much less is known about the relation between brain microstructure and visuomotor processing after stroke. In this study, individual's poststroke and age-matched controls performed a unimanual force task separately with each hand at three levels of visual gain. We collected diffusion MRI data and used probabilistic tractography algorithms to identify the primary and premotor CSTs. Fractional anisotropy (FA) within each tract was used to predict changes in force variability across different levels of visual gain. Our observations revealed that individuals poststroke reduced force variability with an increase in visual gain, performed the force task with greater variability as compared with controls across all gain levels, and had lower FA in the primary motor and premotor CSTs. Our results also demonstrated that the CST descending from the premotor cortex, rather than the primary motor cortex, best predicted force variability. Together, these findings demonstrate that the microstructural properties of the premotor CST predict visual gain-related changes in force variability in individuals poststroke. Hum Brain Mapp 37:2039-2054, 2016. © 2016 Wiley Periodicals, Inc.