Rapid feedback responses correlate with reach adaptation and properties of novel upper limb loads

Dissociated cerebellar contributions to feedforward gait adaptation

The cerebellum is important for motor adaptation. Lesions to the vestibulo-cerebellum selectively cause gait ataxia. Here we investigate how such damage affects locomotor adaptation when performing the 'broken escalator' paradigm. Following an auditory cue, participants were required to step from the fixed surface onto a moving platform (akin to an airport travellator). The experiment included three conditions: 10 stationary (BEFORE), 15 moving (MOVING) and 10 stationary (AFTER) trials. We assessed both behavioural (gait approach velocity and trunk sway after stepping onto the moving platform) and neuromuscular outcomes (lower leg muscle activity, EMG). Unlike controls, cerebellar patients showed reduced after-effects (AFTER trials) with respect to gait approach velocity and leg EMG activity. However, patients with cerebellar damage maintain the ability to learn the trunk movement required to maximise stability after stepping onto the moving platform (i.e., reactive postural behaviours). Importantly, our findings reveal that these patients could even initiate these behaviours in a feedforward manner, leading to an after-effect. These findings reveal that the cerebellum is crucial for feedforward locomotor control, but that adaptive locomotor behaviours learned via feedback (i.e., reactive) mechanisms may be preserved following cerebellum damage.

The independence of impairments in proprioception and visuomotor adaptation after stroke

BACKGROUND

Proprioceptive impairments are common after stroke and are associated with worse motor recovery and poor rehabilitation outcomes. Motor learning may also be an important factor in motor recovery, and some evidence in healthy adults suggests that reduced proprioceptive function is associated with reductions in motor learning. It is unclear how impairments in proprioception and motor learning relate after stroke. Here we used robotics and a traditional clinical assessment to examine the link between impairments in proprioception after stroke and a type of motor learning known as visuomotor adaptation.

METHODS

We recruited participants with first-time unilateral stroke and controls matched for overall age and sex. Proprioceptive impairments in the more affected arm were assessed using robotic arm position- (APM) and movement-matching (AMM) tasks. We also assessed proprioceptive impairments using a clinical scale (Thumb Localization Test; TLT). Visuomotor adaptation was assessed using a task that systematically rotated hand cursor feedback during reaching movements (VMR). We quantified how much participants adapted to the disturbance and how many trials they took to adapt to the same levels as controls. Spearman's rho was used to examine the relationship between proprioception, assessed using robotics and the TLT, and visuomotor adaptation. Data from healthy adults were used to identify participants with stroke who were impaired in proprioception and visuomotor adaptation. The independence of impairments in proprioception and adaptation were examined using Fisher's exact tests.

RESULTS

Impairments in proprioception (58.3%) and adaptation (52.1%) were common in participants with stroke (n = 48; 2.10% acute, 70.8% subacute, 27.1% chronic stroke). Performance on the APM task, AMM task, and TLT scores correlated weakly with measures of visuomotor adaptation. Fisher's exact tests demonstrated that impairments in proprioception, assessed using robotics and the TLT, were independent from impairments in visuomotor adaptation in our sample.

CONCLUSION

Our results suggest impairments in proprioception may be independent from impairments in visuomotor adaptation after stroke. Further studies are needed to understand factors that influence the relationship between motor learning, proprioception and other rehabilitation outcomes throughout stroke recovery.

Modulations of stretch reflex by altering visuomotor contexts

Various functional modulations of the stretch reflex help to stabilize actions, but the computational mechanism behind its context-dependent tuning remains unclear. While many studies have demonstrated that motor contexts associated with the task goal cause functional modulation of the stretch reflex of upper limbs, it is not well understood how visual contexts independent of the task requirements affect the stretch reflex. To explore this issue, we conducted two experiments testing 20 healthy human participants (age range 20-45, average 31.3 ± 9.0), in which visual contexts were manipulated in a visually guided reaching task. During wrist flexion movements toward a visual target, a mechanical load was applied to the wrist joint to evoke stretch reflex of wrist flexor muscle (flexor carpi radialis). The first experiment (n = 10) examined the effect of altering the visuomotor transformation on the stretch reflex that was evaluated with surface electromyogram. We found that the amplitude of the stretch reflex decreased (p = 0.024) when a rotational transformation of 90° was introduced between the hand movement and the visual cursor, whereas the amplitude did not significantly change (p = 0.26) when the rotational transformation was accompanied by a head rotation so that the configuration of visual feedback was maintained in visual coordinates. The results suggest that the stretch reflex was regulated depending on whether the visuomotor mapping had already been acquired or not. In the second experiment (n = 10), we examined how uncertainty in the visual target or hand cursor affects the stretch reflex by removing these visual stimuli. We found that the reflex amplitude was reduced by the disappearance of the hand cursor (p = 0.039), but was not affected by removal of the visual target (p = 0.27), suggesting that the visual state of the body and target contribute differently to the reflex tuning. These findings support the idea that visual updating of the body state is crucial for regulation of quick motor control driven by proprioceptive signals.

Human reaching control in dynamic environments

Closed-loop models of movement control have attracted growing interest in how the nervous system transforms sensory information into motor commands, and several brain structures have been identified as neural substrates for these computational operations. Recently, several studies have focused on how these models need to be updated when environmental parameters change. Current evidence suggests that when the task changes, rapid control updates enable flexible modifications of current actions and online decisions. At the same time, when movement dynamics change, humans use different strategies based on a combination of adaptation and modulation of controller sensitivity to exogenous perturbations (robust control). This review proposes a unified framework to capture these results based on online estimation of model parameters with dynamic updates in control. The reviewed studies also identify the time scales of associated behavioral mechanisms to guide future research on the neural basis of movement control.

Identifying a Upper-Limb Phase-Dependent Variable under Perturbations for Powered Prosthesis Arm Control

This paper investigates upper-limb kinematic reaching responses during a mechanical perturbation to understand interjoint arm coordination used towards powered prosthesis control development. Common prosthesis arm controllers use electromyography sensors with data-driven models to decode muscle activation signals in controlling prosthesis joint movements. However, these control approaches produce non-natural, discrete movements with no guarantee the controller can react to unexpected disturbances during continuous task motion. Determining a continuous phase-dependent variable for measuring a human's progression during reaching can derive a time-invariant kinematic function to control the prosthesis joint in a natural, continuous manner. A perturbation experimental study was conducted across three participants in evaluating the shoulder and elbow joint kinematics to examine the existence of a phase shift during reaching. Experimental results demonstrated the effects of arm proximal-distal interjoint coordination that validated the proposed mechanical phase variable of the shoulder used in parameterizing elbow joint kinematic for reaching. This could allow for a continuous phase-based control strategy that can handle disturbances to achieve arm reaching in prosthesis control.

The nervous system tunes sensorimotor gains when reaching in variable mechanical environments

Humans often move in the presence of mechanical disturbances that can vary in direction and amplitude throughout movement. These disturbances can jeopardize the outcomes of our actions, such as when drinking from a glass of water on a turbulent flight or carrying a cup of coffee while walking on a busy sidewalk. Here, we examine control strategies that allow the nervous system to maintain performance when reaching in the presence of mechanical disturbances that vary randomly throughout movement. Healthy participants altered their control strategies to make movements more robust against disturbances. The change in control was associated with faster reaching movements and increased responses to proprioceptive and visual feedback that were tuned to the variability of the disturbances. Our findings highlight that the nervous system exploits a continuum of control strategies to increase its responsiveness to sensory feedback when reaching in the presence of increasingly variable physical disturbances.

Proprioceptive and Visual Feedback Responses in Macaques Exploit Goal Redundancy

A common problem in motor control concerns how to generate patterns of muscle activity when there are redundant solutions to attain a behavioral goal. Optimal feedback control is a theory that has guided many behavioral studies exploring how the motor system incorporates task redundancy. This theory predicts that kinematic errors that deviate the limb should not be corrected if one can still attain the behavioral goal. Studies in humans demonstrate that the motor system can flexibly integrate visual and proprioceptive feedback of the limb with goal redundancy within 90 ms and 70 ms, respectively. Here, we show monkeys (Macaca mulatta) demonstrate similar abilities to exploit goal redundancy. We trained four male monkeys to reach for a goal that was either a narrow square or a wide, spatially redundant rectangle. Monkeys exhibited greater trial-by-trial variability when reaching to the wide goal consistent with exploiting goal redundancy. On random trials we jumped the visual feedback of the hand and found monkeys corrected for the jump when reaching to the narrow goal and largely ignored the jump when reaching for the wide goal. In a separate set of experiments, we applied mechanical loads to the arm of the monkey and found similar corrective responses based on goal shape. Muscle activity reflecting these different corrective responses were detected for the visual and mechanical perturbations starting at ∼90 and ∼70 ms, respectively. Thus, rapid motor responses in macaques can exploit goal redundancy similar to humans, creating a paradigm to study the neural basis of goal-directed motor action and motor redundancy.SIGNIFICANCE STATEMENT Moving in the world requires selecting from an infinite set of possible motor commands. Theories predict that motor commands are selected that exploit redundancies. Corrective responses in humans to either visual or proprioceptive disturbances of the limb can rapidly exploit redundant trajectories to a goal in <100 ms after a disturbance. However, uncovering the neural correlates generating these rapid motor corrections has been hampered by the absence of an animal model. We developed a behavioral paradigm in monkeys that incorporates redundancy in the form of the shape of the goal. Critically, monkeys exhibit corrective responses and timings similar to humans performing the same task. Our paradigm provides a model for investigating the neural correlates of sophisticated rapid motor corrections.

Separability of Human Motor Memories during reaching adaptation with force cues

Judging by the breadth of our motor repertoire during daily activities, it is clear that learning different tasks is a hallmark of the human motor system. However, for reaching adaptation to different force fields, the conditions under which this is possible in laboratory settings have remained a challenging question. Previous work has shown that independent movement representations or goals enabled dual adaptation. Considering the importance of force feedback during limb control, here we hypothesised that independent cues delivered by means of background loads could support simultaneous adaptation to various velocity-dependent force fields, for identical kinematic plan and movement goal. We demonstrate in a series of experiments that indeed healthy adults can adapt to opposite force fields, independently of the direction of the background force cue. However, when the cue and force field were in the same direction but differed by heir magnitude, the formation of different motor representations was still observed but the associated mechanism was subject to increased interference. Finally, we highlight that this paradigm allows dissociating trial-by-trial adaptation from online feedback adaptation, as these two mechanisms are associated with different time scales that can be identified reliably and reproduced in a computational model.

Contextual cues are not unique for motor learning: Task-dependant switching of feedback controllers

The separation of distinct motor memories by contextual cues is a well known and well studied phenomenon of feedforward human motor control. However, there is no clear evidence of such context-induced separation in feedback control. Here we test both experimentally and computationally if context-dependent switching of feedback controllers is possible in the human motor system. Specifically, we probe visuomotor feedback responses of our human participants in two different tasks—stop and hit—and under two different schedules. The first, blocked schedule, is used to measure the behaviour of stop and hit controllers in isolation, showing that it can only be described by two independent controllers with two different sets of control gains. The second, mixed schedule, is then used to compare how such behaviour evolves when participants regularly switch from one task to the other. Our results support our hypothesis that there is contextual switching of feedback controllers, further extending the accumulating evidence of shared features between feedforward and feedback control.

Extensive evidence has demonstrated that humans can learn distinct motor memories (i.e. independent feedforward controllers) using contextual cues. However, there is little evidence that such contextual cues produce similar separation of feedback controllers. As accumulating evidence highlights the connection between feedforward and feedback control, we propose that context may be used to separate feedback controllers as well. It has not been trivial to test experimentally whether a change in context also modulates the feedback control, as the controller output is affected by other non-contextual factors such as movement kinematics, time-to-target or the properties of the perturbation used to probe the control. Here we present a computational approach based on normative modelling where we separate the effects of the context from other non-contextual effects on the visuomotor feedback system. We then show experimentally that task context independently modulates the feedback control in a particular manner that can be reliably predicted using optimal feedback control.

Task space exploration improves adaptation after incompatible virtual surgeries

Humans have a remarkable capacity to learn new motor skills, a process that requires novel muscle activity patterns. Muscle synergies may simplify the generation of muscle patterns through the selection of a small number of synergy combinations. Learning new motor skills may then be achieved by acquiring novel muscle synergies. In a previous study, we used myoelectric control to construct virtual surgeries that altered the mapping from muscle activity to cursor movements. After compatible virtual surgeries, which could be compensated by recombining subject-specific muscle synergies, participants adapted quickly. In contrast, after incompatible virtual surgeries, which could not be compensated by recombining existing synergies, participants explored new muscle patterns, but failed to adapt. Here, we tested whether task space exploration can promote learning of novel muscle synergies, required to overcome an incompatible surgery. Participants performed the same reaching task as in our previous study, but with more time to complete each trial, thus allowing for exploration. We found an improvement in trial success after incompatible virtual surgeries. Remarkably, improvements in movement direction accuracy after incompatible surgeries occurred faster for corrective movements than for the initial movement, suggesting that learning of new synergies is more effective when used for feedback control. Moreover, reaction time was significantly higher after incompatible than after compatible virtual surgeries, suggesting an increased use of an explicit adaptive strategy to overcome incompatible surgeries. Taken together, these results indicate that exploration is important for skill learning and suggest that human participants, with sufficient time, can learn new muscle synergies.

Adaptive Feedback Control in Human Reaching Adaptation to Force Fields

Sensorimotor adaptation is a central function of the nervous system, as it allows humans and other animals to flexibly anticipate their interaction with the environment. In the context of human reaching adaptation to force fields, studies have traditionally separated feedforward (FF) and feedback (FB) processes involved in the improvement of behavior. Here, we review computational models of FF adaptation to force fields and discuss them in light of recent evidence highlighting a clear involvement of feedback control. Instead of a model in which FF and FB mechanisms adapt in parallel, we discuss how online adaptation in the feedback control system can explain both trial-by-trial adaptation and improvements in online motor corrections. Importantly, this computational model combines sensorimotor control and short-term adaptation in a single framework, offering novel perspectives for our understanding of human reaching adaptation and control.

Integration of proprioceptive and visual feedback during online control of reaching

Visual and proprioceptive feedback both contribute to perceptual decisions, but it remains unknown how these feedback signals are integrated together or consider factors such as delays and variance during online control. We investigated this question by having participants reach to a target with randomly applied mechanical and/or visual disturbances. We observed that the presence of visual feedback during a mechanical disturbance did not increase the size of the muscle response significantly but did decrease variance, consistent with a dynamic Bayesian integration model. In a control experiment, we verified that vision had a potent influence when mechanical and visual disturbances were both present but opposite in sign. These results highlight a complex process for multisensory integration, where visual feedback has a relatively modest influence when the limb is mechanically disturbed, but a substantial influence when visual feedback becomes misaligned with the limb.

NEW & NOTEWORTHY Visual feedback is more accurate, but proprioceptive feedback is faster. How should you integrate these sources of feedback to guide limb movement? As predicted by dynamic Bayesian models, the size of the muscle response to a mechanical disturbance was essentially the same whether visual feedback was present or not. Only under artificial conditions, such as when shifting the position of a cursor representing hand position, can one observe a muscle response from visual feedback.

Motor skill training without online visual feedback enhances feedforward control

Motor skill learning involves improvement in feedforward control, the ability to execute a motor plan more reliably, and feedback control, the ability to adjust the motor plan on the fly. The dependence between these control components and the association between training conditions and their improvement have not been directly examined. This study characterizes the contribution of feedforward and feedback control components to motor skill learning using the arc-pointing task (APT), a drawing task that requires high motor acuity. In experiment 1, the performance of three groups of subjects was tested before and after training with online visual feedback (OF group), with knowledge of performance feedback that was presented after movement completion (KP group), and with both online and KP feedback (KP + OF group). Although the improvement of the OF group was not different from the improvement of the KP + OF group, comparison of the KP and KP + OF groups revealed an advantage to the KP group in the fast test speed, suggesting that training without online feedback leads to a greater improvement in feedforward control. In experiment 2, subject's improvement was examined using test probes for estimating feedback and feedforward control. Both KP + OF and KP groups showed improvement in feedforward and feedback conditions with a trend toward a greater improvement of the KP group. Our results suggest that online visual feedback suppresses improvement in feedforward control during motor skill learning.NEW & NOTEWORTHY Becoming a skillful player requires both executing reliable movements and being able to efficiently control them online. We study here how training with and without online visual feedback affects feedforward and feedback control improvement in a drawing task that requires high precision. We show that training with online feedback suppresses improvement in feedforward control and leads to inferior performance in fast movements.

Savings in Human Force Field Learning Supported by Feedback Adaptation

Savings have been described as the ability of healthy humans to relearn a previously acquired motor skill faster than the first time, which in the context of motor adaptation suggests that the learning rate in the brain could be adjusted when a perturbation is recognized. Alternatively, it has been argued that apparent savings were the consequence of a distinct process that instead of reflecting a change in the learning rate, revealed an explicit re-aiming strategy. Based on recent evidence that feedback adaptation may be central to both planning and control, we hypothesized that this component could genuinely accelerate relearning in human adaptation to force fields (FFs) during reaching. Consistent with our hypothesis, we observed that on re-exposure to a previously learned FF, the very first movement performed by healthy volunteers in the relearning context was better adapted to the external disturbance, and this occurred without any anticipation or cognitive strategy because the relearning session was started unexpectedly. We conclude that feedback adaptation is a medium by which the nervous system can genuinely accelerate learning across movements.

Similar stretch reflexes and behavioral patterns are expressed by the dominant and nondominant arms during postural control

Limb dominance is evident in many daily activities, leading to the prominent idea that each hemisphere of the brain specializes in controlling different aspects of movement. Past studies suggest that the dominant arm is primarily controlled via an internal model of limb dynamics that enables the nervous system to produce efficient movements. In contrast, the nondominant arm may be primarily controlled via impedance mechanisms that rely on the strong modulation of sensory feedback from individual joints to control limb posture. We tested whether such differences are evident in behavioral responses and stretch reflexes following sudden displacement of the arm during posture control. Experiment 1 applied specific combinations of elbow-shoulder torque perturbations (the same for all participants). Peak joint displacements, return times, end point accuracy, and the directional tuning and amplitude of stretch reflexes in nearly all muscles were not statistically different between the two arms. Experiment 2 induced specific combinations of joint motion (the same for all participants). Again, peak joint displacements, return times, end point accuracy, and the directional tuning and amplitude of stretch reflexes in nearly all muscles did not differ statistically when countering the imposed loads with each arm. Moderate to strong correlations were found between stretch reflexes and behavioral responses to the perturbations with the two arms across both experiments. Collectively, the results do not support the idea that the dominant arm specializes in exploiting internal models and the nondominant arm in impedance control by increasing reflex gains to counter sudden loads imposed on the arms during posture control.NEW & NOTEWORTHY A prominent hypothesis is that the nervous system controls the dominant arm through predictive internal models and the nondominant arm through impedance mechanisms. We tested whether stretch reflexes of muscles in the two arms also display such specialization during posture control. Nearly all behavioral responses and stretch reflexes did not differ statistically but were strongly correlated between the arms. The results indicate individual signatures of feedback control that are common for the two arms.

Rapid Feedback Responses Parallel the Urgency of Voluntary Reaching Movements

Optimal feedback control is a prominent theory used to interpret human motor behaviour. The theory posits that skilled actions emerge from control policies that link voluntary motor control (feedforward) with flexible feedback corrections (feedback control). It is clear the nervous system can generate flexible motor corrections (reflexes) when performing actions with different goals. We know little, however, about shared features of voluntary actions and feedback control in human movement. Here we reveal a link between the timing demands of voluntary actions and flexible responses to mechanical perturbations. In two experiments, 40 human participants (21 females) made reaching movements with different timing demands. We disturbed the arm with mechanical perturbations at movement onset (Experiment 1) and at locations ranging from movement onset to completion (Experiment 2). We used the resulting muscle responses and limb displacements as a proxy for the control policies that support voluntary reaching movements. We observed an increase in the sensitivity of elbow and shoulder muscle responses and a reduction in limb motion when the task imposed greater urgency to respond to the same perturbations. The results reveal a relationship between voluntary actions and feedback control as the limb was displaced less when moving faster in perturbation trials. Muscle responses scaled with changes in the displacement of the limb in perturbation trials within each timing condition. Across both experiments, human behaviour was captured by simulations based on stochastic optimal feedback control. Taken together, the results highlight flexible control that links sensory processing with features of human reaching movements.

Hierarchical motor adaptations negotiate failures during force field learning

Humans have the amazing ability to learn the dynamics of the body and environment to develop motor skills. Traditional motor studies using arm reaching paradigms have viewed this ability as the process of ‘internal model adaptation’. However, the behaviors have not been fully explored in the case when reaches fail to attain the intended target. Here we examined human reaching under two force fields types; one that induces failures (i.e., target errors), and the other that does not. Our results show the presence of a distinct failure-driven adaptation process that enables quick task success after failures, and before completion of internal model adaptation, but that can result in persistent changes to the undisturbed trajectory. These behaviors can be explained by considering a hierarchical interaction between internal model adaptation and the failure-driven adaptation of reach direction. Our findings suggest that movement failure is negotiated using hierarchical motor adaptations by humans.

How do we improve actions after a movement failure? Although negotiating movement failures is obviously crucial, previous motor-control studies have predominantly examined human movement adaptations in the absence of failures, and it remains unclear how failures affect subsequent movement adaptations. Here we examined this issue by developing a novel force field adaptation task where the hand movement during an arm reaching is perturbed by novel forces that induce a large target error, that is a failure. Our experimental observation and computational modeling show that, in addition to the popular ‘internal model learning’ process of motor adaptations, humans also utilize a ‘failure-negotiating’ process, that enables them to quickly improve movements in the presence of failure, even at the expense of increased arm trajectory deflections, which are subsequently reduced gradually with training after the achievement of the task success. Our results suggest that a hierarchical interaction between these two processes is a key for humans to negotiate movement failures.

Cerebellar contribution to sensorimotor adaptation deficits in humans with spinal cord injury

Humans with spinal cord injury (SCI) show deficits in associating motor commands and sensory feedback. Do these deficits affect their ability to adapt movements to new demands? To address this question, we used a robotic exoskeleton to examine learning of a sensorimotor adaptation task during reaching movements by distorting the relationship between hand movement and visual feedback in 22 individuals with chronic incomplete cervical SCI and 22 age-matched control subjects. We found that SCI individuals showed a reduced ability to learn from movement errors compared with control subjects. Sensorimotor areas in anterior and posterior cerebellar lobules contribute to learning of movement errors in intact humans. Structural brain imaging showed that sensorimotor areas in the cerebellum, including lobules I-VI, were reduced in size in SCI compared with control subjects and cerebellar atrophy increased with increasing time post injury. Notably, the degree of spared tissue in the cerebellum was positively correlated with learning rates, indicating participants with lesser atrophy showed higher learning rates. These results suggest that the reduced ability to learn from movement errors during reaching movements in humans with SCI involves abnormalities in the spinocerebellar structures. We argue that this information might help in the rehabilitation of people with SCI.

Vestibular contributions to online reach execution are processed via mechanisms with knowledge about limb biomechanics

Studies of reach control with the body stationary have shown that proprioceptive and visual feedback signals contributing to rapid corrections during reaching are processed by neural circuits that incorporate knowledge about the physical properties of the limb (an internal model). However, among the most common spatial and mechanical perturbations to the limb are those caused by our body's own motion, suggesting that processing of vestibular signals for online reach control may reflect a similar level of sophistication. We investigated this hypothesis using galvanic vestibular stimulation (GVS) to selectively activate the vestibular sensors, simulating body rotation, as human subjects reached to remembered targets in different directions (forward, leftward, rightward). If vestibular signals contribute to purely kinematic/spatial corrections for body motion, GVS should evoke reach trajectory deviations of similar size in all directions. In contrast, biomechanical modeling predicts that if vestibular processing for online reach control takes into account knowledge of the physical properties of the limb and the forces applied on it by body motion, then GVS should evoke trajectory deviations that are significantly larger during forward and leftward reaches as compared with rightward reaches. When GVS was applied during reaching, the observed deviations were on average consistent with this prediction. In contrast, when GVS was instead applied before reaching, evoked deviations were similar across directions, as predicted for a purely spatial correction mechanism. These results suggest that vestibular signals, like proprioceptive and visual feedback, are processed for online reach control via sophisticated neural mechanisms that incorporate knowledge of limb biomechanics.NEW & NOTEWORTHY Studies examining proprioceptive and visual contributions to rapid corrections for externally applied mechanical and spatial perturbations during reaching have provided evidence for flexible processing of sensory feedback that accounts for musculoskeletal system dynamics. Notably, however, such perturbations commonly arise from our body's own motion. In line with this, we provide compelling evidence that, similar to proprioceptive and visual signals, vestibular signals are processed for online reach control via sophisticated mechanisms that incorporate knowledge of limb biomechanics.

Rapid Changes in Movement Representations during Human Reaching Could Be Preserved in Memory for at Least 850 ms

Humans adapt to mechanical perturbations such as forcefields (FFs) during reaching within tens of trials. However, recent findings suggested that this adaptation may start within one single trial, i.e., online corrective movements can become tuned to the unanticipated perturbations within a trial. This was highlighted in previous works with a reaching experiment in which participants had to stop at a via-point (VP) located between the start and the goal. An FF was applied during the first and second parts of the movement and then occasionally unexpectedly switched off at the VP during catch trials. The results showed an after-effect during the second part of the movement when participants exited the VP. This behavioral result was interpreted as a standard after-effect, but it remained unclear how it was related to conventional trial-by-trial learning. The current study aimed to investigate how long do such changes in movement representations last in memory. For this, we have studied the same reaching task with VP in two situations: one with very short residing time in the VP and the second with an imposed minimum 500 ms dwell time in the VP. In both situations, during the unexpected absence of the FF after VP, after-effects were observed. This suggests that online corrections to the internal representation of reach dynamics can be preserved in memory for around 850 ms of resting time on average. Therefore, rapid changes occurring within movements can thus be preserved in memory long enough to influence trial-by-trial motor adaptation.

Shared internal models for feedforward and feedback control of arm dynamics in non-human primates

Previous work has shown that humans account for and learn novel properties or the arm's dynamics, and that such learning causes changes in both the predictive (i.e., feedforward) control of reaching and reflex (i.e., feedback) responses to mechanical perturbations. Here we show that similar observations hold in old-world monkeys (Macaca fascicularis). Two monkeys were trained to use an exoskeleton to perform a single-joint elbow reaching and to respond to mechanical perturbations that created pure elbow motion. Both of these tasks engaged robust shoulder muscle activity as required to account for the torques that typically arise at the shoulder when the forearm rotates around the elbow joint (i.e., intersegmental dynamics). We altered these intersegmental arm dynamics by having the monkeys generate the same elbow movements with the shoulder joint either free to rotate, as normal, or fixed by the robotic manipulandum, which eliminates the shoulder torques caused by forearm rotation. After fixing the shoulder joint, we found a systematic reduction in shoulder muscle activity. In addition, after releasing the shoulder joint again, we found evidence of kinematic aftereffects (i.e., reach errors) in the direction predicted if failing to compensate for normal arm dynamics. We also tested whether such learning transfers to feedback responses evoked by mechanical perturbations and found a reduction in shoulder feedback responses, as appropriate for these altered arm intersegmental dynamics. Demonstrating this learning and transfer in non-human primates will allow the investigation of the neural mechanisms involved in feedforward and feedback control of the arm's dynamics.

Multiple processes independently predict motor learning

Background

Our ability to acquire, refine and adapt skilled limb movements is a hallmark of human motor learning that allows us to successfully perform many daily activities. The capacity to acquire, refine and adapt other features of motor performance, such as visual search, eye-hand coordination and visuomotor decisions, may also contribute to motor learning. However, the extent to which refinements of multiple behavioral features and their underlying neural processes independently contribute to motor learning remains unknown. In the current study, we used an ethological approach to test the hypothesis that practice-related refinements of multiple behavioral features would be independently predictive of motor learning.

Methods

Eighteen healthy, young adults used an upper-limb robot with eye-tracking to practice six trials of a continuous, visuomotor task once a week for six consecutive weeks. Participants used virtual paddles to hit away 200 “Targets” and avoid hitting 100 “Distractors” that continuously moved towards them from the back of the workspace. Motor learning was inferred from trial-by-trial acquisition and week-by-week retention of improvements on two measures of task performance related to motor execution and motor inhibition. Adaptations involving underlying neural processes were inferred from trial-by-trial acquisition and week-by-week retention of refinements on measures of skilled limb movement, visual search, eye-hand coordination and visuomotor decisions. We tested our hypothesis by quantifying the extent to which refinements on measures of multiple behavioral features (predictors) were independently predictive of improvements on our two measures of task performance (outcomes) after removing all shared variance between predictors.

Results

We found that refinements on measures of skilled limb movement, visual search and eye-hand coordination were independently predictive of improvements on our measure of task performance related to motor execution. In contrast, only refinements of eye-hand coordination were independently predictive of improvements on our measure of task performance related to motor inhibition.

Conclusion

Our results provide indirect evidence that refinements involving multiple, neural processes may independently contribute to motor learning, and distinct neural processes may underlie improvements in task performance related to motor execution and motor inhibition. This also suggests that refinements involving multiple, neural processes may contribute to motor recovery after stroke, and rehabilitation interventions should be designed to produce refinements of all behavioral features that may contribute to motor recovery.

Online corrective responses following target jump in altered gravitoinertial force field point to nested feedforward and feedback control

Studies on goal-directed arm movements have shown a close link between feedforward and feedback control in protocols where both planning and online control processes faced a similar type of perturbation, either mechanical or visual. This particular context might have facilitated the use of an adapted internal model by feedforward and feedback control. Here, we considered this link in a context where, after feedforward control was adapted through proprioception-based processes, feedback control was tested under visual perturbation. We analyzed the response of the reaching hand to target displacements following adaptation to an altered force field induced by rotating participants at constant velocity. Reaching corrections were assessed through variables related to the accuracy (lateral and longitudinal end point errors) and kinematics (movement time, peak velocity) of the corrective movements. The electromyographic activity of different arm muscles (pectoralis, posterior deltoid, biceps brachii, and triceps brachii) was analyzed. Statistical analyses revealed that accuracy and kinematics of corrective movements were strikingly alike between normal and altered gravitoinertial force fields. However, pectoralis and biceps muscle activities recorded during corrective movements were significantly modified to counteract the effect of rotation-induced Coriolis and centrifugal forces on the arm. Remarkably, feedback control was functional from the very first time participants encountered a target jump in the altered force field. Overall, the present results demonstrate that feedforward control enables immediate functional feedback control even when applied to distinct sensorimotor processes.NEW & NOTEWORTHY We investigated the link between feedforward and feedback control when applying a double-step perturbation (visual target jump) during reaching movements performed in modified gravitoinertial environments. Altogether, kinematics and EMG analyses showed that movement corrections were highly effective in the different force fields, suggesting that, although feedforward and feedback control were driven by different sensory inputs, feedback control was remarkably functional from the very first time participants encountered a target jump in the altered force field.

Single versus dual-rate learning when exposed to Coriolis forces during reaching movements

When we reach for an object during a passive whole body rotation, a tangential Coriolis force is generated on the arm. Yet, within a few trials, the brain adapts to this force so it does not disrupt the reach. Is this adaptation governed by a single-rate or dual-rate learning process? Here, guided by state-space modeling, we studied human reach adaptation in a fully-enclosed rotating room. After 90 pre-rotation reaches (baseline), participants were trained to make 240 to-and-fro reaches while the room rotated at 10 rpm (block A), then performed 6 reaches under opposite room rotation (block B), and subsequently made 100 post-rotation reaches (washout). A control group performed the same paradigm, but without the reaches during rotation block B. Single-rate and dual-rate models can be best dissociated if there would be full un-learning of compensation A during block B, but minimal learning of B. From the perspective of a dual-rate model, the un-learning observed in block B would mainly be caused by the faster state, such that the washout reaches would show retention effects of the slower state, called spontaneous recovery. Alternatively, following a single-rate model, the same state would govern the learning in block A and un-learning in block B, such that the washout reaches mimic the baseline reaches. Our results do not provide clear signs of spontaneous recovery in the washout reaches. Model fits further show that a single-rate process outperformed a dual-rate process. We suggest that a single-rate process underlies Coriolis force reach adaptation, perhaps because these forces relate to familiar body dynamics and are assigned to an internal cause.

Timescales of motor memory formation in dual-adaptation

The timescales of adaptation to novel dynamics are well explained by a dual-rate model with slow and fast states. This model can predict interference, savings and spontaneous recovery, but cannot account for adaptation to multiple tasks, as each new task drives unlearning of the previously learned task. Nevertheless, in the presence of appropriate contextual cues, humans are able to adapt simultaneously to opposing dynamics. Consequently this model was expanded, suggesting that dual-adaptation occurs through a single fast process and multiple slow processes. However, such a model does not predict spontaneous recovery within dual-adaptation. Here we assess the existence of multiple fast processes by examining the presence of spontaneous recovery in two experimental variations of an adaptation-de-adaptation-error-clamp paradigm within dual-task adaptation in humans. In both experiments, evidence for spontaneous recovery towards the initially learned dynamics (A) was found in the error-clamp phase, invalidating the one-fast-two-slow dual-rate model. However, as adaptation is not only constrained to two timescales, we fit twelve multi-rate models to the experimental data. BIC model comparison again supported the existence of two fast processes, but extended the timescales to include a third rate: the ultraslow process. Even within our single day experiment, we found little evidence for decay of the learned memory over several hundred error-clamp trials. Overall, we show that dual-adaptation can be best explained by a two-fast-triple-rate model over the timescales of adaptation studied here. Longer term learning may require even slower timescales, explaining why we never forget how to ride a bicycle.

Retaining motor skills is crucial to perform basic daily life tasks. However we still have limited understanding of the computational structure of these motor memories, an understanding that is critical for designing rehabilitation. Here we demonstrate that learning any task involves adaptation of independent fast, slow and ultraslow processes to build a motor memory. The selection of the appropriate motor memory is gated through a contextual cue. Together this work extends our understanding of the architecture of motor memories, by merging disparate computational theories to propose a new model.

Time course of changes in the long-latency feedback response parallels the fast process of short-term motor adaptation

Adapting to novel dynamics involves modifying both feedforward and feedback control. We investigated whether the motor system alters feedback responses during adaptation to a novel force field in a manner similar to adjustments in feedforward control. We simultaneously tracked the time course of both feedforward and feedback systems via independent probes during a force field adaptation task. Participants (n = 35) grasped the handle of a robotic manipulandum and performed reaches to a visual target while the hand and arm were occluded. We introduced an abrupt counterclockwise velocity-dependent force field during a block of reaching trials. We measured movement kinematics and shoulder and elbow muscle activity with surface EMG electrodes. We tracked the feedback stretch response throughout the task. Using force channel trials, we measured overall learning, which was later decomposed into a fast and slow process. We found that the long-latency feedback response (LLFR) was upregulated in the early stages of learning and was correlated with the fast component of feedforward adaptation. The change in feedback response was specific to the long-latency epoch (50-100 ms after muscle stretch) and was observed only in the triceps muscle, which was the muscle required to counter the force field during adaptation. The similarity in time course for the LLFR and the estimated time course of the fast process suggests both are supported by common neural circuits. While some propose that the fast process reflects an explicit strategy, we argue instead that it may be a proxy for the feedback controller.NEW & NOTEWORTHY We investigated whether changes in the feedback stretch response were related to the proposed fast and slow processes of motor adaptation. We found that the long-latency component of the feedback stretch response was upregulated in the early stages of learning and the time course was correlated with the fast process. While some propose that the fast process reflects an explicit strategy, we argue instead that it may be a proxy for the feedback controller.

Double-Step Paradigm in Microgravity: Preservation of Sensorimotor Flexibility in Altered Gravitational Force Field

The way we can correct our ongoing movements to sudden and unforeseen perturbations is key to our ability to rapidly adjust our behavior to novel environmental demands. Referred to as sensorimotor flexibility, this ability can be assessed by the double-step paradigm in which participants must correct their ongoing arm movements to reach targets that unexpectedly change location (i.e., target jump). While this type of corrections has been demonstrated in normogravity in the extent of reasonable spatiotemporal constraints underpinning the target jumps, less is known about sensorimotor flexibility in altered gravitational force fields. We thus aimed to assess sensorimotor flexibility by comparing online arm pointing corrections observed during microgravity episodes of parabolic flights with normogravity standards. Seven participants were asked to point as fast and as accurately as possible toward one of two visual targets with their right index finger. The targets were aligned vertically in the mid-sagittal plane and were separated by 10 cm. In 20% of the trials, the initially illuminated lower target was switched off at movement onset while the upper target was concomitantly switched on prompting participants to change the trajectory of their ongoing movements. Results showed that, both in normogravity and microgravity, participants successfully performed the pointing task including when the target jumped unexpectedly (i.e., comparable success rate). Most importantly, no significant difference was found in target jump trials regarding arm kinematics between both gravitational environments, neither in terms of peak velocity, relative deceleration duration, peak acceleration or time to peak acceleration. Using inverse dynamics based on experimental and anthropometrical data, we demonstrated that the shoulder torques for accelerating and decelerating the vertical arm movements substantially differed between microgravity and normogravity. Our data therefore highlight the capacity of the central nervous system to perform very fast neuromuscular adjustments that are adapted to the gravitational constraints. We discuss our findings by considering the contribution of feedforward and feedback mechanisms in the online control of arm pointing movements.

Feedback Adaptation to Unpredictable Force Fields in 250 ms

Motor learning and adaptation are important functions of the nervous system. Classical studies have characterized how humans adapt to changes in the environment during tasks such as reaching, and have documented improvements in behavior across movements. However, little is known about how quickly the nervous system adapts to such disturbances. In particular, recent work has suggested that adaptation could be sufficiently fast to alter the control strategies of an ongoing movement. To further address the possibility that learning occurred within a single movement, we designed a series of human reaching experiments to extract from muscles recordings the latency of feedback adaptation. Our results confirmed that participants adapted their feedback responses to unanticipated force fields applied randomly. In addition, our analyses revealed that the feedback response was specifically and finely tuned to the ongoing perturbation not only across trials with the same force field, but also across different kinds of force fields. Finally, changes in muscle activity consistent with feedback adaptation occurred in ∼250 ms following reach onset. The adaptation that we observed across trials presented in a random context was similar to the one observed when the force fields could be anticipated, suggesting that these two adaptive processes may be closely linked to each other. In such case, our measurement of 250 ms may correspond to the latency of motor adaptation in the nervous system.

Learning New Feedforward Motor Commands Based on Feedback Responses

Learning a new motor task modifies feedforward (i.e., voluntary) motor commands and such learning also changes the sensitivity of feedback responses (i.e., reflexes) to mechanical perturbations [1-9]. For example, after people learn to generate straight reaching movements in the presence of an external force field or learn to reduce shoulder muscle activity when generating pure elbow movements with shoulder fixation, evoked stretch reflex responses to mechanical perturbations reflect the learning expressed during self-initiated reaching. Such a transfer from feedforward motor commands to feedback responses is thought to take place because of shared neural circuits at the level of the spinal cord, brainstem, and cerebral cortex [10-13]. The presence of shared neural resources also predicts the transfer from feedback responses to feedforward motor commands. Little is known about such a transfer presumably because it is relatively hard to elicit learning in reflexes without engaging associated voluntary responses following mechanical perturbations. Here, we demonstrate such transfer by leveraging two approaches to elicit stretch reflexes while minimizing engagement of voluntary motor responses in the learning process: applying very short mechanical perturbations [14-19] and instructing participants to not respond to them [20-26]. Taken together, our work shows that transfer between feedforward and feedback control is bidirectional, furthering the notion that these processes share common neural circuits that underlie motor learning and transfer.

Visually-updated hand state estimates modulate the proprioceptive reflex independently of motor task requirements

Fast signaling from vision and proprioception to muscle activation plays essential roles in quickly correcting movement. Though many studies have demonstrated modulation of the quick sensorimotor responses as depending on context in each modality, the contribution of multimodal information has not been established. Here, we examined whether state estimates contributing to stretch reflexes are represented solely by proprioceptive information or by multimodal information. Unlike previous studies, we newly found a significant stretch-reflex attenuation by the distortion and elimination of visual-feedback without any change in motor tasks. Furthermore, the stretch-reflex amplitude reduced with increasing elimination durations which would degrade state estimates. By contrast, even though a distortion was introduced in the target-motor-mapping, the stretch reflex was not simultaneously attenuated with visuomotor reflex. Our results therefore indicate that the observed stretch-reflex attenuation is specifically ascribed to uncertainty increase in estimating hand states, suggesting multimodal contributions to the generation of stretch reflexes.

Generalizing movement patterns following shoulder fixation

Generalizing newly learned movement patterns beyond the training context is challenging for most motor learning situations. Here we tested whether learning of a new physical property of the arm during self-initiated reaching generalizes to new arm configurations. Human participants performed a single-joint elbow reaching task and/or countered mechanical perturbations that created pure elbow motion with the shoulder joint free to rotate or locked by the manipulandum. With the shoulder free, we found activation of shoulder extensor muscles for pure elbow extension trials, appropriate for countering torques that arise at the shoulder due to forearm rotation. After locking the shoulder joint, we found a partial reduction in shoulder muscle activity, appropriate because locking the shoulder joint cancels the torques that arise at the shoulder due to forearm rotation. In our first three experiments, we tested whether and to what extent this partial reduction in shoulder muscle activity generalizes when reaching in different situations: 1) different initial shoulder orientation, 2) different initial elbow orientation, and 3) different reach distance/speed. We found generalization for the different shoulder orientation and reach distance/speed as measured by a reliable reduction in shoulder activity in these situations but no generalization for the different elbow orientation. In our fourth experiment, we found that generalization is also transferred to feedback control by applying mechanical perturbations and observing reflex responses in a distinct shoulder orientation. These results indicate that partial learning of new intersegmental dynamics is not sufficient for modifying a general internal model of arm dynamics.NEW & NOTEWORTHY Here we show that partially learning to reduce shoulder muscle activity following shoulder fixation generalizes to other movement conditions, but it does not generalize globally. These findings suggest that the partial learning of new intersegmental dynamics is not sufficient for modifying a general internal model of the arm's dynamics.

Cerebral Contribution to the Execution, But Not Recalibration, of Motor Commands in a Novel Walking Environment

Human movements are flexible as they continuously adapt to changes in the environment. The recalibration of corrective responses to sustained perturbations (e.g., constant force) altering one’s movement contributes to this flexibility. We asked whether the recalibration of corrective actions involve cerebral structures using stroke as a disease model. We characterized changes in muscle activity in stroke survivors and control subjects before, during, and after walking on a split-belt treadmill moving the legs at different speeds. The recalibration of corrective muscle activity was comparable between stroke survivors and control subjects, which was unexpected given the known deficits in feedback responses poststroke. Also, the intact recalibration in stroke survivors contrasted their limited ability to adjust their muscle activity during steady-state split-belt walking. Our results suggest that the recalibration and execution of motor commands are partially dissociable: cerebral lesions interfere with the execution, but not the recalibration, of motor commands on novel movement demands.

A Very Fast Time Scale of Human Motor Adaptation: Within Movement Adjustments of Internal Representations during Reaching

Humans and other animals adapt motor commands to predictable disturbances within tens of trials in laboratory conditions. A central question is how does the nervous system adapt to disturbances in natural conditions when exactly the same movements cannot be practiced several times. Because motor commands and sensory feedback together carry continuous information about limb dynamics, we hypothesized that the nervous system could adapt to unexpected disturbances online.

Humans and other animals adapt motor commands to predictable disturbances within tens of trials in laboratory conditions. A central question is how does the nervous system adapt to disturbances in natural conditions when exactly the same movements cannot be practiced several times. Because motor commands and sensory feedback together carry continuous information about limb dynamics, we hypothesized that the nervous system could adapt to unexpected disturbances online. We tested this hypothesis in two reaching experiments during which velocity-dependent force fields (FFs) were randomly applied. We found that within-movement feedback corrections gradually improved, despite the fact that the perturbations were unexpected. Moreover, when participants were instructed to stop at a via-point, the application of a FF prior to the via-point induced mirror-image after-effects after the via-point, consistent with within-trial adaptation to the unexpected dynamics. These findings suggest a fast time-scale of motor learning, which complements feedback control and supports adaptation of an ongoing movement.

Robust Control in Human Reaching Movements: A Model-Free Strategy to Compensate for Unpredictable Disturbances

Current models of motor learning suggest that multiple timescales support adaptation to changes in visual or mechanical properties of the environment. These models capture patterns of learning and memory across a broad range of tasks, yet do not consider the possibility that rapid changes in behavior may occur without adaptation. Such changes in behavior may be desirable when facing transient disturbances, or when unpredictable changes in visual or mechanical properties of the task make it difficult to form an accurate model of the perturbation. Whether humans can modulate control strategies without an accurate model of the perturbation remains unknown. Here we frame this question in the context of robust control (H _∞-control), a control strategy that specifically considers unpredictable disturbances by increasing initial movement speed and feedback gains. Correspondingly, we demonstrate in two human reaching experiments including males and females that the occurrence of a single unpredictable disturbance led to an increase in movement speed and in the gain of rapid feedback responses to mechanical disturbances on subsequent movements. This strategy reduced perturbation-related motion regardless of the direction of the perturbation. Furthermore, we found that changes in the control strategy were associated with co-contraction, which amplified the gain of muscle responses to both lengthening and shortening perturbations. These results have important implications for studies on motor adaptation because they highlight that trial-by-trial changes in limb motion also reflected changes in control strategies dissociable from error-based adaptation.SIGNIFICANCE STATEMENT Humans and animals use internal representations of movement dynamics to anticipate the impact of predictable disturbances. However, we are often confronted with transient or unpredictable disturbances, and it remains unknown whether and how the nervous system handles these disturbances over fast time scales. Here we hypothesized that humans can modulate their control strategy to make reaching movements less sensitive to perturbations. We tested this hypothesis in the framework of robust control, and found changes in movement speed and feedback gains consistent with the model predictions. These changes impacted participants' behavior on a trial-by-trial basis. We conclude that compensation for disturbances over fast time scales involves a robust control strategy, which potentially plays a key role in motor planning and execution.

Visual Feedback Processing of the Limb Involves Two Distinct Phases

Muscle responses to mechanical disturbances exhibit two distinct phases: a response starting at ~20 ms that is fairly stereotyped, and a response starting at ~60 ms modulated by many behavioral contexts including goal-redundancy and environmental obstacles. Muscle responses to disturbances of visual feedback of the hand arise within ~90 ms. However, little is known whether these muscle responses are sensitive to behavioral contexts. We had 49 human participants (27 male) execute goal-directed reaches with visual feedback of their hand presented as a cursor. On random trials, the cursor jumped laterally to the reach direction, and thus, required a correction to attain the goal. The first experiment demonstrated that the response amplitude starting at 90 ms scaled with jump magnitude, but only for jumps <2 cm. For larger jumps, the duration of the muscle response scaled with the jump size starting after 120 ms. The second experiment demonstrated that the early response was sensitive to goal redundancy as wider targets evoked a smaller corrective response. The third experiment demonstrated that the early response did not consider the presence of obstacles, as this response routinely drove participants directly to the goal even though this path was blocked by an obstacle. Instead, the appropriate muscle response to navigate around the obstacle started after 120 ms. Our findings highlight that visual feedback of the limb involves two distinct phases: a response starting at 90 ms with limited sensitivity to jump magnitude and sensitive to goal-redundancy, and a response starting at 120 ms with increased sensitivity to jump magnitude and environmental factors.SIGNIFICANCE STATEMENT The motor system can integrate proprioceptive feedback to guide an ongoing action in ~60 ms and is flexible to a broad range of behavioral contexts. In contrast, the present study identified that the motor response to a visual disturbance exhibits two distinct phases: an early response starting at 90 ms with limited scaling with disturbance size and sensitivity to goal-redundancy, and a slower response starting after 120 ms with increased sensitivity to disturbance size and sensitive to environmental obstacles. These data suggest visual feedback of the hand is processed through two distinct feedback processes.

Highs and Lows in Motor Control Development

Motor control is classically described as relying on two components: anticipatory control (feedforward processing) and online control (feedback processing). Here we aimed to unveil the developmental steps of both feedback and feedforward control in 5-10 years old children, using a simple and ecological task. We manipulated object's weight in a reach-to-displace paradigm. When the weight was known before lifting it, anticipatory processes were quantifiable during the reaching phase. Conversely, an unknown weight triggered online corrections during the displacing phase. Movement kinematics revealed that children anticipate this objet property as young as 5 y-o. This anticipation becomes adequate around 7 y-o and is paralleled by poor online corrections. This simple yet relevant paradigm should allow quantifying deviations from neurotypical patterns in disorders of motor control.

Corrective Muscle Activity Reveals Subject-Specific Sensorimotor Recalibration

Recent studies suggest that planned and corrective actions are recalibrated during some forms of motor adaptation. However, corrective (also known as reactive) movements in human locomotion are thought to simply reflect sudden environmental changes independently from sensorimotor recalibration. Thus, we asked whether corrective responses can indicate the motor system’s adapted state following prolonged exposure to a novel walking situation inducing sensorimotor adaptation. We recorded electromyographic (EMG) signals bilaterally on 15 leg muscles before, during, and after split-belts walking (i.e., novel walking situation), in which the legs move at different speeds. We exploited the rapid temporal dynamics of corrective responses upon unexpected speed transitions to isolate them from the overall motor output. We found that corrective muscle activity was structurally different following short versus long exposures to split-belts walking. Only after a long exposure, removal of the novel environment elicited corrective muscle patterns that matched those expected in response to a perturbation opposite to the one originally experienced. This indicated that individuals who recalibrated their motor system adopted split-belts environment as their new “normal” and transitioning back to the original walking environment causes subjects to react as if it was novel to them. Interestingly, this learning declined with age, but steady state modulation of muscle activity during split-belts walking did not, suggesting potentially different neural mechanisms underlying these motor patterns. Taken together, our results show that corrective motor commands reflect the adapted state of the motor system, which is less flexible as we age.

A computational scheme for internal models not requiring precise system parameters

Utilization by humans of a precise and adaptable internal model of the dynamics of the body in generating movements is a well-supported concept. The prevailing opinion is that such an internal model ceaselessly develops through long-term repetition and accumulation in the central nervous system (CNS). However, a long-term learning process would not be absolutely necessary for the formation of internal models. It is possible to estimate the dynamics of the system by using a motor command and its resulting output, instead of constructing a model of the dynamics with precise parameters. In this study, a computational model is proposed that uses a motor command and its corresponding output to estimate the dynamics of the system and it is examined whether the proposed model is capable of describing a series of empirical movements. The proposed model was found to be capable of describing humans' fast movements which require compensation for system dynamics as well as sensory delays. In addition, the proposed model shows equifinality under inertial perturbations as seen in several experimental studies. This satisfactory reproducibility of the proposed computation raises the possibility that humans make a movement by estimating the system dynamics with a copy of motor command and sensory output on a momentary basis, without the need to identify precise system parameters.

Shoulder reflexes integrate elbow information at "long-latency" delay throughout a corrective action

Previous studies have demonstrated a progression of function when healthy subjects counter a sudden mechanical load. Short-latency reflexes are linked to local stretch of the particular muscle and its antagonist. Long-latency reflexes integrate stretch information from both local sources and muscles crossing remote joints appropriate for a limb's mechanical interactions. Unresolved is how sensory information is processed throughout the corrective response, since capabilities at some time can be produced by circuits acting at that delay and at briefer delays. One possibility is that local abilities are always expressed at a short-latency delay and integrative abilities are always expressed at a long-latency delay. Alternatively, the neural circuits may be altered over time, leading to a temporal shift in expressing certain abilities; a refractory period could retard integrative responses to a second perturbation, whereas priming could enable integrative responses at short latency. We tested between these three hypotheses in a shoulder muscle by intermixing trials of step torque with either torque pulses ( experiment 1) or double steps of torque ( experiment 2). The second perturbation occurred at 35, 60, and 110 ms after the first perturbation to probe processing throughout the corrective action. The second perturbation reliably evoked short-latency responses in the shoulder muscle linked to only shoulder motion and long-latency responses linked to both shoulder and elbow motion. This pattern is best accounted by the continuous action of controllers with fixed functions. NEW & NOTEWORTHY Sudden displacement of the limb evokes a short-latency reflex, 20-50 ms, based on local muscle stretch and a long-latency reflex based on integrating muscle stretch at different joints. A novel double-perturbation paradigm tested if these abilities are temporally conserved throughout the corrective response or are shifted (retarded or delayed) due to functional changes in the responsible circuits. Multi-joint integration was reliably expressed at a long-latency delay consistent with the continuous operation of circuits with fixed abilities.

Sensorimotor Robotic Measures of tDCS- and HD-tDCS-Enhanced Motor Learning in Children

Transcranial direct-current stimulation (tDCS) enhances motor learning in adults. We have demonstrated that anodal tDCS and high-definition (HD) tDCS of the motor cortex can enhance motor skill acquisition in children, but behavioral mechanisms remain unknown. Robotics can objectively quantify complex sensorimotor functions to better understand mechanisms of motor learning. We aimed to characterize changes in sensorimotor function induced by tDCS and HD-tDCS paired motor learning in children within an interventional trial. Healthy, right-handed children (12–18 y) were randomized to anodal tDCS, HD-tDCS, or sham targeting the right primary motor cortex during left-hand Purdue pegboard test (PPT) training over five consecutive days. A KINARM robotic protocol quantifying proprioception, kinesthesia, visually guided reaching, and an object hit task was completed at baseline, posttraining, and six weeks later. Effects of the treatment group and training on changes in sensorimotor parameters were explored. Twenty-four children (median 15.5 years, 52% female) completed all measures. Compared to sham, both tDCS and HD-tDCS demonstrated enhanced motor learning with medium effect sizes. At baseline, multiple KINARM measures correlated with PPT performance. Following training, visually guided reaching in all groups was faster and required less corrective movements in the trained arm (H(2) = 9.250, p = 0.010). Aspects of kinesthesia including initial direction error improved across groups with sustained effects at follow-up (H(2) = 9.000, p = 0.011). No changes with training or stimulation were observed for position sense. For the object hit task, the HD-tDCS group moved more quickly with the right hand compared to sham at posttraining (χ²(2) = 6.255, p = 0.044). Robotics can quantify complex sensorimotor function within neuromodulator motor learning trials in children. Correlations with PPT performance suggest that KINARM metrics can assess motor learning effects. Understanding how tDCS and HD-tDCS enhance motor learning may be improved with robotic outcomes though specific mechanisms remain to be defined. Exploring mechanisms of neuromodulation may advance therapeutic approaches in children with cerebral palsy and other disabilities.

The critical stability task: quantifying sensory-motor control during ongoing movement in nonhuman primates

Everyday behaviors require that we interact with the environment, using sensory information in an ongoing manner to guide our actions. Yet, by design, many of the tasks used in primate neurophysiology laboratories can be performed with limited sensory guidance. As a consequence, our knowledge about the neural mechanisms of motor control is largely limited to the feedforward aspects of the motor command. To study the feedback aspects of volitional motor control, we adapted the critical stability task (CST) from the human performance literature (Jex H, McDonnell J, Phatak A. IEEE Trans Hum Factors Electron 7: 138-145, 1966). In the CST, our monkey subjects interact with an inherently unstable (i.e., divergent) virtual system and must generate sensory-guided actions to stabilize it about an equilibrium point. The difficulty of the CST is determined by a single parameter, which allows us to quantitatively establish the limits of performance in the task for different sensory feedback conditions. Two monkeys learned to perform the CST with visual or vibrotactile feedback. Performance was better under visual feedback, as expected, but both monkeys were able to utilize vibrotactile feedback alone to successfully perform the CST. We also observed changes in behavioral strategy as the task became more challenging. The CST will have value for basic science investigations of the neural basis of sensory-motor integration during ongoing actions, and it may also provide value for the design and testing of bidirectional brain computer interface systems. NEW & NOTEWORTHY Currently, most behavioral tasks used in motor neurophysiology studies require primates to make short-duration, stereotyped movements that do not necessitate sensory feedback. To improve our understanding of sensorimotor integration, and to engineer meaningful artificial sensory feedback systems for brain-computer interfaces, it is crucial to have a task that requires sensory feedback for good control. The critical stability task demands that sensory information be used to guide long-duration movements.

Feedforward and Feedback Control Share an Internal Model of the Arm's Dynamics

Recent work has shown that, when countering external forces, the nervous system adjusts not only predictive (i.e., feedforward) control of reaching but also reflex (i.e., feedback) responses to mechanical perturbations. Here we show that altering the physical properties of the arm (i.e., intersegmental dynamics) causes the nervous system to adjust feedforward control and that this learning transfers to feedback responses even though the latter were never directly trained. Forty-five human participants (30 females) performed a single-joint elbow reaching task and countered mechanical perturbations that created pure elbow motion. In our first experiment, we altered intersegmental dynamics by asking participants to generate pure elbow movements when the shoulder joint was either free to rotate or locked by the robotic manipulandum. With the shoulder unlocked, we found robust activation of shoulder flexor muscles for pure elbow flexion trials, as required to counter the interaction torques that arise at the shoulder because of forearm rotation. After locking the shoulder joint, which cancels these interaction torques, we found a substantial reduction in shoulder muscle activity over many trials. In our second experiment, we tested whether such learning transfers to feedback control. Mechanical perturbations applied to the arm with the shoulder unlocked revealed that feedback responses also account for intersegmental dynamics. After locking the shoulder joint, we found a substantial reduction in shoulder feedback responses, as appropriate for the altered intersegmental dynamics. Our work suggests that feedforward and feedback control share an internal model of the arm's dynamics.SIGNIFICANCE STATEMENT Here we show that altering the physical properties of the arm causes people to learn new motor commands and that this learning transfers to their reflex responses to unexpected mechanical perturbations, even though the reflex responses were never directly trained. Our results suggest that feedforward motor commands and reflex responses share an internal model of the arm's dynamics.

Long-latency reflexes for inter-effector coordination reflect a continuous state feedback controller

Successful performance in many everyday tasks requires compensating unexpected mechanical disturbance to our limbs and body. The long-latency reflex plays an important role in this process because it is the fastest response to integrate sensory information across several effectors, like when linking the elbow and shoulder or the arm and body. Despite the dozens of studies on inter-effector long-latency reflexes, there has not been a comprehensive treatment of how these reveal the basic control organization that sets constraints on any candidate model of neural feedback control such as optimal feedback control. We considered three contrasting ways that controllers can be organized: multiple independent controllers vs. a multiple-input multiple-output (MIMO) controller, a continuous feedback controller vs. an intermittent feedback controller, and a direct MIMO controller vs. a state feedback controller. Following a primer on control theory and review of the relevant evidence, we conclude that continuous state feedback control best describes the organization of inter-effector coordination by the long-latency reflex.

Rapid feedback responses are flexibly coordinated across arm muscles to support goal-directed reaching

A transcortical pathway helps support goal-directed reaching by processing somatosensory information to produce rapid feedback responses across multiple joints and muscles. Here, we tested whether such feedback responses can account for changes in arm configuration and for arbitrary visuomotor transformations-two manipulations that alter how muscles at the elbow and wrist need to be coordinated to achieve task success. Participants used a planar three degree-of-freedom exoskeleton robot to move a cursor to a target following a mechanical perturbation that flexed the elbow. In our first experiment, the cursor was mapped to the veridical position of the robot handle, but participants grasped the handle with two different hand orientations (thumb pointing upward or thumb pointing downward). We found that large rapid feedback responses were evoked in wrist extensor muscles when wrist extension helped move the cursor to the target (i.e., thumb upward), and in wrist flexor muscles when wrist flexion helped move the cursor to the target (i.e., thumb downward). In our second experiment, participants grasped the robot handle with their thumb pointing upward, but the cursor's movement was either veridical or was mirrored such that flexing the wrist moved the cursor as if the participant extended their wrist, and vice versa. After extensive practice, we found that rapid feedback responses were appropriately tuned to the wrist muscles that supported moving the cursor to the target when the cursor was mapped to the mirrored movement of the wrist, but were not tuned to the appropriate wrist muscles when the cursor was remapped to the wrist's veridical movement. NEW & NOTEWORTHY We show that rapid feedback responses were evoked in different wrist muscles depending on the arm's orientation, and this muscle activity was appropriate to generate the wrist motion that supported a reaching action. Notably, we also show that these rapid feedback responses can be evoked in wrist muscles that are detrimental to a reaching action if a nonveridical mapping between wrist and hand motion is extensively learned.

State-Based Delay Representation and Its Transfer from a Game of Pong to Reaching and Tracking

To accurately estimate the state of the body, the nervous system needs to account for delays between signals from different sensory modalities. To investigate how such delays may be represented in the sensorimotor system, we asked human participants to play a virtual pong game in which the movement of the virtual paddle was delayed with respect to their hand movement. We tested the representation of this new mapping between the hand and the delayed paddle by examining transfer of adaptation to blind reaching and blind tracking tasks. These blind tasks enabled to capture the representation in feedforward mechanisms of movement control. A Time Representation of the delay is an estimation of the actual time lag between hand and paddle movements. A State Representation is a representation of delay using current state variables: the distance between the paddle and the ball originating from the delay may be considered as a spatial shift; the low sensitivity in the response of the paddle may be interpreted as a minifying gain; and the lag may be attributed to a mechanical resistance that influences paddle's movement. We found that the effects of prolonged exposure to the delayed feedback transferred to blind reaching and tracking tasks and caused participants to exhibit hypermetric movements. These results, together with simulations of our representation models, suggest that delay is not represented based on time, but rather as a spatial gain change in visuomotor mapping.

Perspectives on classical controversies about the motor cortex

Primary motor cortex has been studied for more than a century, yet a consensus on its functional contribution to movement control is still out of reach. In particular, there remains controversy as to the level of control produced by motor cortex ("low-level" movement dynamics vs. "high-level" movement kinematics) and the role of sensory feedback. In this review, we present different perspectives on the two following questions: What does activity in motor cortex reflect? and How do planned motor commands interact with incoming sensory feedback during movement? The four authors each present their independent views on how they think the primary motor cortex (M1) controls movement. At the end, we present a dialogue in which the authors synthesize their views and suggest possibilities for moving the field forward. While there is not yet a consensus on the role of M1 or sensory feedback in the control of upper limb movements, such dialogues are essential to take us closer to one.

Rapid visuomotor feedback gains are tuned to the task dynamics

Here, we test whether rapid visuomotor feedback responses are selectively tuned to the task dynamics. The responses do not exhibit gain scaling, but they do vary with the level and stability of task dynamics. Moreover, these feedback gains are independently tuned to perturbations to the left and right, depending on these dynamics. Our results demonstrate that the sensorimotor control system regulates the feedback gain as part of the adaptation process, tuning them appropriately to the environment.

Adaptation to novel dynamics requires learning a motor memory, or a new pattern of predictive feedforward motor commands. Recently, we demonstrated the upregulation of rapid visuomotor feedback gains early in curl force field learning, which decrease once a predictive motor memory is learned. However, even after learning is complete, these feedback gains are higher than those observed in the null field trials. Interestingly, these upregulated feedback gains in the curl field were not observed in a constant force field. Therefore, we suggest that adaptation also involves selectively tuning the feedback sensitivity of the sensorimotor control system to the environment. Here, we test this hypothesis by measuring the rapid visuomotor feedback gains after subjects adapt to a variety of novel dynamics generated by a robotic manipulandum in three experiments. To probe the feedback gains, we measured the magnitude of the motor response to rapid shifts in the visual location of the hand during reaching. While the feedback gain magnitude remained similar over a larger than a fourfold increase in constant background load, the feedback gains scaled with increasing lateral resistance and increasing instability. The third experiment demonstrated that the feedback gains could also be independently tuned to perturbations to the left and right, depending on the lateral resistance, demonstrating the fractionation of feedback gains to environmental dynamics. Our results show that the sensorimotor control system regulates the gain of the feedback system as part of the adaptation process to novel dynamics, appropriately tuning them to the environment.

NEW & NOTEWORTHY Here, we test whether rapid visuomotor feedback responses are selectively tuned to the task dynamics. The responses do not exhibit gain scaling, but they do vary with the level and stability of task dynamics. Moreover, these feedback gains are independently tuned to perturbations to the left and right, depending on these dynamics. Our results demonstrate that the sensorimotor control system regulates the feedback gain as part of the adaptation process, tuning them appropriately to the environment.