Postural control of arm and fingers through integration of movement commands

Inverting a model of neuromuscular control to estimate descending activation patterns that generate fast-reaching movements

Reaching movements generally show smooth kinematic profiles that are invariant across varying movement speeds even as interaction torques and muscle properties vary nonlinearly with speed. How the brain brings about these invariant profiles is an open question. We developed an analytical inverse dynamics method to estimate descending activation patterns directly from observed joint angle trajectories based on a simple model of the stretch reflex, and of muscle and biomechanical dynamics. We estimated descending activation patterns for experimental data from eight different planar two-joint movements performed at two movement times (fast: 400 ms; slow: 800 ms). The temporal structure of descending activation differed qualitatively across speeds, consistent with the idea that the nervous system uses an internal model to generate anticipatory torques during fast movement. This temporal structure also depended on the cocontraction level of antagonistic muscle groups. Comparing estimated muscle activation and descending activation revealed the contribution of the stretch reflex to movement generation that was found to set in after about 20% of movement time.NEW & NOTEWORTHY By estimating descending activation patterns directly from observed movement kinematics based on a model of the dynamics of the stretch reflex, of muscle force generation, and of the biomechanics of the limb, we observed how brain signals must be temporally structured to enable fast movement.

Identifying Distinct Neural Features between the Initial and Corrective Phases of Precise Reaching Using AutoLFADS

Many initial movements require subsequent corrective movements, but how the motor cortex transitions to make corrections and how similar the encoding is to initial movements is unclear. In our study, we explored how the brain's motor cortex signals both initial and corrective movements during a precision reaching task. We recorded a large population of neurons from two male rhesus macaques across multiple sessions to examine the neural firing rates during not only initial movements but also subsequent corrective movements. AutoLFADS, an autoencoder-based deep-learning model, was applied to provide a clearer picture of neurons' activity on individual corrective movements across sessions. Decoding of reach velocity generalized poorly from initial to corrective submovements. Unlike initial movements, it was challenging to predict the velocity of corrective movements using traditional linear methods in a single, global neural space. We identified several locations in the neural space where corrective submovements originated after the initial reaches, signifying firing rates different than the baseline before initial movements. To improve corrective movement decoding, we demonstrate that a state-dependent decoder incorporating the population firing rates at the initiation of correction improved performance, highlighting the diverse neural features of corrective movements. In summary, we show neural differences between initial and corrective submovements and how the neural activity encodes specific combinations of velocity and position. These findings are inconsistent with assumptions that neural correlations with kinematic features are global and independent, emphasizing that traditional methods often fall short in describing these diverse neural processes for online corrective movements.

Motor cortex retains and reorients neural dynamics during motor imagery

The most prominent characteristic of motor cortex is its activation during movement execution, but it is also active when we simply imagine movements in the absence of actual motor output. Despite decades of behavioural and imaging studies, it is unknown how the specific activity patterns and temporal dynamics in motor cortex during covert motor imagery relate to those during motor execution. Here we recorded intracortical activity from the motor cortex of two people who retain some residual wrist function following incomplete spinal cord injury as they performed both actual and imagined isometric wrist extensions. We found that we could decompose the population activity into three orthogonal subspaces, where one was similarly active during both action and imagery, and the others were active only during a single task type-action or imagery. Although they inhabited orthogonal neural dimensions, the action-unique and imagery-unique subspaces contained a strikingly similar set of dynamic features. Our results suggest that during motor imagery, motor cortex maintains the same overall population dynamics as during execution by reorienting the components related to motor output and/or feedback into a unique, output-null imagery subspace.

Preparatory activity and the expansive null-space

The study of the cortical control of movement experienced a conceptual shift over recent decades, as the basic currency of understanding shifted from single-neuron tuning towards population-level factors and their dynamics. This transition was informed by a maturing understanding of recurrent networks, where mechanism is often characterized in terms of population-level factors. By estimating factors from data, experimenters could test network-inspired hypotheses. Central to such hypotheses are 'output-null' factors that do not directly drive motor outputs yet are essential to the overall computation. In this Review, we highlight how the hypothesis of output-null factors was motivated by the venerable observation that motor-cortex neurons are active during movement preparation, well before movement begins. We discuss how output-null factors then became similarly central to understanding neural activity during movement. We discuss how this conceptual framework provided key analysis tools, making it possible for experimenters to address long-standing questions regarding motor control. We highlight an intriguing trend: as experimental and theoretical discoveries accumulate, the range of computational roles hypothesized to be subserved by output-null factors continues to expand.

Phasic and tonic muscle synergies are different in number, structure and sparseness

In the last two decades, muscle synergies analysis has been commonly used to assess the neurophysiological mechanisms underlying human motor control. Several synergy models and algorithms have been employed for processing the electromyographic (EMG) signal, and it has been shown that the coordination of motor control is characterized by the presence of phasic (movement-related) and tonic (anti-gravity and related to co-contraction) EMG components. Neural substrates indicate that phasic and tonic components have non-homogeneous origin; however, it is still unclear if these components are generated by the same set of synergies or by distinct synergies. This study aims at testing whether phasic and tonic components are generated by distinct phasic and tonic synergies or by the same set of synergies with phasic and tonic activation coefficients. The study also aims at characterizing the differences between the phasic and the tonic synergies. Using a comprehensive mapping of upper-limb point-to-point movements, synergies were extracted from phasic and tonic EMG signal separately, estimating the tonic components with a linear ramp model. The goodness of reconstruction (R2) as a function of the number of synergies was compared, and sets of synergies extracted from each dataset at three R2 threshold levels (0.80, 0.85, 0.90) were retained for further analysis. Then, shared, phasic-specific, and tonic-specific synergies were extracted from the two datasets concatenated. The dimensionality of the synergies shared between the phasic and the tonic datasets was estimated with a bootstrap procedure based on the evaluation of the distribution of principal angles between the subspaces spanned by phasic and tonic synergies due to noise. We found only few shared synergies, indicating that phasic and tonic synergies have in general different structures. To compare consistent differences in synergy composition, shared, phasic-specific, and tonic-specific synergies were clustered separately. Phasic-specific clusters were more numerous than tonic-specific ones, suggesting that they were more differentiated among subjects. The structure of phasic clusters and the higher sparseness indicated that phasic synergies capture specific muscle activation patterns related to the movement while tonic synergies show co-contraction of multiple muscles for joint stabilization and holding postures. These results suggest that in many scenarios phasic and tonic synergies should be extracted separately, especially when performing muscle synergy analysis in patients with abnormal tonic activity and for tuning devices with gravity support.

Sensory prediction error drives subconscious motor learning outside of the laboratory

Sensorimotor adaptation is supported by at least two parallel learning systems: an intentionally controlled explicit strategy and an involuntary implicit learning system. Past work focused on constrained reaches or finger movements in laboratory environments has shown subconscious learning systems to be driven in part by sensory prediction error (SPE), i.e., the mismatch between the realized and expected outcome of an action. We designed a ball rolling task to explore whether SPEs can drive implicit motor adaptation during complex whole body movements that impart physical motion on external objects. After applying a visual shift, participants rapidly adapted their rolling angles to reduce the error between the ball and the target. We removed all visual feedback and told participants to aim their throw directly toward the primary target, revealing an unintentional 5.06° implicit adjustment to reach angles that decayed over time. To determine whether this implicit adaptation was driven by SPE, we gave participants a second aiming target that would "solve" the visual shift, as in the study by Mazzoni and Krakauer (Mazzoni P, Krakauer JW. J Neurosci 26: 3642-3645, 2006). Remarkably, after rapidly reducing ball-rolling error to zero (due to enhancements in strategic aiming), the additional aiming target caused rolling angles to deviate beyond the primary target by 3.15°. This involuntary overcompensation, which worsened task performance, is a hallmark of SPE-driven implicit learning. These results show that SPE-driven implicit processes, previously observed within simplified finger or planar reaching movements, actively contribute to motor adaptation in more complex naturalistic skill-based tasks.NEW & NOTEWORTHY Implicit and explicit learning systems have been detected using simple, constrained movements inside the laboratory. How these systems impact movements during complex whole body, skill-based tasks has not been established. Here, we demonstrate that sensory prediction errors significantly impact how a person updates their movements, replicating findings from the laboratory in an unconstrained ball-rolling task. This real-world validation is an important step toward explaining how subconscious learning helps humans execute common motor skills in dynamic environments.

Neuromuscular control: from a biomechanist's perspective

Understanding neural control of movement necessitates a collaborative approach between many disciplines, including biomechanics, neuroscience, and motor control. Biomechanics grounds us to the laws of physics that our musculoskeletal system must obey. Neuroscience reveals the inner workings of our nervous system that functions to control our body. Motor control investigates the coordinated motor behaviours we display when interacting with our environment. The combined efforts across the many disciplines aimed at understanding human movement has resulted in a rich and rapidly growing body of literature overflowing with theories, models, and experimental paradigms. As a result, gathering knowledge and drawing connections between the overlapping but seemingly disparate fields can be an overwhelming endeavour. This review paper evolved as a need for us to learn of the diverse perspectives underlying current understanding of neuromuscular control. The purpose of our review paper is to integrate ideas from biomechanics, neuroscience, and motor control to better understand how we voluntarily control our muscles. As biomechanists, we approach this paper starting from a biomechanical modelling framework. We first define the theoretical solutions (i.e., muscle activity patterns) that an individual could feasibly use to complete a motor task. The theoretical solutions will be compared to experimental findings and reveal that individuals display structured muscle activity patterns that do not span the entire theoretical solution space. Prevalent neuromuscular control theories will be discussed in length, highlighting optimality, probabilistic principles, and neuromechanical constraints, that may guide individuals to families of muscle activity solutions within what is theoretically possible. Our intention is for this paper to serve as a primer for the neuromuscular control scientific community by introducing and integrating many of the ideas common across disciplines today, as well as inspire future work to improve the representation of neural control in biomechanical models.

Distinct adaptation processes underlie multidigit force coordination for dexterous manipulation

The human sensorimotor system can adapt to various changes in the environmental dynamics by updating motor commands to improve performance after repeated exposure to the same task. However, the characteristics and mechanisms of the adaptation process remain unknown for dexterous manipulation, a unique motor task in which the body physically interacts with the environment with multiple effectors, i.e., digits, in parallel. We addressed this gap by using robotic manipulanda to investigate the changes in the digit force coordination following mechanical perturbation of an object held by tripod grasps. As the participants gradually adapted to lifting the object under perturbations, we quantified two components of digit force coordination. One is the direction-specific manipulation moment that directly counteracts the perturbation, whereas the other one is the direction-independent internal moment that supports the stability and stiffness of the grasp. We found that trial-to-trial improvement of task performance was associated with increased manipulation moment and a gradual decrease of the internal moment. These two moments were characterized by different rates of adaptation. We also examined how these two force coordination components respond to changes in perturbation directions. Importantly, we found that the manipulation moment was sensitive to the extent of repetitive exposure to the previous context that has an opposite perturbation direction, whereas the internal moment did not. However, the internal moment was sensitive to whether the postchange perturbation direction was previously experienced. Our results reveal, for the first time, that two distinct processes underlie the adaptation of multidigit force coordination for dexterous manipulation.NEW & NOTEWORTHY Changes in digit force coordination in multidigit object manipulation were quantified with a novel experimental design in which human participants adapted to mechanical perturbations applied to the object. Our results show that the adaptation of digit force coordination can be characterized by two distinct components that operate at different timescales. We further show that these two components respond to changes in perturbation direction differently.

The human motor cortex contributes to gravity compensation to maintain posture and during reaching

The neural control of posture and movement is interdependent. During voluntary movement, the neural motor command is executed by the motor cortex through the corticospinal tract and its collaterals and subcortical targets. Here we address the question of whether the control mechanism for the postural adjustments at nonmoving joints is also involved in overcoming gravity at the moving joints. We used single-pulse transcranial magnetic stimulation to measure the corticospinal excitability in humans during postural and reaching tasks. We hypothesized that the corticospinal excitability is proportional to background muscle activity and the gravity-related joint moments during both static postures and reaching movements. To test this hypothesis, we used visual targets in virtual reality to instruct five postures and three movements with or against gravity. We then measured the amplitude and gain of motor evoked potentials in multiple arm and hand muscles at several phases of the reaching motion and during static postures. The stimulation caused motor evoked potentials in all muscles that were proportional to the muscle activity. During both static postures and reaching movements, the muscle activity and the corticospinal contribution to these muscles changed in proportion with the postural moments needed to support the arm against gravity, supporting the hypothesis. Notably, these changes happened not only in antigravity muscles. Altogether, these results provide evidence that the changes in corticospinal excitability cause muscle cocontraction that modulates limb stiffness. This suggests that the motor cortex is involved in producing postural adjustments that support the arm against gravity during posture maintenance and reaching.NEW & NOTEWORTHY Animal studies suggest that the corticospinal tract and its collaterals are crucial for producing postural adjustments that accompany movement in limbs other than the moving limb. Here we provide evidence for a similar control schema for both arm posture maintenance and gravity compensation during movement of the same limb. The observed interplay between the postural and movement control signals within the corticospinal tract may help explain the underlying neural motor deficits after stroke.

Motor cortex activity across movement speeds is predicted by network-level strategies for generating muscle activity

Learned movements can be skillfully performed at different paces. What neural strategies produce this flexibility? Can they be predicted and understood by network modeling? We trained monkeys to perform a cycling task at different speeds, and trained artificial recurrent networks to generate the empirical muscle-activity patterns. Network solutions reflected the principle that smooth well-behaved dynamics require low trajectory tangling. Network solutions had a consistent form, which yielded quantitative and qualitative predictions. To evaluate predictions, we analyzed motor cortex activity recorded during the same task. Responses supported the hypothesis that the dominant neural signals reflect not muscle activity, but network-level strategies for generating muscle activity. Single-neuron responses were better accounted for by network activity than by muscle activity. Similarly, neural population trajectories shared their organization not with muscle trajectories, but with network solutions. Thus, cortical activity could be understood based on the need to generate muscle activity via dynamics that allow smooth, robust control over movement speed.

A neuromuscular model of human locomotion combines spinal reflex circuits with voluntary movements

Existing models of human walking use low-level reflexes or neural oscillators to generate movement. While appropriate to generate the stable, rhythmic movement patterns of steady-state walking, these models lack the ability to change their movement patterns or spontaneously generate new movements in the specific, goal-directed way characteristic of voluntary movements. Here we present a neuromuscular model of human locomotion that bridges this gap and combines the ability to execute goal directed movements with the generation of stable, rhythmic movement patterns that are required for robust locomotion. The model represents goals for voluntary movements of the swing leg on the task level of swing leg joint kinematics. Smooth movements plans towards the goal configuration are generated on the task level and transformed into descending motor commands that execute the planned movements, using internal models. The movement goals and plans are updated in real time based on sensory feedback and task constraints. On the spinal level, the descending commands during the swing phase are integrated with a generic stretch reflex for each muscle. Stance leg control solely relies on dedicated spinal reflex pathways. Spinal reflexes stimulate Hill-type muscles that actuate a biomechanical model with eight internal joints and six free-body degrees of freedom. The model is able to generate voluntary, goal-directed reaching movements with the swing leg and combine multiple movements in a rhythmic sequence. During walking, the swing leg is moved in a goal-directed manner to a target that is updated in real-time based on sensory feedback to maintain upright balance, while the stance leg is stabilized by low-level reflexes and a behavioral organization switching between swing and stance control for each leg. With this combination of reflex-based stance leg and voluntary, goal-directed control of the swing leg, the model controller generates rhythmic, stable walking patterns in which the swing leg movement can be flexibly updated in real-time to step over or around obstacles.

Using Artificial Intelligence for Assistance Systems to Bring Motor Learning Principles into Real World Motor Tasks

Humans learn movements naturally, but it takes a lot of time and training to achieve expert performance in motor skills. In this review, we show how modern technologies can support people in learning new motor skills. First, we introduce important concepts in motor control, motor learning and motor skill learning. We also give an overview about the rapid expansion of machine learning algorithms and sensor technologies for human motion analysis. The integration between motor learning principles, machine learning algorithms and recent sensor technologies has the potential to develop AI-guided assistance systems for motor skill training. We give our perspective on this integration of different fields to transition from motor learning research in laboratory settings to real world environments and real world motor tasks and propose a stepwise approach to facilitate this transition.

Evidence for an internal model of friction when controlling kinetic energy at impact to slide an object along a surface toward a target

Although the role of an internal model of gravity for the predictive control of the upper limbs is quite well established, evidence is lacking regarding an internal model of friction. In this study, 33 male and female human participants performed a striking movement (with the index finger) to slide a plastic cube-like object to a given target distance. The surface material (aluminum or balsa wood) on which the object slides, the surface slope (-10°, 0, or +10°) and the target distance (25 cm or 50 cm) varied across conditions, with ten successive trials in each condition. Analysis of the object speed at impact and spatial error suggests that: 1) the participants chose to impart a similar speed to the object in the first trial regardless of the surface material to facilitate the estimation of the coefficient of friction; 2) the movement is parameterized across repetitions to reduce spatial error; 3) an internal model of friction can be generalized when the slope changes. Biomechanical analysis showed interindividual variability in the recruitment of the upper limb segments and in the adjustment of finger speed at impact in order to transmit the kinetic energy required to slide the object to the target distance. In short, we provide evidence that the brain builds an internal model of friction that makes it possible to parametrically control a striking movement in order to regulate the amount of kinetic energy required to impart the appropriate initial speed to the object.

A network information theoretic framework to characterise muscle synergies in space and time

Objective Current approaches to muscle synergy extraction rely on linear dimensionality reduction algorithms that make specific assumptions on the underlying signals. However, to capture nonlinear time varying, large-scale but also muscle-specific interactions, a more generalised approach is required. Approach Here we developed a novel framework for muscle synergy extraction that relaxes model assumptions by using a combination of information- and network theory and dimensionality reduction. We first quantify informational dynamics between muscles, time-samples or muscle-time pairings using a novel mutual information formulation. We then model these pairwise interactions as multiplex networks and identify modules representing the network architecture. We employ this modularity criterion as the input parameter for dimensionality reduction, which verifiably extracts the identified modules, and also to characterise salient structures within each module. Main results This novel framework captures spatial, temporal and spatiotemporal interactions across two benchmark datasets of reaching movements, producing distinct spatial groupings and both tonic and phasic temporal patterns. Readily interpretable muscle synergies spanning multiple spatial and temporal scales were identified, demonstrating significant task dependence, ability to capture trial-to-trial fluctuations and concordance across participants. Furthermore, our framework identifies submodular structures that represent the distributed networks of co-occurring signal interactions across scales. Significance The capabilities of this framework are illustrated through the concomitant continuity with previous research and novelty of the insights gained. Several previous limitations are circumvented including the extraction of functionally meaningful and multiplexed pairwise muscle couplings under relaxed model assumptions. The extracted synergies provide a holistic view of the movement while important details of task performance are readily interpretable. The identified muscle groupings transcend biomechanical constraints and the temporal patterns reveal characteristics of fundamental motor control mechanisms. We conclude that this framework opens new opportunities for muscle synergy research and can constitute a bridge between existing models and recent network-theoretic endeavours.

Data-efficient Causal Decoding of Spiking Neural Activity using Weighted Voting

Brain-Computer Interface systems can contribute to a vast set of applications such as overcoming physical disabilities in people with neural injuries or hands-free control of devices in healthy individuals. However, having systems that can accurately interpret intention online remains a challenge in this field. Robust and data-efficient decoding-despite the dynamical nature of cortical activity and causality requirements for physical function-is among the most important challenges that limit the widespread use of these devices for real-world applications. Here, we present a causal, data-efficient neural decoding pipeline that predicts intention by first classifying recordings in short sliding windows. Next, it performs weighted voting over initial predictions up to the current point in time to report a refined final prediction. We demonstrate its utility by classifying spiking neural activity collected from the human posterior parietal cortex for a cue, delay, imaginary motor task. This pipeline provides higher classification accuracy than state-of-the-art time windowed spiking activity based causal methods, and is robust to the choice of hyper-parameters.

Diverse inhibitory projections from the cerebellar interposed nucleus

The cerebellum consists of parallel circuit modules that contribute to diverse behaviors, spanning motor to cognitive. Recent work employing cell-type-specific tracing has identified circumscribed output channels of the cerebellar nuclei (CbN) that could confer tight functional specificity. These studies have largely focused on excitatory projections of the CbN, however, leaving open the question of whether inhibitory neurons also constitute multiple output modules. We mapped output and input patterns to intersectionally restricted cell types of the interposed and adjacent interstitial nuclei in mice. In contrast to the widespread assumption of primarily excitatory outputs and restricted inferior olive-targeting inhibitory output, we found that inhibitory neurons from this region ramified widely within the brainstem, targeting both motor- and sensory-related nuclei, distinct from excitatory output targets. Despite differences in output targeting, monosynaptic rabies tracing revealed largely shared afferents to both cell classes. We discuss the potential novel functional roles for inhibitory outputs in the context of cerebellar theory.

Neurons in Primary Motor Cortex Encode External Perturbations during an Orientation Reaching Task

When confronting an abrupt external perturbation force during movement, subjects continuously adjust their behaviors to adapt to changes. Such adaptation is of great importance for realizing flexible motor control in varied environments, but the potential cortical neuronal mechanisms behind it have not yet been elucidated. Aiming to reveal potential neural control system compensation for external disturbances, we applied an external orientation perturbation while monkeys performed an orientation reaching task and simultaneously recorded the neural activity in the primary motor cortex (M1). We found that a subpopulation of neurons in the primary motor cortex specially created a time-locked activity in response to a “go” signal in the adaptation phase of the impending orientation perturbation and did not react to a “go” signal under the normal task condition without perturbation. Such neuronal activity was amplified as the alteration was processed and retained in the extinction phase; then, the activity gradually faded out. The increases in activity during the adaptation to the orientation perturbation may prepare the system for the impending response. Our work provides important evidence for understanding how the motor cortex responds to external perturbations and should advance research about the neurophysiological mechanisms underlying motor learning and adaptation.

A leg to stand on: computational models of proprioception

Dexterous motor control requires feedback from proprioceptors, internal mechanosensory neurons that sense the body's position and movement. An outstanding question in neuroscience is how diverse proprioceptive feedback signals contribute to flexible motor control. Genetic tools now enable targeted recording and perturbation of proprioceptive neurons in behaving animals; however, these experiments can be challenging to interpret, due to the tight coupling of proprioception and motor control. Here, we argue that understanding the role of proprioceptive feedback in controlling behavior will be aided by the development of multiscale models of sensorimotor loops. We review current phenomenological and structural models for proprioceptor encoding and discuss how they may be integrated with existing models of posture, movement, and body state estimation.

A bang-bang control model predicts the triphasic muscles activity during hand reaching

There are numerous ways to reach for an apple hanging from a tree. Yet, our motor system uses a specific muscle activity pattern that features activity bursts and silent periods. We suggest that these bursts are an evidence against the common view that the brain controls the commands to the muscles in a smooth continuous manner. Instead, we propose a model in which a motor plan is transformed into a piecewise-constant control signal that is low-pass filtered and transmitted to the muscles with different muscle-specific delays. We use a Markov chain Monte Carlo (MCMC) method to identify transitions in the state of the muscles following initial activation and show that fitting a bang-bang control model to the kinematics of movement predicts these transitions in the state of the muscles. Such a bang-bang controller suggests that the brain reduces the complexity of the problem of ballistic movements control by sending commands to the muscles at sparse times. Identifying this bang-bang controller can be useful to develop efficient controllers for neuroprostheses and other physical human-robot interaction systems.NEW & NOTEWORTHY While ballistic hand reaching movements are characterized by smooth position and velocity signals, the activity of the muscles exhibits bursts and silent periods. Here, we propose that a model based on bang-bang control provides the link between the abrupt changes in the muscle activity and the smooth reaching trajectory. Using bang-bang control instead of continuous control may simplify the design of prostheses and other physical human-robot interaction systems.

Postural control of arm and fingers through integration of movement commands

Every movement ends in a period of stillness. Current models assume that commands that hold the limb at a target location do not depend on the commands that moved the limb to that location. Here, we report a surprising relationship between movement and posture in primates: on a within-trial basis, the commands that hold the arm and finger at a target location depend on the mathematical integration of the commands that moved the limb to that location. Following damage to the corticospinal tract, both the move and hold period commands become more variable. However, the hold period commands retain their dependence on the integral of the move period commands. Thus, our data suggest that the postural controller possesses a feedforward module that uses move commands to calculate a component of hold commands. This computation may arise within an unknown subcortical system that integrates cortical commands to stabilize limb posture.