Useful properties of spinal circuits for learning and performing planar reaches

A computational study of how an α- to γ-motoneurone collateral can mitigate velocity-dependent stretch reflexes during voluntary movement

The primary motor cortex does not uniquely or directly produce alpha motoneurone (α-MN) drive to muscles during voluntary movement. Rather, α-MN drive emerges from the synthesis and competition among excitatory and inhibitory inputs from multiple descending tracts, spinal interneurons, sensory inputs, and proprioceptive afferents. One such fundamental input is velocity-dependent stretch reflexes in lengthening muscles, which should be inhibited to enable voluntary movement. It remains an open question, however, the extent to which unmodulated stretch reflexes disrupt voluntary movement, and whether and how they are inhibited in limbs with numerous multiarticular muscles. We used a computational model of a Rhesus Macaque arm to simulate movements with feedforward α-MN commands only, and with added velocity-dependent stretch reflex feedback. We found that velocity-dependent stretch reflex caused movement-specific, typically large and variable disruptions to arm movements. These disruptions were greatly reduced when modulating velocity-dependent stretch reflex feedback (i) as per the commonly proposed (but yet to be clarified) idealized alpha-gamma (α-γ) coactivation or (ii) an alternative α-MN collateral projection to homonymous γ-MNs. We conclude that such α-MN collaterals are a physiologically tenable propriospinal circuit in the mammalian fusimotor system. These collaterals could still collaborate with α-γ coactivation, and the few skeletofusimotor fibers (β-MNs) in mammals, to create a flexible fusimotor ecosystem to enable voluntary movement. By locally and automatically regulating the highly nonlinear neuro-musculo-skeletal mechanics of the limb, these collaterals could be a critical low-level enabler of learning, adaptation, and performance via higher-level brainstem, cerebellar, and cortical mechanisms.

An alpha- to gamma-motoneurone collateral can mitigate velocity-dependent stretch reflexes during voluntary movement: A computational study

The primary motor cortex does not uniquely or directly produce alpha motoneurone (α-MN) drive to muscles during voluntary movement. Rather, α-MN drive emerges from the synthesis and competition among excitatory and inhibitory inputs from multiple descending tracts, spinal interneurons, sensory inputs, and proprioceptive afferents. One such fundamental input is velocity-dependent stretch reflexes in lengthening muscles, which should be inhibited to enable voluntary movement. It remains an open question, however, the extent to which unmodulated stretch reflexes disrupt voluntary movement, and whether and how they are inhibited in limbs with numerous multi-articular muscles. We used a computational model of a Rhesus Macaque arm to simulate movements with feedforward α-MN commands only, and with added velocity-dependent stretch reflex feedback. We found that velocity-dependent stretch reflex caused movement-specific, typically large and variable disruptions to arm movements. These disruptions were greatly reduced when modulating velocity-dependent stretch reflex feedback (i) as per the commonly proposed (but yet to be clarified) idealized alpha-gamma (α-γ) co-activation or (ii) an alternative α-MN collateral projection to homonymous γ-MNs. We conclude that such α-MN collaterals are a physiologically tenable, but previously unrecognized, propriospinal circuit in the mammalian fusimotor system. These collaterals could still collaborate with α-γ co-activation, and the few skeletofusimotor fibers (β-MNs) in mammals, to create a flexible fusimotor ecosystem to enable voluntary movement. By locally and automatically regulating the highly nonlinear neuro-musculo-skeletal mechanics of the limb, these collaterals could be a critical low-level enabler of learning, adaptation, and performance via higher-level brainstem, cerebellar and cortical mechanisms.

Inverting a model of neuromuscular control to estimate descending activation patterns that generate fast-reaching movements

Reaching movements generally show smooth kinematic profiles that are invariant across varying movement speeds even as interaction torques and muscle properties vary nonlinearly with speed. How the brain brings about these invariant profiles is an open question. We developed an analytical inverse dynamics method to estimate descending activation patterns directly from observed joint angle trajectories based on a simple model of the stretch reflex, and of muscle and biomechanical dynamics. We estimated descending activation patterns for experimental data from eight different planar two-joint movements performed at two movement times (fast: 400 ms; slow: 800 ms). The temporal structure of descending activation differed qualitatively across speeds, consistent with the idea that the nervous system uses an internal model to generate anticipatory torques during fast movement. This temporal structure also depended on the cocontraction level of antagonistic muscle groups. Comparing estimated muscle activation and descending activation revealed the contribution of the stretch reflex to movement generation that was found to set in after about 20% of movement time.NEW & NOTEWORTHY By estimating descending activation patterns directly from observed movement kinematics based on a model of the dynamics of the stretch reflex, of muscle force generation, and of the biomechanics of the limb, we observed how brain signals must be temporally structured to enable fast movement.

The spinal cord facilitates cerebellar upper limb motor learning and control; inputs from neuromusculoskeletal simulation

Complex interactions between brain regions and the spinal cord (SC) govern body motion, which is ultimately driven by muscle activation. Motor planning or learning are mainly conducted at higher brain regions, whilst the SC acts as a brain-muscle gateway and as a motor control centre providing fast reflexes and muscle activity regulation. Thus, higher brain areas need to cope with the SC as an inherent and evolutionary older part of the body dynamics. Here, we address the question of how SC dynamics affects motor learning within the cerebellum; in particular, does the SC facilitate cerebellar motor learning or constitute a biological constraint? We provide an exploratory framework by integrating biologically plausible cerebellar and SC computational models in a musculoskeletal upper limb control loop. The cerebellar model, equipped with the main form of cerebellar plasticity, provides motor adaptation; whilst the SC model implements stretch reflex and reciprocal inhibition between antagonist muscles. The resulting spino-cerebellar model is tested performing a set of upper limb motor tasks, including external perturbation studies. A cerebellar model, lacking the implemented SC model and directly controlling the simulated muscles, was also tested in the same. The performances of the spino-cerebellar and cerebellar models were then compared, thus allowing directly addressing the SC influence on cerebellar motor adaptation and learning, and on handling external motor perturbations. Performance was assessed in both joint and muscle space, and compared with kinematic and EMG recordings from healthy participants. The differences in cerebellar synaptic adaptation between both models were also studied. We conclude that the SC facilitates cerebellar motor learning; when the SC circuits are in the loop, faster convergence in motor learning is achieved with simpler cerebellar synaptic weight distributions. The SC is also found to improve robustness against external perturbations, by better reproducing and modulating muscle cocontraction patterns.

Developing Intelligent Robots that Grasp Affordance

Humans and robots operating in unstructured environments both need to classify objects through haptic exploration and use them in various tasks, but currently they differ greatly in their strategies for acquiring such capabilities. This review explores nascent technologies that promise more convergence. A novel form of artificial intelligence classifies objects according to sensory percepts during active exploration and decides on efficient sequences of exploratory actions to identify objects. Representing objects according to the collective experience of manipulating them provides a substrate for discovering causality and affordances. Such concepts that generalize beyond explicit training experiences are an important aspect of human intelligence that has eluded robots. For robots to acquire such knowledge, they will need an extended period of active exploration and manipulation similar to that employed by infants. The efficacy, efficiency and safety of such behaviors depends on achieving smooth transitions between movements that change quickly from exploratory to executive to reflexive. Animals achieve such smoothness by using a hierarchical control scheme that is fundamentally different from those of conventional robotics. The lowest level of that hierarchy, the spinal cord, starts to self-organize during spontaneous movements in the fetus. This allows its connectivity to reflect the mechanics of the musculoskeletal plant, a bio-inspired process that could be used to adapt spinal-like middleware for robots. Implementation of these extended and essential stages of fetal and infant development is impractical, however, for mechatronic hardware that does not heal and replace itself like biological tissues. Instead such development can now be accomplished in silico and then cloned into physical robots, a strategy that could transcend human performance.

In-silico neuro musculoskeletal model reproduces the movement types obtained by spinal micro stimulation

BACKGROUND AND OBJECTIVES

Virtual patients and physiologies allow experimentation, design, and early-stage clinical trials in-silico. Virtual patient technology for human movement systems that encompasses musculoskeleton and its neural control are few and far in between. Our major goal is to create a neuro- musculoskeletal upper limb in-silico model, which is modular in architecture and generates movement as an emergent phenomenon out of a multiscale co-simulation of spinal cord neural control and musculoskeletal dynamics.

METHODS

The model is developed on the NEUROiD movement simulation platform that enables a co-simulation of popular neural simulator NEURON and the musculoskeletal simulator OpenSim. We further characterized and demonstrated the use of this model in generating a range of commonly observed upper limb movements by means of a spatio-temporal stimulation pattern delivered to the cervical spinal cord.

RESULTS

We were able to characterize the model based on proprioception (Ia, Ib and II fibers), afferent conduction delay and inital postures of the musculoskeletal system. A smooth movement was achieved in all the considered experiments. The generated movements in all degrees of freedom were reproduced in accordance with the previous experimental studies.

CONCLUSION

In this work, design and development of the upper limb model was described in a modular fashion, while reusing existing models and modules. We believe this work enables a first and small step towards an in-silico paradigms for understanding upper limb movement, disease pathology, medication, and rehabilitation.

A model for self-organization of sensorimotor function: the spinal monosynaptic loop

Recent spinal cord literature abounds with descriptions of genetic preprogramming and the molecular control of circuit formation. In this paper, we explore to what extent circuit formation based on learning rather than preprogramming could explain the selective formation of the monosynaptic projections between muscle spindle primary afferents and homonymous motoneurons. We adjusted the initially randomized gains in the neural network according to a Hebbian plasticity rule while exercising the model system with spontaneous muscle activity patterns similar to those observed during early fetal development. Normal connectivity patterns developed only when we modeled β motoneurons, which are known to innervate both intrafusal and extrafusal muscle fibers in vertebrate muscles but were not considered in previous literature regarding selective formation of these synapses in animals with paralyzed muscles. It was also helpful to correctly model the greatly reduced contractility of extrafusal muscle fibers during early development. Stronger and more coordinated muscle activity patterns such as observed later during neonatal locomotion impaired projection selectivity. These findings imply a generic functionality of a musculoskeletal system to imprint important aspects of its mechanical dynamics onto a neural network, without specific preprogramming other than setting a critical period for the formation and maturation of this general pattern of connectivity. Such functionality would facilitate the successful evolution of new species with altered musculoskeletal anatomy, and it may help to explain patterns of connectivity and associated reflexes that appear during abnormal development.NEW & NOTEWORTHY A novel model of self-organization of early spinal circuitry based on a biologically realistic plant, sensors, and neuronal plasticity in conjunction with empirical observations of fetal development. Without explicit need for guiding genetic rules, connection matrices emerge that support functional self-organization of the mature pattern of Ia to motoneuron connectivity in the spinal circuitry.

A neuromuscular model of human locomotion combines spinal reflex circuits with voluntary movements

Existing models of human walking use low-level reflexes or neural oscillators to generate movement. While appropriate to generate the stable, rhythmic movement patterns of steady-state walking, these models lack the ability to change their movement patterns or spontaneously generate new movements in the specific, goal-directed way characteristic of voluntary movements. Here we present a neuromuscular model of human locomotion that bridges this gap and combines the ability to execute goal directed movements with the generation of stable, rhythmic movement patterns that are required for robust locomotion. The model represents goals for voluntary movements of the swing leg on the task level of swing leg joint kinematics. Smooth movements plans towards the goal configuration are generated on the task level and transformed into descending motor commands that execute the planned movements, using internal models. The movement goals and plans are updated in real time based on sensory feedback and task constraints. On the spinal level, the descending commands during the swing phase are integrated with a generic stretch reflex for each muscle. Stance leg control solely relies on dedicated spinal reflex pathways. Spinal reflexes stimulate Hill-type muscles that actuate a biomechanical model with eight internal joints and six free-body degrees of freedom. The model is able to generate voluntary, goal-directed reaching movements with the swing leg and combine multiple movements in a rhythmic sequence. During walking, the swing leg is moved in a goal-directed manner to a target that is updated in real-time based on sensory feedback to maintain upright balance, while the stance leg is stabilized by low-level reflexes and a behavioral organization switching between swing and stance control for each leg. With this combination of reflex-based stance leg and voluntary, goal-directed control of the swing leg, the model controller generates rhythmic, stable walking patterns in which the swing leg movement can be flexibly updated in real-time to step over or around obstacles.

A Model for Self-Organization of Sensorimotor Function: Spinal Interneuronal Integration

Control of musculoskeletal systems depends on integration of voluntary commands and somatosensory feedback in the complex neural circuits of the spinal cord. Particular connectivity patterns have been identified experimentally, and it has been suggested that these may result from the wide variety of transcriptional types that have been observed in spinal interneurons. We ask instead whether the details of these connectivity patterns (and perhaps many others) can arise as a consequence of Hebbian adaptation during early development. We constructed an anatomically simplified model plant system with realistic muscles and sensors and connected it to a recurrent, random neuronal network consisting of both excitatory and inhibitory neurons endowed with Hebbian learning rules. We then generated a wide set of randomized muscle twitches typical of those described during fetal development and allowed the network to learn. Multiple simulations consistently resulted in diverse and stable patterns of activity and connectivity that included subsets of the interneurons that were similar to 'archetypical' interneurons described in the literature. We also found that such learning led to an increased degree of cooperativity between interneurons when performing larger limb movements on which it had not been trained. Hebbian learning gives rise to rich sets of diverse interneurons whose connectivity reflects the mechanical properties of the plant. At least some of the transcriptomic diversity may reflect the effects of this process rather than the cause of the connectivity. Such a learning process seems better suited to respond to the musculoskeletal mutations that underlie the evolution of new species.

Costs of position, velocity, and force requirements in optimal control induce triphasic muscle activation during reaching movement

The nervous system activates a pair of agonist and antagonist muscles to determine the muscle activation pattern for a desired movement. Although there is a problem with redundancy, it is solved immediately, and movements are generated with characteristic muscle activation patterns in which antagonistic muscle pairs show alternate bursts with a triphasic shape. To investigate the requirements for deriving this pattern, this study simulated arm movement numerically by adopting a musculoskeletal arm model and an optimal control. The simulation reproduced the triphasic electromyogram (EMG) pattern observed in a reaching movement using a cost function that considered three terms: end-point position, velocity, and force required; the function minimised neural input. The first, second, and third bursts of muscle activity were generated by the cost terms of position, velocity, and force, respectively. Thus, we concluded that the costs of position, velocity, and force requirements in optimal control can induce triphasic EMG patterns. Therefore, we suggest that the nervous system may control the body by using an optimal control mechanism that adopts the costs of position, velocity, and force required; these costs serve to initiate, decelerate, and stabilise movement, respectively.

A Conceptual Blueprint for Making Neuromusculoskeletal Models Clinically Useful

The ultimate goal of most neuromusculoskeletal modeling research is to improve the treatment of movement impairments. However, even though neuromusculoskeletal models have become more realistic anatomically, physiologically, and neurologically over the past 25 years, they have yet to make a positive impact on the design of clinical treatments for movement impairments. Such impairments are caused by common conditions such as stroke, osteoarthritis, Parkinson’s disease, spinal cord injury, cerebral palsy, limb amputation, and even cancer. The lack of clinical impact is somewhat surprising given that comparable computational technology has transformed the design of airplanes, automobiles, and other commercial products over the same time period. This paper provides the author’s personal perspective for how neuromusculoskeletal models can become clinically useful. First, the paper motivates the potential value of neuromusculoskeletal models for clinical treatment design. Next, it highlights five challenges to achieving clinical utility and provides suggestions for how to overcome them. After that, it describes clinical, technical, collaboration, and practical needs that must be addressed for neuromusculoskeletal models to fulfill their clinical potential, along with recommendations for meeting them. Finally, it discusses how more complex modeling and experimental methods could enhance neuromusculoskeletal model fidelity, personalization, and utilization. The author hopes that these ideas will provide a conceptual blueprint that will help the neuromusculoskeletal modeling research community work toward clinical utility.

Learning to use Muscles

The human musculoskeletal system is highly complex mechanically. Its neural control must deal successfully with this complexity to perform the diverse, efficient, robust and usually graceful behaviors of which humans are capable. Most of those behaviors might be performed by many different subsets of its myriad possible states, so how does the nervous system decide which subset to use? One solution that has received much attention over the past 50 years would be for the nervous system to be fundamentally limited in the patterns of muscle activation that it can access, a concept known as muscle synergies or movement primitives. Another solution, based on engineering control methodology, is for the nervous system to compute the single optimal pattern of muscle activation for each task according to a cost function. This review points out why neither appears to be the solution used by humans. There is a third solution that is based on trial-and-error learning, recall and interpolation of sensorimotor programs that are good-enough rather than limited or optimal. The solution set acquired by an individual during the protracted development of motor skills starting in infancy forms the basis of motor habits, which are inherently low-dimensional. Such habits give rise to muscle usage patterns that are consistent with synergies but do not reflect fundamental limitations of the nervous system and can be shaped by training or disability. This habit-based strategy provides a robust substrate for the control of new musculoskeletal structures during evolution as well as for efficient learning, athletic training and rehabilitation therapy.

Condition-Dependent Neural Dimensions Progressively Shift during Reach to Grasp

Neural population space analysis was performed to assess the dimensionality and dynamics of the neural population in the primary motor cortex (M1) during a reach-grasp-manipulation task in which both the reach location and the object being grasped were varied. We partitioned neural activity into three components: (1) general task-related activity independent of location and object, (2) location- and/or object-related activity, and (3) noise. Neural modulation related to location and/or object was only one-third the size of either general task modulation or noise. The neural dimensions of location and/or object-related activity overlapped with both the general task and noise dimensions. Rather than large amplitude modulation in a fixed set of dimensions, the active dimensions of location and/or object modulation shifted progressively over the time course of a trial.

Rouse and Schieber show that during reach-grasp-manipulate movements, M1 activity related to location and object occurs not in a fixed set but rather in a shifting set of neural dimensions that overlap with those of general task and noise activity.

Model and experiments to optimize co-adaptation in a simplified myoelectric control system

OBJECTIVE

To compensate for a limb lost in an amputation, myoelectric prostheses use surface electromyography (EMG) from the remaining muscles to control the prosthesis. Despite considerable progress, myoelectric controls remain markedly different from the way we normally control movements, and require intense user adaptation. To overcome this, our goal is to explore concurrent machine co-adaptation techniques that are developed in the field of brain-machine interface, and that are beginning to be used in myoelectric controls.

APPROACH

We combined a simplified myoelectric control with a perturbation for which human adaptation is well characterized and modeled, in order to explore co-adaptation settings in a principled manner.

RESULTS

First, we reproduced results obtained in a classical visuomotor rotation paradigm in our simplified myoelectric context, where we rotate the muscle pulling vectors used to reconstruct wrist force from EMG. Then, a model of human adaptation in response to directional error was used to simulate various co-adaptation settings, where perturbations and machine co-adaptation are both applied on muscle pulling vectors. These simulations established that a relatively low gain of machine co-adaptation that minimizes final errors generates slow and incomplete adaptation, while higher gains increase adaptation rate but also errors by amplifying noise. After experimental verification on real subjects, we tested a variable gain that cumulates the advantages of both, and implemented it with directionally tuned neurons similar to those used to model human adaptation. This enables machine co-adaptation to locally improve myoelectric control, and to absorb more challenging perturbations.

SIGNIFICANCE

The simplified context used here enabled to explore co-adaptation settings in both simulations and experiments, and to raise important considerations such as the need for a variable gain encoded locally. The benefits and limits of extending this approach to more complex and functional myoelectric contexts are discussed.

Cardinal features of involuntary force variability can arise from the closed-loop control of viscoelastic afferented muscles

Involuntary force variability below 15 Hz arises from, and is influenced by, many factors including descending neural drive, proprioceptive feedback, and mechanical properties of muscles and tendons. However, their potential interactions that give rise to the well-structured spectrum of involuntary force variability are not well understood due to a lack of experimental techniques. Here, we investigated the generation, modulation, and interactions among different sources of force variability using a physiologically-grounded closed-loop simulation of an afferented muscle model. The closed-loop simulation included a musculotendon model, muscle spindle, Golgi tendon organ (GTO), and a tracking controller which enabled target-guided force tracking. We demonstrate that closed-loop control of an afferented musculotendon suffices to replicate and explain surprisingly many cardinal features of involuntary force variability. Specifically, we present 1) a potential origin of low-frequency force variability associated with co-modulation of motor unit firing rates (i.e.,'common drive'), 2) an in-depth characterization of how proprioceptive feedback pathways suffice to generate 5-12 Hz physiological tremor, and 3) evidence that modulation of those feedback pathways (i.e., presynaptic inhibition of Ia and Ib afferents, and spindle sensitivity via fusimotor drive) influence the full spectrum of force variability. These results highlight the previously underestimated importance of closed-loop neuromechanical interactions in explaining involuntary force variability during voluntary 'isometric' force control. Furthermore, these results provide the basis for a unifying theory that relates spinal circuitry to various manifestations of altered involuntary force variability in fatigue, aging and neurological disease.

Physiological tremor increases when skeletal muscle is shortened: implications for fusimotor control

KEY POINTS

In tonic, isometric, plantarflexion contractions, physiological tremor increases as the ankle joint becomes plantarflexed. Modulation of physiological tremor as a function of muscle stretch differs from that of the stretch reflex amplitude. Amplitude of physiological tremor may be altered as a function of reflex pathway gains. Healthy humans likely increase their γ-static fusimotor drive when muscles shorten. Quantification of physiological tremor by manipulation of joint angle may be a useful experimental probe of afferent gains and/or the integrity of automatic fusimotor control.

ABSTRACT

The involuntary force fluctuations associated with physiological (as distinct from pathological) tremor are an unavoidable component of human motor control. While the origins of physiological tremor are known to depend on muscle afferentation, it is possible that the mechanical properties of muscle-tendon systems also affect its generation, amplification and maintenance. In this paper, we investigated the dependence of physiological tremor on muscle length in healthy individuals. We measured physiological tremor during tonic, isometric plantarflexion torque at 30% of maximum at three ankle angles. The amplitude of physiological tremor increased as calf muscles shortened in contrast to the stretch reflex whose amplitude decreases as muscle shortens. We used a published closed-loop simulation model of afferented muscle to explore the mechanisms responsible for this behaviour. We demonstrate that changing muscle lengths does not suffice to explain our experimental findings. Rather, the model consistently required the modulation of  γ-static fusimotor drive to produce increases in physiological tremor with muscle shortening - while successfully replicating the concomitant reduction in stretch reflex amplitude. This need to control γ-static fusimotor drive explicitly as a function of muscle length has important implications. First, it permits the amplitudes of physiological tremor and stretch reflex to be decoupled. Second, it postulates neuromechanical interactions that require length-dependent γ drive modulation to be independent from α drive to the parent muscle. Lastly, it suggests that physiological tremor can be used as a simple, non-invasive measure of the afferent mechanisms underlying healthy motor function, and their disruption in neurological conditions.

Sex differences in leg dexterity are not present in elite athletes

We studied whether the time-varying forces that control unstable foot-ground interactions provide insight into the neural control of dynamic leg function. Twenty elite (10F, 26.4±3.5yrs) and 20 recreational (10F, 24.8±2.4yrs) athletes used an isolated leg to maximally compress a slender spring designed to buckle at low forces while seated. The foot forces during the compression at the edge of instability quantify the maximal sensorimotor ability to control dynamic foot-ground interactions. Using the nonlinear analysis technique of attractor reconstruction, we characterized the spatial (interquartile range IQR) and geometric (trajectory length TL, volume V, and sum of edge lengths SE) features of the dynamical behavior of those force time series. ANOVA confirmed the already published effect of sex, and a new effect of athletic ability, respectively, in TL (p=0.014 and p<0.001), IQR (p=0.008 and p<0.001), V (p=0.034 and p=0.002), and SE (p=0.033 and p<0.001). Further analysis revealed that, for recreational athletes, females exhibited weaker corrective actions and greater stochasticity than males as per their greater mean values of TL (p=0.003), IQR (p=0.018), V (p=0.017), and SE (p=0.025). Importantly, sex differences disappeared in elite athletes. These results provide an empirical link between sex, athletic ability, and nonlinear dynamical control. This is a first step in understanding the sensorimotor mechanisms for control of unstable foot-ground interactions. Given that females suffer a greater incidence of non-contact knee ligament injuries, these non-invasive and practical metrics of leg dexterity may be both indicators of athletic ability, and predictors of risk of injury.

Muscle and Limb Mechanics

Understanding of the musculoskeletal system has evolved from the collection of individual phenomena in highly selected experimental preparations under highly controlled and often unphysiological conditions. At the systems level, it is now possible to construct complete and reasonably accurate models of the kinetics and energetics of realistic muscles and to combine them to understand the dynamics of complete musculoskeletal systems performing natural behaviors. At the reductionist level, it is possible to relate most of the individual phenomena to the anatomical structures and biochemical processes that account for them. Two large challenges remain. At a systems level, neuroscience must now account for how the nervous system learns to exploit the many complex features that evolution has incorporated into muscle and limb mechanics. At a reductionist level, medicine must now account for the many forms of pathology and disability that arise from the many diseases and injuries to which this highly evolved system is inevitably prone. © 2017 American Physiological Society. Compr Physiol 7:429-462, 2017.

Suboptimal Muscle Synergy Activation Patterns Generalize their Motor Function across Postures

We used a musculoskeletal model to investigate the possible biomechanical and neural bases of using consistent muscle synergy patterns to produce functional motor outputs across different biomechanical conditions, which we define as generalizability. Experimental studies in cats demonstrate that the same muscle synergies are used during reactive postural responses at widely varying configurations, producing similarly-oriented endpoint force vectors with respect to the limb axis. However, whether generalizability across postures arises due to similar biomechanical properties or to neural selection of a particular muscle activation pattern has not been explicitly tested. Here, we used a detailed cat hindlimb model to explore the set of feasible muscle activation patterns that produce experimental synergy force vectors at a target posture, and tested their generalizability by applying them to different test postures. We used three methods to select candidate muscle activation patterns: (1) randomly-selected feasible muscle activation patterns, (2) optimal muscle activation patterns minimizing muscle effort at a given posture, and (3) generalizable muscle activation patterns that explicitly minimized deviations from experimentally-identified synergy force vectors across all postures. Generalizability was measured by the deviation between the simulated force direction of the candidate muscle activation pattern and the experimental synergy force vectors at the test postures. Force angle deviations were the greatest for the randomly selected feasible muscle activation patterns (e.g., >100°), intermediate for effort-wise optimal muscle activation patterns (e.g., ~20°), and smallest for generalizable muscle activation patterns (e.g., <5°). Generalizable muscle activation patterns were suboptimal in terms of effort, often exceeding 50% of the maximum possible effort (cf. ~5% in minimum-effort muscle activation patterns). The feasible muscle activation ranges of individual muscles associated with producing a specific synergy force vector was reduced by ~45% when generalizability requirements were imposed. Muscles recruited in the generalizable muscle activation patterns had less sensitive torque-producing characteristics to changes in postures. We conclude that generalization of function across postures does not arise from limb biomechanics or a single optimality criterion. Muscle synergies may reflect acquired motor solutions globally tuned for generalizability across biomechanical contexts, facilitating rapid motor adaptation.

Enhanced crosslimb transfer of force-field learning for dynamics that are identical in extrinsic and joint-based coordinates for both limbs

Humans are able to adapt their motor commands to make accurate movements in novel sensorimotor environments, such as when wielding tools that alter limb dynamics. However, it is unclear to what extent sensorimotor representations, obtained through experience with one limb, are available to the opposite, untrained limb and in which form they are available. Here, we compared crosslimb transfer of force-field compensation after participants adapted to a velocity-dependent curl field, oriented either in the sagittal or the transverse plane. Due to the mirror symmetry of the limbs, the force field had identical effects for both limbs in joint and extrinsic coordinates in the sagittal plane but conflicting joint-based effects in the transverse plane. The degree of force-field compensation exhibited by the opposite arm in probe trials immediately after initial learning was significantly greater after sagittal (26 ± 5%) than transverse plane adaptation (9 ± 4%; P < 0.001), irrespective of whether participants learned initially with the left or the right arm or via abrupt or gradual exposure to the force field. Thus transfer was impaired when the orientation of imposed dynamics conflicted in intrinsic coordinates for the two limbs. The data reveal that neural representations of novel dynamics are only partially available to the opposite limb, since transfer is incomplete even when force-field perturbation is spatially compatible for the two limbs, according to both intrinsic and extrinsic coordinates.

Advancing brain-machine interfaces: moving beyond linear state space models

Advances in recent years have dramatically improved output control by Brain-Machine Interfaces (BMIs). Such devices nevertheless remain robotic and limited in their movements compared to normal human motor performance. Most current BMIs rely on transforming recorded neural activity to a linear state space composed of a set number of fixed degrees of freedom. Here we consider a variety of ways in which BMI design might be advanced further by applying non-linear dynamics observed in normal motor behavior. We consider (i) the dynamic range and precision of natural movements, (ii) differences between cortical activity and actual body movement, (iii) kinematic and muscular synergies, and (iv) the implications of large neuronal populations. We advance the hypothesis that a given population of recorded neurons may transmit more useful information than can be captured by a single, linear model across all movement phases and contexts. We argue that incorporating these various non-linear characteristics will be an important next step in advancing BMIs to more closely match natural motor performance.

Neuromechanical principles underlying movement modularity and their implications for rehabilitation

Neuromechanical principles define the properties and problems that shape neural solutions for movement. Although the theoretical and experimental evidence is debated, we present arguments for consistent structures in motor patterns, i.e., motor modules, that are neuromechanical solutions for movement particular to an individual and shaped by evolutionary, developmental, and learning processes. As a consequence, motor modules may be useful in assessing sensorimotor deficits specific to an individual and define targets for the rational development of novel rehabilitation therapies that enhance neural plasticity and sculpt motor recovery. We propose that motor module organization is disrupted and may be improved by therapy in spinal cord injury, stroke, and Parkinson's disease. Recent studies provide insights into the yet-unknown underlying neural mechanisms of motor modules, motor impairment, and motor learning and may lead to better understanding of the causal nature of modularity and its underlying neural substrates.

Major remaining gaps in models of sensorimotor systems

Experimental descriptions of the anatomy and physiology of individual components of sensorimotor systems have revealed substantial complexity, making it difficult to intuit how complete systems might work. This has led to increasing efforts to develop and employ mathematical models to study the emergent properties of such systems. Conversely, the development of such models tends to reveal shortcomings in the experimental database upon which models must be constructed and validated. In both cases models are most useful when they point up discrepancies between what we think we know and possibilities that we may have overlooked. This overview considers those components of complete sensorimotor systems that currently appear to be potentially important but poorly understood. These are generally omitted completely from modeled systems or buried in implicit assumptions that underlie the design of the model.

An adaptive spinal-like controller: tunable biomimetic behavior for a robotic limb

Background

Spinal-like regulators have recently been shown to support complex behavioral patterns during volitional goal-oriented reaching paradigms. We use an interpretation of the adaptive spinal-like controller as inspiration for the development of a controller for a robotic limb. It will be demonstrated that a simulated robot arm with linear actuators can achieve biological-like limb movements. In addition, it will be shown that programmability in the regulator enables independent spatial and temporal changes to be defined for movement tasks, downstream of central commands using sensory stimuli. The adaptive spinal-like controller is the first to demonstrate such behavior for complex motor behaviors in multi-joint limb movements.

Methods

The controller is evaluated using a simulated robotic apparatus and three goal-oriented reaching paradigms: 1) shaping of trajectory profiles during reaching; 2) sensitivity of trajectories to sudden perturbations; 3) reaching to a moving target. The experiments were designed to highlight complex motor tasks that are omitted in earlier studies, and important for the development of improved artificial limb control.

Results

In all three cases the controller was able to reach the targets without a priori planning of end-point or segmental motor trajectories. Instead, trajectory spatio-temporal dynamics evolve from properties of the controller architecture using the spatial error (vector distance to goal). Results show that curvature amplitude in hand trajectory paths are reduced by as much as 98% using simple gain scaling techniques, while adaptive network behavior allows the regulator to successfully adapt to perturbations and track a moving target. An important observation for this study is that all motions resemble human-like movements with non-linear muscles and complex joint mechanics.

Conclusions

The controller shows that it can adapt to various behavioral contexts which are not included in previous biomimetic studies. The research supplements an earlier study by examining the tunability of the spinal-like controller for complex reaching tasks. This work is a step toward building more robust controllers for powered artificial limbs.

Bayesian action&perception: representing the world in the brain

Theories of perception seek to explain how sensory data are processed to identify previously experienced objects, but they usually do not consider the decisions and effort that goes into acquiring the sensory data. Identification of objects according to their tactile properties requires active exploratory movements. The sensory data thereby obtained depend on the details of those movements, which human subjects change rapidly and seemingly capriciously. Bayesian Exploration is an algorithm that uses prior experience to decide which next exploratory movement should provide the most useful data to disambiguate the most likely possibilities. In previous studies, a simple robot equipped with a biomimetic tactile sensor and operated according to Bayesian Exploration performed in a manner similar to and actually better than humans on a texture identification task. Expanding on this, "Bayesian Action&Perception" refers to the construction and querying of an associative memory of previously experienced entities containing both sensory data and the motor programs that elicited them. We hypothesize that this memory can be queried (i) to identify useful next exploratory movements during identification of an unknown entity ("action for perception") or (ii) to characterize whether an unknown entity is fit for purpose ("perception for action") or (iii) to recall what actions might be feasible for a known entity (Gibsonian affordance). The biomimetic design of this mechatronic system may provide insights into the neuronal basis of biological action and perception.