Primary Motor Cortex Neurons during Individuated Finger and Wrist Movements: Correlation of Spike Firing Rates with the Motion of Individual Digits versus Their Principal Components

Terminal organization of the corticospinal projection from the arm/hand region of the rostral primary motor cortex (M1r or old M1) to the cervical enlargement (C5-T1) in rhesus monkey

High-resolution anterograde tracers and stereology were used to study the terminal organization of the corticospinal projection (CSP) from the rostral portion of the primary motor cortex (M1r) to spinal levels C5-T1. Most of this projection (90%) terminated contralaterally within laminae V-IX, with the densest distribution in lamina VII. Moderate bouton numbers occurred in laminae VI, VIII, and IX with few in lamina V. Within lamina VII, labeling occurred over the distal-related dorsolateral subsectors and proximal-related ventromedial subsectors. Within motoneuron lamina IX, most terminations occurred in the proximal-related dorsomedial quadrant, followed by the distal-related dorsolateral quadrant. Segmentally, the contralateral lamina VII CSP gradually declined from C5-T1 but was consistently distributed at C5-C7 in lamina IX. The ipsilateral CSP ended in axial-related lamina VIII and adjacent ventromedial region of lamina VII. These findings demonstrate the M1r CSP influences distal and proximal/axial-related spinal targets. Thus, the M1r CSP represents a transitional CSP, positioned between the caudal M1 (M1c) CSP, which is 98% contralateral and optimally organized to mediate distal upper extremity movements (Morecraft et al., 2013), and dorsolateral premotor (LPMCd) CSP being 79% contralateral and optimally organized to mediate proximal/axial movements (Morecraft et al., 2019). This distal to proximal CSP gradient corresponds to the clinical deficits accompanying caudal to rostral motor cortex injury. The lamina IX CSP is considered in the light of anatomical and neurophysiological evidence which suggests M1c gives rise to the major proportion of the cortico-motoneuronal (CM) projection, while there is a limited M1r CM projection.

Compartmentalized dynamics within a common multi-area mesoscale manifold represent a repertoire of human hand movements

The human hand is unique in the animal kingdom for unparalleled dexterity, ranging from complex prehension to fine finger individuation. How does the brain represent such a diverse repertoire of movements? We evaluated mesoscale neural dynamics across the human "grasp network," using electrocorticography and dimensionality reduction methods, for a repertoire of hand movements. Strikingly, we found that the grasp network represented both finger and grasping movements alike. Specifically, the manifold characterizing the multi-areal neural covariance structure was preserved during all movements across this distributed network. In contrast, latent neural dynamics within this manifold were surprisingly specific to movement type. Aligning latent activity to kinematics further uncovered distinct submanifolds despite similarities in synergistic coupling of joints between movements. We thus find that despite preserved neural covariance at the distributed network level, mesoscale dynamics are compartmentalized into movement-specific submanifolds; this mesoscale organization may allow flexible switching between a repertoire of hand movements.

Real-time linear prediction of simultaneous and independent movements of two finger groups using an intracortical brain-machine interface

Modern brain-machine interfaces can return function to people with paralysis, but current upper extremity brain-machine interfaces are unable to reproduce control of individuated finger movements. Here, for the first time, we present a real-time, high-speed, linear brain-machine interface in nonhuman primates that utilizes intracortical neural signals to bridge this gap. We created a non-prehensile task that systematically individuates two finger groups, the index finger and the middle-ring-small fingers combined. During online brain control, the ReFIT Kalman filter could predict individuated finger group movements with high performance. Next, training ridge regression decoders with individual movements was sufficient to predict untrained combined movements and vice versa. Finally, we compared the postural and movement tuning of finger-related cortical activity to find that individual cortical units simultaneously encode multiple behavioral dimensions. Our results suggest that linear decoders may be sufficient for brain-machine interfaces to execute high-dimensional tasks with the performance levels required for naturalistic neural prostheses.

Noise-assisted Multivariate Empirical Mode Decomposition based Causal Decomposition for brain-physiological network in bivariate and multiscale time series

Objective.Noise-assisted Multivariate Empirical Mode Decomposition (NA-MEMD) based Causal Decomposition depicts a cause and effect relationship that is not based on the term of prediction, but rather on the phase dependence of time series. Here, we present the NA-MEMD based Causal Decomposition approach according to the covariation and power views traced to Hume and Kant: a priori cause-effect interaction is first acquired, and the presence of a candidate cause and of the effect is then computed from the sensory input somehow.Approach.Based on the definition of NA-MEMD based Causal Decomposition, we show such causal relation is a phase relation where the candidate causes are not merely followed by effects, but rather produce effects.Main results.The predominant methods used in neuroscience (Granger causality, EMD-based Causal Decomposition) are validated, showing the applicability of NA-MEMD based Causal Decomposition, particular to brain physiological processes in bivariate and multiscale time series.Significance.We point to the potential use in the causality inference analysis in a complex dynamic process.

Postural Representations of the Hand in the Primate Sensorimotor Cortex

Manual dexterity requires proprioceptive feedback about the state of the hand. To date, study of the neural basis of proprioception in the cortex has focused primarily on reaching movements to the exclusion of hand-specific behaviors such as grasping. To fill this gap, we record both time-varying hand kinematics and neural activity evoked in somatosensory and motor cortices as monkeys grasp a variety of objects. We find that neurons in the somatosensory cortex, as well as in the motor cortex, preferentially track time-varying postures of multi-joint combinations spanning the entire hand. This contrasts with neural responses during reaching movements, which preferentially track time-varying movement kinematics of the arm, such as velocity and speed of the limb, rather than its time-varying postural configuration. These results suggest different representations of arm and hand movements suited to the different functional roles of these two effectors.

Putting the "Sensory" Into Sensorimotor Control: The Role of Sensorimotor Integration in Goal-Directed Hand Movements After Stroke

Integration of sensory and motor information is one-step, among others, that underlies the successful production of goal-directed hand movements necessary for interacting with our environment. Disruption of sensorimotor integration is prevalent in many neurologic disorders, including stroke. In most stroke survivors, persistent paresis of the hand reduces function and overall quality of life. Current rehabilitative methods are based on neuroplastic principles to promote motor learning that focuses on regaining motor function lost due to paresis, but the sensory contributions to motor control and learning are often overlooked and currently understudied. There is a need to evaluate and understand the contribution of both sensory and motor function in the rehabilitation of skilled hand movements after stroke. Here, we will highlight the importance of integration of sensory and motor information to produce skilled hand movements in healthy individuals and individuals after stroke. We will then discuss how compromised sensorimotor integration influences relearning of skilled hand movements after stroke. Finally, we will propose an approach to target sensorimotor integration through manipulation of sensory input and motor output that may have therapeutic implications.

Single-Finger Neural Basis Information-Based Neural Decoder for Multi-Finger Movements

In this paper, we investigate the relationship between single and multi-finger movements. By exploiting the neural correlation between the temporal firing patterns between movements, we show that the Pearson's correlation coefficient for the physically related movement pairs are greater than those of others; the firing rates of the neurons that are tuned to a single-finger movements also increases when the corresponding multi-finger movements are instructed. We also use a hierarchical cluster analysis to verify not only the relationship between the single and multi-finger movements, but also the relationship between the flexion and extension movements. Furthermore, we propose a novel decoding method of modeling neural firing patterns while omitting the training process of the multi-finger movements. For the decoding, the Skellam and Gaussian probability distributions are used as mathematical models. The probabilistic distribution model of the multi-finger movements was estimated using the neural activity that was acquired during single-finger movements. As a result, the proposed neural decoding accuracy comparable with that of the supervised neural decoding accuracy when all of the neurons were used for the multi-finger movements. These results suggest that only the neural activities of single-finger movements can be exploited for the control of dexterous multi-finger neuroprosthetics.

Muscle Synergies Obtained from Comprehensive Mapping of the Cortical Forelimb Representation Using Stimulus Triggered Averaging of EMG Activity

Neuromuscular control of voluntary movement may be simplified using muscle synergies similar to those found using non-negative matrix factorization. We recently identified synergies in electromyography (EMG) recordings associated with both voluntary movement and movement evoked by high-frequency long-duration intracortical microstimulation applied to the forelimb representation of the primary motor cortex (M1). The goal of this study was to use stimulus-triggered averaging (StTA) of EMG activity to investigate the synergy profiles and weighting coefficients associated with poststimulus facilitation, as synergies may be hard-wired into elemental cortical output modules and revealed by StTA. We applied StTA at low (LOW, ∼15 μA) and high intensities (HIGH, ∼110 μA) to 247 cortical locations of the M1 forelimb region in two male rhesus macaques while recording the EMG of 24 forelimb muscles. Our results show that 10-11 synergies accounted for 90% of the variation in poststimulus EMG facilitation peaks from the LOW-intensity StTA dataset while only 4-5 synergies were needed for the HIGH-intensity dataset. Synergies were similar across monkeys and current intensities. Most synergy profiles strongly activated only one or two muscles; all joints were represented and most, but not all, joint directions of motion were represented. Cortical maps of the synergy weighting coefficients suggest only a weak organization. StTA of M1 resulted in highly diverse muscle activations, suggestive of the limiting condition of requiring a synergy for each muscle to account for the patterns observed.SIGNIFICANCE STATEMENT Coordination of muscle activity and the neural origin of potential muscle synergies remains a fundamental question of neuroscience. We previously demonstrated that high-frequency long-duration intracortical microstimulation-evoked synergies were unrelated to voluntary movement synergies and were not clearly organized in the cortex. Here we present stimulus-triggered averaging facilitation-related muscle synergies, suggesting that when fundamental cortical output modules are activated, synergies approach the limit of single-muscle control. Thus, we conclude that if the CNS controls movement via linear synergies, those synergies are unlikely to be called from M1. This information is critical for understanding neural control of movement and the development of brain-machine interfaces.

Different contributions of primary motor cortex, reticular formation, and spinal cord to fractionated muscle activation

Coordinated movement requires patterned activation of muscles. In this study, we examined differences in selective activation of primate upper limb muscles by cortical and subcortical regions. Five macaque monkeys were trained to perform a reach and grasp task, and electromyogram (EMG) was recorded from 10 to 24 muscles while weak single-pulse stimuli were delivered through microelectrodes inserted in the motor cortex (M1), reticular formation (RF), or cervical spinal cord (SC). Stimulus intensity was adjusted to a level just above threshold. Stimulus-evoked effects were assessed from averages of rectified EMG. M1, RF, and SC activated 1.5 ± 0.9, 1.9 ± 0.8, and 2.5 ± 1.6 muscles per site (means ± SD); only M1 and SC differed significantly. In between recording sessions, natural muscle activity in the home cage was recorded using a miniature data logger. A novel analysis assessed how well natural activity could be reconstructed by stimulus-evoked responses. This provided two measures: normalized vector length L, reflecting how closely aligned natural and stimulus-evoked activity were, and normalized residual R, measuring the fraction of natural activity not reachable using stimulus-evoked patterns. Average values for M1, RF, and SC were L = 119.1 ± 9.6, 105.9 ± 6.2, and 109.3 ± 8.4% and R = 50.3 ± 4.9, 56.4 ± 3.5, and 51.5 ± 4.8%, respectively. RF was significantly different from M1 and SC on both measurements. RF is thus able to generate an approximation to the motor output with less activation than required by M1 and SC, but M1 and SC are more precise in reaching the exact activation pattern required. Cortical, brainstem, and spinal centers likely play distinct roles, as they cooperate to generate voluntary movements. NEW & NOTEWORTHY Brainstem reticular formation, primary motor cortex, and cervical spinal cord intermediate zone can all activate primate upper limb muscles. However, brainstem output is more efficient but less precise in producing natural patterns of motor output than motor cortex or spinal cord. We suggest that gross muscle synergies from the reticular formation are sculpted and refined by motor cortex and spinal circuits to reach the finely fractionated output characteristic of dexterous primate upper limb movements.

A synergy-based hand control is encoded in human motor cortical areas

How the human brain controls hand movements to carry out different tasks is still debated. The concept of synergy has been proposed to indicate functional modules that may simplify the control of hand postures by simultaneously recruiting sets of muscles and joints. However, whether and to what extent synergic hand postures are encoded as such at a cortical level remains unknown. Here, we combined kinematic, electromyography, and brain activity measures obtained by functional magnetic resonance imaging while subjects performed a variety of movements towards virtual objects. Hand postural information, encoded through kinematic synergies, were represented in cortical areas devoted to hand motor control and successfully discriminated individual grasping movements, significantly outperforming alternative somatotopic or muscle-based models. Importantly, hand postural synergies were predicted by neural activation patterns within primary motor cortex. These findings support a novel cortical organization for hand movement control and open potential applications for brain-computer interfaces and neuroprostheses.

DOI:http://dx.doi.org/10.7554/eLife.13420.001

The human hand can perform an enormous range of movements with great dexterity. Some common everyday actions, such as grasping a coffee cup, involve the coordinated movement of all four fingers and thumb. Others, such as typing, rely on the ability of individual fingers to move relatively independently of one another.

This flexibility is possible in part because of the complex anatomy of the hand, with its 27 bones and their connecting joints and muscles. But with this complexity comes a huge number of possibilities. Any movement-related task – such as picking up a cup – can be achieved via many different combinations of muscle contractions and joint positions. So how does the brain decide which muscles and joints to use?

One theory is that the brain simplifies this problem by encoding particularly useful patterns of joint movements as distinct units or “synergies”. A given task can then be performed by selecting from a small number of synergies, avoiding the need to choose between huge numbers of options every time movement is required.

Leo et al. now provide the first direct evidence for the encoding of synergies by the human brain. Volunteers lying inside a brain scanner reached towards virtual objects – from tennis rackets to toothpicks – while activity was recorded from the area of the brain that controls hand movements. As predicted, the scans showed specific and reproducible patterns of activity. Analysing these patterns revealed that each corresponded to a particular combination of joint positions. These activity patterns, or synergies, could even be ‘decoded’ to work out which type of movement a volunteer had just performed.

Future experiments should examine how the brain combines synergies with sensory feedback to allow movements to be adjusted as they occur. Such findings could help to develop brain-computer interfaces and systems for controlling the movement of artificial limbs.

DOI:http://dx.doi.org/10.7554/eLife.13420.002

Hand synergies: Integration of robotics and neuroscience for understanding the control of biological and artificial hands

The term 'synergy' - from the Greek synergia - means 'working together'. The concept of multiple elements working together towards a common goal has been extensively used in neuroscience to develop theoretical frameworks, experimental approaches, and analytical techniques to understand neural control of movement, and for applications for neuro-rehabilitation. In the past decade, roboticists have successfully applied the framework of synergies to create novel design and control concepts for artificial hands, i.e., robotic hands and prostheses. At the same time, robotic research on the sensorimotor integration underlying the control and sensing of artificial hands has inspired new research approaches in neuroscience, and has provided useful instruments for novel experiments. The ambitious goal of integrating expertise and research approaches in robotics and neuroscience to study the properties and applications of the concept of synergies is generating a number of multidisciplinary cooperative projects, among which the recently finished 4-year European project "The Hand Embodied" (THE). This paper reviews the main insights provided by this framework. Specifically, we provide an overview of neuroscientific bases of hand synergies and introduce how robotics has leveraged the insights from neuroscience for innovative design in hardware and controllers for biomedical engineering applications, including myoelectric hand prostheses, devices for haptics research, and wearable sensing of human hand kinematics. The review also emphasizes how this multidisciplinary collaboration has generated new ways to conceptualize a synergy-based approach for robotics, and provides guidelines and principles for analyzing human behavior and synthesizing artificial robotic systems based on a theory of synergies.

Differences between kinematic synergies and muscle synergies during two-digit grasping

The large number of mechanical degrees of freedom of the hand is not fully exploited during actual movements such as grasping. Usually, angular movements in various joints tend to be coupled, and EMG activities in different hand muscles tend to be correlated. The occurrence of covariation in the former was termed kinematic synergies, in the latter muscle synergies. This study addresses two questions: (i) Whether kinematic and muscle synergies can simultaneously accommodate for kinematic and kinetic constraints. (ii) If so, whether there is an interrelation between kinematic and muscle synergies. We used a reach-grasp-and-pull paradigm and recorded the hand kinematics as well as eight surface EMGs. Subjects had to either perform a precision grip or side grip and had to modify their grip force in order to displace an object against a low or high load. The analysis was subdivided into three epochs: reach, grasp-and-pull, and static hold. Principal component analysis (PCA, temporal or static) was performed separately for all three epochs, in the kinematic and in the EMG domain. PCA revealed that (i) Kinematic- and muscle-synergies can simultaneously accommodate kinematic (grip type) and kinetic task constraints (load condition). (ii) Upcoming grip and load conditions of the grasp are represented in kinematic- and muscle-synergies already during reach. Phase plane plots of the principal muscle-synergy against the principal kinematic synergy revealed (iii) that the muscle-synergy is linked (correlated, and in phase advance) to the kinematic synergy during reach and during grasp-and-pull. Furthermore (iv), pair-wise correlations of EMGs during hold suggest that muscle-synergies are (in part) implemented by coactivation of muscles through common input. Together, these results suggest that kinematic synergies have (at least in part) their origin not just in muscular activation, but in synergistic muscle activation. In short: kinematic synergies may result from muscle synergies.

Do sensorimotor β-oscillations maintain muscle synergy representations in primary motor cortex?

Coherent β-oscillations are a dominant feature of the sensorimotor system yet their function remains enigmatic. We propose that, in addition to cell intrinsic and/or local network interactions, they are supported by activity propagating recurrently around closed neural 'loops' between primary motor cortex (M1), muscles, and back to M1 via somatosensory pathways. Individual loops reciprocally connect individual muscle synergies ('motor primitives') with their representations in M1, and the conduction time around each loop resonates with the periodic spiking of its constituent neurons/muscles. During β-oscillations, this resonance strengthens within-loop connectivity (via long-term potentiation, LTP), whereas non-resonance between different loops weakens connectivity (via long-term depression, LTD) between M1 representations of different muscle synergies. In this way, β-oscillations help maintain accurate and discrete representations of muscle synergies in M1.

Bottlenecks to clinical translation of direct brain-computer interfaces

Despite several decades of research into novel brain-implantable devices to treat a range of diseases, only two—cochlear implants for sensorineural hearing loss and deep brain stimulation for movement disorders—have yielded any appreciable clinical benefit. Obstacles to translation include technical factors (e.g., signal loss due to gliosis or micromotion), lack of awareness of current clinical options for patients that the new therapy must outperform, traversing between federal and corporate funding needed to support clinical trials, and insufficient management expertise. This commentary reviews these obstacles preventing the translation of promising new neurotechnologies into clinical application and suggests some principles that interdisciplinary teams in academia and industry could adopt to enhance their chances of success.