Flexible cortical control of task-specific muscle synergies

DistaNet: grasp-specific distance biofeedback promotes the retention of myoelectric skills

Objective.An active myoelectric interface responds to the user's muscle signals to enable movements. Machine learning can decode user intentions from myoelectric signals. However, machine learning-based interface control lacks continuous, intuitive feedback about task performance, needed to facilitate the acquisition and retention of myoelectric control skills.Approach.We propose DistaNet as a neural network-based framework that extracts smooth, continuous, and low-dimensional signatures of the hand grasps from multi-channel myoelectric signals and provides grasp-specific biofeedback to the users.Main results.Experimental results show its effectiveness in decoding user gestures and providing biofeedback, helping users retain the acquired motor skills.Significance.We demonstrates myoelectric skill retention in a pattern recognition setting for the first time.

Biomimetic versus arbitrary motor control strategies for bionic hand skill learning

A long-standing engineering ambition has been to design anthropomorphic bionic limbs: devices that look like and are controlled in the same way as the biological body (biomimetic). The untested assumption is that biomimetic motor control enhances device embodiment, learning, generalization and automaticity. To test this, we compared biomimetic and non-biomimetic control strategies for non-disabled participants when learning to control a wearable myoelectric bionic hand operated by an eight-channel electromyography pattern-recognition system. We compared motor learning across days and behavioural tasks for two training groups: biomimetic (mimicking the desired bionic hand gesture with biological hand) and arbitrary control (mapping an unrelated biological hand gesture with the desired bionic gesture). For both trained groups, training improved bionic limb control, reduced cognitive reliance and increased embodiment over the bionic hand. Biomimetic users had more intuitive and faster control early in training. Arbitrary users matched biomimetic performance later in training. Furthermore, arbitrary users showed increased generalization to a new control strategy. Collectively, our findings suggest that biomimetic and arbitrary control strategies provide different benefits. The optimal strategy is probably not strictly biomimetic, but rather a flexible strategy within the biomimetic-to-arbitrary spectrum, depending on the user, available training opportunities and user requirements.

Dissecting muscle synergies in the task space

The muscle synergy is a guiding concept in motor control research that relies on the general notion of muscles 'working together' towards task performance. However, although the synergy concept has provided valuable insights into motor coordination, muscle interactions have not been fully characterised with respect to task performance. Here, we address this research gap by proposing a novel perspective to the muscle synergy that assigns specific functional roles to muscle couplings by characterising their task-relevance. Our novel perspective provides nuance to the muscle synergy concept, demonstrating how muscular interactions can 'work together' in different ways: (1) irrespective of the task at hand but also (2) redundantly or (3) complementarily towards common task-goals. To establish this perspective, we leverage information- and network-theory and dimensionality reduction methods to include discrete and continuous task parameters directly during muscle synergy extraction. Specifically, we introduce co-information as a measure of the task-relevance of muscle interactions and use it to categorise such interactions as task-irrelevant (present across tasks), redundant (shared task information), or synergistic (different task information). To demonstrate these types of interactions in real data, we firstly apply the framework in a simple way, revealing its added functional and physiological relevance with respect to current approaches. We then apply the framework to large-scale datasets and extract generalizable and scale-invariant representations consisting of subnetworks of synchronised muscle couplings and distinct temporal patterns. The representations effectively capture the functional interplay between task end-goals and biomechanical affordances and the concurrent processing of functionally similar and complementary task information. The proposed framework unifies the capabilities of current approaches in capturing distinct motor features while providing novel insights and research opportunities through a nuanced perspective to the muscle synergy.

Muscle synergies are associated with intermuscular coherence and cortico-synergy coherence in an isometric upper limb task

To elucidate the underlying physiological mechanisms of muscle synergies, we investigated long-range functional connectivity by cortico-muscular (CMC), intermuscular (IMC) and cortico-synergy (CSC) coherence. Fourteen healthy participants executed an isometric upper limb task in synergy-tuned directions. Cortical activity was recorded using 32-channel electroencephalography (EEG) and muscle activity using 16-channel electromyography (EMG). Using non-negative matrix factorisation (NMF), we calculated muscle synergies from two different tasks. A preliminary multidirectional task was used to identify synergy-preferred directions (PDs). A subsequent coherence task, consisting of generating forces isometrically in the synergy PDs, was used to assess the functional connectivity properties of synergies. Overall, we were able to identify four different synergies from the multidirectional task. A significant alpha band IMC was consistently present in all extracted synergies. Moreover, IMC alpha band was higher between muscles with higher weights within a synergy. Interestingly, CSC alpha band was also significantly higher across muscles with higher weights within a synergy. In contrast, no significant CMC was found between the motor cortex area and synergy muscles. The presence of a shared input onto synergistic muscles within a synergy supports the idea of neurally derived muscle synergies that build human movement. Our findings suggest cortical modulation of some of the synergies and the consequential existence of shared input between muscles within cortically modulated synergies.

3D muscle networks based on vibrational mechanomyography

Objective. Muscle network modeling maps synergistic control during complex motor tasks. Intermuscular coherence (IMC) is key to isolate synchronization underlying coupling in such neuromuscular control. Model inputs, however, rely on electromyography, which can limit the depth of muscle and spatial information acquisition across muscle fibers.Approach. We introduce three-dimensional (3D) muscle networks based on vibrational mechanomyography (vMMG) and IMC analysis to evaluate the functional co-modulation of muscles across frequency bands in concert with the longitudinal, lateral, and transverse directions of muscle fibers. vMMG is collected from twenty subjects using a bespoke armband of accelerometers while participants perform four hand gestures. IMC from four superficial muscles (flexor carpi radialis, brachioradialis, extensor digitorum communis, and flexor carpi ulnaris) is decomposed using matrix factorization into three frequency bands. We further evaluate the practical utility of the proposed technique by analyzing the network responses to various sensor-skin contact force levels, studying changes in quality, and discriminative power of vMMG.Main results. Results show distinct topological differences, with coherent coupling as high as 57% between specific muscle pairs, depending on the frequency band, gesture, and direction. No statistical decrease in signal strength was observed with higher contact force.Significance. Results support the usability vMMG as a tool for muscle connectivity analyses and demonstrate the use of IMC as a new feature space for hand gesture classification. Comparison of spectrotemporal and muscle network properties between levels of force support the robustness of vMMG-based network models to variations in tissue compression. We argue 3D models of vMMG-based muscle networks provide a new foundation for studying synergistic muscle activation, particularly in out-of-clinic scenarios where electrical recording is impractical.

Virtual regression-based myoelectric hand-wrist prosthesis control and electrode site selection using no force feedback

Most transradial prosthesis users with conventional "Sequential" myoelectric control have two electrode sites which control one degree of freedom (DoF) at a time. Rapid EMG co-activation toggles control between DoFs (e.g., hand and wrist), providing limited function. We implemented a regression-based EMG control method which achieved simultaneous and proportional control of two DoFs in a virtual task. We automated electrode site selection using a short-duration (90 s) calibration period, without force feedback. Backward stepwise selection located the best electrodes for either six or 12 electrodes (selected from a pool of 16). We additionally studied two, 2-DoF controllers: "Intuitive" control (hand open-close and wrist pronation-supination controlled virtual target size and rotation, respectively) and "Mapping" control (wrist flexion-extension and ulnar-radial deviation controlled virtual target left-right and up-down movement, respectively). In practice, a Mapping controller would be mapped to control prosthesis hand open-close and wrist pronation-supination. Eleven able-bodied subjects and 4 limb-absent subjects completed virtual target matching tasks (fixed target moves to a new location after being "matched," and subject immediately pursues) and fixed (static) target tasks. For all subjects, both 2-DoF controllers with 6 optimally-sited electrodes had statistically better target matching performance than Sequential control in number of matches (average of 4-7 vs. 2 matches, p< 0.001) and throughput (average of 0.75-1.25 vs. 0.4 bits/s, p< 0.001), but not overshoot rate and path efficiency. There were no statistical differences between 6 and 12 optimally-sited electrodes for both 2-DoF controllers. These results support the feasibility of 2-DoF simultaneous, proportional myoelectric control.

Should bionic limb control mimic the human body? Impact of control strategy on bionic hand skill learning

A longstanding engineering ambition has been to design anthropomorphic bionic limbs: devices that look like and are controlled in the same way as the biological body (biomimetic). The untested assumption is that biomimetic motor control enhances device embodiment, learning, generalization, and automaticity. To test this, we compared biomimetic and non-biomimetic control strategies for able-bodied participants when learning to operate a wearable myoelectric bionic hand. We compared motor learning across days and behavioural tasks for two training groups: Biomimetic (mimicking the desired bionic hand gesture with biological hand) and Arbitrary control (mapping an unrelated biological hand gesture with the desired bionic gesture). For both trained groups, training improved bionic limb control, reduced cognitive reliance, and increased embodiment over the bionic hand. Biomimetic users had more intuitive and faster control early in training. Arbitrary users matched biomimetic performance later in training. Further, arbitrary users showed increased generalization to a novel control strategy. Collectively, our findings suggest that biomimetic and arbitrary control strategies provide different benefits. The optimal strategy is likely not strictly biomimetic, but rather a flexible strategy within the biomimetic to arbitrary spectrum, depending on the user, available training opportunities and user requirements.

Evidence for shared neural information between muscle synergies and corticospinal efficacy

Stroke survivors often exhibit gait dysfunction which compromises self-efficacy and quality of life. Muscle Synergy Analysis (MSA), derived from electromyography (EMG), has been argued as a method to quantify the complexity of descending motor commands and serve as a direct correlate of neural function. However, controversy remains regarding this interpretation, specifically attribution of MSA as a neuromarker. Here we sought to determine the relationship between MSA and accepted neurophysiological parameters of motor efficacy in healthy controls, high (HFH), and low (LFH) functioning stroke survivors. Surface EMG was collected from twenty-four participants while walking at their self-selected speed. Concurrently, transcranial magnetic stimulation (TMS) was administered, during walking, to elicit motor evoked potentials (MEPs) in the plantarflexor muscles during the pre-swing phase of gait. MSA was able to differentiate control and LFH individuals. Conversely, motor neurophysiological parameters, including soleus MEP area, revealed that MEP latency differentiated control and HFH individuals. Significant correlations were revealed between MSA and motor neurophysiological parameters adding evidence to our understanding of MSA as a correlate of neural function and highlighting the utility of combining MSA with other relevant outcomes to aid interpretation of this analysis technique.

Myoelectric Control Performance of Two Degree of Freedom Hand-Wrist Prosthesis by Able-Bodied and Limb-Absent Subjects

Recent research has advanced two degree-of-freedom (DoF), simultaneous, independent and proportional control of hand-wrist prostheses using surface electromyogram signals from remnant muscles as the control input. We evaluated two such regression-based controllers, along with conventional, sequential two-site control with co-contraction mode switching (SeqCon), in box-block, refined-clothespin and door-knob tasks, on 10 able-bodied and 4 limb-absent subjects. Subjects operated a commercial hand and wrist using a socket bypass harness. One 2-DoF controller (DirCon) related the intuitive hand actions of open-close and pronation-supination to the associated prosthesis hand-wrist actions, respectively. The other (MapCon) mapped myoelectrically more distinct, but less intuitive, actions of wrist flexion-extension and ulnar-radial deviation. Each 2-DoF controller was calibrated from separate 90 s calibration contractions. SeqCon performed better statistically than MapCon in the predominantly 1-DoF box-block task (>20 blocks/minute vs. 8-18 blocks/minute, on average). In this task, SeqCon likely benefited from an ability to easily focus on 1-DoF and not inadvertently trigger co-contraction for mode switching. The remaining two tasks require 2-DoFs, and both 2-DoF controllers each performed better (factor of 2-4) than SeqCon. We also compared the use of 12 vs. 6 optimally-selected EMG electrodes as inputs, finding no statistical difference. Overall, we provide further evidence of the benefits of regression-based EMG prosthesis control of 2-DoFs in the hand-wrist.

Discrete action control for prosthetic digits

We aim to develop a paradigm for simultaneous and independent control of multiple degrees of freedom (DOFs) for upper-limb prostheses. To that end, we introduce action control, a novel method to operate prosthetic digits with surface electromyography (EMG) based on multi-output, multi-class classification. At each time step, the decoder classifies movement intent for each controllable DOF into one of three categories: open, close, or stall (i.e., no movement). We implemented a real-time myoelectric control system using this method and evaluated it by running experiments with one unilateral and two bilateral amputees. Participants controlled a six-DOF bar interface on a computer display, with each DOF corresponding to a motor function available in multi-articulated prostheses. We show that action control can significantly and systematically outperform the state-of-the-art method of position control via multi-output regression in both task- and non-task-related measures. Using the action control paradigm, improvements in median task performance over regression-based control ranged from 20.14% to 62.32% for individual participants. Analysis of a post-experimental survey revealed that all participants rated action higher than position control in a series of qualitative questions and expressed an overall preference for the former. Action control has the potential to improve the dexterity of upper-limb prostheses. In comparison with regression-based systems, it only requires discrete instead of real-valued ground truth labels, typically collected with motion tracking systems. This feature makes the system both practical in a clinical setting and also suitable for bilateral amputation. This work is the first demonstration of myoelectric digit control in bilateral upper-limb amputees. Further investigation and preclinical evaluation are required to assess the translational potential of the method.

Co-adaptive control of bionic limbs via unsupervised adaptation of muscle synergies

OBJECTIVE

In this work, we present a myoelectric interface that extracts natural motor synergies from multi-muscle signals and adapts in real-time with new user inputs. With this unsupervised adaptive myocontrol (UAM) system, optimal synergies for control are continuously co-adapted with changes in user motor control, or as a function of perturbed conditions via online non-negative matrix factorization guided by physiologically informed sparseness constraints in lieu of explicit data labelling.

METHODS

UAM was tested in a set of virtual target reaching tasks completed by able-bodied and amputee subjects. Tests were conducted under normative and electrode perturbed conditions to gauge control robustness with comparisons to non-adaptive and supervised adaptive myocontrol schemes. Furthermore, UAM was used to interface an amputee with a multi-functional powered hand prosthesis during standardized Clothespin Relocation Tests, also conducted in normative and perturbed conditions.

RESULTS

In virtual tests, UAM effectively mitigated performance degradation caused by electrode displacement, affording greater resilience over an existing supervised adaptive system for amputee subjects. Induced electrode shifts also had negligible effect on the real world control performance of UAM with consistent completion times (23.91±1.33 s) achieved across Clothespin Relocation Tests in the normative and electrode perturbed conditions.

CONCLUSION

UAM affords comparable robustness improvements to existing supervised adaptive myocontrol interfaces whilst providing additional practical advantages for clinical deployment.

SIGNIFICANCE

The proposed system uniquely incorporates neuromuscular control principles with unsupervised online learning methods and presents a working example of a freely co-adaptive bionic interface.

Simultaneous control of natural and extra degrees of freedom by isometric force and electromyographic activity in the muscle-to-force null space

OBJECTIVE

Muscle activation patterns in the muscle-to-force null space, i.e., patterns that do not generate task-relevant forces, may provide an opportunity for motor augmentation by allowing to control additional end-effectors simultaneously to natural limbs. Here we tested the feasibility of muscular null space control for augmentation by assessing simultaneous control of natural and extra degrees of freedom.

APPROACH

We instructed eight participants to control translation and rotation of a virtual 3D end-effector by simultaneous generation of isometric force at the hand and null space activity extracted in real-time from the electromyographic signals recorded from 15 shoulder and arm muscles. First, we identified the null space components that each participant could control more naturally by voluntary co-contraction. Then, participants performed several blocks of a reaching and holding task. They displaced an ellipsoidal cursor to reach one of nine targets by generating force, and simultaneously rotated the cursor to match the target orientation by activating null space components. We developed an information-theoretic metric, an index of difficulty defined as the sum of a spatial and a temporal term, to assess individual null space control ability for both reaching and holding.

MAIN RESULTS

On average, participants could reach the targets in most trials already in the first block (72%) and they improved with practice (maximum 93%) but holding performance remained lower (maximum 43%). As there was a high inter-individual variability in performance, we performed a simulation with different spatial and temporal task conditions to estimate those for which each individual participants would have performed best.

SIGNIFICANCE

Muscular null space control is feasible and may be used to control additional virtual or robotics end-effectors. However, decoding of motor commands must be optimized according to individual null space control ability.

Temporal control of muscle synergies is linked with alpha-band neural drive

KEY POINTS

It is theorized that the nervous system controls groups of muscles together as functional units, or 'synergies', resulting in correlated electromyographic (EMG) signals among muscles. However, such correlation does not necessarily imply group-level neural control. Oscillatory synchronization (coherence) among EMG signals implies neural coupling, but it is not clear how this relates to control of muscle synergies. EMG was recorded from seven arm muscles of 10 adult participants rotating an upper limb ergometer, and EMG-EMG coherence, EMG amplitude correlations and their relationship with each other were characterized. A novel method to derive multi-muscle synergies from EMG-EMG coherence is presented and these are compared with classically defined synergies. Coherent alpha-band (8-16 Hz) drive was strongest among muscles whose gross activity levels are well correlated within a given task. The cross-muscle distribution and temporal modulation of coherent alpha-band drive suggests a possible role in the neural coordination/monitoring of synergies.

ABSTRACT

During movement, groups of muscles may be controlled together by the nervous system as an adaptable functional entity, or 'synergy'. The rules governing when (or if) this occurs during voluntary behaviour in humans are not well understood, at least in part because synergies are usually defined by correlated patterns of muscle activity without regard for the underlying structure of their neural control. In this study, we investigated the extent to which comodulation of muscle output (i.e. correlation of electromyographic (EMG) amplitudes) implies that muscles share intermuscular neural input (assessed via EMG-EMG coherence analysis). We first examined this relationship among pairs of upper limb muscles engaged in an arm cycling task. We then applied a novel multidimensional EMG-EMG coherence analysis allowing synergies to be characterized on the basis of shared neural drive. We found that alpha-band coherence (8-16 Hz) is related to the degree to which overall muscle activity levels correlate over time. The extension of this coherence analysis to describe the cross-muscle distribution and temporal modulation of alpha-band drive revealed a close match to the temporal and structural features of traditionally defined muscle synergies. Interestingly, the coherence-derived neural drive was inversely associated with, and preceded, changes in EMG amplitudes by ∼200 ms. Our novel characterization of how alpha-band neural drive is dynamically distributed among muscles is a fundamental step forward in understanding the neural origins and correlates of muscle synergies.

Changes in Intermuscular Coherence as a Function of Age and Phase of Speech Production During an Overt Reading Task

PURPOSE

The authors evaluated changes in intermuscular coherence (IMC) of orofacial and speech breathing muscles across phase of speech production in healthy younger and older adults.

METHOD

Sixty adults (30 younger = M: 26.97 year; 30 older = M: 66.37 year) read aloud a list of 40 words. IMC was evaluated across phase: preparation (300 ms before speech onset), initiation (300 ms after onset), and total execution (entire word).

RESULTS

Orofacial IMC was lowest in the initiation, higher in preparation, and highest for the total execution phase. Chest wall IMC was lowest for the preparation and initiation and highest for the total execution phase. Despite age-related differences in accuracy, neuromuscular modulation for phase was similar between groups.

CONCLUSION

These results expand our knowledge of speech motor control by demonstrating that IMC is sensitive to phase of speech planning and production.

Optimal Approach for Signal Detection in Steady-State Visual Evoked Potentials in Humans Using Single-Channel EEG and Stereoscopic Stimuli

In EEG studies, one of the most common ways to detect a weak periodic signal in the steady-state visual evoked potential (SSVEP) is spectral evaluation, a process that detects peaks of power present at notable temporal frequencies. However, the presence of noise decreases the signal-to-noise ratio (SNR), which in turn lowers the probability of successful detection of these spectral peaks. In this paper, using a single EEG channel, we compare the detection performance of four different metrics to analyse the SSVEP: two metrics that use spectral power density, and two other metrics that use phase coherency. We employ these metrics find weak signals with a known temporal frequency hidden in the SSVEP, using both simulation and real data from a stereoscopic apparent depth movement perception task. We demonstrate that out of these metrics, the phase coherency analysis is the most sensitive way to find weak signals in the SSVEP, provided that the phase information of the stimulus eliciting the SSVEP is preserved.

Learning to use Muscles

The human musculoskeletal system is highly complex mechanically. Its neural control must deal successfully with this complexity to perform the diverse, efficient, robust and usually graceful behaviors of which humans are capable. Most of those behaviors might be performed by many different subsets of its myriad possible states, so how does the nervous system decide which subset to use? One solution that has received much attention over the past 50 years would be for the nervous system to be fundamentally limited in the patterns of muscle activation that it can access, a concept known as muscle synergies or movement primitives. Another solution, based on engineering control methodology, is for the nervous system to compute the single optimal pattern of muscle activation for each task according to a cost function. This review points out why neither appears to be the solution used by humans. There is a third solution that is based on trial-and-error learning, recall and interpolation of sensorimotor programs that are good-enough rather than limited or optimal. The solution set acquired by an individual during the protracted development of motor skills starting in infancy forms the basis of motor habits, which are inherently low-dimensional. Such habits give rise to muscle usage patterns that are consistent with synergies but do not reflect fundamental limitations of the nervous system and can be shaped by training or disability. This habit-based strategy provides a robust substrate for the control of new musculoskeletal structures during evolution as well as for efficient learning, athletic training and rehabilitation therapy.

Neuronal Activity Distributed in Multiple Cortical Areas during Voluntary Control of the Native Arm or a Brain-Computer Interface

Voluntary control of visually-guided upper extremity movements involves neuronal activity in multiple areas of the cerebral cortex. Studies of brain-computer interfaces (BCIs) that use spike recordings for input, however, have focused largely on activity in the region from which those neurons that directly control the BCI, which we call BCI units, are recorded. We hypothesized that just as voluntary control of the arm and hand involves activity in multiple cortical areas, so does voluntary control of a BCI. In two subjects (Macaca mulatta) performing a center-out task both with a hand-held joystick and with a BCI directly controlled by four primary motor cortex (M1) BCI units, we recorded the activity of other, non-BCI units in M1, dorsal premotor cortex (PMd) and ventral premotor cortex (PMv), primary somatosensory cortex (S1), dorsal posterior parietal cortex (dPPC), and the anterior intraparietal area (AIP). In most of these areas, non-BCI units were active in similar percentages and at similar modulation depths during both joystick and BCI trials. Both BCI and non-BCI units showed changes in preferred direction (PD). Additionally, the prevalence of effective connectivity between BCI and non-BCI units was similar during both tasks. The subject with better BCI performance showed increased percentages of modulated non-BCI units with increased modulation depth and increased effective connectivity during BCI as compared with joystick trials; such increases were not found in the subject with poorer BCI performance. During voluntary, closed-loop control, non-BCI units in a given cortical area may function similarly whether the effector is the native upper extremity or a BCI-controlled device.

Muscle Synergies and Coherence Networks Reflect Different Modes of Coordination During Walking

When walking speed is increased, the frequency ratio between the arm and leg swing switches spontaneously from 2:1 to 1:1. We examined whether these switches are accompanied by changes in functional connectivity between multiple muscles. Subjects walked on a treadmill with their arms swinging along their body while kinematics and surface electromyography (EMG) of 26 bilateral muscles across the body were recorded. Walking speed was varied from very slow to normal. We decomposed EMG envelopes and intermuscular coherence spectra using non-negative matrix factorization (NMF), and the resulting modes were combined into multiplex networks and analyzed for their community structure. We found five relevant muscle synergies that significantly differed in activation patterns between 1:1 and 2:1 arm-leg coordination and the transition period between them. The corresponding multiplex network contained a single module indicating pronounced muscle co-activation patterns across the whole body during a gait cycle. NMF of the coherence spectra distinguished three EMG frequency bands: 4-8, 8-22, and 22-60 Hz. The community structure of the multiplex network revealed four modules, which clustered functional and anatomical linked muscles across modes of coordination. Intermuscular coherence at 4-22 Hz between upper and lower body and within the legs was particularly pronounced for 1:1 arm-leg coordination and was diminished when switching between modes of coordination. These findings suggest that the stability of arm-leg coordination is associated with modulations in long-distant neuromuscular connectivity.

When 90% of the variance is not enough: residual EMG from muscle synergy extraction influences task performance

Muscle synergies are usually identified via dimensionality reduction techniques, such that the identified synergies reconstruct the muscle activity to an accuracy level defined heuristically, often set to 90% of the variance. Here, we question the assumption that the residual muscle activity not explained by the synergies is due to noise. We hypothesize instead that the residual activity is not entirely random and can influence the execution of motor tasks. Young healthy subjects performed an isometric reaching task in which the surface electromyography of 10 arm muscles was mapped onto a two-dimensional force used to control a cursor. Three to five synergies explained 90% of the variance in muscle activity. We altered the muscle-force mapping via "hard" and "easy" virtual surgeries. Whereas in both surgeries the forces associated with synergies spanned the same dimension of the virtual environment, the muscle-force mapping was as close as possible to the initial mapping in the easy surgery; in contrast, it was as far as possible in the hard surgery. This design maximized potential differences in reaching errors attributable to residual activity. Results show that the easy surgery produced smaller directional errors than the hard surgery. Additionally, simulations of surgeries constructed with 1 to 10 synergies show that the errors in the easy and hard surgeries differ significantly for up to 8 synergies, which explains 98% of the variance on average. Our study thus indicates the need for cautious interpretations of results derived from synergy extraction techniques based on heuristics with lenient accuracy levels.NEW & NOTEWORTHY The muscle synergy hypothesis posits that the central nervous system simplifies motor control by grouping muscles into modules. Current techniques use dimensionality reduction, such that the identified synergies reconstruct 90% of the muscle activity. We show that residual muscle activity following such identification can have a large systematic effect on movements, even when the number of synergies approaches the number of muscles. Current synergy extraction techniques must therefore be updated to identify true physiological synergies.

The effects of motor modularity on performance, learning and generalizability in upper-extremity reaching: a computational analysis

It has been hypothesized that the central nervous system simplifies the production of movement by limiting motor commands to a small set of modules known as muscle synergies. Recently, investigators have questioned whether a low-dimensional controller can produce the rich and flexible behaviours seen in everyday movements. To study this issue, we implemented muscle synergies in a biomechanically realistic model of the human upper extremity and performed computational experiments to determine whether synergies introduced task performance deficits, facilitated the learning of movements, and generalized to different movements. We derived sets of synergies from the muscle excitations our dynamic optimizations computed for a nominal task (reaching in a plane). Then we compared the performance and learning rates of a controller that activated all muscles independently to controllers that activated the synergies derived from the nominal reaching task. We found that a controller based on synergies had errors within 1 cm of a full-dimensional controller and achieved faster learning rates (as estimated from computational time to converge). The synergy-based controllers could also accomplish new tasks-such as reaching to targets on a higher or lower plane, and starting from alternative initial poses-with average errors similar to a full-dimensional controller.

Parkinson's Disease Exhibits Amplified Intermuscular Coherence During Dynamic Voluntary Action

Parkinson's disease (PD) is typically diagnosed and evaluated on the basis of overt motor dysfunction, however, subtle changes in the frequency spectrum of neural drive to muscles have been reported as well. During dynamic actions, coactive muscles of healthy adults often share a common source of 6-15 Hz (alpha-band) neural drive, creating synchronous alpha-band activity in their EMG signals. Individuals with PD commonly exhibit kinetic action tremor at similar frequencies, but the potential relationship between the intermuscular alpha-band neural drive seen in healthy adults and the action tremor associated with PD is not well-understood. A close relationship is most tenable during voluntary dynamic tasks where alpha-band neural drive is strongest in healthy adults, and where neural circuits affected by PD are most engaged. In this study, we characterized the frequency spectrum of EMG synchronization (intermuscular coherence) in 16 participants with PD and 15 age-matched controls during two dynamic motor tasks: (1) rotation of a dial between the thumb and index finger, and (2) dynamic scaling of isometric precision pinch force. These tasks produce different profiles of coherence between the first dorsal interosseous and abductor pollicis brevis muscles. We sought to determine if alpha-band intermuscular coherence would be amplified in participants with PD relative to controls, if such differences would be task-specific, and if they would correlate with symptom severity. We found that relative to controls, the PD group displayed amplified, but similarly task-dependent, coherence in the alpha-band. The magnitude of coherence during the rotation task correlated with overall symptom severity as per the UPDRS rating scale. Finally, we explored the potential for our coherence measures, with no additional information, to discriminate individuals with PD from controls. The area under the Receiver Operating Characteristic curve (AUC) indicated a clear separation between groups (AUC = 0.96), even though participants with PD were on their typical medication and displayed only mild-moderate symptoms. We conclude that a task-dependent, intermuscular neural drive within the alpha-band is amplified in PD. Its quantification via intermuscular coherence analysis may provide a useful tool for detecting the presence of PD, or assessing its progression.

The effects of different tracking tasks on muscle synergy through visual feedback

By recruiting a modular organization of muscle with relative activities, the arm motion can be indicated by the neural system and generated for performing a variety of motor tasks. In this study, a Non-negative Matrix Factorization with initial estimation is applied to identify and extract primary muscle synergies and their activation patterns from the processed EMG recordings during three multidirectional tracking tasks with visual feedback interaction. The effects of task variety and tracking accuracy by visual feedback on muscle synergies and their activation patterns are explored by statistic analysis. The results showed that only the task variety affected what synergies were indicated by the neural system, but both task variety and visual feedback affected the duration and magnitude of the primary synergies. Thus, for active rehabilitation application, it is advised that if the purpose is to enhance the synergy indication from the neural system, the task completion accuracy should be emphasized, but if the purpose is to expand the motion area, the task variety should be diversified.

Jaw Elevator Muscle Coordination during Rhythmic Mastication in Primates: Are Triplets Units of Motor Control?

The activity of mammal jaw elevator muscles during chewing has often been described using the concept of the triplet motor pattern, in which triplet I (balancing side superficial masseter and medial pterygoid; working side posterior temporalis) is consistently activated before triplet II (working side superficial masseter and medial pterygoid; balancing side posterior temporalis), and each triplet of muscles is recruited and modulated as a unit. Here, new measures of unison, synchrony, and coordination are used to determine whether in 5 primate species (Propithecus verreauxi, Eulemur fulvus, Papio anubis, Macaca fuscata,and Pan troglodytes)muscles in the same triplet are active more in unison, are more synchronized, and are more highly coordinated than muscles in different triplets. Results show that triplet I muscle pairs are active more in unison than other muscle pairs in Eulemur, Macaca, and Papio,buttriplet muscle pairs are mostly not more tightly synchronized than non-triplet pairs. Triplet muscles are more coordinated during triplet pattern cycles than non-triplet cycles, while non-triplet muscle pairs are more coordinated during non-triplet cycles than triplet cycles. These results suggest that the central nervous system alters patterns of coordination between cycles, recruiting triplet muscles as a coordinated unit during triplet cycles but employing a different pattern of muscle coordination during non-triplet cycles. The triplet motor pattern may simplify modulation of rhythmic mastication by being one possible unit of coordination that can be recruited on a cycle-to-cycle basis.

Continuous Description of Human 3D Motion Intent Through Switching Mechanism

Post-stroke motor recovery highly relies on voluntarily participating in active rehabilitation as early as possible for promoting the reorganization of the patient's brain. In this paper, a new method is proposed which manipulates cable-based rehabilitation robots to assist multi-joint body motions. This uses an electromyography (EMG) decoder for continuous estimation of voluntary motion intention to establish a cooperative human-machine interface for promoting the participation in rehabilitation exercises. In particular, for multi-joint complex tasks in three-dimensional space, a switching mechanism has been developed which can carve up tasks into separate simple motions. For each simple motion, a linear six-inputs and three-outputs time-invariant model is established respectively. The inputs are the processed muscle activations of six arm muscles, and the outputs are voluntary forces of participants when executing a multi-directional tracking task with visual feedback. The experiments for examining the decoder model and EMG-based controller include model training, testing and controller application phases with seven healthy participants. Experimental results demonstrate that the decoder model with the switching mechanism could effectively recognize arm movement intention and provide appropriate assistance to the participants. This study finds that the switching mechanism can improve both the model estimation accuracy and the completeness for executing complex tasks.

Model and experiments to optimize co-adaptation in a simplified myoelectric control system

OBJECTIVE

To compensate for a limb lost in an amputation, myoelectric prostheses use surface electromyography (EMG) from the remaining muscles to control the prosthesis. Despite considerable progress, myoelectric controls remain markedly different from the way we normally control movements, and require intense user adaptation. To overcome this, our goal is to explore concurrent machine co-adaptation techniques that are developed in the field of brain-machine interface, and that are beginning to be used in myoelectric controls.

APPROACH

We combined a simplified myoelectric control with a perturbation for which human adaptation is well characterized and modeled, in order to explore co-adaptation settings in a principled manner.

RESULTS

First, we reproduced results obtained in a classical visuomotor rotation paradigm in our simplified myoelectric context, where we rotate the muscle pulling vectors used to reconstruct wrist force from EMG. Then, a model of human adaptation in response to directional error was used to simulate various co-adaptation settings, where perturbations and machine co-adaptation are both applied on muscle pulling vectors. These simulations established that a relatively low gain of machine co-adaptation that minimizes final errors generates slow and incomplete adaptation, while higher gains increase adaptation rate but also errors by amplifying noise. After experimental verification on real subjects, we tested a variable gain that cumulates the advantages of both, and implemented it with directionally tuned neurons similar to those used to model human adaptation. This enables machine co-adaptation to locally improve myoelectric control, and to absorb more challenging perturbations.

SIGNIFICANCE

The simplified context used here enabled to explore co-adaptation settings in both simulations and experiments, and to raise important considerations such as the need for a variable gain encoded locally. The benefits and limits of extending this approach to more complex and functional myoelectric contexts are discussed.

Effect of User Practice on Prosthetic Finger Control With an Intuitive Myoelectric Decoder

Machine learning-based myoelectric control is regarded as an intuitive paradigm, because of the mapping it creates between muscle co-activation patterns and prosthesis movements that aims to simulate the physiological pathways found in the human arm. Despite that, there has been evidence that closed-loop interaction with a classification-based interface results in user adaptation, which leads to performance improvement with experience. Recently, there has been a focus shift toward continuous prosthesis control, yet little is known about whether and how user adaptation affects myoelectric control performance in dexterous, intuitive tasks. We investigate the effect of short-term adaptation with independent finger position control by conducting real-time experiments with 10 able-bodied and two transradial amputee subjects. We demonstrate that despite using an intuitive decoder, experience leads to significant improvements in performance. We argue that this is due to the lack of an utterly natural control scheme, which is mainly caused by differences in the anatomy of human and artificial hands, movement intent decoding inaccuracies, and lack of proprioception. Finally, we extend previous work in classification-based and wrist continuous control by verifying that offline analyses cannot reliably predict real-time performance, thereby reiterating the importance of validating myoelectric control algorithms with real-time experiments.

The human sensorimotor cortex fosters muscle synergies through cortico-synergy coherence

In neuromotor control, the dimensionality of complex muscular activation patterns is effectively reduced through the emergence of muscle synergies. Muscle synergies are tailored to task-specific biomechanical needs. Traditionally, they are considered as low-dimensional neural output of the spinal cord and as such their coherent cortico-muscular pathways have remained underexplored in humans. We investigated whether muscle synergies have a higher-order origin, especially, whether they are manifest in the cortical motor network. We focused on cortical muscle synergy representations involved in balance control and examined changes in cortico-synergy coherence accompanying short-term balance training. We acquired electromyography and electro-encephalography and reconstructed cortical source activity using adaptive spatial filters. The latter were based on three muscle synergies decomposed from the activity of nine unilateral leg muscles using non-negative matrix factorization. The corresponding cortico-synergy coherence displayed phase-locked activity at the Piper rhythm, i.e., cortico-spinal synchronization around 40 Hz. Our study revealed the presence of muscle synergies in the motor cortex, in particular, in the paracentral lobule, known for the representation of lower extremities. We conclude that neural oscillations synchronize between the motor cortex and spinal motor neuron pools signifying muscle synergies. The corresponding cortico-synergy coherence around the Piper rhythm decreases with training-induced balance improvement.

Data Driven Spatial Filtering Can Enhance Abstract Myoelectric Control in Amputees

Myoelectric control based on multi-sensor techniques can provide an enhanced signal to noise ratio but increases hardware cost and complexity. Sensor arrays are also attractive in a prosthetics context when exact muscle positions are unknown, such as may be the case after limb loss. We present preliminary data obtained while four amputee participants engaged in an abstract myoelectric decoding task. The decoder was controlled by muscles of the forearm or upper arm depending on the level of limb loss. We compare performance using a pair of surface electromyography sensors and while using a data driven weighting of eight sensors. Performance rates demonstrate that amputee participants are able to learn the myoelectric task. Results trend strongly toward enhanced performance when using multiple spatially weighted sensors. Further studies are required to test whether the use of additional myoelectric sensing hardware in abstract decoding would lead to effective prosthesis control.

Spasms after spinal cord injury show low-frequency intermuscular coherence

Intermuscular coherence allows the investigation of common input to muscle groups. Although beta-band (15–30 Hz) intermuscular coherence is well understood as originating from the cortex, the source of intermuscular coherence at lower frequencies is still unclear. We used a wearable device that recorded electromyographic (EMG) signals during a 24-h period in four lower limb muscles of seven spinal cord injury patients (American Spinal Cord Injury Association impairment scale: A, 6 subjects; B, 1 subject) while they went about their normal daily life activities. We detected natural spasms occurring during these long-lasting recordings and calculated intermuscular coherence between all six possible combinations of muscle pairs. There was significant intermuscular coherence at low frequencies, between 2 and 13 Hz. The most likely source for this was the spinal cord and its peripheral feedback loops, because the spinal lesions in these patients had interrupted connections to supraspinal structures. This is the first report to demonstrate that the spinal cord is capable of producing low-frequency intermuscular coherence with severely reduced or abolished descending drive.

NEW & NOTEWORTHY This is the first report to demonstrate that intermuscular coherence between lower limb muscles at low frequencies can be produced by the spinal cord with severely reduced or abolished descending drive.

A Classification Method for Myoelectric Control of Hand Prostheses Inspired by Muscle Coordination

Dexterous upper limb myoelectric prostheses can, to some extent, restore the motor functions lost after an amputation. However, ensuring the reliability of myoelectric control is still an open challenge. In this paper, we propose a classification method that exploits the regularity in muscle activation patterns (uniform scaling) across different force levels within a given movement class. This assumption leads to a simple training procedure, using training data collected at single contraction intensity for each movement class. The proposed method was compared to the widely accepted benchmark [linear discriminant analysis (LDA) classifier] using off-line and online evaluation. The off-line classification errors obtained with the new method were either lower or higher than LDA depending upon the chosen feature set. In the online evaluation, the new classification method was operated using amplitude-EMG features and compared to the state-of-the-art LDA classifier combined with the time domain feature set. The online evaluation was performed in 11 able-bodied and one amputee subject using a set of four functional tasks mimicking daily-life activities. The tasks assessed the dexterity (e.g., switching between functions) and robustness of control (e.g., handling heavy objects). With the new classification scheme, the amputee performed better in all functional tasks, whereas the able-bodied subjects performed significantly better in three out of four functional tasks. Overall, the novel method outperformed the state-of-the-art approach (LDA) while utilizing less training data and a smaller feature set. The proposed method is, therefore, a simple but effective and robust classification scheme, convenient for online implementation and clinical use.

Abstract Decoding using Bayesian Muscle Activation Estimators

Two recursive Bayesian muscle activation estimators were compared against standard linear filtering during use of a myoelectric abstract decoder. The decoder was controlled by intrinsic muscles of the hand. In both experiments the linear filter outperformed the Bayesian methods in terms of general score. The Bayesian muscle decoders were faster to respond to changes in muscle activity and show promise for significantly enhancing overall decoder communication rate.

Myoelectric control with abstract decoders

OBJECTIVE

The objective of this study was to compare the use of muscles appropriate for partial-hand prostheses with those typically used for complete hand devices and to determine whether differences in their underlying neural substrates translate to different levels of myoelectric control.

APPROACH

We developed a novel abstract myoelectric decoder based on motor learning. Three muscle pairs, namely, an intrinsic and independent, an intrinsic and synergist and finally, an extrinsic and antagonist, were tested during abstract myoelectric control. Feedback conditions probed the roles of feed-forward and feedback mechanisms.

RESULTS

Both performance levels and rates of improvement were significantly higher for intrinsic hand muscles relative to muscles of the forearm. Intrinsic hand muscles showed considerable improvement generalising to decoder use without visual feedback. Results indicate that visual feedback from the decoder is used for transitioning between muscle activity levels, but not for maintaining state. Both individual and group performance were found to be strongly related to motor variability.

SIGNIFICANCE

Physiological differences inherent to the hand muscles can translate to improved prosthesis control. Our results support the use of motor learning based techniques for upper-limb myoelectric control and strongly argues for their utility in control of partial-hand prostheses. We provide evidence of myoelectric control skill acquisition and offer a formal definition for abstract decoding in the context of prosthetic control.

A Systematic Review on Muscle Synergies: From Building Blocks of Motor Behavior to a Neurorehabilitation Tool

The central nervous system (CNS) is believed to utilize specific predefined modules, called muscle synergies (MS), to accomplish a motor task. Yet questions persist about how the CNS combines these primitives in different ways to suit the task conditions. The MS hypothesis has been a subject of debate as to whether they originate from neural origins or nonneural constraints. In this review article, we present three aspects related to the MS hypothesis: (1) the experimental and computational evidence in support of the existence of MS, (2) algorithmic approaches for extracting them from surface electromyography (EMG) signals, and (3) the possible role of MS as a neurorehabilitation tool. We note that recent advances in computational neuroscience have utilized the MS hypothesis in motor control and learning. Prospective advances in clinical, medical, and engineering sciences and in fields such as robotics and rehabilitation stand to benefit from a more thorough understanding of MS.

Space-by-Time Modular Decomposition Effectively Describes Whole-Body Muscle Activity During Upright Reaching in Various Directions

The modular control hypothesis suggests that motor commands are built from precoded modules whose specific combined recruitment can allow the performance of virtually any motor task. Despite considerable experimental support, this hypothesis remains tentative as classical findings of reduced dimensionality in muscle activity may also result from other constraints (biomechanical couplings, data averaging or low dimensionality of motor tasks). Here we assessed the effectiveness of modularity in describing muscle activity in a comprehensive experiment comprising 72 distinct point-to-point whole-body movements during which the activity of 30 muscles was recorded. To identify invariant modules of a temporal and spatial nature, we used a space-by-time decomposition of muscle activity that has been shown to encompass classical modularity models. To examine the decompositions, we focused not only on the amount of variance they explained but also on whether the task performed on each trial could be decoded from the single-trial activations of modules. For the sake of comparison, we confronted these scores to the scores obtained from alternative non-modular descriptions of the muscle data. We found that the space-by-time decomposition was effective in terms of data approximation and task discrimination at comparable reduction of dimensionality. These findings show that few spatial and temporal modules give a compact yet approximate representation of muscle patterns carrying nearly all task-relevant information for a variety of whole-body reaching movements.

Evidence for sparse synergies in grasping actions

Converging evidence shows that hand-actions are controlled at the level of synergies and not single muscles. One intriguing aspect of synergy-based action-representation is that it may be intrinsically sparse and the same synergies can be shared across several distinct types of hand-actions. Here, adopting a normative angle, we consider three hypotheses for hand-action optimal-control: sparse-combination hypothesis (SC) – sparsity in the mapping between synergies and actions - i.e., actions implemented using a sparse combination of synergies; sparse-elements hypothesis (SE) – sparsity in synergy representation – i.e., the mapping between degrees-of-freedom (DoF) and synergies is sparse; double-sparsity hypothesis (DS) – a novel view combining both SC and SE – i.e., both the mapping between DoF and synergies and between synergies and actions are sparse, each action implementing a sparse combination of synergies (as in SC), each using a limited set of DoFs (as in SE). We evaluate these hypotheses using hand kinematic data from six human subjects performing nine different types of reach-to-grasp actions. Our results support DS, suggesting that the best action representation is based on a relatively large set of synergies, each involving a reduced number of degrees-of-freedom, and that distinct sets of synergies may be involved in distinct tasks.

On neuromechanical approaches for the study of biological and robotic grasp and manipulation

Biological and robotic grasp and manipulation are undeniably similar at the level of mechanical task performance. However, their underlying fundamental biological vs. engineering mechanisms are, by definition, dramatically different and can even be antithetical. Even our approach to each is diametrically opposite: inductive science for the study of biological systems vs. engineering synthesis for the design and construction of robotic systems. The past 20 years have seen several conceptual advances in both fields and the quest to unify them. Chief among them is the reluctant recognition that their underlying fundamental mechanisms may actually share limited common ground, while exhibiting many fundamental differences. This recognition is particularly liberating because it allows us to resolve and move beyond multiple paradoxes and contradictions that arose from the initial reasonable assumption of a large common ground. Here, we begin by introducing the perspective of neuromechanics, which emphasizes that real-world behavior emerges from the intimate interactions among the physical structure of the system, the mechanical requirements of a task, the feasible neural control actions to produce it, and the ability of the neuromuscular system to adapt through interactions with the environment. This allows us to articulate a succinct overview of a few salient conceptual paradoxes and contradictions regarding under-determined vs. over-determined mechanics, under- vs. over-actuated control, prescribed vs. emergent function, learning vs. implementation vs. adaptation, prescriptive vs. descriptive synergies, and optimal vs. habitual performance. We conclude by presenting open questions and suggesting directions for future research. We hope this frank and open-minded assessment of the state-of-the-art will encourage and guide these communities to continue to interact and make progress in these important areas at the interface of neuromechanics, neuroscience, rehabilitation and robotics.

Effects of hand configuration on muscle force coordination, co-contraction and concomitant intermuscular coupling during maximal isometric flexion of the fingers

PURPOSE

The mechanisms governing the control of musculoskeletal redundancy remain to be fully understood. The hand is highly redundant, and shows different functional role of extensors according to its configuration for a same functional task of finger flexion. Through intermuscular coherence analysis combined with hand musculoskeletal modelling during maximal isometric hand contractions, our aim was to better understand the neural mechanisms underlying the control of muscle force coordination and agonist-antagonist co-contraction.

METHODS

Thirteen participants performed maximal isometric flexions of the fingers in two configurations: power grip (Power) and finger-pressing on a surface (Press). Hand kinematics and force/moment measurements were used as inputs in a musculoskeletal model of the hand to determine muscular tensions and co-contraction. EMG-EMG coherence analysis was performed between wrist and finger flexors and extensor muscle pairs in alpha, beta and gamma frequency bands.

RESULTS

Concomitantly with tailored muscle force coordination and increased co-contraction between Press and Power (mean difference: 48.08%; p < 0.05), our results showed muscle-pair-specific modulation of intermuscular coupling, characterized by pair-specific modulation of EMG-EMG coherence between Power and Press (p < 0.05), and a negative linear association between co-contraction and intermuscular coupling for the ECR/FCR agonist-antagonist muscle pair (r = - 0.65; p < 0.05).

CONCLUSIONS

This study brings new evidence that pair-specific modulation of EMG-EMG coherence is related to modulation of muscle force coordination during hand contractions. Our results highlight the functional importance of intermuscular coupling as a mechanism contributing to the control of muscle force synergies and agonist-antagonist co-contraction.

Improved prosthetic hand control with concurrent use of myoelectric and inertial measurements

Background

Myoelectric pattern recognition systems can decode movement intention to drive upper-limb prostheses. Despite recent advances in academic research, the commercial adoption of such systems remains low. This limitation is mainly due to the lack of classification robustness and a simultaneous requirement for a large number of electromyogram (EMG) electrodes. We propose to address these two issues by using a multi-modal approach which combines surface electromyography (sEMG) with inertial measurements (IMs) and an appropriate training data collection paradigm. We demonstrate that this can significantly improve classification performance as compared to conventional techniques exclusively based on sEMG signals.

Methods

We collected and analyzed a large dataset comprising recordings with 20 able-bodied and two amputee participants executing 40 movements. Additionally, we conducted a novel real-time prosthetic hand control experiment with 11 able-bodied subjects and an amputee by using a state-of-the-art commercial prosthetic hand. A systematic performance comparison was carried out to investigate the potential benefit of incorporating IMs in prosthetic hand control.

Results

The inclusion of IM data improved performance significantly, by increasing classification accuracy (CA) in the offline analysis and improving completion rates (CRs) in the real-time experiment. Our findings were consistent across able-bodied and amputee subjects. Integrating the sEMG electrodes and IM sensors within a single sensor package enabled us to achieve high-level performance by using on average 4-6 sensors.

Conclusions

The results from our experiments suggest that IMs can form an excellent complimentary source signal for upper-limb myoelectric prostheses. We trust that multi-modal control solutions have the potential of improving the usability of upper-extremity prostheses in real-life applications.

Electronic supplementary material

The online version of this article (doi:10.1186/s12984-017-0284-4) contains supplementary material, which is available to authorized users.

Intermuscular coherence reflects functional coordination

Coherence analysis has the ability to identify the presence of common descending drive shared by motor unit pools and reveals its spectral properties. However, the link between spectral properties of shared neural drive and functional interactions among muscles remains unclear. We assessed shared neural drive between muscles of the thumb and index finger while participants executed two mechanically distinct precision pinch tasks, each requiring distinct functional coordination among muscles. We found that shared neural drive was systematically reduced or enhanced at specific frequencies of interest (~10 and ~40 Hz). While amplitude correlations between surface EMG signals also exhibited changes across tasks, only their coherence has strong physiological underpinnings indicative of neural binding. Our results support the use of intermuscular coherence as a tool to detect when coactivated muscles are members of a functional group or synergy of neural origin. Furthermore, our results demonstrate the advantages of considering neural binding at 10, ~20, and >30 Hz, as indicators of task-dependent neural coordination strategies.NEW & NOTEWORTHY It is often unclear whether correlated activity among muscles reflects their neural binding or simply reflects the constraints defining the task. Using the fact that high-frequency coherence between EMG signals (>6 Hz) is thought to reflect shared neural drive, we demonstrate that coherence analysis can reveal the neural origin of distinct muscle coordination patterns required by different tasks.

Deep learning-based artificial vision for grasp classification in myoelectric hands

OBJECTIVE

Computer vision-based assistive technology solutions can revolutionise the quality of care for people with sensorimotor disorders. The goal of this work was to enable trans-radial amputees to use a simple, yet efficient, computer vision system to grasp and move common household objects with a two-channel myoelectric prosthetic hand.

APPROACH

We developed a deep learning-based artificial vision system to augment the grasp functionality of a commercial prosthesis. Our main conceptual novelty is that we classify objects with regards to the grasp pattern without explicitly identifying them or measuring their dimensions. A convolutional neural network (CNN) structure was trained with images of over 500 graspable objects. For each object, 72 images, at [Formula: see text] intervals, were available. Objects were categorised into four grasp classes, namely: pinch, tripod, palmar wrist neutral and palmar wrist pronated. The CNN setting was first tuned and tested offline and then in realtime with objects or object views that were not included in the training set.

MAIN RESULTS

The classification accuracy in the offline tests reached [Formula: see text] for the seen and [Formula: see text] for the novel objects; reflecting the generalisability of grasp classification. We then implemented the proposed framework in realtime on a standard laptop computer and achieved an overall score of [Formula: see text] in classifying a set of novel as well as seen but randomly-rotated objects. Finally, the system was tested with two trans-radial amputee volunteers controlling an i-limb Ultra^TM prosthetic hand and a motion control^TM prosthetic wrist; augmented with a webcam. After training, subjects successfully picked up and moved the target objects with an overall success of up to [Formula: see text]. In addition, we show that with training, subjects' performance improved in terms of time required to accomplish a block of 24 trials despite a decreasing level of visual feedback.

SIGNIFICANCE

The proposed design constitutes a substantial conceptual improvement for the control of multi-functional prosthetic hands. We show for the first time that deep-learning based computer vision systems can enhance the grip functionality of myoelectric hands considerably.

Beta Band Corticomuscular Drive Reflects Muscle Coordination Strategies

During force production, hand muscle activity is known to be coherent with activity in primary motor cortex, specifically in the beta-band (15–30 Hz) frequency range. It is not clear, however, if this coherence reflects the control strategy selected by the nervous system for a given task, or if it instead reflects an intrinsic property of cortico-spinal communication. Here, we measured corticomuscular and intermuscular coherence between muscles of index finger and thumb while a two-finger pinch grip of identical net force was applied to objects which were either stable (allowing synergistic activation of finger muscles) or unstable (requiring individuated finger control). We found that beta-band corticomuscular coherence with the first dorsal interosseous (FDI) and abductor pollicis brevis (APB) muscles, as well as their beta-band coherence with each other, was significantly reduced when individuated control of the thumb and index finger was required. We interpret these findings to show that beta-band coherence is reflective of a synergistic control strategy in which the cortex binds task-related motor neurons into functional units.

High-Frequency Intermuscular Coherence between Arm Muscles during Robot-Mediated Motor Adaptation

Adaptation of arm reaching in a novel force field involves co-contraction of upper limb muscles, but it is not known how the co-ordination of multiple muscle activation is orchestrated. We have used intermuscular coherence (IMC) to test whether a coherent intermuscular coupling between muscle pairs is responsible for novel patterns of activation during adaptation of reaching in a force field. Subjects (N = 16) performed reaching trials during a null force field, then during a velocity-dependent force field and then again during a null force field. Reaching trajectory error increased during early adaptation to the force-field and subsequently decreased during later adaptation. Co-contraction in the majority of all possible muscle pairs also increased during early adaptation and decreased during later adaptation. In contrast, IMC increased during later adaptation and only in a subset of muscle pairs. IMC consistently occurred in frequencies between ~40–100 Hz and during the period of arm movement, suggesting that a coherent intermuscular coupling between those muscles contributing to adaptation enable a reduction in wasteful co-contraction and energetic cost during reaching.

Rapid control and feedback rates enhance neuroprosthetic control

Brain-machine interfaces (BMI) create novel sensorimotor pathways for action. Much as the sensorimotor apparatus shapes natural motor control, the BMI pathway characteristics may also influence neuroprosthetic control. Here, we explore the influence of control and feedback rates, where control rate indicates how often motor commands are sent from the brain to the prosthetic, and feedback rate indicates how often visual feedback of the prosthetic is provided to the subject. We developed a new BMI that allows arbitrarily fast control and feedback rates, and used it to dissociate the effects of each rate in two monkeys. Increasing the control rate significantly improved control even when feedback rate was unchanged. Increasing the feedback rate further facilitated control. We also show that our high-rate BMI significantly outperformed state-of-the-art methods due to higher control and feedback rates, combined with a different point process mathematical encoding model. Our BMI paradigm can dissect the contribution of different elements in the sensorimotor pathway, providing a unique tool for studying neuroprosthetic control mechanisms.

A Quaternion Weighted Fourier Linear Combiner for Modeling Physiological Tremor

GOAL

This paper offers a new approach to model physiological tremor aiming at attenuating undesired vibrations of the tip of microsurgical instruments.

METHOD

Several tremor modeling algorithms, such as the weighted Fourier linear combiner (wFLC), have proved effective. They, however, treat the three-dimensional (3-D) tremor signal as three independent 1-D signals in the x-, y-, and z-axes. In addition, the force f by which a surgeon holds the instrument has never been taken into account in modeling. Hence, conventional algorithms are inherently blind to any potential multidimensional couplings.

RESULTS

We first show that there exists statistically significant subject- and task-dependent coherence between data in the x-, y-, z -, and f-axes. We hypothesize that a filter that models the tremor in 4-D ( x , y, z, and f ) yields a more accurate model of tremor. We, therefore, developed a quaternion version of the wFLC algorithm and termed it QwFLC. We tested the proposed QwFLC algorithm with real physiological tremor data that were recorded from five novice subjects and four experienced microsurgeons. Although compared to wFLC, QwFLC requires six times larger computational resources, we showed that QwFLC can improve the modeling by up to 67% and that the improvement is proportional to the total coherence between the tremor in xyz and the force signal.

CONCLUSION

By taking into account interactions of the 3-D tremor and the force data, the tremor modeling performance enhances significantly.

Functional connectivity in the neuromuscular system underlying bimanual coordination

Neural synchrony has been suggested as a mechanism for integrating distributed sensorimotor systems involved in coordinated movement. To test the role of corticomuscular and intermuscular coherence in bimanual coordination, we experimentally manipulated the degree of coordination between hand muscles by varying the sensitivity of the visual feedback to differences in bilateral force. In 16 healthy participants, cortical activity was measured using EEG and muscle activity of the flexor pollicis brevis of both hands using high-density electromyography (HDsEMG). Using the uncontrolled manifold framework, coordination between bilateral forces was quantified by the synergy index R_V in the time and frequency domain. Functional connectivity was assessed using corticomuscular coherence between muscle activity and cortical source activity and intermuscular coherence between bilateral EMG activity. The synergy index increased in the high coordination condition. R_V was higher in the high coordination condition in frequencies between 0 and 0.5 Hz; for the 0.5- to 2-Hz frequency band, this pattern was inverted. Corticomuscular coherence in the beta band (16-30 Hz) was maximal in the contralateral motor cortex and was reduced in the high coordination condition. In contrast, intermuscular coherence was observed at 5-12 Hz and increased with bimanual coordination. Within-subject comparisons revealed a negative correlation between R_V and corticomuscular coherence and a positive correlation between R_V and intermuscular coherence. Our findings suggest two distinct neural pathways: 1) corticomuscular coherence reflects direct corticospinal projections involved in controlling individual muscles; and 2) intermuscular coherence reflects diverging pathways involved in the coordination of multiple muscles.

Long-Term Stability of Motor Cortical Activity: Implications for Brain Machine Interfaces and Optimal Feedback Control

The human motor system is capable of remarkably precise control of movements--consider the skill of professional baseball pitchers or surgeons. This precise control relies upon stable representations of movements in the brain. Here, we investigated the stability of cortical activity at multiple spatial and temporal scales by recording local field potentials (LFPs) and action potentials (multiunit spikes, MSPs) while two monkeys controlled a cursor either with their hand or directly from the brain using a brain-machine interface. LFPs and some MSPs were remarkably stable over time periods ranging from 3 d to over 3 years; overall, LFPs were significantly more stable than spikes. We then assessed whether the stability of all neural activity, or just a subset of activity, was necessary to achieve stable behavior. We showed that projections of neural activity into the subspace relevant to the task (the "task-relevant space") were significantly more stable than were projections into the task-irrelevant (or "task-null") space. This provides cortical evidence in support of the minimum intervention principle, which proposes that optimal feedback control (OFC) allows the brain to tightly control only activity in the task-relevant space while allowing activity in the task-irrelevant space to vary substantially from trial to trial. We found that the brain appears capable of maintaining stable movement representations for extremely long periods of time, particularly so for neural activity in the task-relevant space, which agrees with OFC predictions.

SIGNIFICANCE STATEMENT

It is unknown whether cortical signals are stable for more than a few weeks. Here, we demonstrate that motor cortical signals can exhibit high stability over several years. This result is particularly important to brain-machine interfaces because it could enable stable performance with infrequent recalibration. Although we can maintain movement accuracy over time, movement components that are unrelated to the goals of a task (such as elbow position during reaching) often vary from trial to trial. This is consistent with the minimum intervention principle of optimal feedback control. We provide evidence that the motor cortex acts according to this principle: cortical activity is more stable in the task-relevant space and more variable in the task-irrelevant space.

Greater intermanual transfer in the elderly suggests age-related bilateral motor cortex activation is compensatory

ABSTRACT. Hemispheric lateralization of movement control diminishes with age; whether this is compensatory or maladaptive is debated. The authors hypothesized that if compensatory, bilateral activation would lead to greater intermanual transfer in older subjects learning tasks that activate the cortex unilaterally in young adults. They studied 10 young and 14 older subjects, learning a unimanual visuomotor task comprising a feedforward phase, where there is unilateral cortical activation in young adults, and a feedback phase, which activates the cortex bilaterally in both age groups. Increased intermanual transfer was demonstrated in older subjects during feedforward learning, with no difference between groups during feedback learning. This finding is consistent with bilateral cortical activation being compensatory to maintain performance despite declining computational efficiency in neural networks.