Neural bases of hand synergies

Biomimetic learning of hand gestures in a humanoid robot

Hand gestures are a natural and intuitive form of communication, and integrating this communication method into robotic systems presents significant potential to improve human-robot collaboration. Recent advances in motor neuroscience have focused on replicating human hand movements from synergies also known as movement primitives. Synergies, fundamental building blocks of movement, serve as a potential strategy adapted by the central nervous system to generate and control movements. Identifying how synergies contribute to movement can help in dexterous control of robotics, exoskeletons, prosthetics and extend its applications to rehabilitation. In this paper, 33 static hand gestures were recorded through a single RGB camera and identified in real-time through the MediaPipe framework as participants made various postures with their dominant hand. Assuming an open palm as initial posture, uniform joint angular velocities were obtained from all these gestures. By applying a dimensionality reduction method, kinematic synergies were obtained from these joint angular velocities. Kinematic synergies that explain 98% of variance of movements were utilized to reconstruct new hand gestures using convex optimization. Reconstructed hand gestures and selected kinematic synergies were translated onto a humanoid robot, Mitra, in real-time, as the participants demonstrated various hand gestures. The results showed that by using only few kinematic synergies it is possible to generate various hand gestures, with 95.7% accuracy. Furthermore, utilizing low-dimensional synergies in control of high dimensional end effectors holds promise to enable near-natural human-robot collaboration.

A tensor decomposition reveals ageing-induced differences in muscle and grip-load force couplings during object lifting

Do motor patterns of object lifting movements change as a result of ageing? Here we propose a methodology for the characterization of these motor patterns across individuals of different age groups. Specifically, we employ a bimanual grasp-lift-replace protocol with younger and older adults and combine measurements of muscle activity with grip and load forces to provide a window into the motor strategies supporting effective object lifts. We introduce a tensor decomposition to identify patterns of muscle activity and grip-load force ratios while also characterizing their temporal profiles and relative activation across object weights and participants of different age groups. We then probe age-induced changes in these components. A classification analysis reveals three motor components that are differentially recruited between the two age groups. Linear regression analyses further show that advanced age and poorer manual dexterity can be predicted by the coupled activation of forearm and hand muscles which is associated with high levels of grip force. Our findings suggest that ageing may induce stronger muscle couplings in distal aspects of the upper limbs, and a less economic grasping strategy to overcome age-related decline in manual dexterity.

Kinematic synergies show good consistency when extracted with a low-cost markerless device and a marker-based motion tracking system

Recently, markerless tracking systems, such as RGB-Depth cameras, have spread to overcome some of the limitations of the gold standard marker-based tracking systems. Although these systems are valuable substitutes for human motion analysis, as they guarantee higher flexibility, faster setup time and lower costs, their tracking accuracy is lower with respect to marker-based systems. Many studies quantified the error made by markerless systems in terms of body segment length estimation, articular angles, and biomechanics, concluding that they are appropriate for many clinical applications related to motion analysis. We propose an innovative approach to compare a markerless tracking system (Kinect V2) with a gold standard marker-based system (Vicon), based on motor control assessment. We quantified kinematic synergies from the tracking data of fifteen participants performing multi-directional upper limb movements. Kinematic synergy analysis decomposes the kinematic data into a reduced set of motor primitives that describe how the central nervous system coordinates motion at spatial and temporal level. Synergies were extracted with the recently released mixed-matrix factorization algorithm. Four synergies were extracted from both marker-based and markerless datasets and synergies were grouped in 6 clusters for each dataset. Cosine similarity in each cluster was ⩾0.60 in both systems, showing good consistency of synergies. Good matching was found between synergies extracted from markerless and from marker-based data, with a cosine similarity between matched synergies ⩾0.60 in 5 out 6 synergies. These results showed that the markerless sensor can be feasible for kinematic synergy analysis for gross movements, as it correctly estimates the number of synergies and in most cases also their spatial and temporal organization.

Static and Dynamic Hand Gestures: A Review of Techniques of Virtual Reality Manipulation

This review explores the historical and current significance of gestures as a universal form of communication with a focus on hand gestures in virtual reality applications. It highlights the evolution of gesture detection systems from the 1990s, which used computer algorithms to find patterns in static images, to the present day where advances in sensor technology, artificial intelligence, and computing power have enabled real-time gesture recognition. The paper emphasizes the role of hand gestures in virtual reality (VR), a field that creates immersive digital experiences through the Ma blending of 3D modeling, sound effects, and sensing technology. This review presents state-of-the-art hardware and software techniques used in hand gesture detection, primarily for VR applications. It discusses the challenges in hand gesture detection, classifies gestures as static and dynamic, and grades their detection difficulty. This paper also reviews the haptic devices used in VR and their advantages and challenges. It provides an overview of the process used in hand gesture acquisition, from inputs and pre-processing to pose detection, for both static and dynamic gestures.

Arm muscle synergies enhance hand posture prediction in combination with forearm muscle synergies

Objective.We analyze and interpret arm and forearm muscle activity in relation with the kinematics of hand pre-shaping during reaching and grasping from the perspective of human synergistic motor control.Approach.Ten subjects performed six tasks involving reaching, grasping and object manipulation. We recorded electromyographic (EMG) signals from arm and forearm muscles with a mix of bipolar electrodes and high-density grids of electrodes. Motion capture was concurrently recorded to estimate hand kinematics. Muscle synergies were extracted separately for arm and forearm muscles, and postural synergies were extracted from hand joint angles. We assessed whether activation coefficients of postural synergies positively correlate with and can be regressed from activation coefficients of muscle synergies. Each type of synergies was clustered across subjects.Main results.We found consistency of the identified synergies across subjects, and we functionally evaluated synergy clusters computed across subjects to identify synergies representative of all subjects. We found a positive correlation between pairs of activation coefficients of muscle and postural synergies with important functional implications. We demonstrated a significant positive contribution in the combination between arm and forearm muscle synergies in estimating hand postural synergies with respect to estimation based on muscle synergies of only one body segment, either arm or forearm (p< 0.01). We found that dimensionality reduction of multi-muscle EMG root mean square (RMS) signals did not significantly affect hand posture estimation, as demonstrated by comparable results with regression of hand angles from EMG RMS signals.Significance.We demonstrated that hand posture prediction improves by combining activity of arm and forearm muscles and we evaluate, for the first time, correlation and regression between activation coefficients of arm muscle and hand postural synergies. Our findings can be beneficial for myoelectric control of hand prosthesis and upper-limb exoskeletons, and for biomarker evaluation during neurorehabilitation.

Effects of Transcutaneous Electrical Nerve Stimulation with Taping on Wrist Spasticity, Strength, and Upper Extremity Function in Patients with Stroke: A Randomized Control Trial

Objective: Six months after the onset of stroke, over 60% of patients experience upper limb dysfunction, with spasticity being a major contributor alongside muscle weakness. This study investigated the effect of transcutaneous electrical nerve stimulation (TENS) with taping on wrist spasticity, strength, and upper extremity function in patients with stroke. Methods: In total, 40 patients with stroke were included and randomly divided into two groups: the TENS + taping (n = 20, age 52.4 ± 9.3 (range: 39 to 70)) and TENS (n = 20, age 53.5 ± 10.8 (range: 39 to 74)) groups. All subjects performed 30 sessions of task-related training, which included 10 min of postural control training and 20 min of task performance. Additionally, all subjects received TENS on the spastic muscle belly for 30 min before task-related training. In the TENS + taping group, taping was additionally applied to the forearm and wrist but not in the TENS group. The Modified Ashworth Scale was used to measure spasticity, and a handheld dynamometer was used to measure muscle strength. The Fugl-Meyer Assessment of Upper Extremity was used to evaluate the functional ability of the upper extremity. Results: In the TENS + taping group, spasticity and upper extremity function were significantly improved as compared to those in the TENS group (p < 0.05). However, no significant difference in muscle strength was observed between the two groups (p > 0.05). Conclusions: This study demonstrated that the combination of TENS and taping for spasticity and function of the upper extremity was more effective in relieving the spasticity than TENS alone. Therefore, we suggest this combination as an additional treatment for spasticity and function of the upper extremity.

Robust neural decoding for dexterous control of robotic hand kinematics

BACKGROUND

Manual dexterity is a fundamental motor skill that allows us to perform complex daily tasks. Neuromuscular injuries, however, can lead to the loss of hand dexterity. Although numerous advanced assistive robotic hands have been developed, we still lack dexterous and continuous control of multiple degrees of freedom in real-time. In this study, we developed an efficient and robust neural decoding approach that can continuously decode intended finger dynamic movements for real-time control of a prosthetic hand.

METHODS

High-density electromyogram (HD-EMG) signals were obtained from the extrinsic finger flexor and extensor muscles, while participants performed either single-finger or multi-finger flexion-extension movements. We implemented a deep learning-based neural network approach to learn the mapping from HD-EMG features to finger-specific population motoneuron firing frequency (i.e., neural-drive signals). The neural-drive signals reflected motor commands specific to individual fingers. The predicted neural-drive signals were then used to continuously control the fingers (index, middle, and ring) of a prosthetic hand in real-time.

RESULTS

Our developed neural-drive decoder could consistently and accurately predict joint angles with significantly lower prediction errors across single-finger and multi-finger tasks, compared with a deep learning model directly trained on finger force signals and the conventional EMG-amplitude estimate. The decoder performance was stable over time and was robust to variations of the EMG signals. The decoder also demonstrated a substantially better finger separation with minimal predicted error of joint angle in the unintended fingers.

CONCLUSIONS

This neural decoding technique offers a novel and efficient neural-machine interface that can consistently predict robotic finger kinematics with high accuracy, which can enable dexterous control of assistive robotic hands.

Quantifying Hand Strength and Isometric Pinch Individuation Using a Flexible Pressure Sensor Grid

Modulating force between the thumb and another digit, or isometric pinch individuation, is critical for daily tasks and can be impaired due to central or peripheral nervous system injury. Because surgical and rehabilitative efforts often focus on regaining this dexterous ability, we need to be able to consistently quantify pinch individuation across time and facilities. Currently, a standardized metric for such an assessment does not exist. Therefore, we tested whether we could use a commercially available flexible pressure sensor grid (Tekscan F-Socket [Tekscan Inc., Norwood, MA, USA]) to repeatedly measure isometric pinch individuation and maximum voluntary contraction (MVC) in twenty right-handed healthy volunteers at two visits. We developed a novel equation informed by the prior literature to calculate isometric individuation scores that quantified percentage of force on the grid generated by the indicated digit. MVC intra-class correlation coefficients (ICCs) for the left and right hands were 0.86 (p < 0.0001) and 0.88 (p < 0.0001), respectively, suggesting MVC measurements were consistent over time. However, individuation score ICCs, were poorer (left index ICC 0.41, p = 0.28; right index ICC -0.02, p = 0.51), indicating that this protocol did not provide a sufficiently repeatable individuation assessment. These data support the need to develop novel platforms specifically for repeatable and objective isometric hand dexterity assessments.

The spatio-temporal architecture of everyday manual behavior

In everyday activities, humans move alike to manipulate objects. Prior works suggest that hand movements are built by a limited set of basic building blocks consisting of a set of common postures. However, how the low dimensionality of hand movements supports the adaptability and flexibility of natural behavior is unknown. Through a sensorized glove, we collected kinematics data from thirty-six participants preparing and having breakfast in naturalistic conditions. By means of an unbiased analysis, we identified a repertoire of hand states. Then, we tracked their transitions over time. We found that manual behavior can be described in space through a complex organization of basic configurations. These, even in an unconstrained experiment, recurred across subjects. A specific temporal structure, highly consistent within the sample, seems to integrate such identified hand shapes to realize skilled movements. These findings suggest that the simplification of the motor commands unravels in the temporal dimension more than in the spatial one.

Sensing, Actuating, and Interacting Through Passive Body Dynamics: A Framework for Soft Robotic Hand Design

Robotic hands have long strived to reach the performance of human hands. The physical complexity and extraordinary capabilities of the human hand, in terms of sensing, actuation, and cognitive abilities, make achieving this goal challenging. At the heart of the physical structure of the hand is its' passive behaviors. Seen most clearly in soft robotic hands, these behaviors influence and affect the mechanical, sensing, and control functionalities. With this perspective, we present a framework through which passivity in robot hands can be understood, by concretely identifying the role of passivity in the design, fabrication, and control of soft hands. In this framework we focus on the interactions between the physical hand and the: environment, internal actuation, sensor morphology, and wrist control. Taking these surrounding systems away, we are left with a passive soft hand whose behaviors emerge from external interactions. Inspired by the human hand, we define the role of these four key interacting pillars and review how state-of-the art robot hands utilize these four elements to aid functionality. We show how these pillars promote hybrid soft-rigid hands with rich behaviors, providing benefits in terms of the increased adaptability to uncertain environments, improved scalability and reduction in the cost of actuation, sensing, and control. This review provides a conceptual framework for approaching hand design and analysis through consideration of the passive behaviors. This highlights not only the advances that can be made by approaching the problem in this way but also the outstanding challenges that stem from this outlook.

Distinct adaptation processes underlie multidigit force coordination for dexterous manipulation

The human sensorimotor system can adapt to various changes in the environmental dynamics by updating motor commands to improve performance after repeated exposure to the same task. However, the characteristics and mechanisms of the adaptation process remain unknown for dexterous manipulation, a unique motor task in which the body physically interacts with the environment with multiple effectors, i.e., digits, in parallel. We addressed this gap by using robotic manipulanda to investigate the changes in the digit force coordination following mechanical perturbation of an object held by tripod grasps. As the participants gradually adapted to lifting the object under perturbations, we quantified two components of digit force coordination. One is the direction-specific manipulation moment that directly counteracts the perturbation, whereas the other one is the direction-independent internal moment that supports the stability and stiffness of the grasp. We found that trial-to-trial improvement of task performance was associated with increased manipulation moment and a gradual decrease of the internal moment. These two moments were characterized by different rates of adaptation. We also examined how these two force coordination components respond to changes in perturbation directions. Importantly, we found that the manipulation moment was sensitive to the extent of repetitive exposure to the previous context that has an opposite perturbation direction, whereas the internal moment did not. However, the internal moment was sensitive to whether the postchange perturbation direction was previously experienced. Our results reveal, for the first time, that two distinct processes underlie the adaptation of multidigit force coordination for dexterous manipulation.NEW & NOTEWORTHY Changes in digit force coordination in multidigit object manipulation were quantified with a novel experimental design in which human participants adapted to mechanical perturbations applied to the object. Our results show that the adaptation of digit force coordination can be characterized by two distinct components that operate at different timescales. We further show that these two components respond to changes in perturbation direction differently.

Decomposition into dynamic features reveals a conserved temporal structure in hand kinematics

The human hand is a unique and highly complex effector. The ability to describe hand kinematics with a small number of features suggests that complex hand movements are composed of combinations of simpler movements. This would greatly simplify the neural control of hand movements. If such movement primitives exist, a dimensionality reduction approach designed to exploit these features should outperform existing methods. We developed a deep neural network to capture the temporal dynamics of movements and demonstrate that the features learned allow accurate representation of functional hand movements using lower-dimensional representations than previously reported. We show that these temporal features are highly conserved across individuals and can interpolate previously unseen movements, indicating that they capture the intrinsic structure of hand movements. These results indicate that functional hand movements are defined by a low-dimensional basis set of movement primitives with important temporal dynamics and that these features are common across individuals.

•

Hand movements are comprised of a low-dimensional set of movement primitives

•

Primitive movements have an important temporal component

•

Spatiotemporal movement primitives are conserved across individuals

•

New complex movements can be flexibly reconstructed using these primitives

Data Fusion-Based Musculoskeletal Synergies in the Grasping Hand

The hypothesis that the central nervous system (CNS) makes use of synergies or movement primitives in achieving simple to complex movements has inspired the investigation of different types of synergies. Kinematic and muscle synergies have been extensively studied in the literature, but only a few studies have compared and combined both types of synergies during the control and coordination of the human hand. In this paper, synergies were extracted first independently (called kinematic and muscle synergies) and then combined through data fusion (called musculoskeletal synergies) from 26 activities of daily living in 22 individuals using principal component analysis (PCA) and independent component analysis (ICA). By a weighted linear combination of musculoskeletal synergies, the recorded kinematics and the recorded muscle activities were reconstructed. The performances of musculoskeletal synergies in reconstructing the movements were compared to the synergies reported previously in the literature by us and others. The results indicate that the musculoskeletal synergies performed better than the synergies extracted without fusion. We attribute this improvement in performance to the musculoskeletal synergies that were generated on the basis of the cross-information between muscle and kinematic activities. Moreover, the synergies extracted using ICA performed better than the synergies extracted using PCA. These musculoskeletal synergies can possibly improve the capabilities of the current methodologies used to control high dimensional prosthetics and exoskeletons.

Handedness is associated with less common input to spinal motor neurons innervating different hand muscles

Whether the neural control of manual behaviours differs between the dominant and non-dominant hand is poorly understood. This study aimed to determine whether the level of common synaptic input to motor neurons innervating the same or different muscles differs between the dominant and the non-dominant hand. Seventeen participants performed two motor tasks with distinct mechanical requirements: an isometric pinch and an isometric rotation of a pinched dial. Each task was performed at 30% of maximum effort and was repeated with the dominant and non-dominant hand. Motor units were identified from two intrinsic (flexor digitorum interosseous and thenar) and one extrinsic muscle (flexor digitorum superficialis) from high-density surface electromyography recordings. Two complementary approaches were used to estimate common synaptic inputs. First, we calculated the coherence between groups of motor neurons from the same and from different muscles. Then, we estimated the common input for all pairs of motor neurons by correlating the low-frequency oscillations of their discharge rate. Both analyses led to the same conclusion, indicating less common synaptic input between motor neurons innervating different muscles in the dominant hand than in the non-dominant hand, which was only observed during the isometric rotation task. No between-side differences in common input were observed between motor neurons of the same muscle. This lower level of common input could confer higher flexibility in the recruitment of motor units, and therefore, in mechanical outputs. Whether this difference between the dominant and non-dominant arm is the cause or the consequence of handedness remains to be determined.

Reconstructing Synergy-Based Hand Grasp Kinematics from Electroencephalographic Signals

Brain-machine interfaces (BMIs) have become increasingly popular in restoring the lost motor function in individuals with disabilities. Several research studies suggest that the CNS may employ synergies or movement primitives to reduce the complexity of control rather than controlling each DoF independently, and the synergies can be used as an optimal control mechanism by the CNS in simplifying and achieving complex movements. Our group has previously demonstrated neural decoding of synergy-based hand movements and used synergies effectively in driving hand exoskeletons. In this study, ten healthy right-handed participants were asked to perform six types of hand grasps representative of the activities of daily living while their neural activities were recorded using electroencephalography (EEG). From half of the participants, hand kinematic synergies were derived, and a neural decoder was developed, based on the correlation between hand synergies and corresponding cortical activity, using multivariate linear regression. Using the synergies and the neural decoder derived from the first half of the participants and only cortical activities from the remaining half of the participants, their hand kinematics were reconstructed with an average accuracy above 70%. Potential applications of synergy-based BMIs for controlling assistive devices in individuals with upper limb motor deficits, implications of the results in individuals with stroke and the limitations of the study were discussed.

How the hand has shaped sign languages

In natural languages, biological constraints push toward cross-linguistic homogeneity while linguistic, cultural, and historical processes promote language diversification. Here, we investigated the effects of these opposing forces on the fingers and thumb configurations (handshapes) used in natural sign languages. We analyzed over 38,000 handshapes from 33 languages. In all languages, the handshape exhibited the same form of adaptation to biological constraints found in tasks for which the hand has naturally evolved (e.g., grasping). These results were not replicated in fingerspelling—another task where the handshape is used—thus revealing a signing-specific adaptation. We also showed that the handshape varies cross-linguistically under the effects of linguistic, cultural, and historical processes. Their effects could thus emerge even without departing from the demands of biological constraints. Handshape’s cross-linguistic variability consists in changes in the frequencies with which the most faithful handshapes to biological constraints appear in individual sign languages.

Unsupervised Myocontrol of a Virtual Hand Based on a Coadaptive Abstract Motor Mapping

Applications of simultaneous and proportional control for upper-limb prostheses typically rely on supervised machine learning to map muscle activations to prosthesis movements. This scheme often poses problems for individuals with limb differences, as they may not be able to reliably reproduce the training activations required to construct a natural motor mapping. We propose an unsupervised myocontrol paradigm that eliminates the need for labeled data by mapping the most salient muscle synergies in arbitrary order to a number of predefined prosthesis actions. The paradigm is coadaptive, in the sense that while the user learns to control the system via interaction, the system continually refines the identification of the user's muscular synergies. Our evaluation consisted of eight subjects without limb-loss performing target achievement control tasks of four actions of the hand and wrist. The subjects achieved comparable performance using the proposed unsupervised myocontrol paradigm and a supervised benchmark method, despite reporting increased mental load with the former.

Whole Body Coordination for Self-Assistance in Locomotion

The dynamics of the human body can be described by the accelerations and masses of the different body parts (e.g., legs, arm, trunk). These body parts can exhibit specific coordination patterns with each other. In human walking, we found that the swing leg cooperates with the upper body and the stance leg in different ways (e.g., in-phase and out-of-phase in vertical and horizontal directions, respectively). Such patterns of self-assistance found in human locomotion could be of advantage in robotics design, in the design of any assistive device for patients with movement impairments. It can also shed light on several unexplained infrastructural features of the CNS motor control. Self-assistance means that distributed parts of the body contribute to an overlay of functions that are required to solve the underlying motor task. To draw advantage of self-assisting effects, precise and balanced spatiotemporal patterns of muscle activation are necessary. We show that the necessary neural connectivity infrastructure to achieve such muscle control exists in abundance in the spinocerebellar circuitry. We discuss how these connectivity patterns of the spinal interneurons appear to be present already perinatally but also likely are learned. We also discuss the importance of these insights into whole body locomotion for the successful design of future assistive devices and the sense of control that they could ideally confer to the user.

Kinematic synergies in over-ground slip recovery outcomes: Distinct strategies or a single strategy?

BACKGROUND

After experiencing an unexpected slip perturbation, individuals' behavioral performance can be classified into three categories: recovery, feet-forward fall, and split fall. Researchers are uncertain whether these differences in slip outcomes are due to distinct strategies or part of a single strategy.

RESEARCH QUESTION

Whether older adults with different behavioral outcomes during their novel slip have different kinematic synergies?

METHODS

The kinematic synergies were extracted from segment angles in 87 participants using principal component analysis (PCA). The first two principal components (PC1 and PC2) in pre-slip, early-reactive, and late-reactive phases were compared across different slip outcomes.

RESULTS

Results showed that the kinematic synergies in pre-slip and early-reactive phases are highly consistent among the three outcomes (recovery, split fall, and feet-forward fall). For the late-reactive phase, both split falls and feet-forward falls showed different kinematics synergies from recoveries.

SIGNIFICANCE

Our findings indicated that a single strategy might be used for different slip outcomes in the pre-slip and early-reactive phases, while distinct strategies were used by fallers compared to recovered individuals. Specifically, larger trunk flexion in pre-slip phase, larger knee flexion and plantar flexion of the slipping limb in both early-reactive and late-reactive phase, and larger knee extension of the recovery limb in late-reactive phase would lower the fall risk. This study would help to assess the vulnerabilities in control strategy, according to which individualized treatment could be provided to reduce predisposition to specific types of falls.

Dynamical Synergies of Multidigit Hand Prehension

Hand prehension requires highly coordinated control of contact forces. The high-dimensional sensorimotor system of the human hand operates at ease, but poses several challenges when replicated in artificial hands. This paper investigates how the dynamical synergies, coordinated spatiotemporal patterns of contact forces, contribute to the hand grasp, and whether they could potentially capture the force primitives in a low-dimensional space. Ten right-handed subjects were recruited to grasp and hold mass-varied objects. The contact forces during this multidigit prehension were recorded using an instrumented grip glove. The dynamical synergies were derived using principal component analysis (PCA). The contact force patterns during the grasps were reconstructed using the first few synergies. The significance of the dynamical synergies, the influence of load forces and task configurations on the synergies were explained. This study also discussed the contribution of biomechanical constraints on the first few synergies and the current challenges and possible applications of the dynamical synergies in the design and control of exoskeletons. The integration of the dynamical synergies into exoskeletons will be realized in the near future.

Bio-Inspired Control System for Fingers Actuated by Multiple SMA Actuators

Spiking neural networks are able to control with high precision the rotation and force of single-joint robotic arms when shape memory alloy wires are used for actuation. Bio-inspired robotic arms such as anthropomorphic fingers include more junctions that are actuated simultaneously. Starting from the hypothesis that the motor cortex groups the control of multiple muscles into neural synergies, this work presents for the first time an SNN structure that is able to control a series of finger motions by activation of groups of neurons that drive the corresponding actuators in sequence. The initial motion starts when a command signal is received, while the subsequent ones are initiated based on the sensors’ output. In order to increase the biological plausibility of the control system, the finger is flexed and extended by four SMA wires connected to the phalanges as the main tendons. The results show that the artificial finger that is controlled by the SNN is able to smoothly perform several motions of the human index finger while the command signal is active. To evaluate the advantages of using SNN, we compared the finger behaviours when the SMA actuators are driven by SNN, and by a microcontroller, respectively. In addition, we designed an electronic circuit that models the sensor’s output in concordance with the SNN output.

A Model for Self-Organization of Sensorimotor Function: Spinal Interneuronal Integration

Control of musculoskeletal systems depends on integration of voluntary commands and somatosensory feedback in the complex neural circuits of the spinal cord. Particular connectivity patterns have been identified experimentally, and it has been suggested that these may result from the wide variety of transcriptional types that have been observed in spinal interneurons. We ask instead whether the details of these connectivity patterns (and perhaps many others) can arise as a consequence of Hebbian adaptation during early development. We constructed an anatomically simplified model plant system with realistic muscles and sensors and connected it to a recurrent, random neuronal network consisting of both excitatory and inhibitory neurons endowed with Hebbian learning rules. We then generated a wide set of randomized muscle twitches typical of those described during fetal development and allowed the network to learn. Multiple simulations consistently resulted in diverse and stable patterns of activity and connectivity that included subsets of the interneurons that were similar to 'archetypical' interneurons described in the literature. We also found that such learning led to an increased degree of cooperativity between interneurons when performing larger limb movements on which it had not been trained. Hebbian learning gives rise to rich sets of diverse interneurons whose connectivity reflects the mechanical properties of the plant. At least some of the transcriptomic diversity may reflect the effects of this process rather than the cause of the connectivity. Such a learning process seems better suited to respond to the musculoskeletal mutations that underlie the evolution of new species.

Diversified physiological sensory input connectivity questions the existence of distinct classes of spinal interneurons

The spinal cord is engaged in all forms of motor performance but its functions are far from understood. Because network connectivity defines function, we explored the connectivity of muscular, tendon, and tactile sensory inputs among a wide population of spinal interneurons in the lower cervical segments. Using low noise intracellular whole cell recordings in the decerebrated, non-anesthetized cat in vivo, we could define mono-, di-, and trisynaptic inputs as well as the weights of each input. Whereas each neuron had a highly specific input, and each indirect input could moreover be explained by inputs in other recorded neurons, we unexpectedly also found the input connectivity of the spinal interneuron population to form a continuum. Our data hence contrasts with the currently widespread notion of distinct classes of interneurons. We argue that this suggested diversified physiological connectivity, which likely requires a major component of circuitry learning, implies a more flexible functionality.

Execution of natural manipulation in the air enhances the beta-rhythm intermuscular coherences of the human arm depending on muscle pairs

Natural manipulation tasks in air consist of two kinematic components: a grasping component, with activation of the hand muscles, and a lifting component, with activation of the proximal muscles. However, it remains unclear whether the synchronized motor commands to the hand/proximal arm muscles are divergently controlled during the task. Therefore, we examined how intermuscular coherence was modulated depending on the muscle combinations during grip and lift (G&L) tasks. Electromyograms (EMGs) were recorded from the biceps brachii (BB), triceps brachii (TB), flexor digitorum superficialis (FDS), and extensor digitorum communis (EDC) muscles. The participants were required to maintain G&L tasks involving a small cubical box with the thumb and index and middle fingers. Consequently, we found that the beta-rhythm coherence (15-35 Hz) in BB-TB, BB-FDS, and TB-EDC pairs during G&L was significantly larger than that during the isolated task with cocontraction of the two target muscles but not BB-EDC, TB-FDS, and FDS-EDC (task and muscle pair specificities). These increases in beta-rhythm coherence were also observed in intramuscular EMG recordings. Furthermore, the results from the execution of several mimic G&L tasks revealed that the separated task-related motor signals and combinations between the motor signals/sensations of the fingertips or object load had minor contributions to the increase in the coherence. These results suggest that during G&L the central nervous system regulates synchronous drive onto motoneurons depending on the muscle pairs and that the multiple combination effect of the sensations of touch/object load and motor signals in the task promotes the synchrony of these pairs.NEW & NOTEWORTHY Natural manipulation in air consists of two kinematic components: grasping, with activation of hand muscles, and lifting, with activation of proximal muscles. We show that during the maintenance of object manipulation in air the central nervous system regulates the synchronous drive onto human motoneuron pools depending on the hand/proximal muscle pairs and that the multiple combination effect of the sensations of touch/object load and motor signals in the task promotes the synchrony of these pairs.

Modification of Hand Muscular Synergies in Stroke Patients after Robot-Aided Rehabilitation

The central nervous system (CNS) is able to control a very high number of degrees of freedom to perform complex movements of both upper and lower limbs. However, what strategies the CNS adopts to perform complex tasks are not completely clear and are still being studied. Recent studies confirm that stroke subjects with mild and moderate impairment show altered upper limb muscle patterns, but the muscular patterns of the hand have not completely investigated, although the hand represents a paramount tool for performing activities of daily living (ADLs) and stroke can significantly alter the mobilization of this part of the body. In this context, this study aims at investigating hand muscular synergies in chronic stroke patients and evaluating some possible benefits in the robot-aided rehabilitation treatment of the hand in these subjects. Seven chronic stroke patients with mild-to-moderate impairment (FM>30) were involved in this study. They received a 5-week robot-aided rehabilitation treatment with the Gloreha hand exoskeleton, and muscle synergies of both the healthy and injured hand were evaluated at the beginning and at the end of the treatment. The performed analysis showed a very high degree of similarity of the involved synergies between the healthy and the injured limb both before and after the rehabilitation treatment (mean similarity index values: H-BR: 0.88±0.03, H-AR: 0.94±0.03, BR-AR: 0.89±0.05). The increasing similarity is regarded as an effect of the robot-aided rehabilitation treatment and future activities will be performed to increase the population involved in the study.

A straightforward and miniature implementation method of postural synergies to replicate human grasp characteristics accurately and intuitively

Postural synergies have great potential for replicating human grasp characteristics, simplify grasp control and reduce the number of hardware actuators required. However, due to their complex mapping relationship and jagged transmission ratio, the implemented mechanisms are always too bulky and loose, which greatly limits their application. With current solutions, the replication accuracy of motion characteristics or intuitive control is compromised, and hitherto no work in the literature has reported the replication errors. To overcome these limitations, we present a novel design framework to determine the actuation configuration, implementation scheme and physical parameters. In this way, the mechanism is miniaturized and can be compactly embedded in the palm of the hand. A self-contained synergistic robot hand with integrated mechanism, sensors and a suitable electrical system is built. The experiments demonstrate that the robot hand can accurately replicate the motion characteristics of two primary synergies, maintain intuitive control to simplify grasp control, has a good capability for anthropomorphic motion and can grasp different objects with versatile grasp functionality.

Compartmentalized dynamics within a common multi-area mesoscale manifold represent a repertoire of human hand movements

The human hand is unique in the animal kingdom for unparalleled dexterity, ranging from complex prehension to fine finger individuation. How does the brain represent such a diverse repertoire of movements? We evaluated mesoscale neural dynamics across the human "grasp network," using electrocorticography and dimensionality reduction methods, for a repertoire of hand movements. Strikingly, we found that the grasp network represented both finger and grasping movements alike. Specifically, the manifold characterizing the multi-areal neural covariance structure was preserved during all movements across this distributed network. In contrast, latent neural dynamics within this manifold were surprisingly specific to movement type. Aligning latent activity to kinematics further uncovered distinct submanifolds despite similarities in synergistic coupling of joints between movements. We thus find that despite preserved neural covariance at the distributed network level, mesoscale dynamics are compartmentalized into movement-specific submanifolds; this mesoscale organization may allow flexible switching between a repertoire of hand movements.

Quantitative Investigation of Hand Grasp Functionality: Hand Joint Motion Correlation, Independence, and Grasping Behavior

Modeling and understanding human grasp functionality are fundamental in prosthetics, robotics, medicine, and rehabilitation, since they contribute to exploring motor control mechanism, evaluating grasp function, and designing and controlling prosthetic hands or exoskeletons. However, there are still limitations in providing a comprehensive and quantitative understanding of hand grasp functionality. After simultaneously considering three significant and essential influence factors in daily grasping contained relative position, object shape, and size, this paper presents the tolerance grasping to provide a more comprehensive understanding of human grasp functionality. The results of joint angle distribution and variance explained by PCs supported that tolerance grasping can represent hand grasp functionality more comprehensively. Four synergies are found and account for 93% ± 1.5% of the overall variance. The ANOVA confirmed that there was no significant individual difference in the first four postural synergies. The common patterns of grasping behavior were found and characterized by the mean value of postural synergy across 10 subjects. The independence analysis demonstrates that the tolerance grasping results highly correlate with unstructured natural grasping and more accurately correspond to cortical representation size of finger movement. The potential for exploring the neuromuscular control mechanism of human grasping is discussed. The analysis of hand grasp characteristics that contained joint angle distribution, correlation, independence, and postural synergies, presented here, should be more representative to provide a more comprehensive understanding of hand grasp functionality.

Sensing and decoding the neural drive to paralyzed muscles during attempted movements of a person with tetraplegia using a sleeve array

Motor neurons convey information about motor intent that can be extracted and interpreted to control assistive devices. However, most methods for measuring the firing activity of single neurons rely on implanted microelectrodes. Although intracortical brain-computer interfaces (BCIs) have been shown to be safe and effective, the requirement for surgery poses a barrier to widespread use that can be mitigated by instead using noninvasive interfaces. The objective of this study was to evaluate the feasibility of deriving motor control signals from a wearable sensor that can detect residual motor unit activity in paralyzed muscles after chronic cervical spinal cord injury (SCI). Despite generating no observable hand movement, volitional recruitment of motor units below the level of injury was observed across attempted movements of individual fingers and overt wrist and elbow movements. Subgroups of motor units were coactive during flexion or extension phases of the task. Single digit movement intentions were classified offline from the EMG power (RMS) or motor unit firing rates with median classification accuracies >75% in both cases. Simulated online control of a virtual hand was performed with a binary classifier to test feasibility of real-time extraction and decoding of motor units. The online decomposition algorithm extracted motor units in 1.2 ms, and the firing rates predicted the correct digit motion 88 ± 24% of the time. This study provides the first demonstration of a wearable interface for recording and decoding firing rates of motor units below the level of injury in a person with motor complete SCI.

Learning Grasp Configuration Through Object-Specific Hand Primitives for Posture Planning of Anthropomorphic Hands

The proposal of postural synergy theory has provided a new approach to solve the problem of controlling anthropomorphic hands with multiple degrees of freedom. However, generating the grasp configuration for new tasks in this context remains challenging. This study proposes a method to learn grasp configuration according to the shape of the object by using postural synergy theory. By referring to past research, an experimental paradigm is first designed that enables the grasping of 50 typical objects in grasping and operational tasks. The angles of the finger joints of 10 subjects were then recorded when performing these tasks. Following this, four hand primitives were extracted by using principal component analysis, and a low-dimensional synergy subspace was established. The problem of planning the trajectories of the joints was thus transformed into that of determining the synergy input for trajectory planning in low-dimensional space. The average synergy inputs for the trajectories of each task were obtained through the Gaussian mixture regression, and several Gaussian processes were trained to infer the inputs trajectories of a given shape descriptor for similar tasks. Finally, the feasibility of the proposed method was verified by simulations involving the generation of grasp configurations for a prosthetic hand control. The error in the reconstructed posture was compared with those obtained by using postural synergies in past work. The results show that the proposed method can realize movements similar to those of the human hand during grasping actions, and its range of use can be extended from simple grasping tasks to complex operational tasks.

Synergistic Organization of Neural Inputs from Spinal Motor Neurons to Extrinsic and Intrinsic Hand Muscles

Our current understanding of synergistic muscle control is based on the analysis of muscle activities. Modules (synergies) in muscle coordination are extracted from electromyographic (EMG) signal envelopes. Each envelope indirectly reflects the neural drive received by a muscle; therefore, it carries information on the overall activity of the innervating motor neurons. However, it is not known whether the output of spinal motor neurons, whose number is orders of magnitude greater than the muscles they innervate, is organized in a low-dimensional fashion when performing complex tasks. Here, we hypothesized that motor neuron activities exhibit a synergistic organization in complex tasks and therefore that the common input to motor neurons results in a large dimensionality reduction in motor neuron outputs. To test this hypothesis, we factorized the output spike trains of motor neurons innervating 14 intrinsic and extrinsic hand muscles and analyzed the dimensionality of control when healthy individuals exerted isometric forces using seven grip types. We identified four motor neuron synergies, accounting for >70% of the variance of the activity of 54.1 ± 12.9 motor neurons, and we identified four functionally similar muscle synergies. However, motor neuron synergies better discriminated individual finger forces than muscle synergies and were more consistent with the expected role of muscles actuating each finger. Moreover, in a few cases, motor neurons innervating the same muscle were active in separate synergies. Our findings suggest a highly divergent net neural inputs to spinal motor neurons from spinal and supraspinal structures, contributing to the dimensionality reduction captured by muscle synergies.SIGNIFICANCE STATEMENT We addressed whether the output of spinal motor neurons innervating multiple hand muscles could be accounted for by a modular organization, i.e., synergies, previously described to account for the coordination of multiple muscles. We found that motor neuron synergies presented similar dimensionality (implying a >10-fold reduction in dimensionality) and structure as muscle synergies. Nonetheless, the synergistic behavior of subsets of motor neurons within a muscle was also observed. These results advance our understanding of how neuromuscular control arises from mapping descending inputs to muscle activation signals. We provide, for the first time, insights into the organization of neural inputs to spinal motor neurons which, to date, has been inferred through analysis of muscle synergies.

Linking Individual Movements to a Skilled Repertoire: Fast Modulation of Motor Synergies by Repetition of Stereotyped Movements

Motor skills emerge when practicing individual movements enables the motor system to extract building instructions that facilitate the generation of future diverse movements. Here we asked how practicing stereotyped movements for minutes affects motor synergies that encode human motor skills acquired over years of training. Participants trained a kinematically highly constrained combined index-finger and thumb movement. Before and after training, finger movements were evoked at rest by transcranial magnetic stimulation (TMS). Post-training, the angle between posture vectors describing TMS-evoked movements and the training movements temporarily decreased, suggesting the presence of a short-term memory for the trained movement. Principal component analysis was used to identify joint covariance patterns in TMS-evoked movements. The quality of reconstruction of training or grasping movements from linear combinations of a small subset of these TMS-derived synergies was used as an index of neural efficiency of movement generation. The reconstruction quality increased for the trained movement but remained constant for grasping movements. These findings suggest that the motor system rapidly reorganizes to enhance the coding efficiency of a difficult movement without compromising the coding efficiency of overlearned movements. Practice of individual movements may drive an unsupervised bottom-up process that ultimately shapes synergistic neuronal organization by constant competition of action memories.

A Systematic Analysis of Hand Movement Functionality: Qualitative Classification and Quantitative Investigation of Hand Grasp Behavior

Understanding human hand movement functionality is fundamental in neuroscience, robotics, prosthetics, and rehabilitation. People are used to investigate movement functionality separately from qualitative or quantitative perspectives. However, it is still limited to providing an integral framework from both perspectives in a logical manner. In this paper, we provide a systematic framework to qualitatively classify hand movement functionality, build prehensile taxonomy to explore the general influence factors of human prehension, and accordingly design a behavioral experiment to quantitatively understand the hand grasp. In qualitative analysis, two facts are explicitly proposed: (1) the arm and wrist make a vital contribution to hand movement functionality; (2) the relative position (relative position in this paper is defined as the distance between the center of the human wrist and the object center of gravity) is a general influence factor significantly impacting human prehension. In quantitative analysis, the significant influence of three factors, object shape, size, and relative position, is quantitatively demonstrated. Simultaneously considering the impact of relative position, object shape, and size, the prehensile taxonomy and behavioral experiment results presented here should be more representative and complete to understand human grasp functionality. The systematic framework presented here is general and applicable to other body parts, such as wrist, arm, etc. Finally, many potential applications and the limitations are clarified.

A Systematic Review of EMG Applications for the Characterization of Forearm and Hand Muscle Activity during Activities of Daily Living: Results, Challenges, and Open Issues

The role of the hand is crucial for the performance of activities of daily living, thereby ensuring a full and autonomous life. Its motion is controlled by a complex musculoskeletal system of approximately 38 muscles. Therefore, measuring and interpreting the muscle activation signals that drive hand motion is of great importance in many scientific domains, such as neuroscience, rehabilitation, physiotherapy, robotics, prosthetics, and biomechanics. Electromyography (EMG) can be used to carry out the neuromuscular characterization, but it is cumbersome because of the complexity of the musculoskeletal system of the forearm and hand. This paper reviews the main studies in which EMG has been applied to characterize the muscle activity of the forearm and hand during activities of daily living, with special attention to muscle synergies, which are thought to be used by the nervous system to simplify the control of the numerous muscles by actuating them in task-relevant subgroups. The state of the art of the current results are presented, which may help to guide and foster progress in many scientific domains. Furthermore, the most important challenges and open issues are identified in order to achieve a better understanding of human hand behavior, improve rehabilitation protocols, more intuitive control of prostheses, and more realistic biomechanical models.

Grasping Assisting Algorithm in Tele-Operated Robotic Gripper

The involvement of Robots and automated machines in different industries has increased drastically in recent years. Part of this revolution is accomplishing tasks previously performed by humans with advanced robots, which would replace the entire human workforce in the future. In some industries the workers are required to complete different operations in hazardous or difficult environments. Operations like these could be replaced with the use of tele-operated systems that have the capability of grasping objects in their surroundings, thus abandoning the need for the physical presence of the human operator at the area while still allowing control. In this research our goal is to create an assisting system that would improve the grasping of a human operator using a tele-operated robotic gripper and arm, while advising the operator but not forcing a solution. For a given set of objects we computed the optimal grasp to be achieved by the gripper, based on two grasp quality measures of our choosing (namely power grasp and precision grasp). We then tested the performance of different human subjects who tried to grasp the different objects with the tele-operated system, while comparing their success to unassisted and assisted grasping. Our goal is to create an assisting algorithm that would compute optimal grasps and might be integrated into a complete, state-of-the-art tele-operated system.

Role of Tactile Noise in the Control of Digit Normal Force

Whenever we grasp and lift an object, our tactile system provides important information on the contact location and the force exerted on our skin. The human brain integrates signals from multiple sites for a coherent representation of object shape, inertia, weight, and other material properties. It is still an open question whether the control of grasp force occurs at the level of individual fingers or whether it is also influenced by the control and the signals from the other fingers of the same hand. In this work, we approached this question by asking participants to lift, transport, and replace a sensorized object, using three- and four-digit grasp. Tactile input was altered by covering participant's fingertips with a rubber thimble, which reduced the reliability of the tactile sensory input. In different experimental conditions, we covered between one and three fingers opposing the thumb. Normal forces at each finger and the thumb were recorded while grasping and holding the object, with and without the thimble. Consistently with previous studies, reducing tactile sensitivity increased the overall grasping force. The gasping force increased in the covered finger, whereas it did not change from baseline in the remaining bare fingers (except the thumb for equilibrium constraints). Digit placement and object tilt were not systematically affected by rubber thimble conditions. Our results suggest that, in each finger opposing thumb, digit normal force is controlled locally in response to the applied tactile perturbation.

Synergy-Based Sensor Reduction for Recording the Whole Hand Kinematics

Simultaneous measurement of the kinematics of all hand segments is cumbersome due to sensor placement constraints, occlusions, and environmental disturbances. The aim of this study is to reduce the number of sensors required by using kinematic synergies, which are considered the basic building blocks underlying hand motions. Synergies were identified from the public KIN-MUS UJI database (22 subjects, 26 representative daily activities). Ten synergies per subject were extracted as the principal components explaining at least 95% of the total variance of the angles recorded across all tasks. The 220 resulting synergies were clustered, and candidate angles for estimating the remaining angles were obtained from these groups. Different combinations of candidates were tested and the one providing the lowest error was selected, its goodness being evaluated against kinematic data from another dataset (KINE-ADL BE-UJI). Consequently, the original 16 joint angles were reduced to eight: carpometacarpal flexion and abduction of thumb, metacarpophalangeal and interphalangeal flexion of thumb, proximal interphalangeal flexion of index and ring fingers, metacarpophalangeal flexion of ring finger, and palmar arch. Average estimation errors across joints were below 10% of the range of motion of each joint angle for all the activities. Across activities, errors ranged between 3.1% and 16.8%.

Task-Space Synergies for Reaching Using Upper-Limb Prostheses

Synergistic prostheses enable the coordinated movement of the human-prosthetic arm, as required by activities of daily living. This is achieved by coupling the motion of the prosthesis to the human command, such as the residual limb movement in motion-based interfaces. Previous studies demonstrated that developing human-prosthetic synergies in joint-space must consider individual motor behaviour and the intended task to be performed, requiring personalisation and task calibration. In this work, an alternative synergy-based strategy, utilising a synergistic relationship expressed in task-space, is proposed. This task-space synergy has the potential to replace the need for personalisation and task calibration with a model-based approach requiring knowledge of the individual user's arm kinematics, the anticipated hand motion during the task and voluntary information from the prosthetic user. The proposed method is compared with surface electromyography-based and joint-space synergy-based prosthetic interfaces in a study of motor behaviour and task performance on able-bodied subjects using a VR-based transhumeral prosthesis. Experimental results showed that for a set of forward reaching tasks the proposed task-space synergy achieves comparable performance to joint-space synergies without the need to rely on time-consuming calibration processes or human motor learning. Case study results with an amputee subject motivate the further development of the proposed task-space synergy method.

Dimensionality analysis of forearm muscle activation for myoelectric control in transradial amputees

Establishing a natural communication interface between the user and the terminal device is one of the central challenges of hand neuroprosthetics research. Surface electromyography (EMG) is the most common source of neural signals for interpreting a user’s intent in these interfaces. However, how the capacity of EMG generation is affected by various clinical parameters remains largely unknown. In this study, we examined the EMG activity of forearm muscles recorded from 11 transradially amputated subjects who performed a wide range of movements. EMG recordings from 40 able-bodied subjects were also analyzed to provide comparative benchmarks. By using non-negative matrix factorization, we extracted the synergistic EMG patterns for each subject to estimate the dimensionality of muscle control, under the framework of motor synergies. We found that amputees exhibited less than four synergies (with substantial variability related to the length of remaining limb and age), whereas able-bodied subjects commonly demonstrate five or more synergies. The results of this study provide novel insight into the muscle synergy framework and the design of natural myoelectric control interfaces.

Spontaneously emerging patterns in human visual cortex and their functional connectivity are linked to the patterns evoked by visual stimuli

The function of spontaneous brain activity is an important issue in neuroscience. Here we test the hypothesis that patterns of spontaneous activity code representational patterns evoked by stimuli. We compared in human visual cortex multivertex patterns of spontaneous activity to patterns evoked by ecological visual stimuli (faces, bodies, scenes) and low-level visual features (e.g., phase-scrambled faces). Specifically, we identified regions that preferred particular stimulus categories during localizer scans (e.g., extrastriate body area for bodies), measured multivertex patterns for each category during event-related task scans, and then correlated over vertices these stimulus-evoked patterns to the pattern measured on each frame of resting-state scans. The mean correlation coefficient was essentially zero for all regions/stimulus categories, indicating that resting multivertex patterns were not biased toward particular stimulus-evoked patterns. However, the spread of correlation coefficients between stimulus-evoked and resting patterns, positive and negative, was significantly greater for the preferred stimulus category of an ROI. The relationship between spontaneous and stimulus-evoked multivertex patterns also governed the temporal correlation or functional connectivity of patterns of spontaneous activity between individual regions (pattern-based functional connectivity). Resting multivertex patterns related to an object category fluctuated preferentially between ROIs preferring the same category, and fluctuations of the pattern for a category (e.g., body) within its preferred ROIs were largely uncorrelated with fluctuations of the pattern for a disparate category (e.g., scene) within its preferred ROIs. These results support the proposal that spontaneous multivertex activity patterns are linked to stimulus-evoked patterns, consistent with a representational function for spontaneous activity.NEW & NOTEWORTHY Spontaneous brain activity was once thought to reflect only noise, but evidence of strong spatiotemporal regularities has motivated a search for functional explanations. Here we show that the spatial pattern of spontaneous activity in human high-level and early visual cortex is related to the spatial patterns evoked by stimuli. Moreover, these patterns partly govern spontaneous spatiotemporal interactions between regions, so-called functional connectivity. These results support the hypothesis that spontaneous activity serves a representational function.

Forelimb force direction and magnitude independently controlled by spinal modules in the macaque

Studies in frogs and rodents have shown that to deal with the complexity of controlling all the muscles in the body the brain can activate sets of neurons in the spinal cord with a single signal. Here, we provide confirmation of a similar system of “modular” output in nonhuman primates. Costimulation at two spinal sites resulted in force field directionality that was the linear sum of the fields from each site. However, unlike the frog and rodent, the magnitude of the force vectors was greater than the simple sum (supralinear). Thus, while force direction in primates is controlled by the linear sum of modular output, force amplitude might be adjusted by additional sources shared by those modules.

Modular organization of the spinal motor system is thought to reduce the cognitive complexity of simultaneously controlling the large number of muscles and joints in the human body. Although modular organization has been confirmed in the hindlimb control system of several animal species, it has yet to be established in the forelimb motor system or in primates. Expanding upon experiments originally performed in the frog lumbar spinal cord, we examined whether costimulation of two sites in the macaque monkey cervical spinal cord results in motor activity that is a simple linear sum of the responses evoked by stimulating each site individually. Similar to previous observations in the frog and rodent hindlimb, our analysis revealed that in most cases (77% of all pairs) the directions of the force fields elicited by costimulation were highly similar to those predicted by the simple linear sum of those elicited by stimulating each site individually. A comparable simple summation of electromyography (EMG) output, especially in the proximal muscles, suggested that this linear summation of force field direction was produced by a spinal neural mechanism whereby the forelimb motor output recruited by costimulation was also summed linearly. We further found that the force field magnitudes exhibited supralinear (amplified) summation, which was also observed in the EMG output of distal forelimb muscles, implying a novel feature of primate forelimb control. Overall, our observations support the idea that complex movements in the primate forelimb control system are made possible by flexibly combined spinal motor modules.

Non-invasive analysis of motor neurons controlling the intrinsic and extrinsic muscles of the hand

OBJECTIVE

We present a non-invasive framework for investigating efferent commands to 14 extrinsic and intrinsic hand muscles. We extend previous studies (limited to a few muscles) on common synaptic input among pools of motor neurons in a large number of muscles.

APPROACH

Seven subjects performed sinusoidal isometric contractions to complete seven types of grasps, with each finger and with three combinations of fingers in opposition with the thumb. High-density surface EMG (HD-sEMG) signals (384 channels in total) recorded from the 14 muscles were decomposed into the constituent motor unit action potentials. This provided a non-invasive framework for the investigation of motor neuron discharge patterns, muscle coordination and efferent commands of the hand muscles during grasping. Moreover, during grasping tasks, it was possible to identify common neural information among pools of motor neurons innervating the investigated muscles. For this purpose, principal component analysis (PCA) was applied to the smoothed discharge rates of the decoded motor units.

MAIN RESULTS

We found that the first principal component (PC1) of the ensemble of decoded motor neuron spike trains explained a variance of (53.0 ± 10.9) % and was positively correlated with force (R = 0.67 ± 0.10 across all subjects and tasks). By grouping the pools of motor neurons from extrinsic or intrinsic muscles, the PC1 explained a proportion of variance of (57.1 ± 11.3) % and (56.9 ± 11.8) %, respectively, and was correlated with force with R = 0.63 ± 0.13 and 0.63 ± 0.13, respectively.

SIGNIFICANCE

These observations demonstrate a low dimensional control of motor neurons across multiple muscles that can be exploited for extracting control signals in neural interfacing. The proposed framework was designed for hand rehabilitation perspectives, such as post-stroke rehabilitation and hand-exoskeleton control.

Hand Kinematics Characterization While Performing Activities of Daily Living Through Kinematics Reduction

Improving the understanding of hand kinematics during the performance of activities of daily living may help improve the control of hand prostheses and hand function assessment. This work identifies sparse synergies (each degree of freedom is present mainly in only one synergy), representative of the global population, with emphasis in unveiling the coordination of joints with small range of motion (palmar arching and fingers abduction). The study is the most complete study described in the literature till now, involving 22 healthy subjects and 26 representative day-to-day life activities. Principal component analysis was used to reduce the original 16 angles recorded with an instrumented glove. Five synergies explained 75% of total variance: closeness (coordinated flexion and abduction of metacarpophalangeal finger joints), digit arching (flexion of proximal interphalangeal joints), palmar-thumb coordination (coordination of palmar arching and thumb carpometacarpal flexion), thumb opposition, and thumb arch. The temporal evolution of these synergies is provided during reaching per intended grasp and during manipulation per specific task, which could be used as normative patterns for the global population. Reaching has been observed to require the modulation of closeness, digit arch and thumb opposition synergies, with different control patterns per grasp. All the synergies are very important during manipulation and need to be modulated for all the tasks. Finally, groups of tasks with similar kinematic requirements in terms of synergies have been identified, which could benefit the selection of tasks for rehabilitation and hand function assessments.

Dexterous Object Manipulation Requires Context-Dependent Sensorimotor Cortical Interactions in Humans

Dexterous object manipulation is a hallmark of human evolution and a critical skill for everyday activities. A previous work has used a grasping context that predominantly elicits memory-based control of digit forces by constraining where the object should be grasped. For this "constrained" grasping context, the primary motor cortex (M1) is involved in storage and retrieval of digit forces used in previous manipulations. In contrast, when choice of digit contact points is allowed ("unconstrained" grasping), behavioral studies revealed that forces are adjusted, on a trial-to-trial basis, as a function of digit position. This suggests a role of online feedback of digit position for force control. However, despite the ubiquitous nature of unconstrained hand-object interactions in activities of daily living, the underlying neural mechanisms are unknown. Using noninvasive brain stimulation, we found the role of primary motor cortex (M1) and somatosensory cortex (S1) to be sensitive to grasping context. In constrained grasping, M1 but not S1 is involved in storing and retrieving learned digit forces and position. In contrast, in unconstrained grasping, M1 and S1 are involved in modulating digit forces to position. Our findings suggest that the relative contribution of memory and online feedback modulates sensorimotor cortical interactions for dexterous manipulation.

Static, Dynamic, and Cognitive Fit of Exosystems for the Human Operator

OBJECTIVE

To define static, dynamic, and cognitive fit and their interactions as they pertain to exosystems and to document open research needs in using these fit characteristics to inform exosystem design.

BACKGROUND

Initial exosystem sizing and fit evaluations are currently based on scalar anthropometric dimensions and subjective assessments. As fit depends on ongoing interactions related to task setting and user, attempts to tailor equipment have limitations when optimizing for this limited fit definition.

METHOD

A targeted literature review was conducted to inform a conceptual framework defining three characteristics of exosystem fit: static, dynamic, and cognitive. Details are provided on the importance of differentiating fit characteristics for developing exosystems.

RESULTS

Static fit considers alignment between human and equipment and requires understanding anthropometric characteristics of target users and geometric equipment features. Dynamic fit assesses how the human and equipment move and interact with each other, with a focus on the relative alignment between the two systems. Cognitive fit considers the stages of human-information processing, including somatosensation, executive function, and motor selection. Human cognitive capabilities should remain available to process task- and stimulus-related information in the presence of an exosystem. Dynamic and cognitive fit are operationalized in a task-specific manner, while static fit can be considered for predefined postures.

CONCLUSION

A deeper understanding of how an exosystem fits an individual is needed to ensure good human-system performance. Development of methods for evaluating different fit characteristics is necessary.

APPLICATION

Methods are presented to inform exosystem evaluation across physical and cognitive characteristics.

Compression of dynamic tactile information in the human hand

A key problem in the study of the senses is to describe how sense organs extract perceptual information from the physics of the environment. We previously observed that dynamic touch elicits mechanical waves that propagate throughout the hand. Here, we show that these waves produce an efficient encoding of tactile information. The computation of an optimal encoding of thousands of naturally occurring tactile stimuli yielded a compact lexicon of primitive wave patterns that sparsely represented the entire dataset, enabling touch interactions to be classified with an accuracy exceeding 95%. The primitive tactile patterns reflected the interplay of hand anatomy with wave physics. Notably, similar patterns emerged when we applied efficient encoding criteria to spiking data from populations of simulated tactile afferents. This finding suggests that the biomechanics of the hand enables efficient perceptual processing by effecting a preneuronal compression of tactile information.

Similar effects of two different external supports on wrist joint position sense in healthy subjects: A randomized clinical trial

The hand is one of the most injured organs. Proprioceptive rehabilitation decreases the incidence of injury while using external supports can increase proprioception. The aim of this study was to investigate the effects of taping and elastic bandaging on wrist joint position sense (proprioception) in healthy individuals. Sixty-eight healthy students were included in our study and randomized into two groups. External supports were to apply to the dominant hand for 24hours in both groups. Joint position sense was evaluated with an angle reproduction test before applying the external support and 20 minutes after and then 24hours later with the external support and after removing it. There were significant improvements in joint position sense 20 minutes after applying the external support and 24hours later (P<0.05). Although a significant decrease in joint position sense was observed after removing the external support compared to while wearing it (P<0.05), there was a significant improvement in the joint position sense relative to the pre-study assessment (P<0.05). In between group comparisons, the only significant difference was observed 20 minutes after the external support was applied: the taping group had better results in joint flexion position sense than the bandaging group (P<0.05), but in the other assessments there were no significant differences between two groups (P>0.05). It was found that two different types of external support can improve the wrist joint's position sense in healthy subjects. These procedures can be used as a supplemental treatment in wrist rehabilitation.