Multi-finger prehension: control of a redundant mechanical system

Spatiotemporal Modeling of Grip Forces Captures Proficiency in Manual Robot Control

New technologies for monitoring grip forces during hand and finger movements in non-standard task contexts have provided unprecedented functional insights into somatosensory cognition. Somatosensory cognition is the basis of our ability to manipulate and transform objects of the physical world and to grasp them with the right amount of force. In previous work, the wireless tracking of grip-force signals recorded from biosensors in the palm of the human hand has permitted us to unravel some of the functional synergies that underlie perceptual and motor learning under conditions of non-standard and essentially unreliable sensory input. This paper builds on this previous work and discusses further, functionally motivated, analyses of individual grip-force data in manual robot control. Grip forces were recorded from various loci in the dominant and non-dominant hands of individuals with wearable wireless sensor technology. Statistical analyses bring to the fore skill-specific temporal variations in thousands of grip forces of a complete novice and a highly proficient expert in manual robot control. A brain-inspired neural network model that uses the output metric of a self-organizing pap with unsupervised winner-take-all learning was run on the sensor output from both hands of each user. The neural network metric expresses the difference between an input representation and its model representation at any given moment in time and reliably captures the differences between novice and expert performance in terms of grip-force variability.Functionally motivated spatiotemporal analysis of individual average grip forces, computed for time windows of constant size in the output of a restricted amount of task-relevant sensors in the dominant (preferred) hand, reveal finger-specific synergies reflecting robotic task skill. The analyses lead the way towards grip-force monitoring in real time. This will permit tracking task skill evolution in trainees, or identify individual proficiency levels in human robot-interaction, which represents unprecedented challenges for perceptual and motor adaptation in environmental contexts of high sensory uncertainty. Cross-disciplinary insights from systems neuroscience and cognitive behavioral science, and the predictive modeling of operator skills using parsimonious Artificial Intelligence (AI), will contribute towards improving the outcome of new types of surgery, in particular the single-port approaches such as NOTES (Natural Orifice Transluminal Endoscopic Surgery) and SILS (Single-Incision Laparoscopic Surgery).

Grip force as a functional window to somatosensory cognition

Analysis of grip force signals tailored to hand and finger movement evolution and changes in grip force control during task execution provide unprecedented functional insight into somatosensory cognition. Somatosensory cognition is the basis of our ability to act upon and to transform the physical world around us, to recognize objects on the basis of touch alone, and to grasp them with the right amount of force for lifting and manipulating them. Recent technology has permitted the wireless monitoring of grip force signals recorded from biosensors in the palm of the human hand to track and trace human grip forces deployed in cognitive tasks executed under conditions of variable sensory (visual, auditory) input. Non-invasive multi-finger grip force sensor technology can be exploited to explore functional interactions between somatosensory brain mechanisms and motor control, in particular during learning a cognitive task where the planning and strategic execution of hand movements is essential. Sensorial and cognitive processes underlying manual skills and/or hand-specific (dominant versus non-dominant hand) behaviors can be studied in a variety of contexts by probing selected measurement loci in the fingers and palm of the human hand. Thousands of sensor data recorded from multiple spatial locations can be approached statistically to breathe functional sense into the forces measured under specific task constraints. Grip force patterns in individual performance profiling may reveal the evolution of grip force control as a direct result of cognitive changes during task learning. Grip forces can be functionally mapped to from-global-to-local coding principles in brain networks governing somatosensory processes for motor control in cognitive tasks leading to a specific task expertise or skill. Under the light of a comprehensive overview of recent discoveries into the functional significance of human grip force variations, perspectives for future studies in cognition, in particular the cognitive control of strategic and task relevant hand movements in complex real-world precision task, are pointed out.

Decoupled Control of Grasp and Rotation Constraints During Prehension of Weightless Objects

Gravity provides critical information for the adjustment of body movement or manipulation of the handheld object. Indeed, the changes in gravity modify the mechanical constraints of prehensile actions, which may be accompanied by the changes in control strategies. The current study examined the effect of the gravitational force of a handheld object on the control strategies for subactions of multidigit prehension. A total of eight subjects performed prehensile tasks while grasping and lifting the handle by about 250 mm along the vertical direction. The experiment consisted of two conditions: lifting gravity-induced (1g) and weightless (0g) handheld objects. The weightless object condition was implemented utilizing a robot arm that produced a constant antigravitational force of the handle. The current analysis was limited to the two-dimensional grasping plane, and the notion of the virtual finger was employed to formulate the cause–effect chain of elemental variables during the prehensile action. The results of correlation analyses confirmed that decoupled organization of two subsets of mechanical variables was observed in both 1g and 0g conditions. While lifting the handle, the two subsets of variables were assumed to contribute to the grasping and rotational equilibrium, respectively. Notably, the normal forces of the thumb and virtual finger had strong positive correlations. In contrast, the normal forces had no significant relationship with the variables as to the moment of force. We conclude that the gravitational force had no detrimental effect on adjustments of the mechanical variables for the rotational action and its decoupling from the grasping equilibrium.

Transfer and generalization of learned manipulation between unimanual and bimanual tasks

Successful object manipulation, such as preventing object roll, relies on the modulation of forces and centers of pressure (point of application of digits on each grasp surface) prior to lift onset to generate a compensatory torque. Whether or not generalization of learned manipulation can occur after adding or removing effectors is not known. We examined this by recruiting participants to perform lifts in unimanual and bimanual grasps and analyzed results before and after transfer. Our results show partial generalization of learned manipulation occurred when switching from a (1) unimanual to bimanual grasp regardless of object center of mass, and (2) bimanual to unimanual grasp when the center of mass was on the thumb side. Partial generalization was driven by the modulation of effectors' center of pressure, in the appropriate direction but of insufficient magnitude, while load forces did not contribute to torque generation after transfer. In addition, we show that the combination of effector forces and centers of pressure in the generation of compensatory torque differ between unimanual and bimanual grasping. These findings highlight that (1) high-level representations of learned manipulation enable only partial learning transfer when adding or removing effectors, and (2) such partial generalization is mainly driven by modulation of effectors' center of pressure.

Correlating Grip Force Signals from Multiple Sensors Highlights Prehensile Control Strategies in a Complex Task-User System

Wearable sensor systems with transmitting capabilities are currently employed for the biometric screening of exercise activities and other performance data. Such technology is generally wireless and enables the non-invasive monitoring of signals to track and trace user behaviors in real time. Examples include signals relative to hand and finger movements or force control reflected by individual grip force data. As will be shown here, these signals directly translate into task, skill, and hand-specific (dominant versus non-dominant hand) grip force profiles for different measurement loci in the fingers and palm of the hand. The present study draws from thousands of such sensor data recorded from multiple spatial locations. The individual grip force profiles of a highly proficient left-hander (expert), a right-handed dominant-hand-trained user, and a right-handed novice performing an image-guided, robot-assisted precision task with the dominant or the non-dominant hand are analyzed. The step-by-step statistical approach follows Tukey's "detective work" principle, guided by explicit functional assumptions relating to somatosensory receptive field organization in the human brain. Correlation analyses (Person's product moment) reveal skill-specific differences in co-variation patterns in the individual grip force profiles. These can be functionally mapped to from-global-to-local coding principles in the brain networks that govern grip force control and its optimization with a specific task expertise. Implications for the real-time monitoring of grip forces and performance training in complex task-user systems are brought forward.

Seven Properties of Self-Organization in the Human Brain

The principle of self-organization has acquired a fundamental significance in the newly emerging field of computational philosophy. Self-organizing systems have been described in various domains in science and philosophy including physics, neuroscience, biology and medicine, ecology, and sociology. While system architecture and their general purpose may depend on domain-specific concepts and definitions, there are (at least) seven key properties of self-organization clearly identified in brain systems: (1) modular connectivity, (2) unsupervised learning, (3) adaptive ability, (4) functional resiliency, (5) functional plasticity, (6) from-local-to-global functional organization, and (7) dynamic system growth. These are defined here in the light of insight from neurobiology, cognitive neuroscience and Adaptive Resonance Theory (ART), and physics to show that self-organization achieves stability and functional plasticity while minimizing structural system complexity. A specific example informed by empirical research is discussed to illustrate how modularity, adaptive learning, and dynamic network growth enable stable yet plastic somatosensory representation for human grip force control. Implications for the design of “strong” artificial intelligence in robotics are brought forward.

Cortical neurons multiplex reward-related signals along with sensory and motor information

Rewards are known to influence neural activity associated with both motor preparation and execution. This influence can be exerted directly upon the primary motor (M1) and somatosensory (S1) cortical areas via the projections from reward-sensitive dopaminergic neurons of the midbrain ventral tegmental areas. However, the neurophysiological manifestation of reward-related signals in M1 and S1 are not well understood. Particularly, it is unclear how the neurons in these cortical areas multiplex their traditional functions related to the control of spatial and temporal characteristics of movements with the representation of rewards. To clarify this issue, we trained rhesus monkeys to perform a center-out task in which arm movement direction, reward timing, and magnitude were manipulated independently. Activity of several hundred cortical neurons was simultaneously recorded using chronically implanted microelectrode arrays. Many neurons (9-27%) in both M1 and S1 exhibited activity related to reward anticipation. Additionally, neurons in these areas responded to a mismatch between the reward amount given to the monkeys and the amount they expected: A lower-than-expected reward caused a transient increase in firing rate in 60-80% of the total neuronal sample, whereas a larger-than-expected reward resulted in a decreased firing rate in 20-35% of the neurons. Moreover, responses of M1 and S1 neurons to reward omission depended on the direction of movements that led to those rewards. These observations suggest that sensorimotor cortical neurons corepresent rewards and movement-related activity, presumably to enable reward-based learning.

Skilful force control in expert pianists

Dexterous object manipulation in skilful behaviours such as surgery, craft making, and musical performance involves fast, precise, and efficient control of force with the fingers. A challenge in playing musical instruments is the requirement of independent control of the magnitude and rate of force production, which typically vary in relation to loudness and tempo. However, it is unknown how expert musicians skilfully control finger force to elicit tones with a wide range of loudness and tempi. Here, we addressed this issue by comparing the variation of spatiotemporal characteristics of force during repetitive and simultaneous piano keystrokes in relation to the loudness and tempo between pianists and musically untrained individuals. While the peak key-descending velocity varied with loudness but not with tempo in both groups, the peak and impulse of the key-depressing force were smaller in pianists than in the non-musicians, specifically when eliciting loud tones, suggesting superior energetic efficiency in the trained individuals. The key-depressing force was more consistent across strikes in pianists than in the non-musicians at all loudness levels but only at slow tempi, confirming expertise-dependency of precise force control. A regression analysis demonstrated that individual differences in the keystroke rates when playing at the fastest tempo across the trained pianists were negatively associated with the force impulse during the key depression but not with the peak force only at the loudest tone. This suggests that rapid reductions of force following the key depression plays a role in considerably fast performance of repetitive piano keystrokes.

Finger-thumb coupling contributes to exaggerated thumb flexion in stroke survivors

The purpose of this study was to investigate altered finger-thumb coupling in individuals with chronic hemiparesis poststroke. First, an external device stretched finger flexor muscles by passively rotating the metacarpophalangeal (MCP) joints. Subjects then performed isometric finger or thumb force generation. Forces/torques and electromyographic signals were recorded for both the thumb and finger muscles. Stroke survivors with moderate (n = 9) and severe (n = 9) chronic hand impairment participated, along with neurologically intact individuals (n = 9). Stroke survivors exhibited strong interactions between finger and thumb flexors. The stretch reflex evoked by stretch of the finger flexors of stroke survivors led to heteronymous reflex activity in the thumb, while attempts to produce isolated voluntary finger MCP flexion torque/thumb flexion force led to increased and undesired thumb force/finger MCP torque production poststroke with a striking asymmetry between voluntary flexion and extension. Coherence between the long finger and thumb flexors estimated using intermuscular electromyographic correlations, however, was small. Coactivation of thumb and finger flexor muscles was common in stroke survivors, whether activation was evoked by passive stretch or voluntary activation. The coupling appears to arise from subcortical or spinal sources. Flexor coupling between the thumb and fingers seems to contribute to undesired thumb flexor activity after stroke and may impact rehabilitation outcomes.

Internal forces during static prehension: effects of age and grasp configuration

The authors studied effects of healthy aging on 3 components of the internal force vector during static prehensile tasks. Young and older subjects held an instrumented handle using a 5-digit prismatic grasp under different digit configurations and external torques. Across digit configurations, older subjects showed larger internal normal (grip) and tangential (load-resisting) digit force components and larger internal moment of force. In contrast to earlier reports, safety margin values were not higher in the older subjects. The results show that the increased grip force in older persons is a specific example of a more general age-related problem reflected in the generation of large internal force vectors in prehensile tasks. It is possible that the higher internal forces increase the apparent stiffness of the hand+handle system and, hence, contribute to its stability. This strategy, however, may be maladaptive, energetically wasteful, and inefficient in ensuring safety of hand-held objects.

Spatio-temporal analysis reveals active control of both task-relevant and task-irrelevant variables

The Uncontrolled Manifold (UCM) hypothesis and Minimal Intervention principle propose that the observed differential variability across task relevant (i.e., task goals) vs. irrelevant (i.e., in the null space of those goals) variables is evidence of a separation of task variables for efficient neural control, ranked by their respective variabilities (sometimes referred to as hierarchy of control). Support for this comes from spatial domain analyses (i.e., structure of) of kinematic, kinetic, and EMG variability. While proponents admit the possibility of preferential as opposed to strictly uncontrolled variables, such distinctions have only begun to be quantified or considered in the temporal domain when inferring control action. Here we extend the study of task variability during tripod static grasp to the temporal domain by applying diffusion analysis. We show that both task-relevant and task-irrelevant parameters show corrective action at some time scales; and conversely, that task-relevant parameters do not show corrective action at other time scales. That is, the spatial fluctuations of fingertip forces show, as expected, greater ranges of variability in task-irrelevant variables (>98% associated with changes in total grasp force; vs. only <2% in task-relevant changes associated with acceleration of the object). But at some time scales, however, temporal fluctuations of task-irrelevant variables exhibit negative correlations clearly indicative of corrective action (scaling exponents <0.5); and temporal fluctuations of task-relevant variables exhibit neutral and positive correlations clearly indicative of absence of corrective action (scaling exponents ≥0.5). In agreement with recent work in other behavioral contexts, these results propose we revise our understanding of variability vis-á-vis task relevance by considering both spatial and temporal features of all task variables when inferring control action and understanding how the CNS confronts task redundancy. Instead of a dichotomy of presence vs. absence of control, we should speak of a continuum of weaker to stronger—and potentially different—control strategies in specific spatiotemporal domains, indicated here by the magnitude of deviation from the 0.5 scaling exponent. Moreover, these results are counter examples to the UCM hypothesis and the Minimal Intervention principle, and the similar nature of control actions across time scales in both task-relevant and task-irrelevant spaces points to a level of modularity not previously recognized.

Characterizing coordination of grasp and twist in hand function of healthy and post-stroke subjects

The goal of this study was to characterize the coordination of grasp and twist in hand function of normal and post-stroke subjects using a two degree of freedom hand robot. Results of the analysis of data from eight control subjects indicated that normal grip coordination involves the linear modulation of grip force with load torque. Thus, there was a high correlation between grip force and load torque. Also, the force generated by the thumb was highly correlated with the force generated by the index, middle and ring fingers. Finally, the safety margin used to stabilize grasp and avoid slip was consistent across normal subjects. In contrast, results from chronic post-stroke subjects indicated that they generally: (1) exerted excessive grip force to stabilize grasp using their ipsilesional hand; (2) lost the close amplitude coupling between grip force and load torque; and (3) lost the close modulation of the thumb force with finger force. These results suggest that our methods may provide objective, quantitative means of characterizing coordination problems following stroke.

Effects of aerobic fitness on aging-related changes of interhemispheric inhibition and motor performance

Physical fitness has been long associated with maintenance and improvement of motor performance as we age. In particular, measures of psychomotor speed and motor dexterity tend to be higher in physically fit aging adults as compared to their sedentary counterparts. Using functional magnetic resonance imaging (fMRI) and transcranial magnetic stimulation (TMS), we explored the patterns of neural activity that may, in part, account for differences between individuals of varying physical fitness levels. In this study, we enrolled both sedentary and physically fit middle age (40–60) and younger (18–30) adults and measured upper extremity motor performance during behavioral testing. In a follow-up session, we employed TMS and fMRI to assess levels of interhemispheric communication during unimanual tasks. Results show that increased physical fitness is associated with better upper extremity motor performance on distal dexterity assessments and increased levels of interhemispheric inhibition in middle age adults. Further, the functional correlates of changes of ipsilateral activity appears to be restricted to the aging process as younger adults of varying fitness levels do not differ in hemispheric patterns of activity or motor performance. We conclude that sedentary aging confers a loss of interhemispheric inhibition that is deleterious to some aspects of motor function, as early as midlife, but these changes can be mediated by chronic engagement in aerobic exercise.

An involuntary stereotypical grasp tendency pervades voluntary dynamic multifinger manipulation

We used a novel apparatus with three hinged finger pads to characterize collaborative multifinger interactions during dynamic manipulation requiring individuated control of fingertip motions and forces. Subjects placed the thumb, index, and middle fingertips on each hinged finger pad and held it-unsupported-with constant total grasp force while voluntarily oscillating the thumb's pad. This task combines the need to 1) hold the object against gravity while 2) dynamically reconfiguring the grasp. Fingertip force variability in this combined motion and force task exhibited strong synchrony among normal (i.e., grasp) forces. Mechanical analysis and simulation show that such synchronous variability is unnecessary and cannot be explained solely by signal-dependent noise. Surprisingly, such variability also pervaded control tasks requiring different individuated fingertip motions and forces, but not tasks without finger individuation such as static grasp. These results critically extend notions of finger force variability by exposing and quantifying a pervasive challenge to dynamic multifinger manipulation: the need for the neural controller to carefully and continuously overlay individuated finger actions over mechanically unnecessary synchronous interactions. This is compatible with-and may explain-the phenomenology of strong coupling of hand muscles when this delicate balance is not yet developed, as in early childhood, or when disrupted, as in brain injury. We conclude that the control of healthy multifinger dynamic manipulation has barely enough neuromechanical degrees of freedom to meet the multiple demands of ecological tasks and critically depends on the continuous inhibition of synchronous grasp tendencies, which we speculate may be of vestigial evolutionary origin.

Multi-digit coordination during lifting a horizontally oriented object: synergies control with referent configurations

We explored digit coordination during the acceleration phase of a quick lifting movement of a hand-held horizontal object. We tested three hypotheses related to: (1) the scaling of mechanical variables produced by the hand with changes in the external load, torque, and moment of inertia; (2) changes in the safety margin for the thumb with both the loading conditions and acceleration; and (3) changes in the indices of synergies. The subjects held a horizontal handle with a prismatic grasp (the thumb acted on top of the handle) and performed series of "very quick" lifting movements to a visual target. Multi-digit synergies were quantified as co-variation indices among elemental variables (forces and moments produced by individual digits). The resultant force scaled with the external load but not torque, while the grip force scaled with the external torque but not load. The safety margin dropped with an increase in acceleration; it also showed changes with the external torque and moment of inertia. Total moment of force was primarily produced by the tangential forces (over 80 %) across all movement phases and loading conditions. The index and little fingers produced close to zero moment with their normal forces, while the middle and ring fingers produced consistent moments due to the reproducible shifts of their centers of pressure. Synergy indices at the upper level of the assumed hierarchy (the task is shared between the thumb and virtual finger--an imagined digit with the action equal to that of the four fingers combined) did not drop with acceleration for the three force vector components and one of the moment vector components. They did drop with acceleration at the lower level (virtual finger action is shared among the four fingers). There was a trade-off between synergy indices computed at the two levels for the three force vector components, but not for the moment of force components. We confirmed specialization of different fingers with respect to different task components in quick manipulation tasks. The findings have implications for hypotheses on the control of voluntary movements involving redundant sets of effectors. Within the referent configuration hypothesis, components of a referent configuration may be adjusted to task mechanical characteristics using simple scaling rules. The neural organization of multi-digit synergies in a hierarchal system is able to selectively protect synergies related to stabilization of some performance variables from detrimental effects of the rate of change of those variables. A large number of apparently redundant elemental variables are not the source of additional computational problems but may be beneficial, allowing the central nervous system to facilitate synergies at both levels of the hierarchy.

The superposition principle applied to grasping an object producing moments outside anatomically-defined axes

The superposition principle suggests that motor commands can be divided into individually controlled components that summate to produce complex motor actions. Previous studies have examined the validity of this principle in human grasping by changing moments acting on an object about a single anatomically-defined axis and asking subjects to hold the object while their forearm was constrained. Superposition was reflected as separate control of the grip force and moments required to prevent object slip and maintain orientation. The objective of this study was to examine the robustness of this principle by: 1) expanding the range of tasks to include those where moments act on an object with respect to moment arms not necessarily in line with the anatomically-defined axes; 2) asking subjects to hold the object in an unconstrained manner. Ten subjects were asked to lift and hold an object vertically under eighteen moment conditions. Force and moment data from all digits were analysed using principal components analysis (PCA). Different PCAs were run for variable sets corresponding to moments about the long axis of the forearm (M(x)), the vertical (M(y)) and grip (M(z)) axes, and for the entire dataset (M(3D)). The PCA showed grip force and moment variables on separate PCs for the M(x), M(y), and M(3D) variable sets. The M(3D) PCA also showed a separation of variables corresponding to moments about each anatomically-defined axis. Thus, the present results show that the superposition principle holds during natural manipulation of an object experiencing external moments outside the anatomically-defined axes.

Age effects on rotational hand action

We investigated age-related differences in finger coordination during rotational hand actions. Two hypotheses based on earlier studies were tested: higher safety margins and lower synergy indices were expected in the elderly. Young and elderly subjects held a handle instrumented with five six-component force sensors and performed discrete accurate pronation and supination movements. The weight of the system was counterbalanced with another load. Indices of synergies stabilizing salient performance variables, such as total normal force, total tangential force, moments produced by these forces, and total moment of force were computed at two levels of a hypothetical control hierarchy, at the virtual finger-thumb level and at the individual finger level. At each level, synergy indices reflected the normalized difference between the sum of the variances of elemental variables and variance of their combined output, both computed at comparable phases over repetitive trials. The elderly group performed the task slower and showed lower safety margins for the thumb during the rotation phase. Overall, the synergy indices were not lower in the elderly group. In several cases, these indices were significantly higher in the elderly than in the younger participants. Hence, both main hypotheses have been falsified. We interpret the unexpectedly low safety margins in the elderly as resulting from several factors such as increased force variability, impaired feed-forward control, and the fact that there was no danger of dropping the object. Our results suggest that in some natural tasks, such as the one used in this study, healthy elderly persons show no impairment, as compared to younger persons, in their ability to organize digits into synergies stabilizing salient performance variables.

Static prehension of a horizontally oriented object in three dimensions

We studied static prehension of a horizontally oriented object. Specific hypotheses were explored addressing such issues as the sharing patterns of the total moment of force across the digits, presence of mechanically unnecessary digit forces, and trade-off between multi-digit synergies at the two levels of the assumed control hierarchy. Within the assumed hierarchy, at the upper level, the task is shared between the thumb and virtual finger (an imagined finger producing a wrench equal to the sum of the wrenches of individual fingers). At the lower level, action of the virtual finger is shared among the four actual fingers. The subjects held statically a horizontally oriented handle instrumented with six-component force/torque sensors with different loads and torques acting about the long axis of the handle. The thumb acted from above while the four fingers supported the weight of the object. When the external torque was zero, the thumb produced mechanically unnecessary force of about 2.8 N, which did not depend on the external load magnitude. When the external torque was not zero, tangential forces produced over 80% of the total moment of force. The normal forces by the middle and ring fingers produced consistent moments against the external torque, while the normal forces of the index and little fingers did not. Force and moment variables at both hierarchical levels were stabilized by covaried across trials adjustments of forces/moments produced by individual digits with the exception of the normal force analyzed at the lower level of the hierarchy. There was a trade-off between synergy indices computed at the two levels of the hierarchy for the three components of the total force vector, but not for the moment of force components. Overall, the results have shown that task mechanics are only one factor that defines forces produced by individual digits. Other factors, such as loading sensory receptors may lead to mechanically unnecessary forces. There seems to be no single rule (for example, ensuring similar safety margin values) that would describe sharing of the normal and tangential forces and be valid across tasks. Fingers that are traditionally viewed as less accurate (e.g., the ring finger) may perform more consistently in certain tasks. The observations of the trade-off between the synergy indices computed at two levels for the force variables but not for the moment of force variables suggest that the degree of redundancy (the number of excessive elemental variables) at the higher level is an important factor.

Prehension synergies during smooth changes of the external torque

We studied characteristics of digit action and their co-variation patterns across trials (prehension synergies) during static holding of an object while the external torque could change slowly and smoothly. The subjects held in the air an instrumented handle with an attachment that allowed a smooth change in the external torque over about 12 s; the load was always kept constant. Series of trials were performed under three conditions: The torque could be zero throughout the trial, or it could change slowly requiring a smooth change of the effort from a non-zero pronation value to zero (PR-0) or from a non-zero supination value to zero (SU-0). The handle was kept vertical at all times. Indices of variance and co-variation of elemental variables (forces and moments of force produced by individual digits) stabilizing such performance variables as total normal force, total tangential force, and total moment of force were computed at two levels of an assumed control hierarchy. At the upper level, the task is shared between the thumb and virtual finger (an imagined digit with the mechanical action equal to that of the four fingers), while at the lower level, the action of the virtual finger is shared among the actual four fingers. We analyzed the total moment of force as the sum of the moments of force produced by the thumb and virtual finger and also as the sum of the moments of force produced by the normal forces and tangential forces. The results showed that the adjustments in the total moment of force were produced primarily with changes in the moment produced by the virtual finger and by changes in the moment produced by the normal forces. The normal force of the thumb at the final state (which was the same across conditions) was larger in the two conditions with changes in the external torque. The safety margin was significantly higher in the PR-0 condition, and it dropped with the decrease in the external torque. A co-contraction index was computed to reflect the moment of force production by the fingers acting against the total moment produced by the virtual finger. It was higher for the SU-0 condition. Most variance indices dropped with a decrease in the external torque. The co-variation indices, however, remained unchanged over the trial duration. They showed signs of a trade-off between the two levels of the assumed hierarchy: larger indices at the higher level corresponded to smaller indices at the lower level. This study and the previous one (Sun et al. in Exp Brain Res 209:571-585, 2011) document several previously unknown features of prehensile tasks. The results show that characteristics of digit action and interaction in such tasks depend not only on the magnitudes of external constraints but also on a variety of other factors including time changes in the constraints and their history.

Two stages and three components of the postural preparation to action

Previous studies of postural preparation to action/perturbation have primarily focused on anticipatory postural adjustments (APAs), the changes in muscle activation levels resulting in the production of net forces and moments of force. We hypothesized that postural preparation to action consists of two stages: (1) Early postural adjustments (EPAs), seen a few hundred ms prior to an expected external perturbation and (2) APAs seen about 100 ms prior to the perturbation. We also hypothesized that each stage consists of three components, anticipatory synergy adjustments seen as changes in covariation of the magnitudes of commands to muscle groups (M-modes), changes in averaged across trials levels of muscle activation, and mechanical effects such as shifts of the center of pressure. Nine healthy participants were subjected to external perturbations created by a swinging pendulum while standing in a semi-squatting posture. Electrical activity of twelve trunk and leg muscles and displacements of the center of pressure were recorded and analyzed. Principal component analysis was used to identify four M-modes within the space of muscle activations using indices of integrated muscle activation. This analysis was performed twice, over two phases, 400-700 ms prior to the perturbation and over 200 ms just prior to the perturbation. Similar robust results were obtained using the data from both phases. An index of a multi-M-mode synergy stabilizing the center of pressure displacement was computed using the framework of the uncontrolled manifold hypothesis. The results showed high synergy indices during quiet stance. Each of the two stages started with a drop in the synergy index followed by a change in the averaged across trials activation levels in postural muscles. There was a very long electromechanical delay during the early postural adjustments and a much shorter delay during the APAs. Overall, the results support our main hypothesis on the two stages and three components of the postural preparation to action/perturbation. This is the first study to document anticipatory synergy adjustments in whole-body tasks. We interpret the results within the referent configuration hypothesis (an extension of the equilibrium-point hypothesis): The early postural adjustment is based primarily on changes in the coactivation command, while the APAs involve changes in the reciprocal command. The results fit an earlier hypothesis that whole-body movements are controlled by a neuromotor hierarchy where each level involves a few-to-many mappings organized to stabilize its overall output.

Stabilization of the total force in multi-finger pressing tasks studied with the 'inverse piano' technique

When one finger changes its force, other fingers of the hand can show unintended force changes in the same direction (enslaving) and in the opposite direction (error compensation). We tested a hypothesis that externally imposed changes in finger force predominantly lead to error compensation effects in other fingers thus stabilizing the total force. A novel device, the "inverse piano", was used to impose controlled displacements to one of the fingers over different magnitudes and at different rates. Subjects (n=10) pressed with four fingers at a constant force level and then one of the fingers was unexpectedly raised. The subjects were instructed not to interfere with possible changes in the finger forces. Raising a finger caused an increase in its force and a drop in the force of the other three fingers. Overall, total force showed a small increase. Larger force drops were seen in neighbors of the raised finger (proximity effect). The results showed that multi-finger force stabilizing synergies dominate during involuntary reactions to externally imposed finger force changes. Within the referent configuration hypothesis, the data suggest that the instruction "not to interfere" leads to adjustments of the referent coordinates of all the individual fingers.

Prehension of half-full and half-empty glasses: time and history effects on multi-digit coordination

We explored how digit forces and indices of digit coordination depend on the history of getting to a particular set of task parameters during static prehension tasks. The participants held in the right hand an instrumented handle with a light-weight container attached on top of the handle. At the beginning of each trial, the container could be empty, filled to the half with water (0.4 l), or filled to the top (0.8 l). The water was pumped in/out of the container at a constant, slow rate over 10 s. At the end of each trial, the participants always held a half-filled container that has just been filled (Empty-Half), emptied (Full-Half) or stayed half-filled throughout the trial (Half-Only). Indices of covariation (synergy indices) of elemental variables (forces and moments of force produced by individual digits) stabilizing such performance variables as total normal force, total tangential force, and total moment of force were computed at two levels of an assumed control hierarchy. At the upper level, the task is shared between the thumb and virtual finger (an imagined digit with the mechanical action equal to that of the four fingers), while at the lower level the action of the virtual finger is shared among the actual four fingers. Filling or emptying the container led to a drop in the safety margin (proportion of grip force over the slipping threshold) below the values observed in the Half-Only condition. Synergy indices at both levels of the hierarchy showed changes over the Full-Half and Empty-Half condition. These changes could be monotonic (typical of moment of force and normal force) or non-monotonic (typical of tangential force). For both normal and tangential forces, higher synergy indices at the higher level of the hierarchy corresponded to lower indices at the lower level. Significant differences in synergy indices across conditions were seen at the final steady state showing that digit coordination during steady holding an object is history dependent. The observations support an earlier hypothesis on a trade-off between synergies at the two levels of a hierarchy. They also suggest that, when a change in task parameters is expected, the neural strategy may involve producing less stable (easier to change) actions. The results suggest that synergy indices may be highly sensitive to changes in a task variable and that effects of such changes persist after the changes are over.

Multi-finger pressing synergies change with the level of extra degrees of freedom

The purpose of this study was to test the principle of motor abundance, which has been hypothesized as the principle by which the central nervous system controls the excessive degrees of freedom of the human movements, in contrast to the traditional negative view of motor redundancy. This study investigated the changes in force stabilizing and moment stabilizing synergies for multi-finger pressing tasks involving different number of fingers. Twelve healthy subjects produced a constant pressing force while watching visual feedback of the total pressing force for the fingers involved in each task. Based on the principle of motor abundance, it was hypothesized that the multi-finger synergies for the total force stabilizing synergy and the total moment stabilizing synergy would be greater as the number of task finger increases. Force stabilizing and moment stabilizing synergies were quantified using the framework of the uncontrolled manifold analysis. It was found that strong force stabilizing synergies existed for all the finger combinations. The index of force stabilizing synergies was greater when the task involved more number of fingers. The index of moment stabilizing synergies was negative for the two-finger combination, representing moment destabilizing synergies. However, the index of moment stabilizing synergies was positive for three-finger and four-finger combinations, representing strong moment stabilizing synergies for these finger combinations. We interpret the findings as an evidence for the principle of abundance for stabilization of both, total force as well as total moment.

Multi-finger interaction during involuntary and voluntary single finger force changes

Two types of finger interaction are characterized by positive co-variation (enslaving) or negative co-variation (error compensation) of finger forces. Enslaving reflects mechanical and neural connections among fingers, while error compensation results from synergic control of fingers to stabilize their net output. Involuntary and voluntary force changes by a finger were used to explore these patterns. We hypothesized that synergic mechanisms will dominate during involuntary force changes, while enslaving will dominate during voluntary finger force changes. Subjects pressed with all four fingers to match a target force that was 10% of their maximum voluntary contraction (MVC). One of the fingers was unexpectedly raised 5.0 mm at a speed of 30.0 mm/s. During finger raising the subject was instructed "not to intervene voluntarily". After the finger was passively lifted and a new steady-state achieved, subjects pressed down with the lifted finger, producing a pulse of force voluntarily. The data were analyzed in terms of finger forces and finger modes (hypothetical commands to fingers reflecting their intended involvement). The target finger showed an increase in force during both phases. In the involuntary phase, the target finger force changes ranged between 10.71 ± 1.89% MVC (I-finger) and 16.60 ± 2.26% MVC (L-finger). Generally, non-target fingers displayed a force decrease with a maximum amplitude of -1.49 ± 0.43% MVC (L-finger). Thus, during the involuntary phase, error compensation was observed--non-lifted fingers showed a decrease in force (as well as in mode magnitude). During the voluntary phase, enslaving was observed--non-target fingers showed an increase in force and only minor changes in mode magnitude. The average change in force of non-target fingers ranged from 21.83 ± 4.47% MVC for R-finger (M-finger task) to 0.71 ± 1.10% MVC for L-finger (I-finger task). The average change in mode of non-target fingers was between -7.34 ± 19.27% MVC for R-finger (L-finger task) and 7.10 ± 1.38% MVC for M-finger (I-finger task). We discuss a range of factors affecting force changes, from purely mechanical effects of finger passive lifting to neural synergic adjustments of commands to individual fingers. The data fit a recently suggested scheme that merges the equilibrium-point hypothesis (control with referent configurations) with the idea of hierarchical synergic control of multi-element systems.

Finger interaction in a three-dimensional pressing task

Accurate control of forces produced by the fingers is essential for performing object manipulation. This study examines the indices of finger interaction when accurate time profiles of force are produced in different directions, while using one of the fingers or all four fingers of the hand. We hypothesized that patterns of unintended force production among shear force components may involve features not observed in the earlier studies of vertical force production. In particular, we expected to see unintended forces generated by non-task fingers not in the direction of the instructed force but in the opposite direction as well as substantial force production in directions orthogonal to the instructed direction. We also tested a hypothesis that multi-finger synergies, quantified using the framework of the uncontrolled manifold hypothesis, will help reduce across-trials variance of both total force magnitude and direction. Young, healthy subjects were required to produce accurate ramps of force in five different directions by pressing on force sensors with the fingers of the right (dominant) hand. The index finger induced the smallest unintended forces in non-task fingers. The little finger showed the smallest unintended forces when it was a non-task finger. Task fingers showed substantial force production in directions orthogonal to the intended force direction. During four-finger tasks, individual force vectors typically pointed off the task direction, with these deviations nearly perfectly matched to produce a resultant force in the task direction. Multi-finger synergy indices reflected strong co-variation in the space of finger modes (commands to fingers) that reduced variability of the total force magnitude and direction across trials. The synergy indices increased in magnitude over the first 30% of the trial time and then stayed at a nearly constant level. The synergy index for stabilization of total force magnitude was higher for shear force components when compared to the downward pressing force component. The results suggest complex interactions between enslaving and synergic force adjustments, possibly reflecting the experience with everyday prehensile tasks. For the first time, the data document multi-finger synergies stabilizing both shear force magnitude and force vector direction. These synergies may play a major role in stabilizing the hand action during object manipulation.

Manipulation of a fragile object

We investigated strategies of adjustments in kinetic and kinematic patterns, and in multi-digit synergies during quick vertical transport of an instrumented handle that collapsed when the grasping force exceeded a certain magnitude (quantified with a fragility index). The collapse threshold of the object was set using a novel electromagnetic device. Moving a fragile object is viewed as a task with two constraints on the grip force defined by the slipping and crushing thresholds. When moving more fragile objects, subjects decreased object peak acceleration, increased movement time, showed a drop in the safety margin (SM) (extra force over the slipping threshold), and showed a tendency toward violating the minimum-jerk criterion. Linear regression analysis of grip force against load force has shown tight coupling between the two with a decline in the coefficient of determination with increased fragility index. The SM was lower in bimanual tasks, compared to unimanual tasks, for both fragile and non-fragile objects. Two novel indices have been introduced and studied, the SM due to fragility and the drop-crush index. Both indices showed a decrease with increased object fragility. Changes in the drop-crush index showed that the subjects would rather crush the fragile objects as opposed to dropping them, possibly reflecting the particular experimental procedure. We did not find differences between the performance indices of the dominant and non-dominant hand thus failing to support the recently formulated dominance hypothesis. The synergies stabilizing grip force were quantified at two levels of an assumed two-level control hierarchy using co-variation indices between elemental variables across trials. There were strong synergies at the upper level of the hierarchy (the task is shared between the opposing groups of digits) that weakened with an increase in object fragility. At the lower level (action of an effector is shared among the four fingers), higher fragility led to higher synergy indices. Analysis of force variance showed that an increase in object fragility was accompanied by exploring a smaller range of equivalent combinations of elemental variables. The additional constraint imposed by high fragility facilitated synergies at the lower level of the hierarchy, while there was evidence for a trade-off between synergies at the two levels.

Prehension synergies and control with referent hand configurations

We used the framework of the equilibrium-point hypothesis (in its updated form based on the notion of referent configuration) to investigate the multi-digit synergies at two levels of a hypothetical hierarchy involved in prehensile actions. Synergies were analyzed at the thumb-virtual finger (VF) level (VF is an imaginary digit with the mechanical action equivalent to that of the four actual fingers) and at the individual finger level. The subjects performed very quick vertical movements of a handle into a target. A load could be attached off-center to provide a pronation or supination torque. In a few trials, the handle was unexpectedly fixed to the table and the digits slipped off the sensors. In such trials, the hand stopped at a higher vertical position and rotated into pronation or supination depending on the expected torque. The aperture showed non-monotonic changes with a large, fast decrease and further increase, ending up with a smaller distance between the thumb and the fingers as compared to unperturbed trials. Multi-digit synergies were quantified using indices of co-variation between digit forces and moments of force across unperturbed trials. Prior to the lifting action, high synergy indices were observed at the individual finger level while modest indices were observed at the thumb-VF level. During the lifting action, the synergies at the individual finger level disappeared while the synergy indices became higher at the thumb-VF level. The results support the basic premise that, within a given task, setting a referent configuration may be described with a few referent values of variables that influence the equilibrium state, to which the system is attracted. Moreover, the referent configuration hypothesis can help interpret the data related to the trade-off between synergies at different hierarchical levels.