Digit Position and Forces Covary during Anticipatory Control of Whole-Hand Manipulation

Dexterous manipulation: differential sensitivity of manipulation and grasp forces to task requirements

How humans coordinate digit forces to perform dexterous manipulation is not well understood. This gap is due to the use of tasks devoid of dexterity requirements and/or the use of analytical techniques that cannot isolate the roles that digit forces play in preventing object slip and controlling object position and orientation (pose). In our recent work, we used a dexterous manipulation task and decomposed digit forces into FG, the internal force that prevents object slip, and FM, the force responsible for object pose control. Unlike FG, FM was modulated from object lift onset to hold, suggesting their different sensitivity to sensory feedback acquired during object lift. However, the extent to which FG and FM can be controlled independently remains to be determined. Importantly, how FG and FM change as a function of object property is mathematically indeterminate and therefore requires active modulation. To address this gap, we systematically changed either object mass or external torque. The FM normal component responsible for object orientation control was modulated to changes in object torque but not mass. In contrast, FG was distinctly modulated to changes in object mass and torque. These findings point to a differential sensitivity of FG and FM to task requirements and provide novel insights into the neural control of dexterous manipulation. Importantly, our results indicate that the proposed digit force decomposition has the potential to capture important differences in how sensory inputs are processed and integrated to simultaneously ensure grasp stability and dexterous object pose control.NEW & NOTEWORTHY Successful dexterous object manipulation requires simultaneous prevention of object slip and object pose control. How these two task goals are attained can be investigated by decomposing digit forces into grasp and manipulation forces, respectively. We found that these forces were characterized by differential sensitivity to changes in object properties (mass and torque). This finding suggests the involvement of distinct sensorimotor mechanisms that, combined, simultaneously ensure grasp stability and dexterous control of object pose.

Force Control Strategy of Five-Digit Precision Grasping With Aligned and Unaligned Configurations

OBJECTIVE

To investigate the digit force control during a five-digit precision grasp in aligned (AG) and unaligned grasping (UG) configurations.

BACKGROUND

The effects of various cylindrical handles for tools on power grasp performance have been previously investigated. However, there is little information on force control strategy of precision grasp to fit various grasping configurations.

METHOD

Twenty healthy young adults were recruited to perform a lift-hold-lower task. The AG and UG configurations on a cylindrical simulator with force transducers were adjusted for each individual. The applied force and moment, the force variability during holding, and force correlations between thumb and each finger were measured.

RESULT

No differences in applied force, force correlation, repeatability, and variability were found between configurations. However, the moments applied in UG were significantly larger than those in AG.

CONCLUSION

The force control during precision grasp did not change significantly across AG and UG except for the digit moment. The simulator is controlled efficiently with large moment during UG, which is thus the optimal configuration for precision grasping with a cylindrical handle. Further research should consider the effects of task type and handle design on force control, especially for individuals with hand disorders.

APPLICATION

To design the handle of specific tool, one should consider the appropriate configuration according to the task requirements of precision grasping to reduce the risk of accumulating extra loads on digits with a cylindrical handle.

Object-centered sensorimotor bias of torque control in the chronic stage following stroke

When lifting objects whose center of mass (CoM) are not centered below the handle one must compensate for arising external torques already at lift-off to avoid object tilt. Previous studies showed that finger force scaling during object lifting may be impaired at both hands following stroke. However, torque control in object manipulation has not yet been studied in patients with stroke. In this pilot study, thirteen patients with chronic stage left hemispheric stroke (SL), nine patients with right hemispheric stroke (SR) and hand-matched controls had to grasp and lift an object with the fingertips of their ipsilesional hand at a handle while preventing object tilt. Object CoM and therewith the external torque was varied by either relocating a covert weight or the handle. The compensatory torque at lift-off (Tcom) is the sum of the torque resulting from (1) grip force being produced at different vertical finger positions (∆CoP × GF) and (2) different vertical load forces on both sides of the handle (∆Fy × w/2). When having to rely on sensorimotor memories, ∆CoP × GF was elevated when the object CoM was on the ipsilesional-, but decreased when CoM was on the contralesional side in SL, whereas ∆Fy × w/2 was biased in the opposite direction, resulting in normal Tcom. SR patients applied a smaller ∆CoP × GF when the CoM was on the contralesional side. Torques were not altered when geometric cues were available. Our findings provide evidence for an object-centered spatial bias of manual sensorimotor torque control with the ipsilesional hand following stroke reminiscent of premotor neglect. Both intact finger force-to-position coordination and visuomotor control may compensate for the spatial sensorimotor bias in most stroke patients. Future studies will have to confirm the found bias and evaluate the association with premotor neglect.

Spatial Instability during Precision Grip–Lift in Children with Poor Manual Dexterity

Although children with developmental coordination disorder (DCD) show impaired precision grip control due to a sensory-motor integration deficit, their spatial instability (such as changes in force direction and object roll during a precision grip task) is unclear. Herein, we investigated the spatial instability in the precision grip force control of children with poor manual dexterity. We divided 66 school-aged children who performed a precision gripping and lifting of heavy- or lightweight objects into those with low manual dexterity (n = 11) and those with high manual dexterity (n = 55) as revealed by the Movement Assessment Battery for Children (2nd edition). The group and weight effects were then determined. The results revealed that the total trajectory lengths of the center of pressure (COP) were longer in the lightweight object data of the children in the low-manual-dexterity group and were related to the children’s grip force. The low-manual-dexterity group also showed a shifted COP position from the center of the object in the medial–lateral direction and in the object roll regardless of the object’s weight; these were closely related in both weights’ tests. These results demonstrated that children with poor manual dexterity show spatial instability and different adaptations to the weight of objects during a precision grip task. Further studies are needed to determine whether these findings would be replicated in children with a diagnosis of DCD.

Anticipatory Motor Planning and Control of Grasp in Children with Unilateral Spastic Cerebral Palsy

Children with unilateral spastic cerebral palsy (USCP) have impairments in motor planning, impacting their ability to grasp objects. We examined the planning of digit position and force and the flexibility of the motor system in covarying these during object manipulation. Eleven children with a left hemisphere lesion (LHL), nine children with a right hemisphere lesion (RHL) and nine typically developing children (controls) participated in the study. Participants were instructed to use a precision grip with their dominant/less affected hand to lift and keep an object level, with either a left, centered or right center of mass (COM) location. Digit positions, forces, compensatory torque and object roll where measured. Although children with USCP generated a compensatory torque and modulated digit placement by lift-off, their index finger was either collinear or higher than the thumb, regardless of COM location, leading to larger rolls after lift-off especially for the RHL group. The findings suggest that while the kinetics of grasp control is intact, the kinematics of grasp control is impaired. This study adds to the understanding of the underlying mechanisms of anticipatory planning and control of grasp in children with USCP and may provide insights on how to improve hand function in children with USCP.

Transfer and generalization of learned manipulation between unimanual and bimanual tasks

Successful object manipulation, such as preventing object roll, relies on the modulation of forces and centers of pressure (point of application of digits on each grasp surface) prior to lift onset to generate a compensatory torque. Whether or not generalization of learned manipulation can occur after adding or removing effectors is not known. We examined this by recruiting participants to perform lifts in unimanual and bimanual grasps and analyzed results before and after transfer. Our results show partial generalization of learned manipulation occurred when switching from a (1) unimanual to bimanual grasp regardless of object center of mass, and (2) bimanual to unimanual grasp when the center of mass was on the thumb side. Partial generalization was driven by the modulation of effectors' center of pressure, in the appropriate direction but of insufficient magnitude, while load forces did not contribute to torque generation after transfer. In addition, we show that the combination of effector forces and centers of pressure in the generation of compensatory torque differ between unimanual and bimanual grasping. These findings highlight that (1) high-level representations of learned manipulation enable only partial learning transfer when adding or removing effectors, and (2) such partial generalization is mainly driven by modulation of effectors' center of pressure.

Intention to be force efficient improves high-level anticipatory coordination of finger positions and forces in young and elderly adults

Successful object manipulation requires anticipatory high-level control of finger positions and forces to prevent object slip and tilt. Unlike young adults, who efficiently scale grip forces (GFs) according to surface conditions, old adults were reported to exert excessive grip forces. In this study, we theoretically show how grip force economy depends on the modulation of the centers of pressure on opposing grip surfaces (ΔCoP) according to object properties. In a grasp-to-lift study with young and elderly participants, we investigated how the instruction to lift the object with efficient GF influences the anticipation of torques, ΔCoP and GF control during complex variations of mass distributions and surface properties. Provision of the explicit instruction to strive for force efficiency prompted both age groups to optimize their ΔCoP modulation, although to a lesser degree in the elderly, and also led to a refinement of torque anticipation for a right-sided weight distribution in the young, but not the elderly participants. Consequently, marked drops in GF levels resulted. Furthermore, participants enhanced ΔCoP modulation and lowered GF safety ratios in challenging surface conditions. Higher GF in the elderly was due to decreased skin-surface friction but also worse ΔCoP modulation for lateralized mass distributions when trying to be force efficient. In contrast, safety margins were not elevated in the elderly, suggesting preserved GF control. Our findings demonstrate how task goals influence high-level motor control of object manipulation differentially in young and elderly participants and highlight the necessity to control for both instructions and friction when investigating GF control.NEW & NOTEWORTHY Previous studies have shown that forces are covaried as a function of centers of pressure (CoPs) to exert adequate torques. Here, we demonstrate that force-efficient object manipulation requires the modulation of CoPs and show that providing the instruction to be force efficient and challenging surface conditions elicits a GF safety ratio reduction as well as an optimization of anticipatory CoP modulation and torques in the young and, to a lesser degree, in the elderly.

Representational Neural Mapping of Dexterous Grasping Before Lifting in Humans

The ability of humans to reach and grasp objects in their environment has been the mainstay paradigm for characterizing the neural circuitry driving object-centric actions. Although much is known about hand shaping, a persistent question is how the brain orchestrates and integrates the grasp with lift forces of the fingers in a coordinated manner. The objective of the current study was to investigate how the brain represents grasp configuration and lift force during a dexterous object-centric action in a large sample of male and female human subjects. BOLD activity was measured as subjects used a precision-grasp to lift an object with a center of mass (CoM) on the left or right with the goal of minimizing tilting the object. The extent to which grasp configuration and lift force varied between left and right CoM conditions was manipulated by grasping the object collinearly (requiring a non-collinear force distribution) or non-collinearly (requiring more symmetrical forces). Bayesian variational representational similarity analyses on fMRI data assessed the evidence that a set of cortical and cerebellar regions were sensitive to grasp configuration or lift force differences between CoM conditions at differing time points during a grasp to lift action. In doing so, we reveal strong evidence that grasping and lift force are not represented by spatially separate functionally specialized regions, but by the same regions at differing time points. The coordinated grasp to lift effort is shown to be under dorsolateral (PMv and AIP) more than dorsomedial control, and under SPL7, somatosensory PSC, ventral LOC and cerebellar control.SIGNIFICANCE STATEMENT Clumsy disasters such as spilling, dropping, and crushing during our daily interactions with objects are a rarity rather than the norm. These disasters are avoided in part as a result of our orchestrated anticipatory efforts to integrate and coordinate grasping and lifting of object interactions, all before the lift of an object even commences. How the brain orchestrates this integration process has been largely neglected by historical approaches independently and solely focusing on reaching and grasping and the neural principles that guide them. Here, we test the extent to which grasping and lifting are represented in a spatially or temporally distinct manner and identified strong evidence for the consecutive emergence of sensitivity to grasping, then lifting within the same region.

The Visual Perception of Material Properties Affects Motor Planning in Prehension: An Analysis of Temporal and Spatial Components of Lifting Cups

The current study examined the role of visually perceived material properties in motor planning, where we analyzed the temporal and spatial components of motor movements during a seated reaching task. We recorded hand movements of 14 participants in three dimensions while they lifted and transported paper cups that differed in weight and glossiness. Kinematic- and spatial analysis revealed speed-accuracy trade-offs to depend on visual material properties of the objects, in which participants reached slower and grabbed closer to the center of mass for stimuli that required to be handled with greater precision. We found grasp-preparation during the first encounters with the cups was not only governed by the anticipated weight of the cups, but also by their visual material properties, namely glossiness. After a series of object lifting, the execution of reaching, the grip position, and the transportation of the cups from one location to another were preeminently guided by the object weight. We also found the planning phase in reaching to be guided by the expectation of hardness and surface gloss. The findings promote the role of general knowledge of material properties in reach-to-grasp movements, in which visual material properties are incorporated in the spatio-temporal components.

Hand forces and placement are modulated and covary during anticipatory control of bimanual manipulation

Dexterous object manipulation relies on the feedforward and feedback control of kinetics (forces) and kinematics (hand shaping and digit placement). Lifting objects with an uneven mass distribution involves the generation of compensatory moments at object lift-off to counter object torques. This is accomplished through the modulation and covariation of digit forces and placement, which has been shown to be a general feature of unimanual manipulation. These feedforward anticipatory processes occur before performance-specific feedback. Whether this adaptation is a feature unique to unimanual dexterous manipulation or general across unimanual and bimanual manipulation is not known. We investigated the generation of compensatory moments through hand placement and force modulation during bimanual manipulation of an object with variable center of mass. Participants were instructed to prevent object roll during the lift. Similar to unimanual grasping, we found modulation and covariation of hand forces and placement for successful performance. Thus this motor adaptation of the anticipatory control of compensatory moment is a general feature across unimanual and bimanual effectors. Our results highlight the involvement of high-level representation of manipulation goals and underscore a sensorimotor circuitry for anticipatory control through a continuum of force and placement modulation of object manipulation across a range of effectors.

NEW & NOTEWORTHY This is the first study, to our knowledge, to show that successful bimanual manipulation of objects with asymmetrical centers of mass is performed through the modulation and covariation of hand forces and placements to generate compensatory moments. Digit force-to-placement modulation is thus a general phenomenon across multiple effectors, such as the fingers of one hand, and both hands. This adds to our understanding of integrating low-level internal representations of object properties into high-level task representations.

Neural Representations of Sensorimotor Memory- and Digit Position-Based Load Force Adjustments Before the Onset of Dexterous Object Manipulation

Anticipatory load forces for dexterous object manipulation in humans are modulated based on visual object property cues, sensorimotor memories of previous experiences with the object, and, when digit positioning varies from trial to trial, the integrating of this sensed variability with force modulation. Studies of the neural representations encoding these anticipatory mechanisms have not considered these mechanisms separately from each other or from feedback mechanisms emerging after lift onset. Here, representational similarity analyses of fMRI data were used to identify neural representations of sensorimotor memories and the sensing and integration of digit position. Cortical activity and movement kinematics were measured as 20 human subjects (11 women) minimized tilt of a symmetrically shaped object with a concealed asymmetric center of mass (CoM, left and right sided). This task required generating compensatory torques in opposite directions, which, without helpful visual CoM cues, relied primarily on sensorimotor memories of the same object and CoM. Digit position was constrained or unconstrained, the latter of which required modulating forces beyond what can be recalled from sensorimotor memories to compensate for digit position variability. Ventral premotor (PMv), somatosensory, and cerebellar lobule regions (CrusII, VIIIa) were sensitive to anticipatory behaviors that reflect sensorimotor memory content, as shown by larger voxel pattern differences for unmatched than matched CoM conditions. Cerebellar lobule I-IV, Broca area 44, and PMv showed greater voxel pattern differences for unconstrained than constrained grasping, which suggests their sensitivity to monitor the online coincidence of planned and actual digit positions and correct for a mismatch by force modulation.SIGNIFICANCE STATEMENT To pick up a water glass without slipping, tipping, or spilling requires anticipatory planning of fingertip load forces before the lift commences. This anticipation relies on object visual properties (e.g., mass/mass distribution), sensorimotor memories built from previous experiences (especially when object properties cannot be inferred visually), and online sensing of where the digits are positioned. There is limited understanding of how the brain represents each of these anticipatory mechanisms. We used fMRI measures of regional brain patterns and digit position kinematics before lift onset of an object with nonsalient visual cues specifically to isolate sensorimotor memories and integration of sensed digit position with force modulation. In doing so, we localized neural representations encoding these anticipatory mechanisms for dexterous object manipulation.

On neuromechanical approaches for the study of biological and robotic grasp and manipulation

Biological and robotic grasp and manipulation are undeniably similar at the level of mechanical task performance. However, their underlying fundamental biological vs. engineering mechanisms are, by definition, dramatically different and can even be antithetical. Even our approach to each is diametrically opposite: inductive science for the study of biological systems vs. engineering synthesis for the design and construction of robotic systems. The past 20 years have seen several conceptual advances in both fields and the quest to unify them. Chief among them is the reluctant recognition that their underlying fundamental mechanisms may actually share limited common ground, while exhibiting many fundamental differences. This recognition is particularly liberating because it allows us to resolve and move beyond multiple paradoxes and contradictions that arose from the initial reasonable assumption of a large common ground. Here, we begin by introducing the perspective of neuromechanics, which emphasizes that real-world behavior emerges from the intimate interactions among the physical structure of the system, the mechanical requirements of a task, the feasible neural control actions to produce it, and the ability of the neuromuscular system to adapt through interactions with the environment. This allows us to articulate a succinct overview of a few salient conceptual paradoxes and contradictions regarding under-determined vs. over-determined mechanics, under- vs. over-actuated control, prescribed vs. emergent function, learning vs. implementation vs. adaptation, prescriptive vs. descriptive synergies, and optimal vs. habitual performance. We conclude by presenting open questions and suggesting directions for future research. We hope this frank and open-minded assessment of the state-of-the-art will encourage and guide these communities to continue to interact and make progress in these important areas at the interface of neuromechanics, neuroscience, rehabilitation and robotics.