Effects of object compliance on three-digit grasping

Grip Force Control During Virtual Interaction With Deformable and Rigid Objects Via a Haptic Gripper

Most studies of grip force control focus on the manipulation of rigid objects. However, in virtual and teleoperation applications, objects are often elastic in the pinch degree-of-freedom, and are manipulated using a handle that presents haptic feedback to the user. When designing controllers for haptic grippers, it is crucial to understand how grip force is controlled when manipulating rigid and deformable objects. Here, we used a virtual teleoperation setup with a haptic gripper interface to investigate grip force control in virtual environments. Ten participants lifted virtual objects and performed vertical, cyclic motions using a haptic gripper. We manipulated the control signal to the virtual interface, the haptic properties of the gripper, and the visual properties of the virtual objects to test their effect on the grip force control. We found that participants modulated their grip force as a function of the anticipated load force in all of the experimental conditions. The control signal and properties of the haptic gripper, but not the visual properties of the objects, affected the baseline and the extent of the grip force modulation. These results can provide design guidelines for haptic grippers that elicit natural grasping in virtual and bilateral teleoperation applications.

A Novel Grip Force Measurement Concept for Tactile Stimulation Mechanisms - Design, Validation, and User Study

In this article, we developed a new grip force measurement concept that allows for embedding tactile stimulation mechanisms in a gripper. This concept is based on a single force sensor to measure the force applied on each side of the gripper, and substantially reduces tactor motion artifacts on force measurement. To test the feasibility of this new concept, we built a device that measures control of grip force in response to a tactile stimulation from a moving tactor. We calibrated and validated our device with a testing setup with a second force sensor over a range of 0 to 20 N without movement of the tactors. We tested the effect of tactor movement on the measured grip force, and measured artifacts of 1% of the measured force. We demonstrated that during the application of dynamically changing grip forces, the average errors were 2.9% and 3.7% for the left and right sides of the gripper, respectively. We characterized the bandwidth, backlash, and noise of our tactile stimulation mechanism. Finally, we conducted a user study and found that in response to tactor movement, participants increased their grip force, the increase was larger for a smaller target force, and depended on the amount of tactile stimulation.

A review of the neurobiomechanical processes underlying secure gripping in object manipulation

O'SHEA, H. and S. J. Redmond. A review of the neurobiomechanical processes underlying secure gripping in object manipulation. NEUROSCI BIOBEHAV REV 286-300, 2021. Humans display skilful control over the objects they manipulate, so much so that biomimetic systems have yet to emulate this remarkable behaviour. Two key control processes are assumed to facilitate such dexterity: predictive cognitive-motor processes that guide manipulation procedures by anticipating action outcomes; and reactive sensorimotor processes that provide important error-based information for movement adaptation. Notwithstanding increased interdisciplinary research interest in object manipulation behaviour, the complexity of the perceptual-sensorimotor-cognitive processes involved and the theoretical divide regarding the fundamentality of control mean that the essential mechanisms underlying manipulative action remain undetermined. In this paper, following a detailed discussion of the theoretical and empirical bases for understanding human dexterous movement, we emphasise the role of tactile-related sensory events in secure object handling, and consider the contribution of certain biophysical and biomechanical phenomena. We aim to provide an integrated account of the current state-of-art in skilled human-object interaction that bridges the literature in neuroscience, cognitive psychology, and biophysics. We also propose novel directions for future research exploration in this area.

Eye tracking a self-moved target with complex hand-target dynamics

Previous work has shown that the ability to track with the eye a moving target is substantially improved when the target is self-moved by the subject's hand compared with when being externally moved. Here, we explored a situation in which the mapping between hand movement and target motion was perturbed by simulating an elastic relationship between the hand and target. Our objective was to determine whether the predictive mechanisms driving eye-hand coordination could be updated to accommodate this complex hand-target dynamics. To fully appreciate the behavioral effects of this perturbation, we compared eye tracking performance when self-moving a target with a rigid mapping (simple) and a spring mapping as well as when the subject tracked target trajectories that he/she had previously generated when using the rigid or spring mapping. Concerning the rigid mapping, our results confirmed that smooth pursuit was more accurate when the target was self-moved than externally moved. In contrast, with the spring mapping, eye tracking had initially similar low spatial accuracy (though shorter temporal lag) in the self versus externally moved conditions. However, within ∼5 min of practice, smooth pursuit improved in the self-moved spring condition, up to a level similar to the self-moved rigid condition. Subsequently, when the mapping unexpectedly switched from spring to rigid, the eye initially followed the expected target trajectory and not the real one, thereby suggesting that subjects used an internal representation of the new hand-target dynamics. Overall, these results emphasize the stunning adaptability of smooth pursuit when self-maneuvering objects with complex dynamics.

ThimbleSense: A Fingertip-Wearable Tactile Sensor for Grasp Analysis

Accurate measurement of contact forces between hand and grasped objects is crucial to study sensorimotor control during grasp and manipulation. In this work, we introduce ThimbleSense, a prototype of individual-digit wearable force/torque sensor based on the principle of intrinsic tactile sensing. By exploiting the integration of this approach with an active marker-based motion capture system, the proposed device simultaneously measures absolute position and orientation of the fingertip, which in turn yields measurements of contacts and force components expressed in a global reference frame. The main advantage of this approach with respect to more conventional solutions is its versatility. Specifically, ThimbleSense can be used to study grasping and manipulation of a wide variety of objects, while still retaining complete force/torque measurements. Nevertheless, validation of the proposed device is a necessary step before it can be used for experimental purposes. In this work, we present the results of a series of experiments designed to validate the accuracy of ThimbleSense measurements and evaluate the effects of distortion of tactile afferent inputs caused by the device's rigid shells on grasp forces.

Effect of homogenous object stiffness on tri-digit grasp properties

This paper presents experimental findings on how humans modulate their muscle activity while grasping objects of varying levels of compliance. We hypothesize that one of the key abilities that allows humans to successfully cope with uncertainties while grasping compliant objects is the ability to modulate muscle activity to control both grasp force and stiffness in a way that is coherent with the task. To that end, subjects were recruited to perform a grasp and lift task with a tripod-grasp device with contact surfaces of variable compliance. Subjects performed the task under four different compliance conditions while surface EMG from the main finger flexor and extensor muscles was recorded along with force and torque data at the contact points. Significant increases in the extensor muscle (the antagonist in the task) and co-contraction levels were found with increasing compliance at the contact points. These results suggest that the motor system may employ a strategy of increasing co-contraction, and thereby stiffness, to counteract the decreased stability in grasping compliant objects. Future experiments will examine the extent to which this phenomenon is also related to specific task features, such as precision versus power grasp and object weight.

Ten-dimensional anthropomorphic arm control in a human brain-machine interface: difficulties, solutions, and limitations

OBJECTIVE

In a previous study we demonstrated continuous translation, orientation and one-dimensional grasping control of a prosthetic limb (seven degrees of freedom) by a human subject with tetraplegia using a brain-machine interface (BMI). The current study, in the same subject, immediately followed the previous work and expanded the scope of the control signal by also extracting hand-shape commands from the two 96-channel intracortical electrode arrays implanted in the subject's left motor cortex.

APPROACH

Four new control signals, dictating prosthetic hand shape, replaced the one-dimensional grasping in the previous study, allowing the subject to control the prosthetic limb with ten degrees of freedom (three-dimensional (3D) translation, 3D orientation, four-dimensional hand shaping) simultaneously.

MAIN RESULTS

Robust neural tuning to hand shaping was found, leading to ten-dimensional (10D) performance well above chance levels in all tests. Neural unit preferred directions were broadly distributed through the 10D space, with the majority of units significantly tuned to all ten dimensions, instead of being restricted to isolated domains (e.g. translation, orientation or hand shape). The addition of hand shaping emphasized object-interaction behavior. A fundamental component of BMIs is the calibration used to associate neural activity to intended movement. We found that the presence of an object during calibration enhanced successful shaping of the prosthetic hand as it closed around the object during grasping.

SIGNIFICANCE

Our results show that individual motor cortical neurons encode many parameters of movement, that object interaction is an important factor when extracting these signals, and that high-dimensional operation of prosthetic devices can be achieved with simple decoding algorithms. ClinicalTrials.gov Identifier: NCT01364480.

A method to study precision grip control in viscoelastic force fields using a robotic gripper

Instrumented objects and multipurpose haptic displays have commonly been used to investigate sensorimotor control of grasping and manipulation. A major limitation of these devices, however, is the extent to which the experimenter can vary the interaction dynamics to fully probe sensorimotor control mechanisms. We propose a novel method to study precision grip control using a grounded robotic gripper with two moving, mechanically coupled finger pads instrumented with force sensors. The device is capable of stably rendering virtual mechanical properties with a wide dynamic range of achievable impedances. Eight viscoelastic force fields with different combinations of stiffness and damping parameters were implemented, and tested on eight healthy subjects performing 30 consecutive repetitions of a grasp, hold, and release task with time and position constraints. Rates of thumb and finger force were found to be highly correlated (r>0.9) during grasping, revealing that, despite the mechanical coupling of the two finger pads, subjects performed grasping movements in a physiological fashion. Subjects quickly adapted to the virtual dynamics (within seven trials), but, depending on the presented force field condition, used different control strategies to correctly perform the task. The proof of principle presented in this paper underscores the potential of such a one-degree-of-freedom robotic gripper to study neural control of grasping, and to provide novel insights on sensorimotor control mechanisms.

Analysis of the effects of surface stiffness on the contact interaction between a finger and a cylindrical handle using a three-dimensional hybrid model

Contact interactions between the hand and handle, such as the contact surface softness and contact surface curvature, will affect both physical effort and musculoskeletal fatigue, thereby the comfort and safety of power tool operations. Previous models of hand gripping can be categorized into two groups: multi-body dynamic models and finite element (FE) models. The goal of the current study is to develop a hybrid FE hand gripping model, which combines the features of conventional FE models and multi-body dynamic models. The proposed model is applied to simulate hand-gripping on a cylindrical handle with covering materials of different softness levels. The model included three finger segments (distal, middle, and proximal phalanxes), three finger joints (the distal interphalangeal (DIP), proximal interphalangeal (PIP), and metacarpophalangeal (MCP) joint), and major anatomical substructures. The model was driven by joint moments, which are the net effects of all passive and active muscular forces acting about the joints. The finger model was first calibrated by using experimental data of human subject tests, and then applied to investigate the effects of surface softness on contact interactions between a finger and a cylindrical handle. Our results show that the maximal compressive stress and strain in the soft tissues of the fingers can be effectively reduced by reducing the stiffness of the covering material.

Adaptive Human Control Gains during Precision Grip

Eight human test subjects attempted to track a desired position trajectory with an instrumented manipulandum (MN). The test subjects used the MN with three different levels of stiffness. A transfer function was developed to represent the human application of a precision grip from the data when the test subjects initially displaced the MN so as to learn the position mapping from the MN onto the display. Another transfer function was formed from the data of the remainder of the experiments, after significant displacement of the MN occurred. Both of these transfer functions accurately modelled the system dynamics for a portion of the experiments, but neither was accurate for the duration of the experiments because the human grip dynamics changed while learning the position mapping. Thus, an adaptive system model was developed to describe the learning process of the human test subjects as they displaced the MN in order to gain knowledge of the position mapping. The adaptive system model was subsequently validated following comparison with the human test subject data. An examination of the average absolute error between the position predicted by the adaptive model and the actual experimental data yielded an overall average error of 0.34mm for all three levels of stiffness.

Manipulation of a fragile object by elderly individuals

We investigated strategies of healthy elderly participants (74-84 years old) during prehension and transport of an object with varying degrees of fragility. Fragility was specified as the maximal normal force that the object could withstand without collapsing. Specifically, kinetic and kinematic variables as well as and force covariation indices were quantified and compared to those shown by young healthy persons (19-28 years old). We tested three hypotheses related to age-related changes in two safety margins (slip safety margin and crush safety margin) and indices of force covariation. Compared to young controls, elderly individuals exhibited a decrease in object acceleration and an increase in movement time, an increase in grip force production, a decrease in the correlation between grip and load forces, an overall decrease in indices of multi-digit synergies, and lower safety margin indices computed with respect to both dropping and crushing the object. Elderly participants preferred to be at a relatively lower risk of crushing the object even if this led to a higher risk of dropping it. Both groups showed an increase in the index of synergy stabilizing total normal force produced by the four fingers with increased fragility of the object. Age-related changes are viewed as a direct result of physiological changes due to aging, not adaptation to object fragility. Such changes in overall characteristics of prehension likely reflect diminished synergic control by the central nervous system of finger forces with aging. The findings corroborate an earlier hypothesis on an age-related shift from synergic to element-based control.

Manipulation of a fragile object

We investigated strategies of adjustments in kinetic and kinematic patterns, and in multi-digit synergies during quick vertical transport of an instrumented handle that collapsed when the grasping force exceeded a certain magnitude (quantified with a fragility index). The collapse threshold of the object was set using a novel electromagnetic device. Moving a fragile object is viewed as a task with two constraints on the grip force defined by the slipping and crushing thresholds. When moving more fragile objects, subjects decreased object peak acceleration, increased movement time, showed a drop in the safety margin (SM) (extra force over the slipping threshold), and showed a tendency toward violating the minimum-jerk criterion. Linear regression analysis of grip force against load force has shown tight coupling between the two with a decline in the coefficient of determination with increased fragility index. The SM was lower in bimanual tasks, compared to unimanual tasks, for both fragile and non-fragile objects. Two novel indices have been introduced and studied, the SM due to fragility and the drop-crush index. Both indices showed a decrease with increased object fragility. Changes in the drop-crush index showed that the subjects would rather crush the fragile objects as opposed to dropping them, possibly reflecting the particular experimental procedure. We did not find differences between the performance indices of the dominant and non-dominant hand thus failing to support the recently formulated dominance hypothesis. The synergies stabilizing grip force were quantified at two levels of an assumed two-level control hierarchy using co-variation indices between elemental variables across trials. There were strong synergies at the upper level of the hierarchy (the task is shared between the opposing groups of digits) that weakened with an increase in object fragility. At the lower level (action of an effector is shared among the four fingers), higher fragility led to higher synergy indices. Analysis of force variance showed that an increase in object fragility was accompanied by exploring a smaller range of equivalent combinations of elemental variables. The additional constraint imposed by high fragility facilitated synergies at the lower level of the hierarchy, while there was evidence for a trade-off between synergies at the two levels.