Characterizing and Imaging Gross and Real Finger Contacts under Dynamic Loading

Distribution Characteristics and Correlation of Edge Sharpness Threshold and Contact Area

It is currently unclear how sharpness discrimination ability is distributed across a wide range of edge sharpness and the effect of contact area on haptic perception. We 3D printed triangular prisms with various edge sharpness and half-edge widths in the full-scale range and conducted 2AFC tasks to gain the haptic threshold distribution. Results show that the distribution curves of the sharpness threshold and its contact area have a similar inflection point at 115 °, implying a boundary between medium-low and high stimuli. It is also found that Weber fractions in the medium stimulus range follow Weber's Law and are consistent with previous studies but lower than the mean of Weber fractions in the high stimulus range. Besides, there is no significant difference in upper and lower thresholds in the medium-low stimulus range but a significant difference in the high stimulus range with the higher upper threshold. Variations in contact area do not affect sharpness discrimination ability when the half-edge width exceeds 2 mm. However, decreasing the half-edge width from 2 mm to 1 mm significantly reduces haptic sensitivity. Our findings offer preliminary evidence contributing to understanding haptic perception in edge sharpness discrimination, encompassing the properties of objects and object-individual interfaces.

Fast grip force adaptation to friction relies on localized fingerpad strains

During object manipulation, humans adjust the grip force to friction, such that slippery objects are squeezed more firmly than sticky ones. This essential mechanism to keep a stable grasp relies on feedback from tactile afferents innervating the fingertips, that are sensitive to local skin strains. To test if this feedback originates from the skin-object interface, we asked participants to perform a grip-lift task with an instrumented object able to monitor skin strains at the contact through transparent plates of different frictions. We observed that, following an unbeknown change in plate across trials, participants adapted their grip force to friction. After switching from high to low friction, we found a significant increase in strain inside the contact arising ~100 ms before the modulation of grip force, suggesting that differences in strain patterns before lift-off are used by the nervous system to quickly adjust the force to the frictional properties of manipulated objects.

Open-Source Instrumented Object to Study Dexterous Object Manipulation

Humans use tactile feedback to perform skillful manipulation. When tactile sensory feedback is unavailable, for instance, if the fingers are anesthetized, dexterity is severely impaired. Imaging the deformation of the finger pad skin when in contact with a transparent plate provides information about the tactile feedback received by the central nervous system. Indeed, skin deformations are transduced into neural signals by the mechanoreceptors of the finger pad skin. Understanding how this feedback is used for active object manipulation would improve our understanding of human dexterity. In this paper, we present a new device for imaging the skin of the finger pad of one finger during manipulation performed with a precision grip. The device's mass (300 g) makes it easy to use during unconstrained dexterous manipulation. Using this device, we reproduced the experiment performed in Delhaye et al. (2021) We extracted the strains aligned with the object's movement, i.e., the vertical strains in the ulnar and radial parts of the fingerpad, to see how correlated they were with the grip force (GF) adaptation. Interestingly, parts of our results differed from those in Delhaye et al. (2021) due to weight and inertia differences between the devices, with average GF across participants differing significantly. Our results highlight a large variability in the behavior of the skin across participants, with generally low correlations between strain and GF adjustments, suggesting that skin deformations are not the primary driver of GF adaptation in this manipulation scenario.

Contact evolution of dry and hydrated fingertips at initial touch

Pressing the fingertips into surfaces causes skin deformations that enable humans to grip objects and sense their physical properties. This process involves intricate finger geometry, non-uniform tissue properties, and moisture, complicating the underlying contact mechanics. Here we explore the initial contact evolution of dry and hydrated fingers to isolate the roles of governing physical factors. Two participants gradually pressed an index finger on a glass surface under three moisture conditions: dry, water-hydrated, and glycerin-hydrated. Gross and real contact area were optically measured over time, revealing that glycerin hydration produced strikingly higher real contact area, while gross contact area was similar for all conditions. To elucidate the causes for this phenomenon, we investigated the combined effects of tissue elasticity, skin-surface friction, and fingerprint ridges on contact area using simulation. Our analyses show the dominant influence of elastic modulus over friction and an unusual contact phenomenon, which we call friction-induced hinging.

Initial contact shapes the perception of friction

Humans have the remarkable ability to manipulate a large variety of objects, regardless of how fragile, heavy, or slippery they are. To correctly scale the grip forces, the nervous system gauges the slipperiness of the surface. This information is present at the instant we first touch an object, even before any lateral force develops. However, how friction could be estimated without slippage only from the fingertip skin deformation is not understood, either in neuroscience or engineering disciplines. This study demonstrates that a radial tensile strain of the skin is involved in the perception of slipperiness during this initial contact. These findings can inform the design of advanced tactile sensors for robotics or prosthetics and for improving haptic human–machine interactions.

Humans efficiently estimate the grip force necessary to lift a variety of objects, including slippery ones. The regulation of grip force starts with the initial contact and takes into account the surface properties, such as friction. This estimation of the frictional strength has been shown to depend critically on cutaneous information. However, the physical and perceptual mechanism that provides such early tactile information remains elusive. In this study, we developed a friction-modulation apparatus to elucidate the effects of the frictional properties of objects during initial contact. We found a correlation between participants’ conscious perception of friction and radial strain patterns of skin deformation. The results provide insights into the tactile cues made available by contact mechanics to the sensorimotor regulation of grip, as well as to the conscious perception of the frictional properties of an object.

How to Measure the Area of Real Contact of Skin on Glass

The contact between the fingertip and an object is formed by a collection of micro-scale junctions, which collectively constitute the real contact area. This real area of contact is only a fraction of the apparent area of contact and is directly linked to the frictional strength of the contact (i.e., the lateral force at which the finger starts sliding). As a consequence, a measure of this area of real contact can help probe into the mechanism behind the friction of skin on glass. In this article, we present two methods to measure the variations of contact area; one that improves upon a tried-and-true fingertip imaging technique to provide ground truth, and the other that relies on the absorption and reflection of acoustic energy. To achieve precise measurements, the ultrasonic method exploits a recently developed model of the interaction that incorporates the non-linearity of squeeze film levitation. The two methods are in good agreement ($\rho =0.94$) over a large range of normal forces and vibration amplitudes. Since the real area of contact fundamentally underlies fingertip friction, the methods described in the article have importance for studying human grasping, understanding friction perception, and controlling surface-haptic devices.

Optimizing a Viscoelastic Finite Element Model to Represent the Dry, Natural, and Moist Human Finger Pressing on Glass

When a fingerpad presses into a hard surface, the development of the contact area depends on the pressing force and speed. Importantly, it also varies with the finger's moisture, presumably because hydration changes the tissue's material properties. Therefore, we collected data from one finger repeatedly pressing a glass plate under three moisture conditions, and we constructed a finite element model that we optimized to simulate the same three scenarios. We controlled the moisture of the subject's finger to be dry, natural, or moist and recorded 15 pressing trials in each condition. The measurements include normal force over time plus finger-contact images that are processed to yield gross contact area. We defined the axially symmetric 3D model's lumped parameters to include an SLS-Kelvin model (spring in series with parallel spring and damper) for the bulk tissue, plus an elastic epidermal layer. Particle swarm optimization was used to find the parameter values that cause the simulation to best match the trials recorded in each moisture condition. The results show that the softness of the bulk tissue reduces as the finger becomes more hydrated. The epidermis of the moist finger model is softest, while the natural finger model has the highest viscosity.

Modeling Sliding Friction Between Human Finger and Touchscreen Under Electroadhesion

When an alternating voltage is applied to the conductive layer of a capacitive touchscreen, an oscillating electroadhesive force (also known as electrovibration) is generated between the human finger and its surface in the normal direction. This electroadhesive force causes an increase in friction between the sliding finger and the touchscreen. Although the practical implementation of this technology is quite straightforward, the physics behind voltage-induced electroadhesion and the resulting contact interactions between human finger and the touchscreen are still under investigation. In this article, we first present the results of our experimental study conducted with a custom-made tribometer to investigate the effect of input voltage on the tangential forces acting on the finger due to electroadhesion during sliding. We then support our experimental results with a contact mechanics model developed for estimating voltage-induced frictional forces between human finger and a touchscreen as a function of the applied normal force. The unknown parameters of the model were estimated via optimization by minimizing the error between the measured tangential forces and the ones generated by the model. The estimated model parameters show a good agreement with the ones reported in the literature.

A Review of Surface Haptics: Enabling Tactile Effects on Touch Surfaces

In this article, we review the current technology underlying surface haptics that converts passive touch surfaces to active ones (machine haptics), our perception of tactile stimuli displayed through active touch surfaces (human haptics), their potential applications (human-machine interaction), and finally, the challenges ahead of us in making them available through commercial systems. This article primarily covers the tactile interactions of human fingers or hands with surface-haptics displays by focusing on the three most popular actuation methods: vibrotactile, electrostatic, and ultrasonic.

Physical Variables Underlying Tactile Stickiness During Fingerpad Detachment

One may notice a relatively wide range of tactile sensations even when touching the same hard, flat surface in similar ways. Little is known about the reasons for this variability, so we decided to investigate how the perceptual intensity of light stickiness relates to the physical interaction between the skin and the surface. We conducted a psychophysical experiment in which nine participants actively pressed their finger on a flat glass plate with a normal force close to 1.5 N and detached it after a few seconds. A custom-designed apparatus recorded the contact force vector and the finger contact area during each interaction as well as pre- and post-trial finger moisture. After detaching their finger, participants judged the stickiness of the glass using a nine-point scale. We explored how sixteen physical variables derived from the recorded data correlate with each other and with the stickiness judgments of each participant. These analyses indicate that stickiness perception mainly depends on the pre-detachment pressing duration, the time taken for the finger to detach, and the impulse in the normal direction after the normal force changes sign; finger-surface adhesion seems to build with pressing time, causing a larger normal impulse during detachment and thus a more intense stickiness sensation. We additionally found a strong between-subjects correlation between maximum real contact area and peak pull-off force, as well as between finger moisture and impulse.

Fingerpad contact evolution under electrovibration

Displaying tactile feedback through a touchscreen via electrovibration has many potential applications in mobile devices, consumer electronics, home appliances and automotive industry though our knowledge and understanding of the underlying contact mechanics are very limited. An experimental study was conducted to investigate the contact evolution between the human finger and a touch screen under electrovibration using a robotic set-up and an imaging system. The results show that the effect of electrovibration is only present during full slip but not before slip. Hence, the coefficient of friction increases under electrovibration as expected during full slip, but the apparent contact area is significantly smaller during full slip when compared to that of no electrovibration condition. It is suggested that the main cause of the increase in friction during full slip is due to an increase in the real contact area and the reduction in apparent area is due to stiffening of the finger skin in the tangential direction.

Electroadhesion with application to touchscreens

There is growing interest in touchscreens displaying tactile feedback due to their tremendous potential in consumer electronics. In these systems, the friction between the user's fingerpad and the surface of the touchscreen is modulated to display tactile effects. One of the promising techniques used in this regard is electrostatic actuation. If, for example, an alternating voltage is applied to the conductive layer of a surface capacitive touchscreen, an attractive electrostatic force is generated between the finger and the surface, which results in an increase in frictional forces acting on the finger moving on the surface. By altering the amplitude, frequency, and waveform of this signal, a rich set of tactile effects can be generated on the touchscreen. Despite the ease of implementation and its powerful effect on our tactile sensation, the contact mechanics leading to an increase in friction due to electroadhesion has not been fully understood yet. In this paper, we present experimental results for how the friction between a finger and a touchscreen depends on the electrostatic attraction and the applied normal pressure. The dependency of the finger-touchscreen interaction on the applied voltage and on several other parameters is also investigated using a mean field theory based on multiscale contact mechanics. We present detailed theoretical analysis of how the area of real contact and the friction force depend on contact parameters, and show that it is possible to further augment the friction force, and hence the tactile feedback displayed to the user by carefully choosing those parameters.

Imaging the 3-D Deformation of the Finger Pad When Interacting with Compliant Materials

We need to understand the physics of how the skin of the finger pad deforms, and their tie to perception, to accurately reproduce a sense of compliance, or 'softness,' in tactile displays. Contact interactions with compliant materials are distinct from those with rigid surfaces where the skin flattens completely. To capture unique patterns in skin deformation over a range of compliances, we developed a stereo imaging technique to visualize the skin through optically clear stimuli. Accompanying algorithms serve to locate and track points marked with ink on the skin, correct for light refraction through stimuli, and estimate aspects of contact between skin and stimulus surfaces. The method achieves a 3-D spatial resolution of 60-120 microns and temporal resolution of 30 frames per second. With human subjects, we measured the skin's deformation over a range of compliances (61-266 kPa), displacements (0-4 mm), and velocities (1- 15 mm/s). The results indicate that the method can differentiate patterns of skin deformation between compliances, as defined by metrics including surface penetration depth, retention of geometric shape, and force per gross contact area. Observations of biomechanical cues of this sort are key to understanding the perceptual encoding of compliance.

Why pens have rubbery grips

The process by which human fingers gives rise to stable contacts with smooth, hard objects is surprisingly slow. Using high-resolution imaging, we found that, when pressed against glass, the actual contact made by finger pad ridges evolved over time following a first-order kinetics relationship. This evolution was the result of a two-stage coalescence process of microscopic junctions made between the keratin of the stratum corneum of the skin and the glass surface. This process was driven by the secretion of moisture from the sweat glands, since increased hydration in stratum corneum causes it to become softer. Saturation was typically reached within 20 s of loading the contact, regardless of the initial moisture state of the finger and of the normal force applied. Hence, the gross contact area, frequently used as a benchmark quantity in grip and perceptual studies, is a poor reflection of the actual contact mechanics that take place between human fingers and smooth, impermeable surfaces. In contrast, the formation of a steady-state contact area is almost instantaneous if the counter surface is soft relative to keratin in a dry state. It is for this reason that elastomers are commonly used to coat grip surfaces.