A Standard Methodology to Characterize the Intrinsic Material Properties of Compliant Test Stimuli

An individual's skin stiffness predicts their tactile discrimination of compliance

Individual differences in tactile acuity have been correlated with age, gender and finger size, whereas the role of the skin's stiffness has been underexplored. Using an approach to image the 3-D deformation of the skin surface during contact with transparent elastic objects, we evaluate a cohort of 40 young participants, who present a diverse range of finger size, skin stiffness and fingerprint ridge breadth. The results indicate that skin stiffness generally correlates with finger size, although individuals with relatively softer skin can better discriminate compliant objects. Analysis of contact at the skin surface reveals that softer skin generates more prominent patterns of deformation, in particular greater rates of change in contact area, which correlate with higher rates of perceptual discrimination of compliance, regardless of finger size. Moreover, upon applying hyaluronic acid to soften individuals' skin, we observe immediate, marked and systematic changes in skin deformation and consequent improvements in perceptual acuity in differentiating compliance. Together, the combination of 3-D imaging of the skin surface, biomechanics measurements, multivariate regression and clustering, and psychophysical experiments show that subtle distinctions in skin stiffness modulate the mechanical signalling of touch and shape individual differences in perceptual acuity. KEY POINTS: Although declines in tactile acuity with ageing are a function of multiple factors, for younger people, the current working hypothesis has been that smaller fingers are better at informing perceptual discrimination because of a higher density of neural afferents. To decouple relative impacts on tactile acuity of skin properties of finger size, skin stiffness, and fingerprint ridge breadth, we combined 3-D imaging of skin surface deformation, biomechanical measurements, multivariate regression and clustering, and psychophysics. The results indicate that skin stiffness generally correlates with finger size, although it more robustly correlates with and predicts an individual's perceptual acuity. In particular, more elastic skin generates higher rates of deformation, which correlate with perceptual discrimination, shown most dramatically by softening each participant's skin with hyaluronic acid. In refining the current working hypothesis, we show the skin's stiffness strongly shapes the signalling of touch and modulates individual differences in perceptual acuity.

An individual's skin stiffness predicts their tactile acuity

Individual differences in tactile acuity have been correlated with age, gender, and finger size, while the role of the skin's stiffness has been underexplored. Using an approach to image the 3-D deformation of the skin surface while in contact with transparent elastic objects, we evaluate a cohort of 40 young participants, who present a diverse range of finger size, skin stiffness, and fingerprint ridge breadth. The results indicate that skin stiffness generally correlates with finger size, although individuals with relatively softer skin can better discriminate compliant objects. Analysis of contact at the skin surface reveals that softer skin generates more prominent patterns of deformation, in particular greater rates of change in contact area, which correlate with higher rates of perceptual discrimination, regardless of finger size. Moreover, upon applying hyaluronic acid to soften individuals' skin, we observe immediate, marked and systematic changes in skin deformation and consequent improvements in perceptual acuity. Together, the combination of 3-D imaging of the skin surface, biomechanics measurements, multivariate regression and clustering, and psychophysical experiments show that subtle distinctions in skin stiffness modulate the mechanical signaling of touch and shape individual differences in perceptual acuity.

Faster Indentation Influences Skin Deformation To Reduce Tactile Discriminability of Compliant Objects

To discriminate the compliance of soft objects, we rely upon spatiotemporal cues in the mechanical deformation of the skin. However, we have few direct observations of skin deformation over time, in particular how its response differs with indentation velocities and depths, and thereby helps inform our perceptual judgments. To help fill this gap, we develop a 3D stereo imaging method to observe contact of the skin's surface with transparent, compliant stimuli. Experiments with human-subjects, in passive touch, are conducted with stimuli varying in compliance, indentation depth, velocity, and time duration. The results indicate that contact durations greater than 0.4 s are perceptually discriminable. Moreover, compliant pairs delivered at higher velocities are more difficult to discriminate because they induce smaller differences in deformation. In a detailed quantification of the skin's surface deformation, we find that several, independent cues aid perception. In particular, the rate of change of gross contact area best correlates with discriminability, across indentation velocities and compliances. However, cues associated with skin surface curvature and bulk force are also predictive, for stimuli more and less compliant than skin, respectively. These findings and detailed measurements seek to inform the design of haptic interfaces.

Controlling fine touch sensations with polymer tacticity and crystallinity

The friction generated between a finger and an object forms the mechanical stimuli behind fine touch perception. To control friction, and therefore tactile perception, current haptic devices typically rely on physical features like bumps or pins, but chemical and microscale morphology of surfaces could be harnessed to recreate a wider variety of tactile sensations. Here, we sought to develop a new way to create tactile sensations by relying on differences in microstructure as quantified by the degree of crystallinity in polymer films. To isolate crystallinity, we used polystyrene films with the same chemical formula and number averaged molecular weights, but which differed in tacticity and annealing conditions. These films were also sufficiently thin as to be rigid which minimized effects from bulk stiffness and had variations in roughness lower than detectable by humans. To connect crystallinity to human perception, we performed mechanical testing with a mock finger to form predictions about the degree of crystallinity necessary to result in successful discrimination by human subjects. Psychophysical testing verified that humans could discriminate surfaces which differed only in the degree of crystallinity. Although related, human performance was not strongly correlated with a straightforward difference in the degree of crystallinity. Rather, human performance was better explained by quantifying transitions in steady to unsteady sliding and the generation of slow frictional waves (r² = 79.6%). Tuning fine touch with polymer crystallinity may lead to better engineering of existing haptic interfaces or lead to new classes of actuators based on changes in microstructure.

Printed Multilayer Piezoelectric Transducers on Paper for Haptic Feedback and Dual Touch-Sound Sensation

With a growing number of electronic devices surrounding our daily life, it becomes increasingly important to create solutions for clear and simple communication and interaction at the human machine interface (HMI). Haptic feedback solutions play an important role as they give a clear direct link and response to the user. This work demonstrates multifunctional haptic feedback devices based on fully printed piezoelectric transducers realized with functional polymers on thin paper substrate. The devices are flexible; lightweight and show very high out-of-plane deflection of 213 µm at a moderate driving voltage of 50 V_rms (root mean square) achieved by an innovative multilayer design with up to five individually controllable active layers. The device creates a very clear haptic sensation to the human skin with a blocking force of 0.6 N at the resonance frequency of 320 Hz, which is located in the most sensitive range of the human fingertip. Additionally the transducer generates audible information above two kilohertz with a remarkable high sound pressure level. Thus the paper-based approach can be used for interactive displays in combination with touch sensation; sound and color prints. The work gives insights into the manufacturing process; the electrical characteristics; and an in-depth analysis of the 3D deflection of the device under variable conditions.

Individual differences impacting skin deformation and tactile discrimination with compliant elastic surfaces

Individual differences in tactile acuity are observed within and between age cohorts. Such differences in acuity may be attributed to various sources, including aspects of nervous system, skin mechanics, finger size, cognitive and behavioral factors, etc. This work considers individual differences, within a younger cohort of participants, in discriminating compliant surfaces. These participants exhibit a range of finger size and stiffness. Interestingly, both their finger size and stiffness well predict their discriminative performance, where softer/smaller fingers outperform stiffer/larger fingers. Stereo imaging captured biomechanical cues in the skin's deformation, including contact area and penetration depth, and their change rates. In those individuals with stiffer/larger fingers, who perceptually performed worse, we observed less distinguishable contact areas and eccentricities, compared to softer/smaller fingers. These particular cues well predicted individual differences observed in perceptual discrimination. In comparison, with two other cues, curvature and penetration depth, the imaging readily distinguished the compliant surfaces irrespective of finger stiffness/size, not aligned with discrimination. In conclusion, in passive touch, we find that individuals with softer/smaller fingers were better at discriminating compliances, and that certain skin deformation cues predict individual differences in perception.

Predicting human touch sensitivity to single atom substitutions in surface monolayers for molecular control in tactile interfaces

The mechanical stimuli generated as a finger interrogates the physical and chemical features of an object form the basis of fine touch. Haptic devices, which are used to control touch, primarily focus on recreating physical features, but the chemical aspects of fine touch may be harnessed to create richer tactile interfaces and reveal fundamental aspects of tactile perception. To connect tactile perception with molecular structure, we systematically varied silane-derived monolayers deposited onto surfaces smoother than the limits of human perception. Through mechanical friction testing and cross-correlation analysis, we made predictions of which pairs of silanes might be distinguishable by humans. We predicted, and demonstrated, that humans can distinguish between two isosteric silanes which differ only by a single nitrogen-for-carbon substitution. The mechanism of tactile contrast originates from a difference in monolayer ordering, as quantified by the Hurst exponent, which was replicated in two alkylsilanes with a three-carbon difference in length. This approach may be generalizable to other materials and lead to new tactile sensations derived from materials chemistry.

Printing Multi-Material Organic Haptic Actuators

Haptic actuators generate touch sensations and provide realism and depth in human-machine interactions. A new generation of soft haptic interfaces is desired to produce the distributed signals over large areas that are required to mimic natural touch interactions. One promising approach is to combine the advantages of organic actuator materials and additive printing technologies. This powerful combination can lead to devices that are ergonomic, readily customizable, and economical for researchers to explore potential benefits and create new haptic applications. Here, an overview of emerging organic actuator materials and digital printing technologies for fabricating haptic actuators is provided. In particular, the focus is on the challenges and potential solutions associated with integration of multi-material actuators, with an eye toward improving the fidelity and robustness of the printing process. Then the progress in achieving compact, lightweight haptic actuators by using an open-source extrusion printer to integrate different polymers and composites in freeform designs is reported. Two haptic interfaces-a tactile surface and a kinesthetic glove-are demonstrated to show that printing with organic materials is a versatile approach for rapid prototyping of various types of haptic devices.

Organic Haptics: Intersection of Materials Chemistry and Tactile Perception

The goal of the field of haptics is to create technologies that manipulate the sense of touch. In virtual and augmented reality, haptic devices are for touch what loudspeakers and RGB displays are for hearing and vision. Haptic systems that utilize micromotors or other miniaturized mechanical devices (e.g., for vibration and pneumatic actuation) produce interesting effects, but are quite far from reproducing the feeling of real materials. They are especially deficient in recapitulating surface properties: fine texture, friction, viscoelasticity, tack, and softness. The central argument of this Progress Report is that to reproduce the feel of everyday objects requires chemistry: molecular control over the properties of materials and ultimately design of materials which can change these properties in real time. Stimuli-responsive organic materials, such as polymers and composites, are a class of materials which can change their oxidation state, conductivity, shape, and rheological properties, and thus might be useful in future haptic technologies. Moreover, the use of such materials in research on tactile perception could help elucidate the limits of human tactile sensitivity. The work described represents the beginnings of this new area of inquiry, in which the defining approach is the marriage of materials science and psychology.

Identifying 3-D spatiotemporal skin deformation cues evoked in interacting with compliant elastic surfaces

We regularly touch soft, compliant fruits and tissues. To help us discriminate them, we rely upon cues embedded in spatial and temporal deformation of finger pad skin. However, we do not yet understand, in touching objects of various compliance, how such patterns evolve over time, and drive perception. Using a 3-D stereo imaging technique in passive touch, we develop metrics for quantifying skin deformation, across compliance, displacement, and time. The metrics map 2-D estimates of terminal contact area to 3-D metrics that represent spatial and temporal changes in penetration depth, surface curvature, and force. To do this, clouds of thousands of 3-D points are reduced in dimensionality into stacks of ellipses, to be more readily comparable between participants and trials. To evaluate the robustness of the derived 3-D metrics, human subjects experiments are performed with stimulus pairs varying in compliance and discriminability. The results indicate that metrics such as penetration depth and surface curvature can distinguish compliances earlier, at less displacement. Observed also are distinct modes of skin deformation, for contact with stiffer objects, versus softer objects that approach the skin's compliance. These observations of the skin's deformation may guide the design and control of haptic actuation.

Visuo-Haptic Discrimination of Viscoelastic Materials

In our daily lives, we interact with different types of deformable materials. Regarding their mechanical behavior, some of those materials lie in a range that is between purely elastic and purely viscous. This range of mechanical behavior is described as viscoelasticity. In certain types of haptic interactions, such as assessment of ripeness of fruit, firmness of cheese, and consistency of organ tissue, we rely heavily on our haptic perception of viscoelastic materials. The relationship between the mechanical behavior of viscoelastic materials and our perception of them has been investigated in the field of psychorheology. However, our knowledge on how we perceive viscoelastic materials is still quite limited though some research work has already been done on purely elastic and purely viscous materials. History- and frequency-dependent behavior of viscoelastic materials result in a complex time-dependent response, which requires relatively more sophisticated models to investigate their behavior than those of purely elastic and viscous materials. In this study, we model viscoelasticity using a "springpot" (i.e., fractional-order derivative element) and express its behavior in the frequency domain using two physical parameters-"magnitude" and "phase" of complex stiffness. In the frequency domain, we are able to devise signal detection experiments where we can investigate the perception of viscoelastic materials using the perceptual terms of "firmness" and "bounciness," corresponding to the physical parameters of "magnitude" and "phase." The results of our experiments show that the just-noticeable difference (JND) for bounciness increases linearly with increasing "phase," following Weber's law, while the JND for firmness is surprisingly independent of the level of "phase."

Role of indentation depth and contact area on human perception of softness for haptic interfaces

In engineering, the "softness" of an object, as measured by an indenter, manifests as two measurable parameters: (i) indentation depth and (ii) contact area. For humans, softness is not well defined, although it is believed that perception depends on the same two parameters. Decoupling their relative contributions, however, has not been straightforward because most bulk-"off-the-shelf"-materials exhibit the same ratio between the indentation depth and contact area. Here, we decoupled indentation depth and contact area by fabricating elastomeric slabs with precise thicknesses and microstructured surfaces. Human subject experiments using two-alternative forced-choice and magnitude estimation tests showed that the indentation depth and contact area contributed independently to perceived softness. We found an explicit relationship between the perceived softness of an object and its geometric properties. Using this approach, it is possible to design objects for human interaction with a desired level of perceived softness.

Roles of Force Cues and Proprioceptive Joint Angles in Active Exploration of Compliant Objects

We employ distinct exploratory procedures to improve our perceptual judgments of an object's properties. For instance, with respect to compliance, we exert pressure against a resisting force. The present work investigates ties between strategies for active control of the finger and resultant cues by which compliances may be discriminated. In particular, we employ elastic spheres that co-vary in compliance and radius, as these generate non-differentiable contact areas and are discriminable only in active touch with proprioceptive inputs. During human-subjects psychophysical experiments, we measure touch force, fingertip displacement, and joint kinematics. Two active touch paradigms are used, with and without a force constraint. First, in behaviorally-controlled situations that make force cues non-useful, the results indicate that participants can employ a force-matching strategy between the compliant objects and rely upon displacement-related cues to differentiate them. We show these cues are directly tied to a proprioception mechanism, specifically, the angle of the MCP joint. However, in the fully active paradigm, participants control displacements instead and discriminate via force-related cues. Similar to prior findings in passive touch, we find that force-related cues, likewise, are used in active touch for the optimal and efficient discrimination of compliant objects.

In the Tactile Discrimination of Compliance, Perceptual Cues in Addition to Contact Area Are Required

In our ability to discriminate compliant, or 'soft,' objects, we rely upon information acquired from interactions at the finger pad. We have yet to resolve the most pertinent perceptual cues. However, doing so is vital for building effective, dynamic displays. By introducing psychophysical illusions through spheres of various size and elasticity, we investigate the utility of contact area cues, thought to be key in encoding compliance. For both active and passive touch, we determine finger pad-to-stimulus contact areas, using an ink-based procedure, as well as discrimination thresholds. The findings indicate that in passive touch, participants cannot discriminate certain small compliant versus large stiff spheres, which generate similar contact areas. In active touch, however, participants easily discriminate these spheres, though contact areas remain similar. Supplementary cues based on stimulus rate and/or proprioception seem vital. One cue that does differ for illusion cases is finger displacement given a volitionally applied force.