Roughness perception of unfamiliar dot pattern textures

Multisensory integration reduces landmark distortions for tactile but not visual targets

Target localization is influenced by the presence of additionally presented nontargets, termed landmarks. In both the visual and tactile modality, these landmarks led to systematic distortions of target localizations often resulting in a shift toward the landmark. This shift has been attributed to averaging the spatial memory of both stimuli. Crucially, everyday experiences often rely on multiple modalities, and multisensory research suggests that inputs from different senses are optimally integrated, not averaged, for accurate perception, resulting in more reliable perception of cross-modal compared with uni-modal stimuli. As this could also lead to a reduced influence of the landmark, we wanted to test whether landmark distortions would be reduced when presented in a different modality or whether landmark distortions were unaffected by the modalities presented. In two experiments (each n = 30) tactile or visual targets were paired with tactile or visual landmarks. Experiment 1 showed that targets were less shifted toward landmarks from the different than the same modality, which was more pronounced for tactile than for visual targets. Experiment 2 aimed to replicate this pattern with increased visual uncertainty to rule out that smaller localization shifts of visual targets due to low uncertainty had led to the results. Still, landmark modality influenced localization shifts for tactile but not visual targets. The data pattern for tactile targets is not in line with memory averaging but seems to reflect the effects of multisensory integration, whereas visual targets were less prone to landmark distortions and do not appear to benefit from multisensory integration.NEW & NOTEWORTHY In the present study, we directly tested the predictions of two different accounts, namely, spatial memory averaging and multisensory integration, concerning the degree of landmark distortions of targets across modalities. We showed that landmark distortions were reduced across modalities compared to distortions within modalities, which is in line with multisensory integration. Crucially, this pattern was more pronounced for tactile than for visual targets.

Crossmodal Texture Perception Is Illumination-Dependent

Visually perceived roughness of 3D textures varies with illumination direction. Surfaces appear rougher when the illumination angle is lowered resulting in a lack of roughness constancy. Here we aimed to investigate whether the visual system also relies on illumination-dependent features when judging roughness in a crossmodal matching task or whether it can access illumination-invariant surface features that can also be evaluated by the tactile system. Participants ( N = 32) explored an abrasive paper of medium physical roughness either tactually, or visually under two different illumination conditions (top vs oblique angle). Subsequently, they had to judge if a comparison stimulus (varying in physical roughness) matched the previously explored standard. Matching was either performed using the same modality as during exploration (intramodal) or using a different modality (crossmodal). In the intramodal conditions, participants performed equally well independent of the modality or illumination employed. In the crossmodal conditions, participants selected rougher tactile matches after exploring the standard visually under oblique illumination than under top illumination. Conversely, after tactile exploration, they selected smoother visual matches under oblique than under top illumination. These findings confirm that visual roughness perception depends on illumination direction and show, for the first time, that this failure of roughness constancy also transfers to judgements made crossmodally.

The interaction between motion and texture in the sense of touch

Besides providing information on elementary properties of objects, like texture, roughness, and softness, the sense of touch is also important in building a representation of object movement and the movement of our hands. Neural and behavioral studies shed light on the mechanisms and limits of our sense of touch in the perception of texture and motion, and of its role in the control of movement of our hands. The interplay between the geometrical and mechanical properties of the touched objects, such as shape and texture, the movement of the hand exploring the object, and the motion felt by touch, will be discussed in this article. Interestingly, the interaction between motion and textures can generate perceptual illusions in touch. For example, the orientation and the spacing of the texture elements on a static surface induces the illusion of surface motion when we move our hand on it or can elicit the perception of a curved trajectory during sliding, straight hand movements. In this work we present a multiperspective view that encompasses both the perceptual and the motor aspects, as well as the response of peripheral and central nerve structures, to analyze and better understand the complex mechanisms underpinning the tactile representation of texture and motion. Such a better understanding of the spatiotemporal features of the tactile stimulus can reveal novel transdisciplinary applications in neuroscience and haptics.

The look and feel of soft are similar across different softness dimensions

The softness of objects can be perceived through several senses. For instance, to judge the softness of a cat's fur, we do not only look at it, we often also run our fingers through its coat. Recently, we have shown that haptically perceived softness covaries with the compliance, viscosity, granularity, and furriness of materials (Dovencioglu, Üstün, Doerschner, & Drewing, 2020). However, it is unknown whether vision can provide similar information about the various aspects of perceived softness. Here, we investigated this question in an experiment with three conditions: in the haptic condition, blindfolded participants explored materials with their hands, in the static visual condition participants were presented with close-up photographs of the same materials, and in the dynamic visual condition participants watched videos of the hand-material interactions that were recorded in the haptic condition. After haptically or visually exploring the materials, participants rated them on various attributes. Our results show a high overall perceptual correspondence among the three experimental conditions. With a few exceptions, this correspondence tended to be strongest between haptic and dynamic visual conditions. These results are discussed with respect to information potentially available through the senses, or through prior experience, when judging the softness of materials.

Different activation signatures in the primary sensorimotor and higher-level regions for haptic three-dimensional curved surface exploration

Haptic object perception begins with continuous exploratory contact, and the human brain needs to accumulate sensory information continuously over time. However, it is still unclear how the primary sensorimotor cortex (PSC) interacts with these higher-level regions during haptic exploration over time. This functional magnetic resonance imaging (fMRI) study investigates time-dependent haptic object processing by examining brain activity during haptic 3D curve and roughness estimations. For this experiment, we designed sixteen haptic stimuli (4 kinds of curves × 4 varieties of roughness) for the haptic curve and roughness estimation tasks. Twenty participants were asked to move their right index and middle fingers along the surface twice and to estimate one of the two features-roughness or curvature-depending on the task instruction. We found that the brain activity in several higher-level regions (e.g., the bilateral posterior parietal cortex) linearly increased as the number of curves increased during the haptic exploration phase. Surprisingly, we found that the contralateral PSC was parametrically modulated by the number of curves only during the late exploration phase but not during the early exploration phase. In contrast, we found no similar parametric modulation activity patterns during the haptic roughness estimation task in either the contralateral PSC or in higher-level regions. Thus, our findings suggest that haptic 3D object perception is processed across the cortical hierarchy, whereas the contralateral PSC interacts with other higher-level regions across time in a manner that is dependent upon the features of the object.

Visual motion information modulates tactile roughness perception

We perceive the roughness of an object through our eyes and hands. Many crossmodal studies have reported that there is no clear visuo-tactile interaction in roughness perception using static visual cues. One exception is that the visual observation of task-irrelevant hand movements, not the texture of task-relevant objects, can enhance the performance of tactile roughness discrimination. Our study investigated whether task-irrelevant visual motion without either object roughness or bodily cues can influence tactile roughness perception. Participants were asked to touch abrasive papers while moving their hand laterally and viewing moving or static sine wave gratings without being able to see their hand, and to estimate the roughness magnitude of the tactile stimuli. Moving gratings with a low spatial frequency induced smoother roughness perceptions than static visual stimuli when the visual grating moved in the direction opposite the hand movements. The effects of visual motion did not appear when the visual stimuli had a high spatial frequency or when the participants touched the tactile stimuli passively. These results indicate that simple task-irrelevant visual movement without object roughness or bodily cues can modulate tactile roughness perception with active body movements in a spatial-frequency-selective manner.

Introduction of a New In-Situ Measurement System for the Study of Touch-Feel Relevant Surface Properties

The touch-feel sensation of product surfaces arouses growing interest in various industry branches. To entangle the underlying physical and material parameters responsible for a specific touch-feel sensation, a new measurement system has been developed. This system aims to record the prime physical interaction parameters at a time, which is considered a necessary prerequisite for a successful physical description of the haptic sensation. The measurement setup enables one to measure the dynamic coefficient of friction, the macroscopic contact area of smooth and rough surfaces, the angle enclosed between the human finger and the soft-touch surfaces and the vibrations induced in the human finger during relative motion at a time. To validate the measurement stand, a test series has been conducted on two soft-touch surfaces of different roughness. While the individual results agree well with the literature, their combination revealed new insights. Finally, the investigation of the haptics of polymer coatings with the presented measuring system should facilitate the design of surfaces with tailor-made touch-feel properties.

Tactile aesthetics: Textures that we like or hate to touch

Considering object identification and recognition as well as human interaction with objects, texture as a surface property plays a crucial role. A deeper understanding of tactile aesthetics can be useful in the applied field such as in product designs that appeal more to our senses and that are more effective in eliciting certain emotional responses from a potential consumer. In the present study, behavioral experiments were performed using unfamiliar custom-made dot pattern stimuli under two complementary questionings. The first question focused on the tactile perceptive attributes related to topographical characteristics of the textures exhibited by the material surfaces. The second question focused on the texture pleasantness related both to the perceptive attributes and to the topographical characteristics of the textures. The perspective of this work opens on complementary fields of research such as neurosciences to determine the brain mechanisms in the processing of the pleasantness of tactile stimuli.

Behavioral analysis of substrate texture preference in a leech, Helobdella austinensis

Leeches in the wild are often found on smooth surfaces, such as vegetation, smooth rocks or human artifacts such as bottles and cans, thus exhibiting what appears to be a "substrate texture preference". Here, we have reproduced this behavior under controlled circumstances, by allowing leeches to step about freely on a range of silicon carbide substrates (sandpaper). To begin to understand the neural mechanisms underlying this texture preference behavior, we have determined relevant parameters of leech behavior both on uniform substrates of varying textures, and in a behavior choice paradigm in which the leech is confronted with a choice between rougher and smoother substrate textures at each step. We tested two non-exclusive mechanisms which could produce substrate texture preference: (1) a Differential Diffusion mechanism, in which a leech is more likely to stop moving on a smooth surface than on a rough one, and (2) a Smoothness Selection mechanism, in which a leech is more likely to attach its front sucker (prerequisite for taking a step) to a smooth surface than to a rough one. We propose that both mechanisms contribute to the texture preference exhibited by leeches.

Tactile perception of the roughness of 3D-printed textures

Surface roughness is one of the most important qualities in haptic perception. Roughness is a major identifier for judgments of material composition, comfort, and friction and is tied closely to manual dexterity. Some attention has been given to the study of roughness perception in the past, but it has typically focused on noncontrollable natural materials or on a narrow range of artificial materials. The advent of high-resolution three-dimensional (3D) printing technology provides the ability to fabricate arbitrary 3D textures with precise surface geometry to be used in tactile studies. We used parametric modeling and 3D printing to manufacture a set of textured plates with defined element spacing, shape, and arrangement. Using active touch and two-alternative forced-choice protocols, we investigated the contributions of these surface parameters to roughness perception in human subjects. Results indicate that large spatial periods produce higher estimations of roughness (with Weber fraction = 0.19), small texture elements are perceived as rougher than large texture elements of the same wavelength, perceptual differences exist between textures with the same spacing but different arrangements, and roughness equivalencies exist between textures differing along different parameters. We posit that papillary ridges serve as tactile processing units, and neural ensembles encode the spatial profiles of the texture contact area to produce roughness estimates. The stimuli and the manufacturing process may be used in further studies of tactile roughness perception and in related neurophysiological applications. NEW & NOTEWORTHY Surface roughness is an integral quality of texture perception. We manufactured textures using high-resolution 3D printing, which allows precise specification of the surface spatial topography. In human psychophysical experiments we investigated the contributions of specific surface parameters to roughness perception. We found that textures with large spatial periods, small texture elements, and irregular, isotropic arrangements elicit the highest estimations of roughness. We propose that roughness correlates inversely with the total contacted surface area.

Human roughness perception and possible factors effecting roughness sensation

Surface texture sensation is significant for business success, in particular for solid surfaces for most of the materials; including foods. Mechanisms of roughness perception are still unknown, especially under different conditions such as lubricants with varying viscosities, different temperatures, or under different force loads during the observation of the surface. This work aims to determine the effect of those unknown factors, with applied sensory tests on 62 healthy participants. Roughness sensation of fingertip was tested under different lubricants including water and diluted syrup solutions at room temperature (25C) and body temperature (37C) by using simple pair-wise comparison to observe the just noticeable difference threshold and perception levels. Additionally, in this research applied force load during roughness observation was tested with pair-wise ranking method to illustrate its possible effect on human sensation. Obtained results showed that human's capability of roughness discrimination reduces with increased viscosity of the lubricant, where the influence of the temperature was not found to be significant. Moreover, the increase in the applied force load showed an increase in the sensitivity of roughness discrimination. Observed effects of the applied factors were also used for estimating the oral sensation of texture during eating. These findings are significant for our fundamental understanding to texture perception, and for the development of new food products with controlled textural features.

PRACTICAL APPLICATIONS

Texture discrimination ability, more specifically roughness discrimination capability, is a significant factor for preference and appreciation for a wide range of materials, including food, furniture, or fabric. To explore the mechanism of sensation capability through tactile senses, it is necessary to identify the relevant factors and define characteristics that dominate the process involved. The results that will be obtained under these principles will be helpful for the industry in the development and optimization of new products, especially for the individuals' with special needs. With this exploratory study, we illustrate differential thresholds of tactile senses under changing conditions of surface lubrication and applied force load. Also, the tests were carried out under different temperatures to understand the oral sensation capability. The results and correlations may provide useful information about texture sensitivity and also methodologies could be applied to general sensory studies.

Look but don't touch: Visual cues to surface structure drive somatosensory cortex

When planning interactions with nearby objects, our brain uses visual information to estimate shape, material composition, and surface structure before we come into contact with them. Here we analyse brain activations elicited by different types of visual appearance, measuring fMRI responses to objects that are glossy, matte, rough, or textured. In addition to activation in visual areas, we found that fMRI responses are evoked in the secondary somatosensory area (S2) when looking at glossy and rough surfaces. This activity could be reliably discriminated on the basis of tactile-related visual properties (gloss, rough, and matte), but importantly, other visual properties (i.e., coloured texture) did not substantially change fMRI activity. The activity could not be solely due to tactile imagination, as asking explicitly to imagine such surface properties did not lead to the same results. These findings suggest that visual cues to an object's surface properties evoke activity in neural circuits associated with tactile stimulation. This activation may reflect the a-priori probability of the physics of the interaction (i.e., the expectation of upcoming friction) that can be used to plan finger placement and grasp force.

The Effect of Task Instruction on Haptic Texture Processing: The Neural Underpinning of Roughness and Spatial Density Perception

Perceived roughness is associated with a variety of physical factors and multiple peripheral afferent types. The current study investigated whether this complexity of the mapping between physical and perceptual space is reflected at the cortical level. In an integrative psychophysical and imaging approach, we used dot pattern stimuli for which previous studies reported a simple linear relationship of interdot spacing and perceived spatial density and a more complex function of perceived roughness. Thus, by using both a roughness and a spatial estimation task, the physical and perceived stimulus characteristics could be dissociated, with the spatial density task controlling for the processing of low-level sensory aspects. Multivoxel pattern analysis was used to investigate which brain regions hold information indicative of the level of the perceived texture characteristics. While information about differences in perceived roughness was primarily available in higher-order cortices, that is, the operculo-insular cortex and a ventral visual cortex region, information about perceived spatial density could already be derived from early somatosensory and visual regions. This result indicates that cortical processing reflects the different complexities of the evaluated haptic texture dimensions. Furthermore, this study is to our knowledge the first to show a contribution of the visual cortex to tactile roughness perception.