Selective visuo-haptic processing of shape and texture

HD-tDCS to the lateral occipital complex improves haptic object recognition

High-definition transcranial direct current stimulation (HD-tDCS) is a non-invasive brain stimulation technique that has been shown to be safe and effective in modulating neuronal activity. The present study investigates the effect of anodal HD-tDCS on haptic object perception and memory through stimulation of the lateral occipital complex (LOC), a structure that has been shown to be involved in both visual and haptic object recognition. In this single-blind, sham-controlled, between-subjects study, blindfolded healthy, sighted participants used their right (dominant) hand to perform haptic discrimination and recognition tasks with 3D-printed, novel objects called "Greebles" while receiving 20 min of 2 milliamp (mA) anodal stimulation (or sham) to the left or right LOC. Compared to sham, those who received left LOC stimulation (contralateral to the hand used) showed an improvement in haptic object recognition but not discrimination-a finding that was evident from the start of the behavioral tasks. A second experiment showed that this effect was not observed with right LOC stimulation (ipsilateral to the hand used). These results suggest that HD-tDCS to the left LOC can improve recognition of objects perceived via touch. Overall, this work sheds light on the LOC as a multimodal structure that plays a key role in object recognition in both the visual and haptic modalities.

Early attentional processing and cortical remapping strategies of tactile stimuli in adults with an early and late-onset visual impairment: A cross-sectional study

Neuroplastic changes appear in people with visual impairment (VI) and they show greater tactile abilities. Improvements in performance could be associated with the development of enhanced early attentional processes based on neuroplasticity. Currently, the various early attentional and cortical remapping strategies that are utilized by people with early (EB) and late-onset blindness (LB) remain unclear. Thus, more research is required to develop effective rehabilitation programs and substitution devices. Our objective was to explore the differences in spatial tactile brain processing in adults with EB, LB and a sighted control group (CG). In this cross-sectional study 27 participants with VI were categorized into EB (n = 14) and LB (n = 13) groups. They were then compared with a CG (n = 15). A vibrotactile device and event-related potentials (ERPs) were utilized while participants performed a spatial tactile line recognition task. The P100 latency and cortical areas of maximal activity were analyzed during the task. The three groups had no statistical differences in P100 latency (p>0.05). All subjects showed significant activation in the right superior frontal areas. Only individuals with VI activated the left superior frontal regions. In EB subjects, a higher activation was found in the mid-frontal and occipital areas. A higher activation of the mid-frontal, anterior cingulate cortex and orbitofrontal zones was observed in LB participants. Compared to the CG, LB individuals showed greater activity in the left orbitofrontal zone, while EB exhibited greater activity in the right superior parietal cortex. The EB had greater activity in the left orbitofrontal region compared to the LB. People with VI may not have faster early attentional processing. EB subjects activate the occipital lobe and right superior parietal cortex during tactile stimulation because of an early lack of visual stimuli and a multimodal information processing. In individuals with LB and EB the orbitofrontal area is activated, suggesting greater emotional processing.

Vision matters for shape representation: Evidence from sculpturing and drawing in the blind

Shape is a property that could be perceived by vision and touch, and is classically considered to be supramodal. While there is mounting evidence for the shared cognitive and neural representation space between visual and tactile shape, previous research tended to rely on dissimilarity structures between objects and had not examined the detailed properties of shape representation in the absence of vision. To address this gap, we conducted three explicit object shape knowledge production experiments with congenitally blind and sighted participants, who were asked to produce verbal features, 3D clay models, and 2D drawings of familiar objects with varying levels of tactile exposure, including tools, large nonmanipulable objects, and animals. We found that the absence of visual experience (i.e., in the blind group) led to stronger differences in animals than in tools and large objects, suggesting that direct tactile experience of objects is essential for shape representation when vision is unavailable. For tools with rich tactile/manipulation experiences, the blind produced overall good shapes comparable to the sighted, yet also showed intriguing differences. The blind group had more variations and a systematic bias in the geometric property of tools (making them stubbier than the sighted), indicating that visual experience contributes to aligning internal representations and calibrating overall object configurations, at least for tools. Taken together, the object shape representation reflects the intricate orchestration of vision, touch and language.

Learning and navigating digitally rendered haptic spatial layouts

Learning spatial layouts and navigating through them rely not simply on sight but rather on multisensory processes, including touch. Digital haptics based on ultrasounds are effective for creating and manipulating mental images of individual objects in sighted and visually impaired participants. Here, we tested if this extends to scenes and navigation within them. Using only tactile stimuli conveyed via ultrasonic feedback on a digital touchscreen (i.e., a digital interactive map), 25 sighted, blindfolded participants first learned the basic layout of an apartment based on digital haptics only and then one of two trajectories through it. While still blindfolded, participants successfully reconstructed the haptically learned 2D spaces and navigated these spaces. Digital haptics were thus an effective means to learn and translate, on the one hand, 2D images into 3D reconstructions of layouts and, on the other hand, navigate actions within real spaces. Digital haptics based on ultrasounds represent an alternative learning tool for complex scenes as well as for successful navigation in previously unfamiliar layouts, which can likely be further applied in the rehabilitation of spatial functions and mitigation of visual impairments.

Disturbance of skin sensation and autism spectrum disorder: A bidirectional Mendelian randomization study

BACKGROUND AND AIM

Patients with autism spectrum disorder (ASD) commonly experience aberrant skin sensation sensitivity; however, the causal relationship is not yet clear. This study uses a bidirectional Mendelian randomization (MR) method to explore the relationship between disturbance of skin sensation (DSS) and ASD.

METHODS

Single-nucleotide polymorphisms (SNPs) extracted from the summary data of genome-wide association studies were used as genetic instruments. MR was performed using the inverse-variance-weighted method, with alternate methods (e.g., weighted median, MR-Egger, simple mode, weighted mode, and MR-pleiotropy residual sum and outlier) and multiple sensitivity analyses to assess horizontal pleiotropy and remove outliers.

RESULTS

The results of the analysis using six SNPs as genetic instruments showed that the DSS is associated with an increased risk of ASD (odds ratio = 1.126, 95% confidence interval = 1.029-1.132; p = .010). The results of the sensitivity analyses were robust with no evidence of pleiotropy. The reverse MR analyses showed no causal effects of ASD on DSS.

CONCLUSION

This study's findings suggest that DSS has potential causal effects on ASD, whereas ASD has no effect on DSS. Thus, skin sensitivity may represent a behavioral marker of ASD, by which some populations could be subtyped in the future.

The neural correlates of texture perception: A systematic review and activation likelihood estimation meta-analysis of functional magnetic resonance imaging studies

INTRODUCTION

Humans use discriminative touch to perceive texture through dynamic interactions with surfaces, activating low-threshold mechanoreceptors in the skin. It was largely assumed that texture was processed in primary somatosensory regions in the brain; however, imaging studies indicate heterogeneous patterns of brain activity associated with texture processing.

METHODS

To address this, we conducted a coordinate-based activation likelihood estimation meta-analysis of 13 functional magnetic resonance imaging studies (comprising 15 experiments contributing 228 participants and 275 foci) selected by a systematic review.

RESULTS

Concordant activations for texture perception occurred in the left primary somatosensory and motor regions, with bilateral activations in the secondary somatosensory, posterior insula, and premotor and supplementary motor cortices. We also evaluated differences between studies that compared touch processing to non-haptic control (e.g., rest or visual control) or those that used haptic control (e.g., shape or orientation perception) to specifically investigate texture encoding. Studies employing a haptic control revealed concordance for texture processing only in the left secondary somatosensory cortex. Contrast analyses demonstrated greater concordance of activations in the left primary somatosensory regions and inferior parietal cortex for studies with a non-haptic control, compared to experiments accounting for other haptic aspects.

CONCLUSION

These findings suggest that texture processing may recruit higher order integrative structures, and the secondary somatosensory cortex may play a key role in encoding textural properties. The present study provides unique insight into the neural correlates of texture-related processing by assessing the influence of non-textural haptic elements and identifies opportunities for a future research design to understand the neural processing of texture.

Beyond sense-specific processing: decoding texture in the brain from touch and sonified movement

Texture, a fundamental object attribute, is perceived through multisensory information including touch and auditory cues. Coherent perceptions may rely on shared texture representations across different senses in the brain. To test this hypothesis, we delivered haptic textures coupled with a sound synthesizer to generate real-time textural sounds. Participants completed roughness estimation tasks with haptic, auditory, or bimodal cues in an MRI scanner. Somatosensory, auditory, and visual cortices were all activated during haptic and auditory exploration, challenging the traditional view that primary sensory cortices are sense-specific. Furthermore, audio-tactile integration was found in secondary somatosensory (S2) and primary auditory cortices. Multivariate analyses revealed shared spatial activity patterns in primary motor and somatosensory cortices, for discriminating texture across both modalities. This study indicates that primary areas and S2 have a versatile representation of multisensory textures, which has significant implications for how the brain processes multisensory cues to interact more efficiently with our environment.

Tactually-related cognitive impairments: sharing of neural substrates across associative tactile agnosia, agraphesthesia, and kinesthetic reading difficulty

INTRODUCTION

A precise understanding of the neural substrates underlying tactually-related cognitive impairments such as bilateral tactile agnosia, bilateral agraphesthesia, kinesthetic alexia and kinesthetic reading difficulty is currently incomplete. In particular, recent data have implicated a role for the lateral occipital tactile visual region, or LOtv, in tactile object naming (Amedi et al. Cerebral Cortex 2002). Thus, this study set out to examine the degree to which the LOtv may be involved in tactually-related cognitive impairments by examining two unique cases.

METHODS

To assess whether LOtv or the visual word form area (VWFA) is involved in tactually-related cognitive impairments, the average activation point of LOtv and that of VWFA were placed on the single-photon emission computed tomography (SPECT) cerebral blood flow images of two patients: one with bilateral associative tactile agnosia, bilateral agraphesthesia, and ineffective kinesthetic reading, and the other with kinesthetic reading difficulty.

RESULTS

The average LOtv coordinate was involved in the area of hypoperfusion in both patients, whereas that of VWFA was not included in any of the hypoperfused areas.

CONCLUSIONS

The results support the view that interruption of LOtv or disconnection to LOtv and to VWFA may cause these tactually-related cognitive impairments. Further, bilateral associative tactile agnosia and bilateral agraphesthesia are attributable toward the damage of the occipital lobe, whereas unilateral or predominantly one-sided associative tactile agnosia and agraphesthesia are attributable toward the damage of the parietal lobe.

Neural and behavioral signatures of the multidimensionality of manipulable object processing

Understanding how we recognize objects requires unravelling the variables that govern the way we think about objects and the neural organization of object representations. A tenable hypothesis is that the organization of object knowledge follows key object-related dimensions. Here, we explored, behaviorally and neurally, the multidimensionality of object processing. We focused on within-domain object information as a proxy for the decisions we typically engage in our daily lives - e.g., identifying a hammer in the context of other tools. We extracted object-related dimensions from subjective human judgments on a set of manipulable objects. We show that the extracted dimensions are cognitively interpretable and relevant - i.e., participants are able to consistently label them, and these dimensions can guide object categorization; and are important for the neural organization of knowledge - i.e., they predict neural signals elicited by manipulable objects. This shows that multidimensionality is a hallmark of the organization of manipulable object knowledge.

Tactile estimation of hedonic and sensory properties during active touch: An electroencephalography study

Perceptual judgements about our physical environment are informed by somatosensory information. In real-world exploration, this often involves dynamic hand movements to contact surfaces, termed active touch. The current study investigated cortical oscillatory changes during active exploration to inform the estimation of surface properties and hedonic preferences of two textured stimuli: smooth silk and rough hessian. A purpose-built touch sensor quantified active touch, and oscillatory brain activity was recorded from 129-channel electroencephalography. By fusing these data streams at a single trial level, oscillatory changes within the brain were examined while controlling for objective touch parameters (i.e., friction). Time-frequency analysis was used to quantify changes in cortical oscillatory activity in alpha (8-12 Hz) and beta (16-24 Hz) frequency bands. Results reproduce findings from our lab, whereby active exploration of rough textures increased alpha-band event-related desynchronisation in contralateral sensorimotor areas. Hedonic processing of less preferred textures resulted in an increase in temporoparietal beta-band and frontal alpha-band event-related desynchronisation relative to most preferred textures, suggesting that higher order brain regions are involved in the hedonic processing of texture. Overall, the current study provides novel insight into the neural mechanisms underlying texture perception during active touch and how this process is influenced by cognitive tasks.

Similar object shape representation encoded in the inferolateral occipitotemporal cortex of sighted and early blind people

We can sense an object's shape by vision or touch. Previous studies suggested that the inferolateral occipitotemporal cortex (ILOTC) implements supramodal shape representations as it responds more to seeing or touching objects than shapeless textures. However, such activation in the anterior portion of the ventral visual pathway could be due to the conceptual representation of an object or visual imagery triggered by touching an object. We addressed these possibilities by directly comparing shape and conceptual representations of objects in early blind (who lack visual experience/imagery) and sighted participants. We found that bilateral ILOTC in both groups showed stronger activation during a shape verification task than during a conceptual verification task made on the names of the same manmade objects. Moreover, the distributed activity in the ILOTC encoded shape similarity but not conceptual association among objects. Besides the ILOTC, we also found shape representation in both groups' bilateral ventral premotor cortices and intraparietal sulcus (IPS), a frontoparietal circuit relating to object grasping and haptic processing. In contrast, the conceptual verification task activated both groups' left perisylvian brain network relating to language processing and, interestingly, the cuneus in early blind participants only. The ILOTC had stronger functional connectivity to the frontoparietal circuit than to the left perisylvian network, forming a modular structure specialized in shape representation. Our results conclusively support that the ILOTC selectively implements shape representation independently of visual experience, and this unique functionality likely comes from its privileged connection to the frontoparietal haptic circuit.

Assessing the representational structure of softness activated by words

Softness is an important material property that can be judged directly, by interacting with an object, but also indirectly, by simply looking at an image of a material. The latter is likely possible by filling in relevant multisensory information from prior experiences with soft materials. Such experiences are thought to lead to associations that make up our representations about perceptual softness. Here, we investigate the structure of this representational space when activated by words, and compare it to haptic and visual perceptual spaces that we obtained in earlier work. To this end, we performed an online study where people rated different sensory aspects of soft materials, presented as written names. We compared the results with the previous studies where identical ratings were made on the basis of visual and haptic information. Correlation and Procrustes analyses show that, overall, the representational spaces of verbally presented materials were similar to those obtained from haptic and visual experiments. However, a classifier analysis showed that verbal representations could better be predicted from those obtained from visual than from haptic experiments. In a second study we rule out that these larger discrepancies in representations between verbal and haptic conditions could be due to difficulties in material identification in haptic experiments. We discuss the results with respect to the recent idea that at perceived softness is a multidimensional construct.

A domain-general frontoparietal network interacts with domain-preferential intermediate pathways to support working memory task

Working memory (WM) is essential for cognition, but the underlying neural mechanisms remain elusive. From a hierarchical processing perspective, this paper proposed and tested a hypothesis that a domain-general network at the top of the WM hierarchy can interact with distinct domain-preferential intermediate circuits to support WM. Employing a novel N-back task, we first identified the posterior superior temporal gyrus (pSTG), middle temporal area (MT), and postcentral gyrus (PoCG) as intermediate regions for biological motion and shape motion processing, respectively. Using further psychophysiological interaction analyses, we delineated a frontal-parietal network (FPN) as the domain-general network. These results were further verified and extended by a delayed match to sample (DMS) task. Although the WM load-dependent and stimulus-free activations during the DMS delay phase confirm the role of FPN as a domain-general network to maintain information, the stimulus-dependent activations within this network during the DMS encoding phase suggest its involvement in the final stage of the hierarchical processing chains. In contrast, the load-dependent activations of intermediate regions in the N-back task highlight their further roles beyond perception in WM tasks. These results provide empirical evidence for a hierarchical processing model of WM and may have significant implications for WM training.

Functional relevance of the extrastriate body area for visual and haptic object recognition: a preregistered fMRI-guided TMS study

The extrastriate body area (EBA) is a region in the lateral occipito-temporal cortex (LOTC), which is sensitive to perceived body parts. Neuroimaging studies suggested that EBA is related to body and tool processing, regardless of the sensory modalities. However, how essential this region is for visual tool processing and nonvisual object processing remains a matter of controversy. In this preregistered fMRI-guided repetitive transcranial magnetic stimulation (rTMS) study, we examined the causal involvement of EBA in multisensory body and tool recognition. Participants used either vision or haptics to identify 3 object categories: hands, teapots (tools), and cars (control objects). Continuous theta-burst stimulation (cTBS) was applied over left EBA, right EBA, or vertex (control site). Performance for visually perceived hands and teapots (relative to cars) was more strongly disrupted by cTBS over left EBA than over the vertex, whereas no such object-specific effect was observed in haptics. The simulation of the induced electric fields confirmed that the cTBS affected regions including EBA. These results indicate that the LOTC is functionally relevant for visual hand and tool processing, whereas the rTMS over EBA may differently affect object recognition between the 2 sensory modalities.

Effects of Fermented Garlic Extract Containing Nitric Oxide Metabolites on Blood Flow in Healthy Participants: A Randomized Controlled Trial

Aged or fermented garlic extract (FGE) is a natural remedy that improves vascular function through increasing vascular nitric oxide (NO) bioavailability. This is because nitrite (NO2-), a NO metabolite, can be produced through bioconversion with macrobacteria during the fermentation of foods like garlic. We aimed to evaluate the effects of NO2- in FGE on blood flow (BF), blood pressure (BP), velocity of the common carotid artery (CCA) and internal carotid artery (ICA), regional cerebral BF (rCBF), and peripheral BF (PBF). The study was divided into two parts: (1) Thirty healthy adults were divided into FGE and placebo groups to compare BP and velocity of the CCA and ICA; and (2) Twenty-eight healthy adults were divided into FGE and placebo groups to compare rCBF and PBF and determine changes before/after ingestion. Significant changes were noted in BP and the velocity of both CCA 30-60 min after FGE ingestion. FGE ingestion resulted in significant increases in rCBF and increases in body surface temperature through alterations in PBF. No detectable clinical side effects were noted. Overall, oral administration of NO2- containing FGE demonstrated acute positive effects in upregulating BF, including the CCA, BP, rCBF, and PBF. Follow-up studies with larger sample sizes and long-term ingestion may be needed.

Distinguishing transient from persistent tactile agnosia after partial anterior circulation infarcts - Behavioral and neuroimaging evidence for white matter disconnection

From a cohort of 36 patients presenting apperceptive tactile agnosia after first cortical ischemic stroke, 14 showed temporary impairment at admission. A previous multi-voxel analysis of the cortical lesions, using as explanatory variable the course of tactile object recognition performance over the recovery period of 9 months, partitioned the cohort into three subgroups. Of the 14 patients constituting two of the subgroups, 7 recovered from their impairment whereas 7 did not. These two subgroups could not be distinguished at admission. The primary aim of the present study is to present two assessments that can do so. The first assessment comprises a pattern of behavioral measures, determined via principal component analysis, encoded in three tests: picking small objects, macrogeometrical discrimination and tactile object recognition. The receiver operating characteristic curve derived from permutation of the behavioral test scores yielded an 80% probability of correct identification of the patient subgroup and an 8% probability for false identification. As done with the permuted scores, the pattern could predict the persistence of affliction of new stroke patients with tactile agnosia. The second predictive assessment extends our previous evaluation of cortical MRI lesion maps to include subcortical regions. Confirming our previous study, the lesions of the persistently impaired subgroup disrupted significantly the anterior arcuatus fasciculus and associated superior longitudinal fasciculus III in the ipsilesional hemisphere, impeding reciprocal information transfer between supramarginal gyrus and both the ventral premotor cortex and Brodmann area 44. Due to the importance of interhemispheric information transfer in tactile agnosia, we performed a supplementary analysis of tactile object recognition scores. It showed that haptic information transfer from the non-affected to the affected hands in the persistent cases partly restored function during the nine months, possibly following restoration of functional interhemispheric haptic information transfer at the border of posterior corpus callosum and splenium. In conclusion, the combined findings of the cortical lesion at subarea PFt of the inferior parietal lobule and the associated subcortical tract lesions permit almost perfect prediction of persistent impairment of tactile object recognition. The study substantiates the need for combined analysis of both cortical lesions and white matter tract disconnections.

Complex Shapes Are Bluish, Darker, and More Saturated; Shape-Color Correspondence in 3D Object Perception

It has been shown that there is a non-random association between shape and color. However, the results of previous studies on the shape-color correspondence did not converge. To address the issue, we focused on shape complexity among a number of shape properties, particularly in terms of 3D shape, and parametrically manipulated the shape complexity and all three components of color. With two experiments, the current study aimed to closely examine the correspondence between shape complexity of 3D shape and color in terms of hue (Experiment 1), luminance, and saturation (Experiment 2). Participants were presented with the 3D shapes in either visual or visuo-haptic modes of exploration. Subsequently, they had to pick from a color palette the color best matching each shape of the object. In Experiment 1, we found that as shapes became more complex, the best associated hue changed from those with long wavelengths to ones with short wavelengths. Results of Experiment 2 demonstrated that as the shapes grew more complex, the associated luminance decreased, and saturation increased. Additionally, adding haptic exploration to visual exploration strengthened the association – for saturation in particular – with the pattern of shape-color correspondence maintained. Taken together, we demonstrated that complex shapes are associated with bluish, darker and more saturated colors, suggesting that shape complexity has a systematic relationship with color including hue, luminance, and saturation.

Effect of Transcranial Electrical Stimulation over the Posterior Parietal Cortex on Tactile Spatial Discrimination Performance

The intraparietal sulcus region, which is part of the posterior parietal cortex (PPC), has been shown to play an important role in discriminating object shapes using the fingers. Transcranial random noise stimulation (tRNS) and anodal transcranial pulsed current stimulation (tPCS) are noninvasive strategies widely used to modulate neural activity in cortical regions. Therefore, we investigated the effects of tRNS and anodal tPCS applied to left or right PPC on the tactile discrimination performance of the right index finger in 20 neurologically healthy subjects. A grating orientation task (GOT) was performed before and immediately after delivering tRNS (stimulus frequency 0.1-640 Hz) in Experiment 1 or anodal tPCS (pulse width 50 ms and inter-pulse interval 5 ms) in Experiment 2. Performing tRNS over the right PPC significantly improved discrimination performance on the GOT. Subjects were classified into low and high baseline performance groups. Conducting tRNS over the left PPC significantly reduced the GOT discrimination performance in the high-performance group. By contrast, anodal tPCS delivered to the PPC of the left and right hemispheres had no significant effect on the tactile GOT discrimination performance of the right hand. We show that transcranial electric stimulation over the PPC may improve tactile perception but the effect depends on stimulus modality, parameters, and on the stimulated hemisphere.

Information Exchange between Cortical Areas: The Visual System as a Model

As nearly all brain functions, perception, motion, and higher-order cognitive functions require coordinated neural information processing within distributed cortical networks. Over the past decades, new theories and techniques emerged that advanced our understanding of how information is transferred between cortical areas. This review surveys critical aspects of interareal information exchange. We begin by examining the brain’s structural connectivity, which provides the basic framework for interareal communication. We then illustrate information exchange between cortical areas using the visual system as an example. Next, well-studied and newly proposed theories that may underlie principles of neural communication are reviewed, highlighting recent work that offers new perspectives on interareal information exchange. We finally discuss open questions in the study of the neural mechanisms underlying interareal information exchange.

Global surface features contribute to human haptic roughness estimations

Previous studies have paid special attention to the relationship between local features (e.g., raised dots) and human roughness perception. However, the relationship between global features (e.g., curved surface) and haptic roughness perception is still unclear. In the present study, a series of roughness estimation experiments was performed to investigate how global features affect human roughness perception. In each experiment, participants were asked to estimate the roughness of a series of haptic stimuli that combined local features (raised dots) and global features (sinusoidal-like curves). Experiments were designed to reveal whether global features changed their haptic roughness estimation. Furthermore, the present study tested whether the exploration method (direct, indirect, and static) changed haptic roughness estimations and examined the contribution of global features to roughness estimations. The results showed that sinusoidal-like curved surfaces with small periods were perceived to be rougher than those with large periods, while the direction of finger movement and indirect exploration did not change this phenomenon. Furthermore, the influence of global features on roughness was modulated by local features, regardless of whether raised-dot surfaces or smooth surfaces were used. Taken together, these findings suggested that an object’s global features contribute to haptic roughness perceptions, while local features change the weight of the contribution that global features make to haptic roughness perceptions.

Tactile disgust: Post-contact can be more disgusting than contact

Several studies have examined if disgust can be evoked by contacting an object-yet none have examined if reported disgust changes when the hand leaves the object. This is surprising given that post-contact tactile disgust is probably a driver of hand hygiene. We examined contact and post-contact tactile disgust and its sensory origins. Participants were asked to touch several objects, making sensory, disgust, and desire-to-handwash evaluations. These ratings were made at three stages-of-contact: object-contact (just touch), post-contact (just touch), and visual post-contact (touch, vision). Disgust was typically highest at post-contact (when the hand left the object). Stickiness and wetness were uniquely predictive of object-contact disgust. Only stickiness drove post-contact disgust, and only wetness visual post-contact disgust. Hand-washing desire was primarily driven by quantity of residue perceived on the hand. These findings suggest that tactile disgust is a multisensory and iterative process relating to object- and residue-adhesiveness.

The look and feel of soft are similar across different softness dimensions

The softness of objects can be perceived through several senses. For instance, to judge the softness of a cat's fur, we do not only look at it, we often also run our fingers through its coat. Recently, we have shown that haptically perceived softness covaries with the compliance, viscosity, granularity, and furriness of materials (Dovencioglu, Üstün, Doerschner, & Drewing, 2020). However, it is unknown whether vision can provide similar information about the various aspects of perceived softness. Here, we investigated this question in an experiment with three conditions: in the haptic condition, blindfolded participants explored materials with their hands, in the static visual condition participants were presented with close-up photographs of the same materials, and in the dynamic visual condition participants watched videos of the hand-material interactions that were recorded in the haptic condition. After haptically or visually exploring the materials, participants rated them on various attributes. Our results show a high overall perceptual correspondence among the three experimental conditions. With a few exceptions, this correspondence tended to be strongest between haptic and dynamic visual conditions. These results are discussed with respect to information potentially available through the senses, or through prior experience, when judging the softness of materials.

Neuroplasticity and Crossmodal Connectivity in the Normal, Healthy Brain

Objective

Neuroplasticity enables the brain to establish new crossmodal connections or reorganize old connections which are essential to perceiving a multisensorial world. The intent of this review is to identify and summarize the current developments in neuroplasticity and crossmodal connectivity, and deepen understanding of how crossmodal connectivity develops in the normal, healthy brain, highlighting novel perspectives about the principles that guide this connectivity.

Methods

To the above end, a narrative review is carried out. The data documented in prior relevant studies in neuroscience, psychology and other related fields available in a wide range of prominent electronic databases are critically assessed, synthesized, interpreted with qualitative rather than quantitative elements, and linked together to form new propositions and hypotheses about neuroplasticity and crossmodal connectivity.

Results

Three major themes are identified. First, it appears that neuroplasticity operates by following eight fundamental principles and crossmodal integration operates by following three principles. Second, two different forms of crossmodal connectivity, namely direct crossmodal connectivity and indirect crossmodal connectivity, are suggested to operate in both unisensory and multisensory perception. Third, three principles possibly guide the development of crossmodal connectivity into adulthood. These are labeled as the principle of innate crossmodality, the principle of evolution-driven 'neuromodular' reorganization and the principle of multimodal experience. These principles are combined to develop a three-factor interaction model of crossmodal connectivity.

Conclusions

The hypothesized principles and the proposed model together advance understanding of neuroplasticity, the nature of crossmodal connectivity, and how such connectivity develops in the normal, healthy brain.

Neural correlates of tactile hardness intensity perception during active grasping

While tactile sensation plays an essential role in interactions with the surroundings, relatively little is known about the neural processes involved in the perception of tactile information. In particular, it remains unclear how different intensities of tactile hardness are represented in the human brain during object manipulation. This study aims to investigate neural responses to various levels of tactile hardness using functional magnetic resonance imaging while people grasp objects to perceive hardness intensity. We used four items with different hardness levels but otherwise identical in shape and texture. A total of Twenty-five healthy volunteers participated in this study. Before scanning, participants performed a behavioral task in which they received a pair of stimuli and they were to report the perceived difference of hardness between them. During scanning, without any visual information, they were randomly given one of the four objects and asked to grasp it. We found significant blood oxygen-level-dependent (BOLD) responses in the posterior insula in the right hemisphere (rpIns) and the right posterior lobe of the cerebellum (rpCerebellum), which parametrically tracked hardness intensity. These responses were supported by BOLD signal changes in the rpCerebellum and rpIns correlating with tactile hardness intensity. Multidimensional scaling analysis showed similar representations of hardness intensity among physical, perceptual, and neural information. Our findings demonstrate the engagement of the rpCerebellum and rpIns in perceiving tactile hardness intensity during active object manipulation.

Temporal Dynamics of Brain White Matter Plasticity in Sighted Subjects during Tactile Braille Learning: A Longitudinal Diffusion Tensor Imaging Study

The white matter (WM) architecture of the human brain changes in response to training, though fine-grained temporal characteristics of training-induced white matter plasticity remain unexplored. We investigated white matter microstructural changes using diffusion tensor imaging at five different time points in 26 sighted female adults during 8 months of training on tactile braille reading. Our results show that training-induced white matter plasticity occurs both within and beyond the trained sensory modality, as reflected by fractional anisotropy (FA) increases in somatosensory and visual cortex, respectively. The observed changes followed distinct time courses, with gradual linear FA increase along the training in the somatosensory cortex and sudden visual cortex cross-modal plasticity occurring after braille input became linguistically meaningful. WM changes observed in these areas returned to baseline after the cessation of learning in line with the supply-demand model of plasticity. These results also indicate that the temporal dynamics of microstructural plasticity in different cortical regions might be modulated by the nature of computational demands. We provide additional evidence that observed FA training-induced changes are behaviorally relevant to tactile reading. Together, these results demonstrate that WM plasticity is a highly dynamic process modulated by the introduction of novel experiences.SIGNIFICANCE STATEMENT Throughout the lifetime the human brain is shaped by various experiences. Training-induced reorganization in white matter (WM) microstructure has been reported, but we know little about its temporal dynamics. To fill this gap, we scanned sighted subjects five times during tactile braille reading training. We observed different dynamics of WM plasticity in the somatosensory and visual cortices implicated in braille reading. The former showed a continuous increase in WM tissue anisotropy along with tactile training, while microstructural changes in the latter were observed only after the participants learned to read braille words. Our results confirm the supply-demand model of brain plasticity and provide evidence that WM reorganization depends on distinct computational demands and functional roles of regions involved in the trained skill.

Brain networks underlying the processing of sound symbolism related to softness perception

Unlike the assumption of modern linguistics, there is non-arbitrary association between sound and meaning in sound symbolic words. Neuroimaging studies have suggested the unique contribution of the superior temporal sulcus to the processing of sound symbolism. However, because these findings are limited to the mapping between sound symbolism and visually presented objects, the processing of sound symbolic information may also involve the sensory-modality dependent mechanisms. Here, we conducted a functional magnetic resonance imaging experiment to test whether the brain regions engaged in the tactile processing of object properties are also involved in mapping sound symbolic information with tactually perceived object properties. Thirty-two healthy subjects conducted a matching task in which they judged the congruency between softness perceived by touch and softness associated with sound symbolic words. Congruency effect was observed in the orbitofrontal cortex, inferior frontal gyrus, insula, medial superior frontal gyrus, cingulate gyrus, and cerebellum. This effect in the insula and medial superior frontal gyri was overlapped with softness-related activity that was separately measured in the same subjects in the tactile experiment. These results indicate that the insula and medial superior frontal gyrus play a role in processing sound symbolic information and relating it to the tactile softness information.

High-definition transcranial direct current stimulation of the lateral occipital cortex influences figure-ground perception

Prior work has shown that the lateral occipital cortex (LO) is involved in recognition of objects and their parts, as well as segregation of that object (or "figure") from its background. No studies, though, have examined how LO's functioning is influenced by non-invasive brain stimulation, particularly during a figure-ground perception task. The present study tested whether high-definition transcranial direct current stimulation (HD-tDCS) to right LO influences the effects of familiarity on figure-ground perception. Following 20 min of offline anodal stimulation (or sham), participants viewed masked stimuli consisting of two regions separated by a vertical border and were asked to report which region they perceived as figure. One region was the "critical" region, which either depicted a portion of a familiar object ("Familiar" stimuli), or a familiar object with its parts rearranged into a novel configuration ("Part-rearranged" stimuli). Previous research using these stimuli has found higher reports of the critical region as figure for Familiar vs. Part-rearranged displays, demonstrating the effect of familiarity on figure assignment. The results of the current study showed that HD-tDCS to right LO significantly influenced this typical behavioral pattern. Specifically, stimulation (vs. sham) increased reports of the critical region as figure for Part-rearranged stimuli, bringing perception of these displays up to the level of the Familiar stimuli. We interpret this finding as evidence that stimulation of right LO increased participants' reliance on the familiarity of the parts in their figure-ground judgements-a finding consistent with and extending previous research showing that LO is indeed sensitive to object parts. This is the first study showing that HD-tDCS to LO can influence the effects of familiarity on figure-ground perception.

Burke's "sensitive" sublime rooted in brain and body versus Kant's transcendental concept in the German Romantic discourse

During the 18th century, debates about what constituted the sublime flourished in Europe, and particularly in Germany. These debates were nourished by two different visions: The Kantian concept supposed that the sublime is supra-sensible and rooted in reason (Logos) rather than in the object, thus provoking a mental state of tension between nature and art; Edmund Burke's concept, on the other hand, conceived of the sublime as a bodily immersive experience, which we here define as "sensitive" sublime. In summary, Burke's view of the sublime is rooted in the senses and not in the power of reason, unlike Kant's. This was to disrupt the mainstream ideas of that time, unconsciously anticipating some of the recent neuroaesthetic acquisitions regarding the central role played by the sensory apparatus in the experience of beauty and of the sublime.

Different activation signatures in the primary sensorimotor and higher-level regions for haptic three-dimensional curved surface exploration

Haptic object perception begins with continuous exploratory contact, and the human brain needs to accumulate sensory information continuously over time. However, it is still unclear how the primary sensorimotor cortex (PSC) interacts with these higher-level regions during haptic exploration over time. This functional magnetic resonance imaging (fMRI) study investigates time-dependent haptic object processing by examining brain activity during haptic 3D curve and roughness estimations. For this experiment, we designed sixteen haptic stimuli (4 kinds of curves × 4 varieties of roughness) for the haptic curve and roughness estimation tasks. Twenty participants were asked to move their right index and middle fingers along the surface twice and to estimate one of the two features-roughness or curvature-depending on the task instruction. We found that the brain activity in several higher-level regions (e.g., the bilateral posterior parietal cortex) linearly increased as the number of curves increased during the haptic exploration phase. Surprisingly, we found that the contralateral PSC was parametrically modulated by the number of curves only during the late exploration phase but not during the early exploration phase. In contrast, we found no similar parametric modulation activity patterns during the haptic roughness estimation task in either the contralateral PSC or in higher-level regions. Thus, our findings suggest that haptic 3D object perception is processed across the cortical hierarchy, whereas the contralateral PSC interacts with other higher-level regions across time in a manner that is dependent upon the features of the object.

Numbsense of shape, texture, and objects after left parietal infarction: A case report

Numbsense is a phenomenon, wherein patients can correctly respond to somatosensory stimuli at a higher rate than expected by chance, but cannot perceive the same stimuli consciously. Previously, numbsense has been reported in tactile localization of stimuli on the patient’s own body. Here, we describe a patient with numbsense that involved touched objects. The patient could not recognize the majority of somatosensory stimuli after left parietal infarction, but could correctly select shape, texture, and object stimuli more frequently than expected by chance.

The Nature of Haptic Working Memory Capacity and Its Relation to Visual Working Memory

I conducted three experiments to investigate haptic working memory capacity using a haptic change detection task with 2D stimuli. I adopted a single-task paradigm comprising haptic single-feature (orientation or texture) and haptic multifeature (orientation and texture) conditions in Experiment 1 and a dual-task paradigm with a primary haptic orientation or texture change detection task and a concurrent secondary visual shape or colour change detection task in Experiments 2-3. I observed that in the single-task paradigm, haptic change detection capacity was higher for single features than it was for multiple features. In haptic working memory, unlike in visual working memory, features of two different dimensions within an object cannot be integrated. In the dual-task paradigm, interference was observed when the concurrent visual shape change detection task was combined with the haptic orientation change detection task although interference was not observed when the concurrent visual colour change detection task was combined with it. In addition, the concurrent visual shape or colour change detection task did not interfere with the capacity for haptic texture memory, which was higher than that for haptic orientation memory. These findings demonstrate that geometric properties perhaps retained a common storage system shared between haptic working memory and visual working memory; however, haptic texture might be retained in an independent stable storage system that is haptic-specific.

Visual motion information modulates tactile roughness perception

We perceive the roughness of an object through our eyes and hands. Many crossmodal studies have reported that there is no clear visuo-tactile interaction in roughness perception using static visual cues. One exception is that the visual observation of task-irrelevant hand movements, not the texture of task-relevant objects, can enhance the performance of tactile roughness discrimination. Our study investigated whether task-irrelevant visual motion without either object roughness or bodily cues can influence tactile roughness perception. Participants were asked to touch abrasive papers while moving their hand laterally and viewing moving or static sine wave gratings without being able to see their hand, and to estimate the roughness magnitude of the tactile stimuli. Moving gratings with a low spatial frequency induced smoother roughness perceptions than static visual stimuli when the visual grating moved in the direction opposite the hand movements. The effects of visual motion did not appear when the visual stimuli had a high spatial frequency or when the participants touched the tactile stimuli passively. These results indicate that simple task-irrelevant visual movement without object roughness or bodily cues can modulate tactile roughness perception with active body movements in a spatial-frequency-selective manner.

Distinct auditory and visual tool regions with multisensory response properties in human parietal cortex

Left parietal cortex has been associated with the human-specific ability of sophisticated tool use. Yet, it is unclear how tool information is represented across senses. Here, we compared auditory and visual tool-specific activations within healthy human subjects to probe the relation of tool-specific networks, uni- and multisensory response properties, and functional and structural connectivity using functional and diffusion-weighted MRI. In each subject, we identified an auditory tool network with regions in left anterior inferior parietal cortex (aud-aIPL), bilateral posterior lateral sulcus, and left inferior precentral sulcus, and a visual tool network with regions in left aIPL (vis-aIPL) and bilateral inferior temporal gyrus. Aud-aIPL was largely separate and anterior/inferior from vis-aIPL, with varying degrees of overlap across subjects. Both regions displayed a strong preference for tools versus other stimuli presented within the same modality. Despite their modality preference, aud-aIPL and vis-aIPL and a region in left inferior precentral sulcus displayed multisensory response properties, as revealed in multivariate analyses. Thus, two largely separate tool networks are engaged by the visual and auditory modalities with nodes in parietal and prefrontal cortex potentially integrating information across senses. The diversification of tool processing in human parietal cortex underpins its critical role in complex object processing.

Mental Rotation of Digitally-Rendered Haptic Objects by the Visually-Impaired

In the event of visual impairment or blindness, information from other intact senses can be used as substitutes to retrain (and in extremis replace) visual functions. Abilities including reading, mental representation of objects and spatial navigation can be performed using tactile information. Current technologies can convey a restricted library of stimuli, either because they depend on real objects or renderings with low resolution layouts. Digital haptic technologies can overcome such limitations. The applicability of this technology was previously demonstrated in sighted participants. Here, we reasoned that visually-impaired and blind participants can create mental representations of letters presented haptically in normal and mirror-reversed form without the use of any visual information, and mentally manipulate such representations. Visually-impaired and blind volunteers were blindfolded and trained on the haptic tablet with two letters (either L and P or F and G). During testing, they haptically explored on any trial one of the four letters presented at 0°, 90°, 180°, or 270° rotation from upright and indicated if the letter was either in a normal or mirror-reversed form. Rotation angle impacted performance; greater deviation from 0° resulted in greater impairment for trained and untrained normal letters, consistent with mental rotation of these haptically-rendered objects. Performance was also generally less accurate with mirror-reversed stimuli, which was not affected by rotation angle. Our findings demonstrate, for the first time, the suitability of a digital haptic technology in the blind and visually-impaired. Classic devices remain limited in their accessibility and in the flexibility of their applications. We show that mental representations can be generated and manipulated using digital haptic technology. This technology may thus offer an innovative solution to the mitigation of impairments in the visually-impaired, and to the training of skills dependent on mental representations and their spatial manipulation.

Perception of surface stickiness in different sensory modalities: an functional MRI study

Surface texture can be perceived not only from tactile, but also from auditory and visual sensory cues. In our previous psychophysical study, we demonstrated that humans can recognize surface stickiness using only one kind of sensory modality without any difficulty. However, the brain regions that would be activated by non-corresponding sensory cues, for example, auditory and visual cues, remain unknown. In this human functional MRI study, we explored brain regions associated with surface stickiness perception in each of three different sensory modalities, and sought for common neural activities across modalities. In the tactile condition, participants actually touched a sticky surface with their right index finger. In the auditory and visual conditions, audio and video clips of tactile explorations of a sticky surface were presented and participants were asked to recall the perceived stickiness as vividly as possible. Our results, based on a general linear model analysis, showed that somatosensory cortices including postcentral gyrus, anterior insula, and anterior intraparietal sulcus were significantly activated across all modalities. Moreover, we observed significant activation of primary sensory regions of each modality. A follow-up conjunction analysis identified that postcentral gyrus, anterior intraparietal sulcus, precentral gyrus, and supplementary motor area were activated in common. These findings could deepen our understanding of the surface stickiness perception in the human brain.

Action execution and action observation elicit mirror responses with the same temporal profile in human SII

The properties of the secondary somatosensory area (SII) have been described by many studies in monkeys and humans. Recent studies on monkeys, however, showed that beyond somatosensory stimuli, SII responds to a wider number of stimuli, a finding requiring a revision that human SII is purely sensorimotor. By recording cortical activity with stereotactic electroencephalography (stereo-EEG), we examined the properties of SI and SII in response to a motor task requiring reaching, grasping and manipulation, as well as the observation of the same actions. Furthermore, we functionally characterized this area with a set of clinical tests, including tactile, acoustical, and visual stimuli. The results showed that only SII activates both during execution and observation with a common temporal profile, whereas SI response were limited to execution. Together with their peculiar response to tactile stimuli, we conclude that the role of SII is pivotal also in the observation of actions involving haptic control.

Active touch facilitates object size perception in children but not adults: A multisensory event related potential study

In order to increase perceptual precision the adult brain dynamically combines redundant information from different senses depending on their reliability. During object size estimation, for example, visual, auditory and haptic information can be integrated to increase the precision of the final size estimate. Young children, however, do not integrate sensory information optimally and instead rely on active touch. Whether this early haptic dominance is reflected in age-related differences in neural mechanisms and whether it is driven by changes in bottom-up perceptual or top-down attentional processes has not yet been investigated. Here, we recorded event-related-potentials from a group of adults and children aged 5-7 years during an object size perception task using auditory, visual and haptic information. Multisensory information was presented either congruently (conveying the same information) or incongruently (conflicting information). No behavioral responses were required from participants. When haptic size information was available via actively tapping the objects, response amplitudes in the mid-parietal area were significantly reduced by information congruency in children but not in adults between 190 ms-250 ms and 310 ms-370 ms. These findings indicate that during object size perception only children's brain activity is modulated by active touch supporting a neural maturational shift from sensory dominance in early childhood to optimal multisensory benefit in adulthood.

Cortical Regions Encoding Hardness Perception Modulated by Visual Information Identified by Functional Magnetic Resonance Imaging With Multivoxel Pattern Analysis

Recent studies have revealed that hardness perception is determined by visual information along with the haptic input. This study investigated the cortical regions involved in hardness perception modulated by visual information using functional magnetic resonance imaging (fMRI) and multivoxel pattern analysis (MVPA). Twenty-two healthy participants were enrolled. They were required to place their left and right hands at the front and back, respectively, of a mirror attached to a platform placed above them while lying in a magnetic resonance scanner. In conditions SFT, MED, and HRD, one of three polyurethane foam pads of varying hardness (soft, medium, and hard, respectively) was presented to the left hand in a given trial, while only the medium pad was presented to the right hand in all trials. MED was defined as the control condition, because the visual and haptic information was congruent. During the scan, the participants were required to push the pad with the both hands while observing the reflection of the left hand and estimate the hardness of the pad perceived by the right (hidden) hand based on magnitude estimation. Behavioral results showed that the perceived hardness was significantly biased toward softer or harder in >73% of the trials in conditions SFT and HRD; we designated these trials as visually modulated (SFTvm and HRDvm, respectively). The accuracy map was calculated individually for each of the pair-wise comparisons of (SFTvm vs. MED), (HRDvm vs. MED), and (SFTvm vs. HRDvm) by a searchlight MVPA, and the cortical regions encoding the perceived hardness with visual modulation were identified by conjunction of the three accuracy maps in group analysis. The cluster was observed in the right sensory motor cortex, left anterior intraparietal sulcus (aIPS), bilateral parietal operculum (PO), and occipito-temporal cortex (OTC). Together with previous findings on such cortical regions, we conclude that the visual information of finger movements processed in the OTC may be integrated with haptic input in the left aIPS, and the subjective hardness perceived by the right hand with visual modulation may be processed in the cortical network between the left PO and aIPS.

Discrimination Thresholds for Passive Tactile Volume Perception by Fingertips

Haptic object perception is still poorly understood up to now. This study investigated the ability of human fingers to discriminate the volume of objects by passive touch. Experiments measured the discrimination threshold of volume using three tasks: passive tactile volume perception, passive tactile area perception, and active tactile volume perception. In each trial, we utilized two plastic cubes to successively stimulate the fingers, and participants were instructed to make comparisons between the stimulus objects’ volume and area. Results showed that there was no significant difference in the discrimination thresholds of tactile volume perception between passive touch and active touch, whereas significant differences in the discrimination thresholds between fingertips, such as the thumb versus the pinky finger. In passive touch, the discrimination thresholds of volume perception were larger than that with surface area perception. We found that the discrimination of the volume of objects is more difficult than the discrimination of the area of the objects.

Neural correlates of top-down modulation of haptic shape versus roughness perception

Exploring an object's shape by touch also renders information about its surface roughness. It has been suggested that shape and roughness are processed distinctly in the brain, a result based on comparing brain activation when exploring objects that differed in one of these features. To investigate the neural mechanisms of top‐down control on haptic perception of shape and roughness, we presented the same multidimensional objects but varied the relevance of each feature. Specifically, participants explored two objects that varied in shape (oblongness of cuboids) and surface roughness. They either had to compare the shape or the roughness in an alternative‐forced‐choice‐task. Moreover, we examined whether the activation strength of the identified brain regions as measured by functional magnetic resonance imaging (fMRI) can predict the behavioral performance in the haptic discrimination task. We observed a widespread network of activation for shape and roughness perception comprising bilateral precentral and postcentral gyrus, cerebellum, and insula. Task‐relevance of the object's shape increased activation in the right supramarginal gyrus (SMG/BA 40) and the right precentral gyrus (PreCG/BA 44) suggesting that activation in these areas does not merely reflect stimulus‐driven processes, such as exploring shape, but also entails top‐down controlled processes driven by task‐relevance. Moreover, the strength of the SMG/PreCG activation predicted individual performance in the shape but not in the roughness discrimination task. No activation was found for the reversed contrast (roughness > shape). We conclude that macrogeometric properties, such as shape, can be modulated by top‐down mechanisms whereas roughness, a microgeometric feature, seems to be processed automatically.

Functional hierarchy for tactile processing in the visual cortex of sighted adults

Perception via different sensory modalities was traditionally believed to be supported by largely separate brain systems. However, a growing number of studies demonstrate that the visual cortices of typical, sighted adults are involved in tactile and auditory perceptual processing. Here, we investigated the spatiotemporal dynamics of the visual cortex's involvement in a complex tactile task: Braille letter recognition. Sighted subjects underwent Braille training and then participated in a transcranial magnetic stimulation (TMS) study in which they tactually identified single Braille letters. During this task, TMS was applied to their left early visual cortex, visual word form area (VWFA), and left early somatosensory cortex at five time windows from 20 to 520 ms following the Braille letter presentation's onset. The subjects' response accuracy decreased when TMS was applied to the early visual cortex at the 120-220 ms time window and when TMS was applied to the VWFA at the 320-420 ms time window. Stimulation of the early somatosensory cortex did not have a time-specific effect on the accuracy of the subjects' Braille letter recognition, but rather caused a general slowdown during this task. Our results indicate that the involvement of sighted people's visual cortices in tactile perception respects the canonical visual hierarchy-the early tactile processing stages involve the early visual cortex, whereas more advanced tactile computations involve high-level visual areas. Our findings are compatible with the metamodal account of brain organization and suggest that the whole visual cortex may potentially support spatial perception in a task-specific, sensory-independent manner.

Hand-Feel Touch Cues and Their Influences on Consumer Perception and Behavior with Respect to Food Products: A Review

There has been a great deal of research investigating intrinsic/extrinsic cues and their influences on consumer perception and purchasing decisions at points of sale, product usage, and consumption. Consumers create expectations toward a food product through sensory information extracted from its surface (intrinsic cues) or packaging (extrinsic cues) at retail stores. Packaging is one of the important extrinsic cues that can modulate consumer perception, liking, and decision making of a product. For example, handling a product packaging during consumption, even just touching the packaging while opening or holding it during consumption, may result in a consumer expectation of the package content. Although hand-feel touch cues are an integral part of the food consumption experience, as can be observed in such an instance, little has been known about their influences on consumer perception, acceptability, and purchase behavior of food products. This review therefore provided a better understanding about hand-feel touch cues and their influences in the context of food and beverage experience with a focus on (1) an overview of touch as a sensory modality, (2) factors influencing hand-feel perception, (3) influences of hand-feel touch cues on the perception of other sensory modalities, and (4) the effects of hand-feel touch cues on emotional responses and purchase behavior.

Visuo-Haptic Exploration for Multimodal Memory

When faced with a novel object, we explore it to understand its shape. This way we combine information coming from different senses, as touch, proprioception and vision, together with the motor information embedded in our motor execution plan. The exploration process provides a structure and constrains this rich flow of inputs, supporting the formation of a unified percept and the memorization of the object features. However, how the exploration strategies are planned is still an open question. In particular, is the exploration strategy used to memorize an object different from the exploration strategy adopted in a recall task? To address this question we used iCube, a sensorized cube which measures its orientation in space and the location of the contacts on its faces. Participants were required to explore the cube faces where little pins were positioned in varying number. Participants had to explore the cube twice and individuate potential differences between the two presentations, which could be performed either haptically alone, or with also vision available. The haptic and visuo-haptic (VH) exploratory strategies changed significantly when finalized to memorize the structure of the object with respect to when the same object was explored to recall and compare it with its memorized instance. These findings indicate that exploratory strategies are adapted not only to the property of the object to be analyzed but also to the prospective use of the resulting representation, be it memorization or recall. The results are discussed in light of the possibility of a systematic modeling of natural VH exploration strategies.

Brain networks underlying tactile softness perception: A functional magnetic resonance imaging study

Humans are adept at perceiving physical properties of an object through touch. Tangible object properties can be categorized into two types: macro-spatial properties, including shape and orientation; and material properties, such as roughness, softness, and temperature. Previous neuroimaging studies have shown that roughness and temperature are extracted at nodes of a network, such as that involving the parietal operculum and insula, which is different from the network engaged in processing macro-spatial properties. However, it is unclear whether other perceptual dimensions pertaining to material properties engage the same regions. Here, we conducted a functional magnetic resonance imaging study to test whether the parietal operculum and insula were involved in extracting tactually-perceived softness magnitude. Fifty-six healthy right-handed participants estimated perceived softness magnitude using their right middle finger. We presented three stimuli that had the same shape but different compliances. The force applied to the finger was manipulated at two levels. Classical mass-univariate analysis showed that activity in the parietal operculum, insula, and medial prefrontal cortex was positively associated with perceived softness magnitude, regardless of the applied force. Softness-related activity was stronger in the ventral striatum in the high-force condition than in the low-force condition. The multivariate voxel pattern analysis showed higher accuracy than chance levels and control regions in the parietal operculum/insula, postcentral gyrus, posterior parietal lobule, and middle occipital gyrus. These results indicate that a distributed set of the brain regions, including the parietal operculum and insula, is involved in representing perceived softness.

Mental Rotation of Digitally-Rendered Haptic Objects

Sensory substitution is an effective means to rehabilitate many visual functions after visual impairment or blindness. Tactile information, for example, is particularly useful for functions such as reading, mental rotation, shape recognition, or exploration of space. Extant haptic technologies typically rely on real physical objects or pneumatically driven renderings and thus provide a limited library of stimuli to users. New developments in digital haptic technologies now make it possible to actively simulate an unprecedented range of tactile sensations. We provide a proof-of-concept for a new type of technology (hereafter haptic tablet) that renders haptic feedback by modulating the friction of a flat screen through ultrasonic vibrations of varying shapes to create the sensation of texture when the screen is actively explored. We reasoned that participants should be able to create mental representations of letters presented in normal and mirror-reversed haptic form without the use of any visual information and to manipulate such representations in a mental rotation task. Healthy sighted, blindfolded volunteers were trained to discriminate between two letters (either L and P, or F and G; counterbalanced across participants) on a haptic tablet. They then tactually explored all four letters in normal or mirror-reversed form at different rotations (0°, 90°, 180°, and 270°) and indicated letter form (i.e., normal or mirror-reversed) by pressing one of two mouse buttons. We observed the typical effect of rotation angle on object discrimination performance (i.e., greater deviation from 0° resulted in worse performance) for trained letters, consistent with mental rotation of these haptically-rendered objects. We likewise observed generally slower and less accurate performance with mirror-reversed compared to prototypically oriented stimuli. Our findings extend existing research in multisensory object recognition by indicating that a new technology simulating active haptic feedback can support the generation and spatial manipulation of mental representations of objects. Thus, such haptic tablets can offer a new avenue to mitigate visual impairments and train skills dependent on mental object-based representations and their spatial manipulation.