Texture recognition based on multi-sensory integration of proprioceptive and tactile signals

Porous nanocomposites with enhanced intrinsic piezoresistive sensitivity for bioinspired multimodal tactile sensors

In this work, we propose porous fluororubber/thermoplastic urethane nanocomposites (PFTNs) and explore their intrinsic piezoresistive sensitivity to pressure. Our experiments reveal that the intrinsic sensitivity of the PFTN-based sensor to pressure up to 10 kPa increases up to 900% compared to the porous thermoplastic urethane nanocomposite (PTN) counterpart and up to 275% compared to the porous fluororubber nanocomposite (PFN) counterpart. For pressures exceeding 10 kPa, the resistance-pressure relationship of PFTN follows a logarithmic function, and the sensitivity is 221% and 125% higher than that of PTN and PFN, respectively. With the excellent intrinsic sensitivity of the thick PFTN film, a single sensing unit with integrated electrode design can imitate human skin for touch detection, pressure perception and traction sensation. The sensing range of our multimodal tactile sensor reaches ~150 Pa, and it exhibits a linear fit over 97% for both normal pressure and shear force. We also demonstrate that an electronic skin, made of an array of sensing units, is capable of accurately recognizing complex tactile interactions including pinch, spread, and tweak motions.

Fusion of dual modalities of non-invasive sensory feedback for object profiling with prosthetic hands

Introduction

Either non-invasive somatotopic or substitute sensory feedback is capable of conveying a single modality of sensory information from prosthetic hands to amputees. However, the neurocognitive ability of amputees to integrate multi-modality sensory information for functional discrimination is unclear. The purpose of this study was to assess the fusion of non-invasive somatotopic tactile and substitute aperture feedbacks for profile perception of multiple physical features during grasping objects.

Methods

Two left transradial amputees with somatotopic evoked tactile sensation (ETS) of five fingers participated in the study. The tactile information of prosthetic hand was provided to amputees by the ETS feedback elicited on the stump projected finger map. Hand aperture information was conveyed to amputees with substitute electrotactile stimulation on the forearm or upper arm. Two types of sensory feedback were integrated to a commercial prosthetic hand. The efficacy of somatotopic ETS feedback on object length identification task was assessed with or without substitute aperture stimulation. The object size identification task was utilized to assess how ETS stimulation at the stump may affect aperture perception with stimulation on the ipsilateral upper arm or forearm. Finally, the task of identifying combined length and size was conducted to evaluate the ability of amputees to integrate the dual modalities of sensory feedback for perceiving profile features.

Results

The study revealed that amputee subjects can effectively integrate the ETS feedback with electrotactile substitutive feedback for object profile discrimination. Specifically, ETS was robust to provide object length information with electrotactile stimulation at either the forearm or upper arm. However, electrotactile stimulation at the upper arm for aperture perception was less susceptible to the interference of ETS stimulation than at the forearm.

Discussion

Amputee subjects are able to combine somatotopic ETS and aperture feedbacks for identifying multi-dimensional features in object profiling. The two sensory streams of information can be fused effectively without mutual interference for functional discrimination.