Perception-to-Cognition Tactile Sensing Based on Artificial-Intelligence-Motivated Human Full-Skin Bionic Electronic Skin

Traditional electronic skin (e-skin), due to the lack of human-brain-like thinking and judging capability, is powerless to accelerate the pace to the intelligent era. Herein, artificial intelligence (AI)-motivated full-skin bionic (FSB) e-skin consisting of the structures of human vellus hair, epidermis-dermis-hypodermis, is proposed. Benefiting from the double interlocked layered microcone structure and supercapacitive iontronic effect, the FSB e-skin exhibits ultrahigh sensitivity of 8053.1 kPa^-1 (<1 kPa), linear sensitivity of 3103.5 kPa^-1 (1-34 kPa), and fast response/recovery time of <5.6 ms. In addition, it can realize the evolution from tactile perception to advanced intelligent tactile cognition after being equipped with a "brain". First, static/dynamic contactless tactile perception is achieved based on the triboelectric effect of the vellus hair bionics. Second, the supercapacitive iontronic effect based structural bionics of the epidermis-dermis-hypodermis and a five-layer multilayer perception (MLP) enable the general intelligent tactile cognition of gesture cognition and robot interaction. Most importantly, by making full use of the FSB e-skin with a six-layer MLP neural network, an advanced intelligent material cognition system is developed for real-time cognition of the object material species and locations via one contact, which surpasses the capability of humans.

Emerging Trends in the Multimodal Nature of Cognition: Touch and Handedness

Advances in tactile cognition and haptics have increased our understanding of the multimodal nature of touch. Haptic data is mostly confined to human performance arising from the flexibility and dexterity of the fingers used to discriminate shapes and objects. Studies with infants indicate that recognition of objects either seen or held in the hand is possible during early periods of infancy. Evidence indicates performance differences between the hands decrease over periods of development, reflecting maturation of the cortical brain system supporting motor skills. Thus ability is not confined to the preferred hand. Tactile process and haptic cognition reflect hand ability. Studies examining manual performance must consider the relevance of haptics in research. Knowing about the evolution of the hands controlled by the cerebral hemispheres is of interest because it is a major contribution to the repertoire of human hand actions. The emergence of RDBM (role differentiated bimanual manipulation) is an important shift in the development of infant manual skills. Between 4 and 7 months of age, infants begin to manipulate objects using RDBM where one hand stabilized an object while the other hand manipulated the object. Understanding the affordance of a tool is an important cognitive milestone in early sensorimotor period that develops during the second year in full-term infants. This ability has also been demonstrated in preterm infants indicating the emergence of handedness during prenatal periods. Thus a multimodal approach that incorporates studies of tactile processes and hand actions may reveal their interactions with task demands and haptic ability.

Humans sense by touch the location of objects that roll in handheld containers

Humans use active touch to gain behaviourally relevant information from their environment, including information about contained objects. Although most common, the perceptual basis of interacting with containers remains largely unexplored. The first aim of this study was to determine how accurately people can sense, by touch only, the location of a contained rolling object. Experiment 1 used tubes containing physical balls and demonstrated a considerable degree of accuracy in estimating the rolled distance. The second aim was to identify the relative effectiveness of the various available physical cues. Experiment 2 employed virtual reality technology to present, in isolation and in various combinations, the constituent haptic cues produced by a rolling ball, which are, the mechanical noise during rolling, the jolts from an impact with an internal wall, and the intensity and timing of the jolts resulting from elastic bounces. The rolling noise was of primary importance to the perceptual estimation task suggesting that the implementation of the laws of motion is based on an analysis of the ball's movement velocity. Although estimates became more accurate when the rolling and impact cues were combined, they were not necessarily more precise. The presence of elastic bounces did not affect performance.

Humans can sense small numbers of objects in a box by touch alone

Everyday experiences suggest that a container, such as a box of chocolate sprinkles, can convey pertinent information about the nature of its content. Despite the familiarity of the experience, we do not know whether people can perceive the number of objects in the container from touch alone and how accurately they can do so. In three experiments, participants handled containers holding between one and five objects and verbally estimated their number. Containers were small cardboard jewelry boxes, and objects were round beads of varying diameter and weight. Any useful visual and auditory cues were precluded. Experiment 1 demonstrated very accurate performance, provided the objects were of sufficient weight. Experiment 2 demonstrated that withholding information about the possible number of objects inside the container does not affect accuracy at a group level but does produce occasional overestimations at an individual level. Experiment 3 demonstrated that removing the weight cue leads to systematic underestimations but does not eliminate people's ability to distinguish between different numbers of objects in the container. This study contributes to a growing picture that container haptics is surprisingly capable.

Humans can sense large numbers of objects in a box by touch alone

Everyday experiences suggest that a container, such as a box of cereal, can convey pertinent information about the nature and quantity of its content. This study investigated how well people can judge large quantities of objects in a container through haptic perception. Stimuli consisted of plastic drinking straws cut to "small" (1.5 cm) or "big" (4.5 cm) pieces contained in plastic food containers. Participants performed both a magnitude estimation of the number of objects and a direct estimation of the proportion of the container perceived to be filled with objects. Overall, participants demonstrated considerable accuracy for both tasks and irrespective of the size of the content. Post-experiment interviews revealed three potential strategies. Participants either focused on the container's contents, the excess space in the container, or the perceived weight of the container (content).