Neural mechanisms of tactile motion integration in somatosensory cortex

Motion perception in touch: resolving contradictory findings by varying probabilities of different trial types

Representational momentum describes the typical overestimation of the final location of a moving stimulus in the direction of stimulus motion. While systematically observed in different sensory modalities, especially vision and audition, in touch, empirical findings indicate a mixed pattern of results, with some published studies suggesting the existence of the phenomenon, while others do not. In the present study, one possible moderating variable, the relative probabilities of different trial types, was explored in an attempt to resolve the seemingly contradictory findings in the literature. In some studies, only consistently moving target stimuli were presented and no representational momentum was observed, while other studies have included inconsistently moving target stimuli in the same experimental block, and observed representational momentum. Therefore, the present study was designed to systematically compare the localization of consistent target motion stimuli across two experimental blocks, for which either only consistent motion trials were presented, or else mixed with inconsistent target motion trials. The results indicate a strong influence of variations in the probability of different trial types on the occurrence of representational momentum. That is, representational momentum only occurred when both trial types (inconsistent and consistent target motion) were presented within one experimental block. The results are discussed in light of recent theoretical advancements in the literature, namely the speed prior account of motion perception.

Multi-finger receptive field properties in primary somatosensory cortex: A revised account of the spatiotemporal integration functions of area 3b

The leading view in the somatosensory system indicates that area 3b serves as a cortical relay site that primarily encodes (cutaneous) tactile features limited to individual digits. Our recent work argues against this model by showing that area 3b cells can integrate both cutaneous and proprioceptive information from the hand. Here, we further test the validity of this model by studying multi-digit (MD) integration properties in area 3b. In contrast to the prevailing view, we show that most cells in area 3b have a receptive field (RF) that extends to multiple digits, with the size of the RF (i.e., the number of responsive digits) increasing across time. Further, we show that MD cells' orientation angle preference is highly correlated across digits. Taken together, these data show that area 3b plays a larger role in generating neural representations of tactile objects, as opposed to just being a "feature detector" relay site.

A Novel Tactile Function Assessment Using a Miniature Tactile Stimulator

Several methods for the measurement of tactile acuity have been devised previously, but unexpected nonspatial cues and intensive manual skill requirements compromise measurement accuracy. Therefore, we must urgently develop an automated, accurate, and noninvasive method for assessing tactile acuity. The present study develops a novel method applying a robotic tactile stimulator to automatically measure tactile acuity that comprises eye-opened, eye-closed training, and testing sessions. Healthy participants judge the orientation of a rotating grating ball presented on their index fingerpads in a two-alternative forced-choice task. A variable rotation speed of 5, 10, 40, or 160 mm/s was used for the tactile measurement at a variety of difficulties. All participants met the passing criteria for the training experiment. Performance in orientation identification, quantified by the proportion of trials with correct answers, differed across scanning directions, with the highest rotation speed (160 mm/s) having the worst performance. Accuracy did not differ between vertical and horizontal orientations. Our results demonstrated the utility of the pre-test training protocol and the functionality of the developed procedure for tactile acuity assessment. The novel protocol performed well when applied to the participants. Future studies will be conducted to apply this method to patients with impairment of light touch.

Neurosensory development of the four brainstem-projecting sensory systems and their integration in the telencephalon

Somatosensory, taste, vestibular, and auditory information is first processed in the brainstem. From the brainstem, the respective information is relayed to specific regions within the cortex, where these inputs are further processed and integrated with other sensory systems to provide a comprehensive sensory experience. We provide the organization, genetics, and various neuronal connections of four sensory systems: trigeminal, taste, vestibular, and auditory systems. The development of trigeminal fibers is comparable to many sensory systems, for they project mostly contralaterally from the brainstem or spinal cord to the telencephalon. Taste bud information is primarily projected ipsilaterally through the thalamus to reach the insula. The vestibular fibers develop bilateral connections that eventually reach multiple areas of the cortex to provide a complex map. The auditory fibers project in a tonotopic contour to the auditory cortex. The spatial and tonotopic organization of trigeminal and auditory neuron projections are distinct from the taste and vestibular systems. The individual sensory projections within the cortex provide multi-sensory integration in the telencephalon that depends on context-dependent tertiary connections to integrate other cortical sensory systems across the four modalities.

Multi-digit tactile perception I: motion integration benefits for tactile trajectories presented bimanually

Interactions with objects involve simultaneous contact with multiple, not necessarily adjacent, skin regions. While advances have been made in understanding the capacity to selectively attend to a single tactile element among distracting stimulations, here, we examine how multiple stimulus elements are explicitly integrated into an overall tactile percept. Across four experiments, participants averaged the direction of two simultaneous tactile motion trajectories of varying discrepancy delivered to different fingerpads. Averaging performance differed between within- and between-hands conditions in terms of sensitivity and precision but was unaffected by somatotopic proximity between stimulated fingers. First, precision was greater in between-hand compared to within-hand conditions, demonstrating a bimanual perceptual advantage in multi-touch integration. Second, sensitivity to the average direction was influenced by the discrepancy between individual motion signals, but only for within-hand conditions. Overall, our experiments identify key factors that influence perception of simultaneous tactile events. In particular, we show that multi-touch integration is constrained by hand-specific rather than digit-specific mechanisms.

The science and engineering behind sensitized brain-controlled bionic hands

Advances in our understanding of brain function, along with the development of neural interfaces that allow for the monitoring and activation of neurons, have paved the way for brain-machine interfaces (BMIs), which harness neural signals to reanimate the limbs via electrical activation of the muscles or to control extracorporeal devices, thereby bypassing the muscles and senses altogether. BMIs consist of reading out motor intent from the neuronal responses monitored in motor regions of the brain and executing intended movements with bionic limbs, reanimated limbs, or exoskeletons. BMIs also allow for the restoration of the sense of touch by electrically activating neurons in somatosensory regions of the brain, thereby evoking vivid tactile sensations and conveying feedback about object interactions. In this review, we discuss the neural mechanisms of motor control and somatosensation in able-bodied individuals and describe approaches to use neuronal responses as control signals for movement restoration and to activate residual sensory pathways to restore touch. Although the focus of the review is on intracortical approaches, we also describe alternative signal sources for control and noninvasive strategies for sensory restoration.

The neural mechanisms of manual dexterity

The hand endows us with unparalleled precision and versatility in our interactions with objects, from mundane activities such as grasping to extraordinary ones such as virtuoso pianism. The complex anatomy of the human hand combined with expansive and specialized neuronal control circuits allows a wide range of precise manual behaviours. To support these behaviours, an exquisite sensory apparatus, spanning the modalities of touch and proprioception, conveys detailed and timely information about our interactions with objects and about the objects themselves. The study of manual dexterity provides a unique lens into the sensorimotor mechanisms that endow the nervous system with the ability to flexibly generate complex behaviour.

The interaction between motion and texture in the sense of touch

Besides providing information on elementary properties of objects, like texture, roughness, and softness, the sense of touch is also important in building a representation of object movement and the movement of our hands. Neural and behavioral studies shed light on the mechanisms and limits of our sense of touch in the perception of texture and motion, and of its role in the control of movement of our hands. The interplay between the geometrical and mechanical properties of the touched objects, such as shape and texture, the movement of the hand exploring the object, and the motion felt by touch, will be discussed in this article. Interestingly, the interaction between motion and textures can generate perceptual illusions in touch. For example, the orientation and the spacing of the texture elements on a static surface induces the illusion of surface motion when we move our hand on it or can elicit the perception of a curved trajectory during sliding, straight hand movements. In this work we present a multiperspective view that encompasses both the perceptual and the motor aspects, as well as the response of peripheral and central nerve structures, to analyze and better understand the complex mechanisms underpinning the tactile representation of texture and motion. Such a better understanding of the spatiotemporal features of the tactile stimulus can reveal novel transdisciplinary applications in neuroscience and haptics.

Directional biases in whole hand motion perception revealed by mid-air tactile stimulation

Many emerging technologies are attempting to leverage the tactile domain to convey complex spatiotemporal information translated directly from the visual domain, such as shape and motion. Despite the intuitive appeal of touch for communication, we do not know to what extent the hand can substitute for the retina in this way. Here we ask whether the tactile system can be used to perceive complex whole hand motion stimuli, and whether it exhibits the same kind of established perceptual biases as reported in the visual domain. Using ultrasound stimulation, we were able to project complex moving dot percepts onto the palm in mid-air, over 30 cm above an emitter device. We generated dot kinetogram stimuli involving motion in three different directional axes ('Horizontal', 'Vertical', and 'Oblique') on the ventral surface of the hand. Using Bayesian statistics, we found clear evidence that participants were able to discriminate tactile motion direction. Furthermore, there was a marked directional bias in motion perception: participants were both better and more confident at discriminating motion in the vertical and horizontal axes of the hand, compared to those stimuli moving obliquely. This pattern directly mirrors the perceptional biases that have been robustly reported in the visual field, termed the 'Oblique Effect'. These data demonstrate the existence of biases in motion perception that transcend sensory modality. Furthermore, we extend the Oblique Effect to a whole hand scale, using motion stimuli presented on the broad and relatively low acuity surface of the palm, away from the densely innervated and much studied fingertips. These findings highlight targeted ultrasound stimulation as a versatile method to convey potentially complex spatial and temporal information without the need for a user to wear or touch a device.

Of mice and monkeys: Somatosensory processing in two prominent animal models

Our understanding of the neural basis of somatosensation is based largely on studies of the whisker system of mice and rats and the hands of macaque monkeys. Results across these animal models are often interpreted as providing direct insight into human somatosensation. Work on these systems has proceeded in parallel, capitalizing on the strengths of each model, but has rarely been considered as a whole. This lack of integration promotes a piecemeal understanding of somatosensation. Here, we examine the functions and morphologies of whiskers of mice and rats, the hands of macaque monkeys, and the somatosensory neuraxes of these three species. We then discuss how somatosensory information is encoded in their respective nervous systems, highlighting similarities and differences. We reflect on the limitations of these models of human somatosensation and consider key gaps in our understanding of the neural basis of somatosensation.

Tactile interactions in the path of tactile apparent motion

Perceptual completion is a fundamental perceptual function serving to maintain robust perception against noise. For example, we can perceive a vivid experience of motion even for the discrete inputs across time and space (apparent motion: AM). In vision, stimuli irrelevant to AM perception are suppressed to maintain smooth AM perception along the AM trajectory where no physical inputs are applied. We investigated whether such perceptual masking induced by perceptual completion of dynamic inputs is general across sensory modalities by focusing on touch. Participants tried to detect a vibro-tactile target stimulus presented along the trajectory of AM induced by two other tactile stimuli on the forearm. In a control condition, the inducing stimuli were applied simultaneously, resulting in no motion percept. Tactile target detection was impaired with tactile AM. Our findings support the notion that the perceptual masking induced by perceptual completion mechanism of AM is a general function rather than a sensory specific effect.

Scrambling the skin: A psychophysical study of adaptation to scrambled tactile apparent motion

An age-old hypothesis proposes that object motion across the receptor surface organizes sensory maps (Lotze, 19th century). Skin patches learn their relative positions from the order in which they are stimulated during motion events. We propose that reversing the local motion within a global motion sequence ('motion scrambling') provides a good test for this idea, and present results of the first experiment implementing the paradigm. We used 6-point apparent motion along the forearm. In the Scrambled sequence, two middle locations were touched in reversed order (1-2-4-3-5-6, followed by 6-5-3-4-2-1, in a continuous loop). This created a double U-turn within an otherwise constant-velocity motion, as if skin patches 3 and 4 physically swapped locations. The control condition, Orderly, proceeded at constant velocity at inter-stimulus onset interval of 120 ms. The 26.4-minute conditioning (delivered in twenty-four 66-s bouts) was interspersed with testing of perceived motion direction between the two middle tactors presented on their own (sequence 3-4 or 4-3). Our twenty participants reported motion direction. Direction discrimination was degraded following exposure to Scrambled pattern and was 0.31 d' weaker than following Orderly conditioning (p = .007). Consistent with the proposed role of motion, this could be the beginning of re-learning of relative positions. An alternative explanation is that greater speed adaptation occurred in the Scrambled pattern, raising direction threshold. In future studies, longer conditioning should tease apart the two explanations: our re-mapping hypothesis predicts an overall reversal in perceived motion direction between critical locations (for either motion direction), whereas the speed adaptation alternative predicts chance-level performance at worst, without reversing.

Increased Right Posterior STS Recruitment Without Enhanced Directional-Tuning During Tactile Motion Processing in Early Deaf Individuals

Upon early sensory deprivation, the remaining modalities often exhibit cross-modal reorganization, such as primary auditory cortex (PAC) recruitment for visual motion processing in early deafness (ED). Previous studies of compensatory plasticity in ED individuals have given less attention to tactile motion processing. In the current study, we aimed to examine the effects of early auditory deprivation on tactile motion processing. We simulated four directions of tactile motion on each participant's right index finger and characterized their tactile motion responses and directional-tuning profiles using population receptive field analysis. Similar tactile motion responses were found within primary (SI) and secondary (SII) somatosensory cortices between ED and hearing control groups, whereas ED individuals showed a reduced proportion of voxels with directionally tuned responses in SI contralateral to stimulation. There were also significant but minimal responses to tactile motion within PAC for both groups. While early deaf individuals show significantly larger recruitment of right posterior superior temporal sulcus (pSTS) region upon tactile motion stimulation, there was no evidence of enhanced directional tuning. Greater recruitment of right pSTS region is consistent with prior studies reporting reorganization of multimodal areas due to sensory deprivation. The absence of increased directional tuning within the right pSTS region may suggest a more distributed population of neurons dedicated to processing tactile spatial information as a consequence of early auditory deprivation.

Principles of tactile search over the body

Although we routinely experience complex tactile patterns over our entire body, how we selectively experience multisite touch over our bodies remains poorly understood. Here, we characterized tactile search behavior over the full body using a tactile analog of the classic visual search task. On each trial, participants judged whether a target stimulus (e.g., 10-Hz vibration) was present or absent anywhere on the body. When present, the target stimulus could occur alone or simultaneously with distractor stimuli (e.g., 30-Hz vibrations) on other body locations. We systematically varied the number and spatial configurations of the distractors as well as the target and distractor frequencies and measured the impact of these factors on tactile search response times. First, we found that response times were faster on target-present trials compared with target-absent trials. Second, response times increased with the number of stimulated sites, suggesting a serial search process. Third, search performance differed depending on stimulus frequencies. This frequency-dependent behavior may be related to perceptual grouping effects based on timing cues. We constructed linear models to explore how the locations of the target and distractor cues influenced tactile search behavior. Our modeling results reveal that, in isolation, cues on the index fingers make relatively greater contributions to search performance compared with stimulation experienced on other body sites. Additionally, costimulation of sites within the same limb or simply on the same body side preferentially influence search behavior. Our collective findings identify some principles of attentional search that are common to vision and touch, but others that highlight key differences that may be unique to body-based spatial perception.NEW & NOTEWORTHY Little is known about how we selectively experience multisite touch patterns over the body. Using a tactile analog of the classic visual target search paradigm, we show that tactile search behavior for flutter cues is generally consistent with a serial search process. Modeling results reveal the preferential contributions of index finger stimulation and two-site stimulus interactions involving ipsilateral patterns and within-limb patterns. Our results offer initial evidence for spatial and temporal principles underlying tactile search behavior over the body.

Parallel Signal Processing of a Wireless Pressure-Sensing Platform Combined with Machine-Learning-Based Cognition, Inspired by the Human Somatosensory System

Inspired by the human somatosensory system, pressure applied to multiple pressure sensors is received in parallel and combined into a representative signal pattern, which is subsequently processed using machine learning. The pressure signals are combined using a wireless system, where each sensor is assigned a specific resonant frequency on the reflection coefficient (S₁₁ ) spectrum, and the applied pressure changes the magnitude of the S₁₁ pole with minimal frequency shift. This allows the differentiation and identification of the pressure applied to each sensor. The pressure sensor consists of polypyrrole-coated microstructured poly(dimethylsiloxane) placed on top of electrodes, operating as a capacitive sensor. The high dielectric constant of polypyrrole enables relatively high pressure-sensing performance. The coils are vertically stacked to enable the reader to receive the signals from all of the sensors simultaneously at a single location, analogous to the junction between neighboring primary neurons to a secondary neuron. Here, the stacking order is important to minimize the interference between the coils. Furthermore, convolutional neural network (CNN)-based machine learning is utilized to predict the applied pressure of each sensor from unforeseen S₁₁ spectra. With increasing training, the prediction accuracy improves (with mean squared error of 0.12), analogous to humans' cognitive learning ability.

Feeling fooled: Texture contaminates the neural code for tactile speed

Motion is an essential component of everyday tactile experience: most manual interactions involve relative movement between the skin and objects. Much of the research on the neural basis of tactile motion perception has focused on how direction is encoded, but less is known about how speed is. Perceived speed has been shown to be dependent on surface texture, but previous studies used only coarse textures, which span a restricted range of tangible spatial scales and provide a limited window into tactile coding. To fill this gap, we measured the ability of human observers to report the speed of natural textures—which span the range of tactile experience and engage all the known mechanisms of texture coding—scanned across the skin. In parallel experiments, we recorded the responses of single units in the nerve and in the somatosensory cortex of primates to the same textures scanned at different speeds. We found that the perception of speed is heavily influenced by texture: some textures are systematically perceived as moving faster than are others, and some textures provide a more informative signal about speed than do others. Similarly, the responses of neurons in the nerve and in cortex are strongly dependent on texture. In the nerve, although all fibers exhibit speed-dependent responses, the responses of Pacinian corpuscle–associated (PC) fibers are most strongly modulated by speed and can best account for human judgments. In cortex, approximately half of the neurons exhibit speed-dependent responses, and this subpopulation receives strong input from PC fibers. However, speed judgments seem to reflect an integration of speed-dependent and speed-independent responses such that the latter help to partially compensate for the strong texture dependence of the former.

Our ability to sense the speed at which a surface moves across our skin is highly unreliable and depends on the texture of the surface. This study shows that speed illusions can be predicted from the responses of a specific population of nerve fibers and of their downstream targets; because the skin is too sparsely innervated to compute tactile speed accurately, the nervous system relies on a heuristic to estimate it.

Focal neocortical lesions impair distant neuronal information processing

KEY POINTS

Parts of the fields of neuroscience and neurology consider the neocortex to be a functionally parcelled structure. Viewed through such a conceptual filter, there are multiple clinical observations after localized stroke lesions that seem paradoxical. We tested the effect that localized stroke-like lesions have on neuronal information processing in a part of the neocortex that is distant to the lesion using animal experiments. We find that the distant lesion degrades the quality of neuronal information processing of tactile input patterns in primary somatosensory cortex. The findings suggest that even the processing of primary sensory information depends on an intact neocortical network, with the implication that all neocortical processing may rely on widespread interactions across large parts of the cortex.

ABSTRACT

Recent clinical studies report a surprisingly weak relationship between the location of cortical brain lesions and the resulting functional deficits. From a neuroscience point of view, such findings raise questions as to what extent functional localization applies in the neocortex and to what extent the functions of different regions depend on the integrity of others. Here we provide an in-depth analysis of the changes in the function of the neocortical neuronal networks after distant focal stroke-like lesions in the anaesthetized rat. Using a recently introduced high resolution analysis of neuronal information processing, consisting of pre-set spatiotemporal patterns of tactile afferent activation against which the neuronal decoding performance can be quantified, we found that stroke-like lesions in distant parts of the cortex significantly degraded the decoding performance of individual neocortical neurons in the primary somatosensory cortex (decoding performance decreased from 30.9% to 24.2% for n = 22 neurons, Wilcoxon signed rank test, P = 0.028). This degrading effect was not due to changes in the firing frequency of the neuron (Wilcoxon signed rank test, P = 0.499) and was stronger the higher the decoding performance of the neuron, indicating a specific impact on the information processing capacity in the cortex. These findings suggest that even primary sensory processing depends on widely distributed cortical networks and could explain observations of focal stroke lesions affecting a large range of functions.

Illusory Motion Reversal in Touch

Psychophysical visual experiments have shown illusory motion reversal (IMR), in which the perceived direction of motion is the opposite of its actual direction. The tactile form of this illusion has also been reported. However, it remains unclear which stimulus characteristics affect the magnitude of IMR. We closely examined the effect of stimulus characteristics on IMR by presenting moving sinusoid gratings and random-dot patterns to 10 participants' fingerpads at different spatial periods, speeds, and indentation depths. All participants perceived a motion direction opposite to the veridical direction some of the time. The illusion was more prevalent at spatial periods of 1 and 2 mm and at extreme speeds of 20 and 320 mm/s. We observed stronger IMR for gratings and much weaker IMR for a random-dot pattern, indicating that edge orientation might be a major contributor to this illusion. These results show that the optimal parameters for IMR are consistent with the characteristics of motion-selective neurons in the somatosensory cortex, as most of these neurons are also orientation-selective. We speculate that these neurons could be the neural substrate that accounts for tactile IMR.

Neural correlates of sparse coding and dimensionality reduction

Supported by recent computational studies, there is increasing evidence that a wide range of neuronal responses can be understood as an emergent property of nonnegative sparse coding (NSC), an efficient population coding scheme based on dimensionality reduction and sparsity constraints. We review evidence that NSC might be employed by sensory areas to efficiently encode external stimulus spaces, by some associative areas to conjunctively represent multiple behaviorally relevant variables, and possibly by the basal ganglia to coordinate movement. In addition, NSC might provide a useful theoretical framework under which to understand the often complex and nonintuitive response properties of neurons in other brain areas. Although NSC might not apply to all brain areas (for example, motor or executive function areas) the success of NSC-based models, especially in sensory areas, warrants further investigation for neural correlates in other regions.

Neural Basis of Touch and Proprioception in Primate Cortex

The sense of proprioception allows us to keep track of our limb posture and movements and the sense of touch provides us with information about objects with which we come into contact. In both senses, mechanoreceptors convert the deformation of tissues-skin, muscles, tendons, ligaments, or joints-into neural signals. Tactile and proprioceptive signals are then relayed by the peripheral nerves to the central nervous system, where they are processed to give rise to percepts of objects and of the state of our body. In this review, we first examine briefly the receptors that mediate touch and proprioception, their associated nerve fibers, and pathways they follow to the cerebral cortex. We then provide an overview of the different cortical areas that process tactile and proprioceptive information. Next, we discuss how various features of objects-their shape, motion, and texture, for example-are encoded in the various cortical fields, and the susceptibility of these neural codes to attention and other forms of higher-order modulation. Finally, we summarize recent efforts to restore the senses of touch and proprioception by electrically stimulating somatosensory cortex. © 2018 American Physiological Society. Compr Physiol 8:1575-1602, 2018.

Intracellular Dynamics in Cuneate Nucleus Neurons Support Self-Stabilizing Learning of Generalizable Tactile Representations

How the brain represents the external world is an unresolved issue for neuroscience, which could provide fundamental insights into brain circuitry operation and solutions for artificial intelligence and robotics. The neurons of the cuneate nucleus form the first interface for the sense of touch in the brain. They were previously shown to have a highly skewed synaptic weight distribution for tactile primary afferent inputs, suggesting that their connectivity is strongly shaped by learning. Here we first characterized the intracellular dynamics and inhibitory synaptic inputs of cuneate neurons in vivo and modeled their integration of tactile sensory inputs. We then replaced the tactile inputs with input from a sensorized bionic fingertip and modeled the learning-induced representations that emerged from varied sensory experiences. The model reproduced both the intrinsic membrane dynamics and the synaptic weight distributions observed in cuneate neurons in vivo. In terms of higher level model properties, individual cuneate neurons learnt to identify specific sets of correlated sensors, which at the population level resulted in a decomposition of the sensor space into its recurring high-dimensional components. Such vector components could be applied to identify both past and novel sensory experiences and likely correspond to the fundamental haptic input features these neurons encode in vivo. In addition, we show that the cuneate learning architecture is robust to a wide range of intrinsic parameter settings due to the neuronal intrinsic dynamics. Therefore, the architecture is a potentially generic solution for forming versatile representations of the external world in different sensor systems.

Brain networks involved in tactile speed classification of moving dot patterns: the effects of speed and dot periodicity

Humans are able to judge the speed of an object’s motion by touch. Research has suggested that tactile judgment of speed is influenced by physical properties of the moving object, though the neural mechanisms underlying this process remain poorly understood. In the present study, functional magnetic resonance imaging was used to investigate brain networks that may be involved in tactile speed classification and how such networks may be affected by an object’s texture. Participants were asked to classify the speed of 2-D raised dot patterns passing under their right middle finger. Activity in the parietal operculum, insula, and inferior and superior frontal gyri was positively related to the motion speed of dot patterns. Activity in the postcentral gyrus and superior parietal lobule was sensitive to dot periodicity. Psycho-physiological interaction (PPI) analysis revealed that dot periodicity modulated functional connectivity between the parietal operculum (related to speed) and postcentral gyrus (related to dot periodicity). These results suggest that texture-sensitive activity in the primary somatosensory cortex and superior parietal lobule influences brain networks associated with tactually-extracted motion speed. Such effects may be related to the influence of surface texture on tactile speed judgment.

Dietary interventions that reduce mTOR activity rescue autistic-like behavioral deficits in mice

Enhanced mammalian target of rapamycin (mTOR) signaling in the brain has been implicated in the pathogenesis of autism spectrum disorder (ASD). Inhibition of the mTOR pathway improves behavior and neuropathology in mouse models of ASD containing mTOR-associated single gene mutations. The current study demonstrated that the amino acids histidine, lysine, threonine inhibited mTOR signaling and IgE-mediated mast cell activation, while the amino acids leucine, isoleucine, valine had no effect on mTOR signaling in BMMCs. Based on these results, we designed an mTOR-targeting amino acid diet (Active 1 diet) and assessed the effects of dietary interventions with the amino acid diet or a multi-nutrient supplementation diet (Active 2 diet) on autistic-like behavior and mTOR signaling in food allergic mice and in inbred BTBR T+Itpr3tf/J mice. Cow's milk allergic (CMA) or BTBR male mice were fed a Control, Active 1, or Active 2 diet for 7 consecutive weeks. CMA mice showed reduced social interaction and increased self-grooming behavior. Both diets reversed behavioral impairments and inhibited the mTOR activity in the prefrontal cortex and amygdala of CMA mice. In BTBR mice, only Active 1 diet reduced repetitive self-grooming behavior and attenuated the mTOR activity in the prefrontal and somatosensory cortices. The current results suggest that activated mTOR signaling pathway in the brain may be a convergent pathway in the pathogenesis of ASD bridging genetic background and environmental triggers (food allergy) and that mTOR over-activation could serve as a potential therapeutic target for the treatment of ASD.

Key considerations in designing a somatosensory neuroprosthesis

In recent years, a consensus has emerged that somatosensory feedback needs to be provided for upper limb neuroprostheses to be useful. An increasingly promising approach to sensory restoration is to electrically stimulate neurons along the somatosensory neuraxis to convey information about the state of the prosthetic limb and about contact with objects. To date, efforts toward artificial sensory feedback have consisted mainly of demonstrating that some sensory information could be conveyed using a small number of stimulation patterns, generally delivered through single electrodes. However impressive these achievements are, results from different studies are hard to compare, as each research team implements different stimulation patterns and tests the elicited sensations differently. A critical question is whether different stimulation strategies will generalize from contrived laboratory settings to activities of daily living. Here, we lay out some key specifications that an artificial somatosensory channel should meet, discuss how different approaches should be evaluated, and caution about looming challenges that the field of sensory restoration will face.

Crossmodal Processing of Haptic Inputs in Sighted and Blind Individuals

In a previous behavioral study, it was shown that early blind individuals were superior to sighted ones in discriminating two-dimensional (2D) tactile angle stimuli. The present study was designed to assess the neural substrate associated with a haptic 2D angle discrimination task in both sighted and blind individuals. Subjects performed tactile angle size discriminations in order to investigate whether the pattern of crossmodal occipital recruitment was lateralized as a function of the stimulated hand. Task-elicited activations were also compared across different difficulty levels to ascertain the potential modulatory role of task difficulty on crossmodal processing within occipital areas. We show that blind subjects had more widespread activation within the right lateral and superior occipital gyri when performing the haptic discrimination task. In contrast, the sighted activated the left cuneus and lingual gyrus more so than the blind when performing the task. Furthermore, activity within visual areas was shown to be predictive of tactile discrimination thresholds in the blind, but not in the sighted. Activity within parietal and occipital areas was modulated by task difficulty, where the easier angle comparison elicited more focal occipital activity along with bilateral posterior parietal activity, whereas the more difficult comparison produced more widespread occipital activity combined with reduced parietal activation. Finally, we show that crossmodal reorganization within the occipital cortex of blind individuals was primarily right lateralized, regardless of the stimulated hand, supporting previous evidence for a right-sided hemispheric specialization of the occipital cortex of blind individuals for the processing of tactile and haptic inputs.

Analysis of haptic information in the cerebral cortex

Haptic sensing of objects acquires information about a number of properties. This review summarizes current understanding about how these properties are processed in the cerebral cortex of macaques and humans. Nonnoxious somatosensory inputs, after initial processing in primary somatosensory cortex, are partially segregated into different pathways. A ventrally directed pathway carries information about surface texture into parietal opercular cortex and thence to medial occipital cortex. A dorsally directed pathway transmits information regarding the location of features on objects to the intraparietal sulcus and frontal eye fields. Shape processing occurs mainly in the intraparietal sulcus and lateral occipital complex, while orientation processing is distributed across primary somatosensory cortex, the parietal operculum, the anterior intraparietal sulcus, and a parieto-occipital region. For each of these properties, the respective areas outside primary somatosensory cortex also process corresponding visual information and are thus multisensory. Consistent with the distributed neural processing of haptic object properties, tactile spatial acuity depends on interaction between bottom-up tactile inputs and top-down attentional signals in a distributed neural network. Future work should clarify the roles of the various brain regions and how they interact at the network level.

Feeling form: the neural basis of haptic shape perception

The tactile perception of the shape of objects critically guides our ability to interact with them. In this review, we describe how shape information is processed as it ascends the somatosensory neuraxis of primates. At the somatosensory periphery, spatial form is represented in the spatial patterns of activation evoked across populations of mechanoreceptive afferents. In the cerebral cortex, neurons respond selectively to particular spatial features, like orientation and curvature. While feature selectivity of neurons in the earlier processing stages can be understood in terms of linear receptive field models, higher order somatosensory neurons exhibit nonlinear response properties that result in tuning for more complex geometrical features. In fact, tactile shape processing bears remarkable analogies to its visual counterpart and the two may rely on shared neural circuitry. Furthermore, one of the unique aspects of primate somatosensation is that it contains a deformable sensory sheet. Because the relative positions of cutaneous mechanoreceptors depend on the conformation of the hand, the haptic perception of three-dimensional objects requires the integration of cutaneous and proprioceptive signals, an integration that is observed throughout somatosensory cortex.

Neuronal activity in somatosensory cortex related to tactile exploration

The very light contact forces (∼0.60 N) applied by the fingertips during tactile exploration reveal a clearly optimized sensorimotor strategy. To investigate the cortical mechanisms involved with this behavior, we recorded 230 neurons in the somatosensory cortex (S1), as two monkeys scanned different surfaces with the fingertips in search of a tactile target without visual feedback. During the exploration, the monkeys, like humans, carefully controlled the finger forces. High-friction surfaces offering greater tangential shear force resistance to the skin were associated with decreased normal contact forces. The activity of one group of neurons was modulated with either the normal or tangential force, with little or no influence from the orthogonal force component. A second group responded to kinetic friction or the ratio of tangential to normal forces rather than responding to a specific parameter, such as force magnitude or direction. A third group of S1 neurons appeared to respond to particular vectors of normal and tangential force on the skin. Although 45 neurons correlated with scanning speed, 32 were also modulated by finger forces, suggesting that forces on the finger should be considered as the primary parameter encoding the skin compliance and that finger speed is a secondary parameter that co-varies with finger forces. Neurons (102) were also tested with different textures, and the activity of 62 of these increased or decreased in relation to the surface friction.

Seeing and Feeling Motion: Canonical Computations in Vision and Touch

While the different sensory modalities are sensitive to different stimulus energies, they are often charged with extracting analogous information about the environment. Neural systems may thus have evolved to implement similar algorithms across modalities to extract behaviorally relevant stimulus information, leading to the notion of a canonical computation. In both vision and touch, information about motion is extracted from a spatiotemporal pattern of activation across a sensory sheet (in the retina and in the skin, respectively), a process that has been extensively studied in both modalities. In this essay, we examine the processing of motion information as it ascends the primate visual and somatosensory neuraxes and conclude that similar computations are implemented in the two sensory systems.

A close look at the cortical areas that support vision and touch suggests that the brain uses similar computational strategies to handle different kinds of sensory inputs.

Effect of mechanical tactile noise on amplitude of visual evoked potentials: multisensory stochastic resonance

The present investigation documents the electrophysiological occurrence of multisensory stochastic resonance in the human visual pathway elicited by tactile noise. We define multisensory stochastic resonance of brain evoked potentials as the phenomenon in which an intermediate level of input noise of one sensory modality enhances the brain evoked response of another sensory modality. Here we examined this phenomenon in visual evoked potentials (VEPs) modulated by the addition of tactile noise. Specifically, we examined whether a particular level of mechanical Gaussian noise applied to the index finger can improve the amplitude of the VEP. We compared the amplitude of the positive P100 VEP component between zero noise (ZN), optimal noise (ON), and high mechanical noise (HN). The data disclosed an inverted U-like graph for all the subjects, thus demonstrating the occurrence of a multisensory stochastic resonance in the P100 VEP.

Multimodal Interactions between Proprioceptive and Cutaneous Signals in Primary Somatosensory Cortex

The classical view of somatosensory processing holds that proprioceptive and cutaneous inputs are conveyed to cortex through segregated channels, initially synapsing in modality-specific areas 3a (proprioception) and 3b (cutaneous) of primary somatosensory cortex (SI). These areas relay their signals to areas 1 and 2 where multimodal convergence first emerges. However, proprioceptive and cutaneous maps have traditionally been characterized using unreliable stimulation tools. Here, we employed a mechanical stimulator that reliably positioned animals' hands in different postures and presented tactile stimuli with superb precision. Single-unit recordings in SI revealed that most neurons responded to cutaneous and proprioceptive stimuli, including cells in areas 3a and 3b. Multimodal responses were characterized by linear and nonlinear effects that emerged during early (∼20 ms) and latter (> 100 ms) stages of stimulus processing, respectively. These data are incompatible with the modality specificity model in SI, and provide evidence for distinct mechanisms of multimodal processing in the somatosensory system.

Connectivity of somatosensory cortical area 1 forms an anatomical substrate for the emergence of multifinger receptive fields and complex feature selectivity in the squirrel monkey (Saimiri sciureus)

Converging evidence shows that interaction of digit-specific input, which is required to form global tactile percepts, begins as early as area 3b in the primary somatosensory cortex with the involvement of intrinsic lateral connections. How tactile processing is further elaborated in area 1, the next stage of the somatosensory cortical hierarchy, is less understood. This question was investigated by studying the tangential distribution of intrinsic and interareal connections of finger representations of area 1. Retrogradely labeled cell densities and anterogradely labeled fibers and terminal patches were plotted and quantified with respect to the hand representation by combining tract tracing with electrophysiological mapping and intrinsic signal optical imaging in somatosensory areas. Intrinsic connections of distal finger pad representations of area 1 spanned the representation of multiple digits indicating strong cross-digit connectivity. Area 1 distal finger pad regions also established high-density connections with homotopic regions of areas 3b and 2. Although similar to area 3b, connections of area 1 distributed more widely and covered a larger somatotopic representation including more proximal parts of the finger representations. The lateral connectivity pattern of area 1 is a suitable anatomical substrate of the emergence of multifinger receptive fields, complex feature selectivity, and invariant stimulus properties of the neurons.

The vision of Hsiao on somatosensation

The goal of this review is to start to consolidate and distill the substantial body of research that comprises the published work of the late Professor Steven S. Hsiao. The studies of Hsiao began by demonstrating the receptive field properties of somatosensory neurons, progressed to describing cortical feature selectivity, and then eventually elevated the field to hopes of tapping into natural neural codes with artificial somatosensory feedback. With ongoing analogies to contemporaneous studies in visual neuroscience, the research results and writings of Hsiao have provided the fields of haptics and somatosensory neurophysiology with the conceptual tools needed to allow profound progress. Specifically, Hsiao suggested that slowly adapting tactile form perception could be restored with cortical microstimulation, rapidly adapting slip reflexes should be relegated to low-level, hard-wired prosthetic components, and Pacinian-corpuscle spatiotemporal population responses could potentially be decoded/encoded to provide information about interactions of hands and hand-held instruments with external objects. Future studies will be guided by these insightful reports from Hsiao.

The neural basis of tactile motion perception

The manipulation of objects commonly involves motion between object and skin. In this review, we discuss the neural basis of tactile motion perception and its similarities with its visual counterpart. First, much like in vision, the perception of tactile motion relies on the processing of spatiotemporal patterns of activation across populations of sensory receptors. Second, many neurons in primary somatosensory cortex are highly sensitive to motion direction, and the response properties of these neurons draw strong analogies to those of direction-selective neurons in visual cortex. Third, tactile speed may be encoded in the strength of the response of cutaneous mechanoreceptive afferents and of a subpopulation of speed-sensitive neurons in cortex. However, both afferent and cortical responses are strongly dependent on texture as well, so it is unclear how texture and speed signals are disambiguated. Fourth, motion signals from multiple fingers must often be integrated during the exploration of objects, but the way these signals are combined is complex and remains to be elucidated. Finally, visual and tactile motion perception interact powerfully, an integration process that is likely mediated by visual association cortex.

Restoring tactile and proprioceptive sensation through a brain interface

Somatosensation plays a critical role in the dexterous manipulation of objects, in emotional communication, and in the embodiment of our limbs. For upper-limb neuroprostheses to be adopted by prospective users, prosthetic limbs will thus need to provide sensory information about the position of the limb in space and about objects grasped in the hand. One approach to restoring touch and proprioception consists of electrically stimulating neurons in somatosensory cortex in the hopes of eliciting meaningful sensations to support the dexterous use of the hands, promote their embodiment, and perhaps even restore the affective dimension of touch. In this review, we discuss the importance of touch and proprioception in everyday life, then describe approaches to providing artificial somatosensory feedback through intracortical microstimulation (ICMS). We explore the importance of biomimicry--the elicitation of naturalistic patterns of neuronal activation--and that of adaptation--the brain's ability to adapt to novel sensory input, and argue that both biomimicry and adaptation will play a critical role in the artificial restoration of somatosensation. We also propose that the documented re-organization that occurs after injury does not pose a significant obstacle to brain interfaces. While still at an early stage of development, sensory restoration is a critical step in transitioning upper-limb neuroprostheses from the laboratory to the clinic.

Path integration in tactile perception of shapes

Whenever we move the hand across a surface, tactile signals provide information about the relative velocity between the skin and the surface. If the system were able to integrate the tactile velocity information over time, cutaneous touch may provide an estimate of the relative displacement between the hand and the surface. Here, we asked whether humans are able to form a reliable representation of the motion path from tactile cues only, integrating motion information over time. In order to address this issue, we conducted three experiments using tactile motion and asked participants (1) to estimate the length of a simulated triangle, (2) to reproduce the shape of a simulated triangular path, and (3) to estimate the angle between two-line segments. Participants were able to accurately indicate the length of the path, whereas the perceived direction was affected by a direction bias (inward bias). The response pattern was thus qualitatively similar to the ones reported in classical path integration studies involving locomotion. However, we explain the directional biases as the result of a tactile motion aftereffect.

Single tactile afferents outperform human subjects in a vibrotactile intensity discrimination task

We simultaneously compared the sensitivity of single primary afferent neurons supplying the glabrous skin of the hand and the psychophysical amplitude discrimination thresholds in human subjects for a set of vibrotactile stimuli delivered to the receptive field. All recorded afferents had a dynamic range narrower than the range of amplitudes across which the subjects could discriminate. However, when the vibration amplitude was chosen to be within the steepest part of the afferent's stimulus-response function the response of single afferents, defined as the spike count over the vibration duration (500 ms), was often more sensitive in discriminating vibration amplitude than the perceptual judgment of the participants. We quantified how the neuronal performance depended on the integration window: for short windows the neuronal performance was inferior to the performance of the subject. The neuronal performance progressively improved with increasing spike count duration and reached a level significantly above that of the subjects when the integration window was 250 ms or longer. The superiority in performance of individual neurons over observers could reflect a nonoptimal integration window or be due to the presence of noise between the sensory periphery and the cortical decision stage. Additionally, it could indicate that the range of perceptual sensitivity comes at the cost of discrimination through pooling across neurons with different response functions.

A multi-digit tactile motion stimulator

BACKGROUND

One of the hallmarks of haptic exploration is that it typically involves movement between skin and object. Explored objects may contact multiple digits simultaneously so information about motion must be integrated across digits, a process about which little is known.

NEW METHOD

To fill this gap, we have developed a stimulator that allows for the simultaneous and independent delivery of motion stimuli to multiple digits. The stimulator consists of individual units that deliver motion with three degrees of freedom: rotation (to produce motion), vertical excursion (to control depth of indentation into the skin) and arm orientation (to control the direction of motion). Each degree of freedom is controlled by a single motor. The compact design of the simulator allows for the side-by-side arrangement of the stimulator units such that they impinge upon adjacent fingers.

RESULTS

To demonstrate the functionality of the stimulator, we performed a series of psychophysical experiments that investigate the perception of motion on multiple fingers. We find that, while the sensitivity to changes in motion direction is equivalent whether stimuli are presented to the same or to different fingers, the perceived direction of motion depends on the relative configuration of the digits.

COMPARISON WITH EXISTING METHODS

We replicated the results of previous experiments investigating motion discrimination with a single digit and were able to extend these findings by investigating motion perception across multiple digits.

CONCLUSION

The novel motion stimulator will be an invaluable tool to investigate how motion information is integrated across multiple digits.

Spatial and temporal codes mediate the tactile perception of natural textures

When we run our fingers over the surface of an object, we acquire information about its microgeometry and material properties. Texture information is widely believed to be conveyed in spatial patterns of activation evoked across one of three populations of cutaneous mechanoreceptive afferents that innervate the fingertips. Here, we record the responses evoked in individual cutaneous afferents in Rhesus macaques as we scan a diverse set of natural textures across their fingertips using a custom-made rotating drum stimulator. We show that a spatial mechanism can only account for the processing of coarse textures. Information about most natural textures, however, is conveyed through precise temporal spiking patterns in afferent responses, driven by high-frequency skin vibrations elicited during scanning. Furthermore, these texture-specific spiking patterns predictably dilate or contract in time with changes in scanning speed; the systematic effect of speed on neuronal activity suggests that it can be reversed to achieve perceptual constancy across speeds. The proposed temporal coding mechanism involves converting the fine spatial structure of the surface into a temporal spiking pattern, shaped in part by the mechanical properties of the skin, and ascribes an additional function to vibration-sensitive mechanoreceptive afferents. This temporal mechanism complements the spatial one and greatly extends the range of tangible textures. We show that a combination of spatial and temporal mechanisms, mediated by all three populations of afferents, accounts for perceptual judgments of texture.

Cross-modal sensory integration of visual-tactile motion information: instrument design and human psychophysics

Information obtained from multiple sensory modalities, such as vision and touch, is integrated to yield a holistic percept. As a haptic approach usually involves cross-modal sensory experiences, it is necessary to develop an apparatus that can characterize how a biological system integrates visual-tactile sensory information as well as how a robotic device infers object information emanating from both vision and touch. In the present study, we develop a novel visual-tactile cross-modal integration stimulator that consists of an LED panel to present visual stimuli and a tactile stimulator with three degrees of freedom that can present tactile motion stimuli with arbitrary motion direction, speed, and indentation depth in the skin. The apparatus can present cross-modal stimuli in which the spatial locations of visual and tactile stimulations are perfectly aligned. We presented visual-tactile stimuli in which the visual and tactile directions were either congruent or incongruent, and human observers reported the perceived visual direction of motion. Results showed that perceived direction of visual motion can be biased by the direction of tactile motion when visual signals are weakened. The results also showed that the visual-tactile motion integration follows the rule of temporal congruency of multi-modal inputs, a fundamental property known for cross-modal integration.

Multiplexing stimulus information through rate and temporal codes in primate somatosensory cortex

In somatosensory cortex, stimulus amplitude is represented at a relatively coarse temporal resolution, while stimulus frequency is represented by precisely timed action potentials.

Our ability to perceive and discriminate textures relies on the transduction and processing of complex, high-frequency vibrations elicited in the fingertip as it is scanned across a surface. How naturalistic vibrations, and by extension texture, are encoded in the responses of neurons in primary somatosensory cortex (S1) is unknown. Combining single unit recordings in awake macaques and perceptual judgments obtained from human subjects, we show that vibratory amplitude is encoded in the strength of the response evoked in S1 neurons. In contrast, the frequency composition of the vibrations, up to 800 Hz, is not encoded in neuronal firing rates, but rather in the phase-locked responses of a subpopulation of neurons. Moreover, analysis of perceptual judgments suggests that spike timing not only conveys stimulus information but also shapes tactile perception. We conclude that information about the amplitude and frequency of natural vibrations is multiplexed at different time scales in S1, and encoded in the rate and temporal patterning of the response, respectively.

When we slide our fingertip across a textured surface, small, complex, and high-frequency vibrations are elicited in the skin and our nervous system extracts information about texture from these vibrations. In this study, we investigate how texture-like vibrations are processed in primary somatosensory cortex (S1). First, we show that the time-varying amplitude of skin vibrations is encoded in the time-varying response rates of a subpopulation of S1 neurons. Second, we show that this same subpopulation of S1 neurons produces responses whose timing closely matches that of the vibrations: The frequency composition of the spiking patterns matches that of the stimulus, even for complex vibrations. We demonstrate that this temporal precision is behaviorally relevant by showing that the tactile perception of vibration is better predicted from neuronal responses when spike timing is taken into consideration than when it is not. The activity of S1 neurons is thus multiplexed at different time scales: Stimulus amplitude, which changes relatively slowly, is represented at a relatively coarse temporal resolution, while stimulus frequency is represented by precisely timed action potentials.

Representation of tactile curvature in macaque somatosensory area 2

Tactile shape information is elaborated in a cortical hierarchy spanning primary (SI) and secondary somatosensory cortex (SII). Indeed, SI neurons in areas 3b and 1 encode simple contour features such as small oriented bars and edges, whereas higher order SII neurons represent large curved contour features such as angles and arcs. However, neural coding of these contour features has not been systematically characterized in area 2, the most caudal SI subdivision in the postcentral gyrus. In the present study, we analyzed area 2 neural responses to embossed oriented bars and curved contour fragments to establish whether curvature representations are generated in the postcentral gyrus. We found that many area 2 neurons (26 of 112) exhibit clear curvature tuning, preferring contours pointing in a particular direction. Fewer area 2 neurons (15 of 112) show preferences for oriented bars. Because area 2 response patterns closely resembled SII patterns, we also compared area 2 and SII response time courses to characterize the temporal dynamics of curvature synthesis in the somatosensory system. We found that curvature representations develop and peak concurrently in area 2 and SII. These results reveal that transitions from orientation tuning to curvature selectivity in the somatosensory cortical hierarchy occur within SI rather than between SI and SII.

Task-dependent modulation of SI physiological responses to targets and distractors

Selective attention experimental designs have shown that neural responses to stimuli in primary somatosensory cortex are stronger when the sensory stimuli are task relevant. Other studies have used animals under no task demands for data collection. The relationship between neural responses in the brain during behavior, and while an animal has no task demands, remains underexplored. We trained two animals to perform somatosensory detection for several weeks, followed by somatosensory discrimination for several weeks. Data in response to physically identical stimuli were collected from cortical implants while the animal was under no task demands before each behavioral session and also during that behavioral session. The Fourier spectra of the field potentials during detection or discrimination compared with the no task condition demonstrated suppression of the somatosensory μ-rhythm that is associated with readiness and anticipation of cognitive use of somatosensory and motor inputs. Responses to the task target were stronger during detection and discrimination than in the no task condition. The amplitude normalized time course of the target evoked response was similar in both cases. Evoked responses to the task distractor were not significantly stronger during behavior than in recordings under no task demands. The normalized time course of the distractor responses showed a suppression that peaks 30-35 ms after the onset of the response. The selectivity of this within trial suppression is the same as the selectivity of enduring suppression evident in studies of sensory cortical plasticity, which suggests the same neural process may be responsible for both.

Correlated input reveals coexisting coding schemes in a sensory cortex

As in other sensory modalities, one function of the somatosensory system is to detect coherence and contrast in the environment. To investigate the neural bases of these computations, we applied different spatiotemporal patterns of stimuli to rat whiskers while recording multiple neurons in the barrel cortex. Model-based analysis of the responses revealed different coding schemes according to the level of input correlation. With uncorrelated stimuli on 24 whiskers, we identified two distinct functional categories of neurons, analogous in the temporal domain to simple and complex cells of the primary visual cortex. With correlated stimuli, however, a complementary coding scheme emerged: two distinct cell populations, similar to reinforcing and antagonist neurons described in the higher visual area MT, responded specifically to correlations. We suggest that similar context-dependent coexisting coding strategies may be present in other sensory systems to adapt sensory integration to specific stimulus statistics.