Self-motion and the shaping of sensory signals

More Than the Sum of Its Parts: Visual-Tactile Integration in the Behaving Rat

We experience the world by constantly integrating cues from multiple modalities to form unified sensory percepts. Once familiar with multimodal properties of an object, we can recognize it regardless of the modality involved. In this chapter we will examine the case of a visual-tactile orientation categorization experiment in rats. We will explore the involvement of the cerebral cortex in recognizing objects through multiple sensory modalities. In the orientation categorization task, rats learned to examine and judge the orientation of a raised, black and white grating using touch, vision, or both. Their multisensory performance was better than the predictions of linear models for cue combination, indicating synergy between the two sensory channels. Neural recordings made from a candidate associative cortical area, the posterior parietal cortex (PPC), reflected the principal neuronal correlates of the behavioral results: PPC neurons encoded both graded information about the object and categorical information about the animal's decision. Intriguingly single neurons showed identical responses under each of the three modality conditions providing a substrate for a neural circuit in the cortex that is involved in modality-invariant processing of objects.

Organization of sensory feature selectivity in the whisker system

•

Neurons in the whisker system are selective to spatial and dynamical properties – features – of sensory stimuli.

•

At each stage of the pathway, different neurons encode distinct features, generating a rich population representation.

•

Whisker touch is robustly represented; neurons respond to touch-driven fast fluctuations in forces at the whisker base.

•

Cortical neurons have more complex and context-dependent selectivity than subcortical, e.g., to collective whisker motion.

•

Understanding how these signals are integrated to construct whisker-mediated percepts requires further research.

Our sensory receptors are faced with an onslaught of different environmental inputs. Each sensory event or encounter with an object involves a distinct combination of physical energy sources impinging upon receptors. In the rodent whisker system, each primary afferent neuron located in the trigeminal ganglion innervates and responds to a single whisker and encodes a distinct set of physical stimulus properties – features – corresponding to changes in whisker angle and shape and the consequent forces acting on the whisker follicle. Here we review the nature of the features encoded by successive stages of processing along the whisker pathway. At each stage different neurons respond to distinct features, such that the population as a whole represents diverse properties. Different neuronal types also have distinct feature selectivity. Thus, neurons at the same stage of processing and responding to the same whisker nevertheless play different roles in representing objects contacted by the whisker. This diversity, combined with the precise timing and high reliability of responses, enables populations at each stage to represent a wide range of stimuli. Cortical neurons respond to more complex stimulus properties – such as correlated motion across whiskers – than those at early subcortical stages. Temporal integration along the pathway is comparatively weak: neurons up to barrel cortex (BC) are sensitive mainly to fast (tens of milliseconds) fluctuations in whisker motion. The topographic organization of whisker sensitivity is paralleled by systematic organization of neuronal selectivity to certain other physical features, but selectivity to touch and to dynamic stimulus properties is distributed in “salt-and-pepper” fashion.

Learning and recognition of tactile temporal sequences by mice and humans

The world around us is replete with stimuli that unfold over time. When we hear an auditory stream like music or speech or scan a texture with our fingertip, physical features in the stimulus are concatenated in a particular order. This temporal patterning is critical to interpreting the stimulus. To explore the capacity of mice and humans to learn tactile sequences, we developed a task in which subjects had to recognise a continuous modulated noise sequence delivered to whiskers or fingertips, defined by its temporal patterning over hundreds of milliseconds. GO and NO-GO sequences differed only in that the order of their constituent noise modulation segments was temporally scrambled. Both mice and humans efficiently learned tactile sequences. Mouse sequence recognition depended on detecting transitions in noise amplitude; animals could base their decision on the earliest information available. Humans appeared to use additional cues, including the duration of noise modulation segments.

DOI:http://dx.doi.org/10.7554/eLife.27333.001

Bilateral Discrimination of Tactile Patterns without Whisking in Freely Running Rats

A majority of whisker discrimination tasks in rodents are performed on head-fixed animals to facilitate tracking or control of the sensory inputs. However, head fixation critically restrains the behavior and thus the incoming stimuli compared with those occurring in natural conditions. In this study, we investigated whether freely behaving rats can discriminate fine tactile patterns while running, in particular when stimuli are presented simultaneously on both sides of the snout. We developed a two-alternative forced-choice task in an automated modified T-maze. Stimuli were either a surface with no bars (smooth) or with vertical bars spaced irregularly or regularly. While running at full speed, rats encountered simultaneously the two discriminanda placed on the two sides of the central aisle. Rats learned to recognize regular bars versus a smooth surface in 8 weeks. They solved the task while running at an average speed of 1 m/s, so that the contact with the stimulus lasted <1 typical whisking cycle, precluding the use of active whisking. Whisker-tracking analysis revealed an asymmetry in the position of the whiskers: they oriented toward the rewarded stimulus during successful trials as early as 60 ms after the first possible contact. We showed that the whiskers and activity in the primary somatosensory cortex are involved during the discrimination process. Finally, we identified irregular patterns of bars that the rats can discriminate from the regular one. This novel task shows that freely moving rodents can make simultaneous bilateral tactile discrimination without whisking.SIGNIFICANCE STATEMENT The whisker system of rodents is a widely used model to study tactile processing. Rats show remarkable abilities in discriminating surfaces by actively moving their whiskers (whisking) against stimuli, typically sampling them several times. This motor strategy affects considerably the way that tactile information is acquired and thus the way that neuronal networks process the information. However, when rats run at high speed, they protract their whiskers in front of the snout without large movements. Here, we investigated whether rats are able to discriminate regular and irregular patterns of vertical bars while running without whisking. We found that the animals can perform a bilateral simultaneous discrimination without whisking and that this involves both whiskers and barrel cortex activity.

Selection of head and whisker coordination strategies during goal-oriented active touch

In the rodent whisker system, a key model for neural processing and behavioral choices during active sensing, whisker motion is increasingly recognized as only part of a broader motor repertoire employed by rodents during active touch. In particular, recent studies suggest whisker and head motions are tightly coordinated. However, conditions governing the selection and temporal organization of such coordinated sensing strategies remain poorly understood. We videographically reconstructed head and whisker motions of freely moving mice searching for a randomly located rewarded aperture, focusing on trials in which animals appeared to rapidly "correct" their trajectory under tactile guidance. Mice orienting after unilateral contact repositioned their whiskers similarly to previously reported head-turning asymmetry. However, whisker repositioning preceded head turn onsets and was not bilaterally symmetric. Moreover, mice selectively employed a strategy we term contact maintenance, with whisking modulated to counteract head motion and facilitate repeated contacts on subsequent whisks. Significantly, contact maintenance was not observed following initial contact with an aperture boundary, when the mouse needed to make a large corrective head motion to the front of the aperture, but only following contact by the same whisker field with the opposite aperture boundary, when the mouse needed to precisely align its head with the reward spout. Together these results suggest that mice can select from a diverse range of sensing strategies incorporating both knowledge of the task and whisk-by-whisk sensory information and, moreover, suggest the existence of high level control (not solely reflexive) of sensing motions coordinated between multiple body parts.

Algorithms of whisker-mediated touch perception

Comparison of the functional organization of sensory modalities can reveal the specialized mechanisms unique to each modality as well as processing algorithms that are common across modalities. Here we examine the rodent whisker system. The whisker's mechanical properties shape the forces transmitted to specialized receptors. The sensory and motor systems are intimately interconnected, giving rise to two forms of sensation: generative and receptive. The sensory pathway is a test bed for fundamental concepts in computation and coding: hierarchical feature detection, sparseness, adaptive representations, and population coding. The central processing of signals can be considered a sequence of filters. At the level of cortex, neurons represent object features by a coordinated population code which encompasses cells with heterogeneous properties.

Whisker encoding of mechanical events during active tactile exploration

Rats use their whiskers to extract a wealth of information about their immediate environment, such as the shape, position or texture of an object. The information is conveyed to mechanoreceptors located within the whisker follicle in the form of a sequence of whisker deflections induced by the whisker/object contact interaction. How the whiskers filter and shape the mechanical information and effectively participate in the coding of tactile features remains an open question to date. In the present article, a biomechanical model was developed that provides predictions of the whisker dynamics during active tactile exploration, amenable to quantitative experimental comparison. This model is based on a decomposition of the whisker profile into a slow, quasi-static sequence and rapid resonant small-scale vibrations. It was applied to the typical situation of a rat actively whisking across a solid object. Having derived the quasi-static sequence of whisker deformation, the resonant properties of the whisker were analyzed, taking into account the boundary conditions imposed by the whisker/surface contact. We then focused on two elementary mechanical events that are expected to trigger significant neural responses, namely (1) the whisker/object first contact and (2) the whisker detachment from the object. Both events were found to trigger a deflection wave propagating upward to the mystacial pad at constant velocity of ≈3–5 m/s. This yielded a characteristic mechanical signature at the whisker base, in the form of a large peak of negative curvature occurring ≈4 ms after the event has been triggered. The dependence in amplitude and lag of this mechanical signal with the main contextual parameters (such as radial or angular distance) was investigated. The model was validated experimentally by comparing its predictions to high-speed video recordings of shock-induced whisker deflections performed on anesthetized rats. The consequences of these results on possible tactile encoding schemes are briefly discussed.

Whisker sensory system - from receptor to decision

One of the great challenges of systems neuroscience is to understand how the neocortex transforms neuronal representations of the physical characteristics of sensory stimuli into the percepts which can guide the animal's decisions. Here we present progress made in understanding behavioral and neurophysiological aspects of a highly efficient sensory apparatus, the rat whisker system. Beginning with the 1970s discovery of "barrels" in the rat and mouse brain, one line of research has focused on unraveling the circuits that transmit information from the whiskers to the sensory cortex, together with the cellular mechanisms that underlie sensory responses. A second, more recent line of research has focused on tactile psychophysics, that is, quantification of the behavioral capacities supported by whisker sensation. The opportunity to join these two lines of investigation makes whisker-mediated sensation an exciting platform for the study of the neuronal bases of perception and decision-making. Even more appealing is the beginning-to-end prospective offered by this system: the inquiry can start at the level of the sensory receptor and conclude with the animal's choice. We argue that rats can switch between two modes of operation of the whisker sensory system: (1) generative mode and (2) receptive mode. In the generative mode, the rat moves its whiskers forward and backward to actively seek contact with objects and to palpate the object after initial contact. In the receptive mode, the rat immobilizes its whiskers to optimize the collection of signals from an object that is moving by its own power. We describe behavioral tasks that rats perform in these different modes. Next, we explore which neuronal codes in sensory cortex account for the rats' discrimination capacities. Finally, we present hypotheses for mechanisms through which "downstream" brain regions may read out the activity of sensory cortex in order to extract the significance of sensory stimuli and, ultimately, to select the appropriate action.

Detection of tactile inputs in the rat vibrissa pathway

The rapid detection of sensory inputs is crucial for survival. Sensory detection explicitly requires the integration of incoming sensory information and the ability to distinguish between relevant information and ongoing neural activity. In this study, head-fixed rats were trained to detect the presence of a brief deflection of their whiskers resulting from a focused puff of air. The animals showed a monotonic increase in response probability and a decrease in reaction time with increased stimulus strength. High-speed video analysis of whisker motion revealed that animals were more likely to detect the stimulus during periods of reduced self-induced motion of the whiskers, thereby allowing the stimulus-induced whisker motion to exceed the ongoing noise. In parallel, we used voltage-sensitive dye (VSD) imaging of barrel cortex in anesthetized rats receiving the same stimulus set as those in the behavioral portion of this study to assess candidate codes that make use of the full spatiotemporal representation and to compare variability in the trial-by-trial nature of the cortical response and the corresponding variability in the behavioral response. By application of an accumulating evidence framework to the population cortical activity measured in separate animals, a strong correspondence was made between the behavioral output and the neural signaling, in terms of both the response probabilities and the reaction times. Taken together, the results here provide evidence for detection performance that is strongly reliant on the relative strength of signal versus noise, with strong correspondence between behavior and parallel electrophysiological findings.

Behavioral study of whisker-mediated vibration sensation in rats

Rats use their vibrissal sensory system to collect information about the nearby environment. They can accurately and rapidly identify object location, shape, and surface texture. Which features of whisker motion does the sensory system extract to construct sensations? We addressed this question by training rats to make discriminations between sinusoidal vibrations simultaneously presented to the left and right whiskers. One set of rats learned to reliably identify which of two vibrations had higher frequency (f(1) vs. f(2)) when amplitudes were equal. Another set of rats learned to reliably identify which of two vibrations had higher amplitude (A(1) vs. A(2)) when frequencies were equal. Although these results indicate that both elemental features contribute to the rats' sensation, a further test found that the capacity to discriminate A and f was reduced to chance when the difference in one feature was counterbalanced by the difference in the other feature: Rats could not discriminate amplitude or frequency whenever A(1)f(1) = A(2)f(2). Thus, vibrations were sensed as the product Af rather than as separable elemental features, A and f. The product Af is proportional to a physical entity, the mean speed. Analysis of performance revealed that rats extracted more information about differences in Af than predicted by the sum of the information in elemental differences. These behavioral experiments support the predictions of earlier physiological studies by demonstrating that rats are "blind" to the elemental features present in a sinusoidal whisker vibration; instead, they perceive a composite feature, the speed of whisker motion.

Thalamic synchrony and the adaptive gating of information flow to cortex

Although it has long been posited that sensory adaptation serves to enhance information flow in sensory pathways, the neural basis remains elusive. Simultaneous single–unit recordings in the thalamus and cortex in anesthetized rats reveal that adaptation differentially influences thalamus and cortex in a manner that fundamentally changes the nature of information conveyed about vibrissae motion. Utilizing an ideal observer of cortical activity, performance in detecting vibrissa deflections degrades with adaptation, while performance in discriminating between vibrissa deflections of different velocities is enhanced, a trend not observed in thalamus. Analysis of simultaneously recorded thalamic neurons does reveal, however, an analogous adaptive change in thalamic synchrony that mirrors the cortical response. An integrate–and–fire model using experimentally measured thalamic input reproduces the observed transformations. The results here suggest a shift in coding strategy with adaptation that directly controls information relayed to cortex, which could have implications for encoding velocity signatures of textures.

Encoding and decoding cortical representations of tactile features in the vibrissa system

During behavior, rats and other rodents use their facial vibrissae to actively explore surfaces through whisking and head/body movement, resulting in complex sensory inputs that vary over a large range of angular velocities and temporal scales. How these complex sensory inputs manifest in the patterns of cortical firing events that ultimately form the perceptual experience is not well understood. Through single-unit cortical recordings of layer 4 neurons in S1 of the anesthetized rat, we systematically quantified the interactions between instantaneous velocity and timing of vibrissa motion, finding a strong interaction between angular velocity and timing of contacts on the tens of milliseconds time scale. From the quantification of these joint tuning properties, a detailed nonlinear encoding model was formulated that was highly predictive of firing probability and timing characteristics of the sparse cortical representation of complex patterned tactile inputs. Within a Bayesian framework, the encoding model was then used to decode tactile patterns under simple transformations of the stimulus along dimensions of velocity and timing, as a demonstration of the lower bound of the idealized perceptual capabilities of the animal.