Supralinear and Supramodal Integration of Visual and Tactile Signals in Rats: Psychophysics and Neuronal Mechanisms

Stability of cross-sensory input to primary somatosensory cortex across experience

Merging information from across sensory modalities is key to forming robust, disambiguated percepts of the world, yet how the brain achieves this feat remains unclear. Recent observations of cross-modal influences in primary sensory cortical areas have suggested that multisensory integration may occur in the earliest stages of cortical processing, but the role of these responses is still poorly understood. We address these questions by testing several hypotheses about the possible functions served by auditory influences on the barrel field of mouse primary somatosensory cortex (S1) using in vivo 2-photon calcium imaging. We observed sound-evoked spiking activity in a small fraction of cells overall, and moreover that this sparse activity was insufficient to encode auditory stimulus identity; few cells responded preferentially to one sound or another, and a linear classifier trained to decode auditory stimuli from population activity performed barely above chance. Moreover S1 did not encode information about specific audio-tactile feature conjunctions that we tested. Our ability to decode auditory audio-tactile stimuli from neural activity remained unchanged after both passive experience and reinforcement. Collectively, these results suggest that while a primary sensory cortex is highly plastic with regard to its own modality, the influence of other modalities are remarkably stable and play a largely stimulus-non-specific role.

Sensory choices as logistic classification

Logistic classification is a simple way to make choices based on a set of factors: give each factor a weight, sum the results, and use the sum to set the log odds of a random draw. This operation is known to describe human and animal choices based on value (economic decisions). There is increasing evidence that it also describes choices based on sensory inputs (perceptual decisions), presented across sensory modalities (multisensory integration) and combined with non-sensory factors such as prior probability, expected value, overall motivation, and recent actions. Logistic classification can also capture the effects of brain manipulations such as local inactivations. The brain may implement it by thresholding stochastic inputs (as in signal detection theory) acquired over time (as in the drift diffusion model). It is the optimal strategy under certain conditions, and the brain appears to use it as a heuristic in a wider set of conditions.

Sensory choices as logistic classification

Logistic classification is a simple way to make choices based on a set of factors: give each factor a weight, sum the results, and use the sum to set the log odds of a random draw. This operation is known to describe human and animal choices based on value (economic decisions). There is increasing evidence that it also describes choices based on sensory inputs (perceptual decisions), presented across sensory modalities (multisensory integration) and combined with non-sensory factors such as prior probability, expected value, overall motivation, and recent actions. Logistic classification can also capture the effects of brain manipulations such as local inactivations. The brain may implement by thresholding stochastic inputs (as in signal detection theory) acquired over time (as in the drift diffusion model). It is the optimal strategy under certain conditions, and the brain appears to use it as a heuristic in a wider set of conditions.

Conductance-based dendrites perform Bayes-optimal cue integration

A fundamental function of cortical circuits is the integration of information from different sources to form a reliable basis for behavior. While animals behave as if they optimally integrate information according to Bayesian probability theory, the implementation of the required computations in the biological substrate remains unclear. We propose a novel, Bayesian view on the dynamics of conductance-based neurons and synapses which suggests that they are naturally equipped to optimally perform information integration. In our approach apical dendrites represent prior expectations over somatic potentials, while basal dendrites represent likelihoods of somatic potentials. These are parametrized by local quantities, the effective reversal potentials and membrane conductances. We formally demonstrate that under these assumptions the somatic compartment naturally computes the corresponding posterior. We derive a gradient-based plasticity rule, allowing neurons to learn desired target distributions and weight synaptic inputs by their relative reliabilities. Our theory explains various experimental findings on the system and single-cell level related to multi-sensory integration, which we illustrate with simulations. Furthermore, we make experimentally testable predictions on Bayesian dendritic integration and synaptic plasticity.

Cortical cellular encoding of thermotactile integration

Recent evidence suggests that primary sensory cortical regions play a role in the integration of information from multiple sensory modalities. How primary cortical neurons integrate different sources of sensory information is unclear, partly because non-primary sensory input to a cortical sensory region is often weak or modulatory. To address this question, we take advantage of the robust representation of thermal (cooling) and tactile stimuli in mouse forelimb primary somatosensory cortex (fS1). Using a thermotactile detection task, we show that the perception of threshold-level cool or tactile information is enhanced when they are presented simultaneously, compared with presentation alone. To investigate the cortical cellular correlates of thermotactile integration, we performed in vivo extracellular recordings from fS1 in awake resting and anesthetized mice during unimodal and bimodal stimulation of the forepaw. Unimodal stimulation evoked thermal- or tactile- specific excitatory and inhibitory responses of fS1 neurons. The most prominent features of combined thermotactile stimulation are the recruitment of unimodally silent fS1 neurons, non-linear integration features, and response dynamics that favor longer response durations with additional spikes. Together, we identify quantitative and qualitative changes in cortical encoding that may underlie the improvement in perception of thermotactile surfaces during haptic exploration.

A primary sensory cortical interareal feedforward inhibitory circuit for tacto-visual integration

Tactile sensation and vision are often both utilized for the exploration of objects that are within reach though it is not known whether or how these two distinct sensory systems combine such information. Here in mice, we used a combination of stereo photogrammetry for 3D reconstruction of the whisker array, brain-wide anatomical tracing and functional connectivity analysis to explore the possibility of tacto-visual convergence in sensory space and within the circuitry of the primary visual cortex (VISp). Strikingly, we find that stimulation of the contralateral whisker array suppresses visually evoked activity in a tacto-visual sub-region of VISp whose visual space representation closely overlaps with the whisker search space. This suppression is mediated by local fast-spiking interneurons that receive a direct cortico-cortical input predominantly from layer 6 neurons located in the posterior primary somatosensory barrel cortex (SSp-bfd). These data demonstrate functional convergence within and between two primary sensory cortical areas for multisensory object detection and recognition.

Triple dissociation of visual, auditory and motor processing in mouse primary visual cortex

Primary sensory cortices respond to crossmodal stimuli-for example, auditory responses are found in primary visual cortex (V1). However, it remains unclear whether these responses reflect sensory inputs or behavioral modulation through sound-evoked body movement. We address this controversy by showing that sound-evoked activity in V1 of awake mice can be dissociated into auditory and behavioral components with distinct spatiotemporal profiles. The auditory component began at approximately 27 ms, was found in superficial and deep layers and originated from auditory cortex. Sound-evoked orofacial movements correlated with V1 neural activity starting at approximately 80-100 ms and explained auditory frequency tuning. Visual, auditory and motor activity were expressed by different laminar profiles and largely segregated subsets of neuronal populations. During simultaneous audiovisual stimulation, visual representations remained dissociable from auditory-related and motor-related activity. This three-fold dissociability of auditory, motor and visual processing is central to understanding how distinct inputs to visual cortex interact to support vision.

More Than the Sum of Its Parts: Visual-Tactile Integration in the Behaving Rat

We experience the world by constantly integrating cues from multiple modalities to form unified sensory percepts. Once familiar with multimodal properties of an object, we can recognize it regardless of the modality involved. In this chapter we will examine the case of a visual-tactile orientation categorization experiment in rats. We will explore the involvement of the cerebral cortex in recognizing objects through multiple sensory modalities. In the orientation categorization task, rats learned to examine and judge the orientation of a raised, black and white grating using touch, vision, or both. Their multisensory performance was better than the predictions of linear models for cue combination, indicating synergy between the two sensory channels. Neural recordings made from a candidate associative cortical area, the posterior parietal cortex (PPC), reflected the principal neuronal correlates of the behavioral results: PPC neurons encoded both graded information about the object and categorical information about the animal's decision. Intriguingly single neurons showed identical responses under each of the three modality conditions providing a substrate for a neural circuit in the cortex that is involved in modality-invariant processing of objects.

From Multisensory Integration to Multisensory Decision-Making

Organisms live in a dynamic environment in which sensory information from multiple sources is ever changing. A conceptually complex task for the organisms is to accumulate evidence across sensory modalities and over time, a process known as multisensory decision-making. This is a new concept, in terms of that previous researches have been largely conducted in parallel disciplines. That is, much efforts have been put either in sensory integration across modalities using activity summed over a duration of time, or in decision-making with only one sensory modality that evolves over time. Recently, a few studies with neurophysiological measurements emerge to study how different sensory modality information is processed, accumulated, and integrated over time in decision-related areas such as the parietal or frontal lobes in mammals. In this review, we summarize and comment on these studies that combine the long-existed two parallel fields of multisensory integration and decision-making. We show how the new findings provide insight into our understanding about neural mechanisms mediating multisensory information processing in a more complete way.

Truly pattern: Nonlinear integration of motion signals is required to account for the responses of pattern cells in rat visual cortex

A key feature of advanced motion processing in the primate dorsal stream is the existence of pattern cells-specialized cortical neurons that integrate local motion signals into pattern-invariant representations of global direction. Pattern cells have also been reported in rodent visual cortex, but it is unknown whether the tuning of these neurons results from truly integrative, nonlinear mechanisms or trivially arises from linear receptive fields (RFs) with a peculiar geometry. Here, we show that pattern cells in rat primary (V1) and lateromedial (LM) visual cortex process motion direction in a way that cannot be explained by the linear spatiotemporal structure of their RFs. Instead, their tuning properties are consistent with and well explained by those of units in a state-of-the-art neural network model of the dorsal stream. This suggests that similar cortical processes underlay motion representation in primates and rodents. The latter could thus serve as powerful model systems to unravel the underlying circuit-level mechanisms.

Visuo-vestibular heading perception: a model system to study multi-sensory decision making

Integrating noisy signals across time as well as sensory modalities, a process named multi-sensory decision making (MSDM), is an essential strategy for making more accurate and sensitive decisions in complex environments. Although this field is just emerging, recent extraordinary works from different perspectives, including computational theory, psychophysical behaviour and neurophysiology, begin to shed new light onto MSDM. In the current review, we focus on MSDM by using a model system of visuo-vestibular heading. Combining well-controlled behavioural paradigms on virtual-reality systems, single-unit recordings, causal manipulations and computational theory based on spiking activity, recent progress reveals that vestibular signals contain complex temporal dynamics in many brain regions, including unisensory, multi-sensory and sensory-motor association areas. This challenges the brain for cue integration across time and sensory modality such as optic flow which mainly contains a motion velocity signal. In addition, new evidence from the higher-level decision-related areas, mostly in the posterior and frontal/prefrontal regions, helps revise our conventional thought on how signals from different sensory modalities may be processed, converged, and moment-by-moment accumulated through neural circuits for forming a unified, optimal perceptual decision. This article is part of the theme issue 'Decision and control processes in multisensory perception'.

Mouse frontal cortex mediates additive multisensory decisions

The brain can combine auditory and visual information to localize objects. However, the cortical substrates underlying audiovisual integration remain uncertain. Here, we show that mouse frontal cortex combines auditory and visual evidence; that this combination is additive, mirroring behavior; and that it evolves with learning. We trained mice in an audiovisual localization task. Inactivating frontal cortex impaired responses to either sensory modality, while inactivating visual or parietal cortex affected only visual stimuli. Recordings from >14,000 neurons indicated that after task learning, activity in the anterior part of frontal area MOs (secondary motor cortex) additively encodes visual and auditory signals, consistent with the mice's behavioral strategy. An accumulator model applied to these sensory representations reproduced the observed choices and reaction times. These results suggest that frontal cortex adapts through learning to combine evidence across sensory cortices, providing a signal that is transformed into a binary decision by a downstream accumulator.

Reduced activity of parvalbumin-positive interneurons in the posterior parietal cortex causes visually dominant multisensory decisions in freely navigating mice

Multisensory integration is vital for animals to make optimal decisions in a complicated sensory environment. However, the neural mechanisms for flexible multisensory behaviors are not well understood. Here, we found that mice exhibit auditory-dominant decisions in the head-fixed and stationary state and switch to make visual-dominant decisions in the freely navigating state to resolve audiovisual conflicts. To understand the neural mechanism of the state-dependent switch in multisensory decisions, we performed in vivo calcium imaging of parvalbumin-expressing (PV⁺) inhibitory neurons in the posterior parietal cortex (PPC), which are known to mediate auditory dominance in the resolution of audiovisual conflicts, in mice on the treadmill. In the stationary state, the PPC PV⁺ neurons showed similar amounts of evoked activity in responses to auditory and visual stimuli and enhanced responses to the multisensory audiovisual stimuli. Conversely, when mice were running on a treadmill, the PV⁺ neurons lost auditory responses and did not show any multisensory enhancement in their activity. When we optogenetically activated the PPC PV⁺ neurons in mice freely navigating the T-maze, the mice made more auditory-dominant decisions without changes in unisensory decisions. Our data demonstrate that the PPC PV⁺ neurons lost their ability to integrate auditory information with the visual one during active navigation. This modulation of the PPC PV⁺ neuron activity is critical for animals to make adaptive multisensory decisions according to their behavioral states.

Excitatory Crossmodal Input to a Widespread Population of Primary Sensory Cortical Neurons

Crossmodal information processing in sensory cortices has been reported in sparsely distributed neurons under normal conditions and can undergo experience- or activity-induced plasticity. Given the potential role in brain function as indicated by previous reports, crossmodal connectivity in the sensory cortex needs to be further explored. Using perforated whole-cell recording in anesthetized adult rats, we found that almost all neurons recorded in the primary somatosensory, auditory, and visual cortices exhibited significant membrane-potential responses to crossmodal stimulation, as recorded when brain activity states were pharmacologically down-regulated in light anesthesia. These crossmodal cortical responses were excitatory and subthreshold, and further seemed to be relayed primarily by the sensory thalamus, but not the sensory cortex, of the stimulated modality. Our experiments indicate a sensory cortical presence of widespread excitatory crossmodal inputs, which might play roles in brain functions involving crossmodal information processing or plasticity.

Task specificity in mouse parietal cortex

Parietal cortex is implicated in a variety of behavioral processes, but it is unknown whether and how its individual neurons participate in multiple tasks. We trained head-fixed mice to perform two visual decision tasks involving a steering wheel or a virtual T-maze and recorded from the same parietal neurons during these two tasks. Neurons that were active during the T-maze task were typically inactive during the steering-wheel task and vice versa. Recording from the same neurons in the same apparatus without task stimuli yielded the same specificity as in the task, suggesting that task specificity depends on physical context. To confirm this, we trained some mice in a third task combining the steering wheel context with the visual environment of the T-maze. This hybrid task engaged the same neurons as those engaged in the steering-wheel task. Thus, participation by neurons in mouse parietal cortex is task specific, and this specificity is determined by physical context.

Olfactory modulation of barrel cortex activity during active whisking and passive whisker stimulation

Rodents depend on olfaction and touch to meet many of their fundamental needs. However, the impact of simultaneous olfactory and tactile inputs on sensory representations in the cortex remains elusive. To study these interactions, we recorded large populations of barrel cortex neurons using 2-photon calcium imaging in head-fixed mice during olfactory and tactile stimulation. Here we show that odors bidirectionally alter activity in a small but significant population of barrel cortex neurons through at least two mechanisms, first by enhancing whisking, and second by a central mechanism that persists after whisking is abolished by facial nerve sectioning. Odor responses have little impact on tactile information, and they are sufficient for decoding odor identity, while behavioral parameters like whisking, sniffing, and facial movements are not odor identity-specific. Thus, barrel cortex activity encodes specific olfactory information that is not linked with odor-induced changes in behavior.

Rodents use both touch and smell to get around. This work describes how olfactory information is combined with touch perception in the cortex to guide behavior.

Functional (ir)Relevance of Posterior Parietal Cortex during Audiovisual Change Detection

The posterior parietal cortex (PPC) plays a key role in integrating sensory inputs from different modalities to support adaptive behavior. Neuronal activity in PPC reflects perceptual decision-making across behavioral tasks, but the mechanistic involvement of PPC is unclear. In an audiovisual change detection task, we tested the hypothesis that PPC is required to arbitrate between the noisy inputs from the two different modalities and help decide in which modality a sensory change occurred. In trained male mice, we found extensive single-neuron and population-level encoding of task-relevant visual and auditory stimuli, trial history, as well as upcoming behavioral responses. However, despite these rich neural correlates, which would theoretically be sufficient to solve the task, optogenetic inactivation of PPC did not affect visual or auditory performance. Thus, despite neural correlates faithfully tracking sensory variables and predicting behavioral responses, PPC was not relevant for audiovisual change detection. This functional dissociation questions the role of sensory- and task-related activity in parietal associative circuits during audiovisual change detection. Furthermore, our results highlight the necessity to dissociate functional correlates from mechanistic involvement when exploring the neural basis of perception and behavior.SIGNIFICANCE STATEMENT The posterior parietal cortex (PPC) is active during many daily tasks, but capturing its function has remained challenging. Specifically, it is proposed to function as an integration hub for multisensory inputs. Here, we tested the hypothesis that, rather than classical cue integration, mouse PPC is involved in the segregation and discrimination of sensory modalities. Surprisingly, although neural activity tracked current and past sensory stimuli and reflected the ongoing decision-making process, optogenetic inactivation did not affect task performance. Thus, we show an apparent redundancy of sensory and task-related activity in mouse PPC. These results narrow down the function of parietal circuits, as well as direct the search for those neural dynamics that causally drive perceptual decision-making.

The influence of sensory potentials on transcranial magnetic stimulation - Electroencephalography recordings

OBJECTIVE

It remains unclear to what extent Transcranial Magnetic Stimulation-evoked potentials (TEPs) reflect sensory (auditory and somatosensory) potentials as opposed to cortical excitability. The present study aimed to determine; a) the extent to which sensory potentials contaminate TEPs using a spatially-matched sham condition, and b) whether sensory potentials reflect auditory or somatosensory potentials alone, or a combination of the two.

METHODS

Twenty healthy participants received active or sham stimulation, with the latter consisting a sham coil click combined with scalp electrical stimulation. Two additional conditions i) electrical stimulation and ii) auditory stimulation alone, were included in a subset of 13 participants.

RESULTS

Signals from active and sham stimulation were correlated in spatial and temporal domains > 55 ms post-stimulation. Relative to auditory or electrical stimulation alone, sham stimulation resulted in a) larger potentials, b) stronger correlations with active stimulation and c) a signal that was not a linear sum of electrical and auditory stimulation alone.

CONCLUSIONS

Sensory potentials can confound interpretations of TEPs at timepoints > 55 ms post-stimulation. Furthermore, TEP contamination cannot be explained by auditory or somatosensory potentials alone, but instead reflects a non-linear interaction between both.

SIGNIFICANCE

Future studies may benefit from controlling for sensory contamination using spatially-matched sham conditions, and which consist of combined auditory and somatosensory stimulation.

Temporal synchrony effects of optic flow and vestibular inputs on multisensory heading perception

Precise heading perception requires integration of optic flow and vestibular cues, yet the two cues often carry distinct temporal dynamics that may confound cue integration benefit. Here, we varied temporal offset between the two sensory inputs while macaques discriminated headings around straight ahead. We find the best heading performance does not occur under natural condition of synchronous inputs with zero offset but rather when visual stimuli are artificially adjusted to lead vestibular by a few hundreds of milliseconds. This amount exactly matches the lag between the vestibular acceleration and visual speed signals as measured from single-unit-activity in frontal and posterior parietal cortices. Manually aligning cues in these areas best facilitates integration with some nonlinear gain modulation effects. These findings are consistent with predictions from a model by which the brain integrates optic flow speed with a faster vestibular acceleration signal for sensing instantaneous heading direction during self-motion in the environment.

Cognitive, Systems, and Computational Neurosciences of the Self in Motion

Navigating by path integration requires continuously estimating one's self-motion. This estimate may be derived from visual velocity and/or vestibular acceleration signals. Importantly, these senses in isolation are ill-equipped to provide accurate estimates, and thus visuo-vestibular integration is an imperative. After a summary of the visual and vestibular pathways involved, the crux of this review focuses on the human and theoretical approaches that have outlined a normative account of cue combination in behavior and neurons, as well as on the systems neuroscience efforts that are searching for its neural implementation. We then highlight a contemporary frontier in our state of knowledge: understanding how velocity cues with time-varying reliabilities are integrated into an evolving position estimate over prolonged time periods. Further, we discuss how the brain builds internal models inferring when cues ought to be integrated versus segregated-a process of causal inference. Lastly, we suggest that the study of spatial navigation has not yet addressed its initial condition: self-location. Expected final online publication date for the Annual Review of Psychology, Volume 73 is January 2022. Please see http://www.annualreviews.org/page/journal/pubdates for revised estimates.

Rats spontaneously perceive global motion direction of drifting plaids

Computing global motion direction of extended visual objects is a hallmark of primate high-level vision. Although neurons selective for global motion have also been found in mouse visual cortex, it remains unknown whether rodents can combine multiple motion signals into global, integrated percepts. To address this question, we trained two groups of rats to discriminate either gratings (G group) or plaids (i.e., superpositions of gratings with different orientations; P group) drifting horizontally along opposite directions. After the animals learned the task, we applied a visual priming paradigm, where presentation of the target stimulus was preceded by the brief presentation of either a grating or a plaid. The extent to which rat responses to the targets were biased by such prime stimuli provided a measure of the spontaneous, perceived similarity between primes and targets. We found that gratings and plaids, when used as primes, were equally effective at biasing the perception of plaid direction for the rats of the P group. Conversely, for the G group, only the gratings acted as effective prime stimuli, while the plaids failed to alter the perception of grating direction. To interpret these observations, we simulated a decision neuron reading out the representations of gratings and plaids, as conveyed by populations of either component or pattern cells (i.e., local or global motion detectors). We concluded that the findings for the P group are highly consistent with the existence of a population of pattern cells, playing a functional role similar to that demonstrated in primates. We also explored different scenarios that could explain the failure of the plaid stimuli to elicit a sizable priming magnitude for the G group. These simulations yielded testable predictions about the properties of motion representations in rodent visual cortex at the single-cell and circuitry level, thus paving the way to future neurophysiology experiments.

Fast cortical dynamics encode tactile grating orientation during active touch

Touch-based object recognition relies on perception of compositional tactile features like roughness, shape, and surface orientation. However, besides roughness, it remains unclear how these different tactile features are encoded by neural activity that is linked with perception. Here, we establish a cortex-dependent perceptual task in which mice discriminate tactile gratings on the basis of orientation using only their whiskers. Multielectrode recordings in the barrel cortex reveal weak orientation tuning in average firing rates (500-ms time scale) during grating exploration despite high levels of cortical activity. Just before decision, orientation information extracted from fast cortical dynamics (100-ms time scale) more closely resembles concurrent psychophysical measurements than single neuron orientation tuning curves. This temporal code conveys both stimulus and choice/action-related information, suggesting that fast cortical dynamics during exploration of a tactile object both reflect the physical stimulus and affect the decision.

Auditory input enhances somatosensory encoding and tactile goal-directed behavior

The capacity of the brain to encode multiple types of sensory input is key to survival. Yet, how neurons integrate information from multiple sensory pathways and to what extent this influences behavior is largely unknown. Using two-photon Ca2+ imaging, optogenetics and electrophysiology in vivo and in vitro, we report the influence of auditory input on sensory encoding in the somatosensory cortex and show its impact on goal-directed behavior. Monosynaptic input from the auditory cortex enhanced dendritic and somatic encoding of tactile stimulation in layer 2/3 (L2/3), but not layer 5 (L5), pyramidal neurons in forepaw somatosensory cortex (S1). During a tactile-based goal-directed task, auditory input increased dendritic activity and reduced reaction time, which was abolished by photoinhibition of auditory cortex projections to forepaw S1. Taken together, these results indicate that dendrites of L2/3 pyramidal neurons encode multisensory information, leading to enhanced neuronal output and reduced response latency during goal-directed behavior.

Conserved visual capacity of rats under red light

Recent studies examine the behavioral capacities of rats and mice with and without visual input, and the neuronal mechanisms underlying such capacities. These animals are assumed to be functionally blind under red light, an assumption that might originate in the fact that they are dichromats who possess ultraviolet and green cones, but not red cones. But the inability to see red as a color does not necessarily rule out form vision based on red light absorption. We measured Long-Evans rats’ capacity for visual form discrimination under red light of various wavelength bands. Upon viewing a black and white grating, they had to distinguish between two categories of orientation: horizontal and vertical. Psychometric curves plotting judged orientation versus angle demonstrate the conserved visual capacity of rats under red light. Investigations aiming to explore rodent physiological and behavioral functions in the absence of visual input should not assume red-light blindness.

Neural Correlates of Multisensory Detection Behavior: Comparison of Primary and Higher-Order Visual Cortex

We act upon stimuli in our surrounding environment by gathering the multisensory information they convey and by integrating this information to decide on a behavioral action. We hypothesized that the anterolateral secondary visual cortex (area AL) of the mouse brain may serve as a hub for sensorimotor transformation of audiovisual information. We imaged neuronal activity in primary visual cortex (V1) and AL of the mouse during a detection task using visual, auditory, and audiovisual stimuli. We found that AL neurons were more sensitive to weak uni- and multisensory stimuli compared to V1. Depending on contrast, different subsets of AL and V1 neurons showed cross-modal modulation of visual responses. During audiovisual stimulation, AL neurons showed stronger differentiation of behaviorally reported versus unreported stimuli compared to V1, whereas V1 showed this distinction during unisensory visual stimulation. Thus, neural population activity in area AL correlates more closely with multisensory detection behavior than V1.

Perceptual Inference, Learning, and Attention in a Multisensory World

Adaptive behavior in a complex, dynamic, and multisensory world poses some of the most fundamental computational challenges for the brain, notably inference, decision-making, learning, binding, and attention. We first discuss how the brain integrates sensory signals from the same source to support perceptual inference and decision-making by weighting them according to their momentary sensory uncertainties. We then show how observers solve the binding or causal inference problem-deciding whether signals come from common causes and should hence be integrated or else be treated independently. Next, we describe the multifarious interplay between multisensory processing and attention. We argue that attentional mechanisms are crucial to compute approximate solutions to the binding problem in naturalistic environments when complex time-varying signals arise from myriad causes. Finally, we review how the brain dynamically adapts multisensory processing to a changing world across multiple timescales.

Choice-dependent cross-modal interaction in the medial prefrontal cortex of rats

Cross-modal interaction (CMI) could significantly influence the perceptional or decision-making process in many circumstances. However, it remains poorly understood what integrative strategies are employed by the brain to deal with different task contexts. To explore it, we examined neural activities of the medial prefrontal cortex (mPFC) of rats performing cue-guided two-alternative forced-choice tasks. In a task requiring rats to discriminate stimuli based on auditory cue, the simultaneous presentation of an uninformative visual cue substantially strengthened mPFC neurons' capability of auditory discrimination mainly through enhancing the response to the preferred cue. Doing this also increased the number of neurons revealing a cue preference. If the task was changed slightly and a visual cue, like the auditory, denoted a specific behavioral direction, mPFC neurons frequently showed a different CMI pattern with an effect of cross-modal enhancement best evoked in information-congruent multisensory trials. In a choice free task, however, the majority of neurons failed to show a cross-modal enhancement effect and cue preference. These results indicate that CMI at the neuronal level is context-dependent in a way that differs from what has been shown in previous studies.

Lapses in perceptual decisions reflect exploration

Perceptual decision-makers often display a constant rate of errors independent of evidence strength. These ‘lapses’ are treated as a nuisance arising from noise tangential to the decision, e.g. inattention or motor errors. Here, we use a multisensory decision task in rats to demonstrate that these explanations cannot account for lapses’ stimulus dependence. We propose a novel explanation: lapses reflect a strategic trade-off between exploiting known rewarding actions and exploring uncertain ones. We tested this model’s predictions by selectively manipulating one action’s reward magnitude or probability. As uniquely predicted by this model, changes were restricted to lapses associated with that action. Finally, we show that lapses are a powerful tool for assigning decision-related computations to neural structures based on disruption experiments (here, posterior striatum and secondary motor cortex). These results suggest that lapses reflect an integral component of decision-making and are informative about action values in normal and disrupted brain states.

Sensory and Behavioral Components of Neocortical Signal Flow in Discrimination Tasks with Short-Term Memory

In the neocortex, each sensory modality engages distinct sensory areas that route information to association areas. Where signal flow converges for maintaining information in short-term memory and how behavior may influence signal routing remain open questions. Using wide-field calcium imaging, we compared cortex-wide neuronal activity in layer 2/3 for mice trained in auditory and tactile tasks with delayed response. In both tasks, mice were either active or passive during stimulus presentation, moving their body or sitting quietly. Irrespective of behavioral strategy, auditory and tactile stimulation activated distinct subdivisions of the posterior parietal cortex, anterior area A and rostrolateral area RL, which held stimulus-related information necessary for the respective tasks. In the delay period, in contrast, behavioral strategy rather than sensory modality determined short-term memory location, with activity converging frontomedially in active trials and posterolaterally in passive trials. Our results suggest behavior-dependent routing of sensory-driven cortical signals flow from modality-specific posterior parietal cortex (PPC) subdivisions to higher association areas.

Multisensory integration in the mouse cortical connectome using a network diffusion model

Having a structural network representation of connectivity in the brain is instrumental in analyzing communication dynamics and neural information processing. In this work, we make steps towards understanding multisensory information flow and integration using a network diffusion approach. In particular, we model the flow of evoked activity, initiated by stimuli at primary sensory regions, using the asynchronous linear threshold (ALT) diffusion model. The ALT model captures how evoked activity that originates at a given region of the cortex “ripples through” other brain regions (referred to as an activation cascade). We find that a small number of brain regions–the claustrum and the parietal temporal cortex being at the top of the list–are involved in almost all cortical sensory streams. This suggests that the cortex relies on an hourglass architecture to first integrate and compress multisensory information from multiple sensory regions, before utilizing that lower dimensionality representation in higher level association regions and more complex cognitive tasks.

Having a structural network representation of connectivity in the brain is instrumental in analyzing communication dynamics and neural information processing. In this work, we make steps towards understanding multisensory information flow and integration using a network diffusion approach. In particular, we model the flow of evoked activity, initiated by stimuli at primary sensory regions, using the asynchronous linear threshold (ALT) diffusion model. The ALT model captures how evoked activity that originates at a given region of the cortex “ripples through” other brain regions (referred to as an activation cascade). We apply the ALT model to the mouse connectome provided by the Allen Institute for Brain Science. A first result, using functional datasets based on voltage-sensitive dye (VSD) imaging, is that the ALT model, despite its simplicity, predicts the temporal ordering of each sensory activation cascade quite accurately. We further apply this model to study multisensory integration and find that a small number of brain regionsthe claustrum and the parietal temporal cortex being at the top of the listare involved in almost all cortical sensory streams. This suggests that the cortex relies on an hourglass architecture to first integrate and compress multisensory information from multiple sensory regions, before utilizing that lower dimensionality representation in higher level association regions and more complex cognitive tasks.

Neuronal Encoding of Multisensory Motion Features in the Rat Associative Parietal Cortex

Motion perception is facilitated by the interplay of various sensory channels. In rodents, the cortical areas involved in multisensory motion coding remain to be identified. Using voltage-sensitive-dye imaging, we revealed a visuo-tactile convergent region that anatomically corresponds to the associative parietal cortex (APC). Single unit responses to moving visual gratings or whiskers deflections revealed a specific coding of motion characteristics strikingly found in both sensory modalities. The heteromodality of this region was further supported by a large proportion of bimodal neurons and by a classification procedure revealing that APC carries information about motion features, sensory origin and multisensory direction-congruency. Altogether, the results point to a central role of APC in multisensory integration for motion perception.

Cross-Talk of Low-Level Sensory and High-Level Cognitive Processing: Development, Mechanisms, and Relevance for Cross-Modal Abilities of the Brain

The emergence of cross-modal learning capabilities requires the interaction of neural areas accounting for sensory and cognitive processing. Convergence of multiple sensory inputs is observed in low-level sensory cortices including primary somatosensory (S1), visual (V1), and auditory cortex (A1), as well as in high-level areas such as prefrontal cortex (PFC). Evidence shows that local neural activity and functional connectivity between sensory cortices participate in cross-modal processing. However, little is known about the functional interplay between neural areas underlying sensory and cognitive processing required for cross-modal learning capabilities across life. Here we review our current knowledge on the interdependence of low- and high-level cortices for the emergence of cross-modal processing in rodents. First, we summarize the mechanisms underlying the integration of multiple senses and how cross-modal processing in primary sensory cortices might be modified by top-down modulation of the PFC. Second, we examine the critical factors and developmental mechanisms that account for the interaction between neuronal networks involved in sensory and cognitive processing. Finally, we discuss the applicability and relevance of cross-modal processing for brain-inspired intelligent robotics. An in-depth understanding of the factors and mechanisms controlling cross-modal processing might inspire the refinement of robotic systems by better mimicking neural computations.

A passive, camera-based head-tracking system for real-time, three-dimensional estimation of head position and orientation in rodents

Tracking head position and orientation in small mammals is crucial for many applications in the field of behavioral neurophysiology, from the study of spatial navigation to the investigation of active sensing and perceptual representations. Many approaches to head tracking exist, but most of them only estimate the 2D coordinates of the head over the plane where the animal navigates. Full reconstruction of the pose of the head in 3D is much more more challenging and has been achieved only in handful of studies, which employed headsets made of multiple LEDs or inertial units. However, these assemblies are rather bulky and need to be powered to operate, which prevents their application in wireless experiments and in the small enclosures often used in perceptual studies. Here we propose an alternative approach, based on passively imaging a lightweight, compact, 3D structure, painted with a pattern of black dots over a white background. By applying a cascade of feature extraction algorithms that progressively refine the detection of the dots and reconstruct their geometry, we developed a tracking method that is highly precise and accurate, as assessed through a battery of validation measurements. We show that this method can be used to study how a rat samples sensory stimuli during a perceptual discrimination task and how a hippocampal place cell represents head position over extremely small spatial scales. Given its minimal encumbrance and wireless nature, our method could be ideal for high-throughput applications, where tens of animals need to be simultaneously and continuously tracked.NEW & NOTEWORTHY Head tracking is crucial in many behavioral neurophysiology studies. Yet reconstruction of the head's pose in 3D is challenging and typically requires implanting bulky, electrically powered headsets that prevent wireless experiments and are hard to employ in operant boxes. Here we propose an alternative approach, based on passively imaging a compact, 3D dot pattern that, once implanted over the head of a rodent, allows estimating the pose of its head with high precision and accuracy.

Whisker-Mediated Touch System in Rodents: From Neuron to Behavior

A key question in systems neuroscience is to identify how sensory stimuli are represented in neuronal activity, and how the activity of sensory neurons in turn is “read out” by downstream neurons and give rise to behavior. The choice of a proper model system to address these questions, is therefore a crucial step. Over the past decade, the increasingly powerful array of experimental approaches that has become available in non-primate models (e.g., optogenetics and two-photon imaging) has spurred a renewed interest for the use of rodent models in systems neuroscience research. Here, I introduce the rodent whisker-mediated touch system as a structurally well-established and well-organized model system which, despite its simplicity, gives rise to complex behaviors. This system serves as a behaviorally efficient model system; known as nocturnal animals, along with their olfaction, rodents rely on their whisker-mediated touch system to collect information about their surrounding environment. Moreover, this system represents a well-studied circuitry with a somatotopic organization. At every stage of processing, one can identify anatomical and functional topographic maps of whiskers; “barrelettes” in the brainstem nuclei, “barreloids” in the sensory thalamus, and “barrels” in the cortex. This article provides a brief review on the basic anatomy and function of the whisker system in rodents.

Perceptual uncertainty

The number of the distinct tactile percepts exceeds the number of receptor types in the skin, signifying that perception cannot be explained by a one-to-one mapping from a single receptor channel to a corresponding percept. The abundance of touch experiences results from multiplexing (the coexistence of multiple codes within a single channel, increasing the available information content of that channel) and from the mixture of receptor channels by divergence and convergence. When a neuronal representation emerges through the combination of receptor channels, perceptual uncertainty can occur-a perceptual judgment is affected by a stimulus feature that would be, ideally, excluded from the task. Though uncertainty seems at first glance to reflect nonoptimality in sensory processing, it is actually a consequence of efficient coding mechanisms that exploit prior knowledge about objects that are touched. Studies that analyze how perceptual judgments are "fooled" by variations in sensory input can reveal the neuronal mechanisms underlying the tactile experience.

Sensorimotor processing in the rodent barrel cortex

Tactile sensory information from facial whiskers provides nocturnal tunnel-dwelling rodents, including mice and rats, with important spatial and textural information about their immediate surroundings. Whiskers are moved back and forth to scan the environment (whisking), and touch signals from each whisker evoke sparse patterns of neuronal activity in whisker-related primary somatosensory cortex (wS1; barrel cortex). Whisking is accompanied by desynchronized brain states and cell-type-specific changes in spontaneous and evoked neuronal activity. Tactile information, including object texture and location, appears to be computed in wS1 through integration of motor and sensory signals. wS1 also directly controls whisker movements and contributes to learned, whisker-dependent, goal-directed behaviours. The cell-type-specific neuronal circuitry in wS1 that contributes to whisker sensory perception is beginning to be defined.

Functional Architecture and Encoding of Tactile Sensorimotor Behavior in Rat Posterior Parietal Cortex

The posterior parietal cortex (PPC) in rodents is reciprocally connected to primary somatosensory and vibrissal motor cortices. The PPC neuronal circuitry could thus encode and potentially integrate incoming somatosensory information and whisker motor output. However, the information encoded across PPC layers during refined sensorimotor behavior remains largely unknown. To uncover the sensorimotor features represented in PPC during voluntary whisking and object touch, we performed loose-patch single-unit recordings and extracellular recordings of ensemble activity, covering all layers of PPC in anesthetized and awake, behaving male rats. First, using single-cell receptive field mapping, we revealed the presence of coarse somatotopy along the mediolateral axis in PPC. Second, we found that spiking activity was modulated during exploratory whisking in layers 2-4 and layer 6, but not in layer 5 of awake, behaving rats. Population spiking activity preceded actual movement, and whisker trajectory endpoints could be decoded by population spiking, suggesting that PPC is involved in movement planning. Finally, population spiking activity further increased in response to active whisker touch but only in PPC layers 2-4. Thus, we find layer-specific processing, which emphasizes the computational role of PPC during whisker sensorimotor behavior.SIGNIFICANCE STATEMENT The posterior parietal cortex (PPC) is thought to merge information on motor output and sensory input to orchestrate interaction with the environment, but the function of different PPC microcircuit components is poorly understood. We recorded neuronal activity in rat PPC during sensorimotor behavior involving motor and sensory pathways. We uncovered that PPC layers have dedicated function: motor and sensory information is merged in layers 2-4; layer 6 predominantly represents motor information. Collectively, PPC activity predicts future motor output, thus entailing a motor plan. Our results are important for understanding how PPC computationally processes motor output and sensory input. This understanding may facilitate decoding of brain activity when using brain-machine interfaces to overcome loss of function after, for instance, spinal cord injury.

Prediction of Choice from Competing Mechanosensory and Choice-Memory Cues during Active Tactile Decision Making

Perceptual decision making is an active process where animals move their sense organs to extract task-relevant information. To investigate how the brain translates sensory input into decisions during active sensation, we developed a mouse active touch task where the mechanosensory input can be precisely measured and that challenges animals to use multiple mechanosensory cues. Male mice were trained to localize a pole using a single whisker and to report their decision by selecting one of three choices. Using high-speed imaging and machine vision, we estimated whisker-object mechanical forces at millisecond resolution. Mice solved the task by a sensory-motor strategy where both the strength and direction of whisker bending were informative cues to pole location. We found competing influences of immediate sensory input and choice memory on mouse choice. On correct trials, choice could be predicted from the direction and strength of whisker bending, but not from previous choice. In contrast, on error trials, choice could be predicted from previous choice but not from whisker bending. This study shows that animal choices during active tactile decision making can be predicted from mechanosensory and choice-memory signals, and provides a new task well suited for the future study of the neural basis of active perceptual decisions.SIGNIFICANCE STATEMENT Due to the difficulty of measuring the sensory input to moving sense organs, active perceptual decision making remains poorly understood. The whisker system provides a way forward since it is now possible to measure the mechanical forces due to whisker-object contact during behavior. Here we train mice in a novel behavioral task that challenges them to use rich mechanosensory cues but can be performed using one whisker and enables task-relevant mechanical forces to be precisely estimated. This approach enables rigorous study of how sensory cues translate into action during active, perceptual decision making. Our findings provide new insight into active touch and how sensory/internal signals interact to determine behavioral choices.

The circuit architecture of cortical multisensory processing: Distinct functions jointly operating within a common anatomical network

Our perceptual systems continuously process sensory inputs from different modalities and organize these streams of information such that our subjective representation of the outside world is a unified experience. By doing so, they also enable further cognitive processing and behavioral action. While cortical multisensory processing has been extensively investigated in terms of psychophysics and mesoscale neural correlates, an in depth understanding of the underlying circuit-level mechanisms is lacking. Previous studies on circuit-level mechanisms of multisensory processing have predominantly focused on cue integration, i.e. the mechanism by which sensory features from different modalities are combined to yield more reliable stimulus estimates than those obtained by using single sensory modalities. In this review, we expand the framework on the circuit-level mechanisms of cortical multisensory processing by highlighting that multisensory processing is a family of functions - rather than a single operation - which involves not only the integration but also the segregation of modalities. In addition, multisensory processing not only depends on stimulus features, but also on cognitive resources, such as attention and memory, as well as behavioral context, to determine the behavioral outcome. We focus on rodent models as a powerful instrument to study the circuit-level bases of multisensory processes, because they enable combining cell-type-specific recording and interventional techniques with complex behavioral paradigms. We conclude that distinct multisensory processes share overlapping anatomical substrates, are implemented by diverse neuronal micro-circuitries that operate in parallel, and are flexibly recruited based on factors such as stimulus features and behavioral constraints.

Integration of visual and whisker signals in rat superior colliculus

Multisensory integration is a process by which signals from different sensory modalities are combined to facilitate detection and localization of external events. One substrate for multisensory integration is the midbrain superior colliculus (SC) which plays an important role in orienting behavior. In rodent SC, visual and somatosensory (whisker) representations are in approximate registration, but whether and how these signals interact is unclear. We measured spiking activity in SC of anesthetized hooded rats, during presentation of visual- and whisker stimuli that were tested simultaneously or in isolation. Visual responses were found in all layers, but were primarily located in superficial layers. Whisker responsive sites were primarily found in intermediate layers. In single- and multi-unit recording sites, spiking activity was usually only sensitive to one modality, when stimuli were presented in isolation. By contrast, we observed robust and primarily suppressive interactions when stimuli were presented simultaneously to both modalities. We conclude that while visual and whisker representations in SC of rat are partially overlapping, there is limited excitatory convergence onto individual sites. Multimodal integration may instead rely on suppressive interactions between modalities.

Perceptual Decision-Making: A Field in the Midst of a Transformation

Major changes are underway in the field of perceptual decision-making. Single-neuron studies have given way to population recordings with identified cell types, traditional analyses have been extended to accommodate these large and diverse collections of neurons, and novel methods of neural disruption have provided insights about causal circuits. Further, the field has expanded to include multiple new species: rodents and invertebrates, for example, have been instrumental in demonstrating the importance of internal state on neural responses. Finally, a renewed interest in ethological stimuli prompted development of new behaviors, frequently analyzed by new, automated movement tracking methods. Taken together, these advances constitute a seismic shift in both our approach and understanding of how incoming sensory signals are used to guide decisions.

Visual Evidence Accumulation Guides Decision-Making in Unrestrained Mice

The ability to manipulate neural activity with precision is an asset in uncovering neural circuits for decision-making. Diverse tools for manipulating neurons are available for mice, but their feasibility remains unclear, especially when decisions require accumulating visual evidence. For example, whether mice' decisions reflect leaky accumulation is unknown, as are the relevant/irrelevant factors that influence decisions. Further, causal circuits for visual evidence accumulation are poorly understood. To address this, we measured decisions in mice judging the fluctuating rate of a flash sequence. An initial analysis (>500,000 trials, 29 male and female mice) demonstrated that information throughout the 1000 ms trial influenced choice, with early information most influential. This suggests that information persists in neural circuits for ∼1000 ms with minimal accumulation leak. Next, in a subset of animals, we probed strategy more extensively and found that although animals were influenced by stimulus rate, they were unable to entirely suppress the influence of stimulus brightness. Finally, we identified anteromedial (AM) visual area via retinotopic mapping and optogenetically inhibited it using JAWS. Light activation biased choices in both injected and uninjected animals, demonstrating that light alone influences behavior. By varying stimulus-response contingency while holding stimulated hemisphere constant, we surmounted this obstacle to demonstrate that AM suppression biases decisions. By leveraging a large dataset to quantitatively characterize decision-making behavior, we establish mice as suitable for neural circuit manipulation studies. Further, by demonstrating that mice accumulate visual evidence, we demonstrate that this strategy for reducing uncertainty in decision-making is used by animals with diverse visual systems.SIGNIFICANCE STATEMENT To connect behaviors to their underlying neural mechanism, a deep understanding of behavioral strategy is needed. This understanding is incomplete for mice. To surmount this, we measured the outcome of >500,000 decisions made by 29 mice trained to judge visual stimuli and performed behavioral/optogenetic manipulations in smaller subsets. Our analyses offer new insights into mice' decision-making strategies and compares them with those of other species. We then disrupted neural activity in a candidate neural structure and examined the effect on decisions. Our findings establish mice as suitable for visual accumulation of evidence decisions. Further, the results highlight similarities in decision-making strategies across very different species.

Audiovisual Integration Enhances Stimulus Detection Performance in Mice

The detection of objects in the external world improves when humans and animals integrate object features of multiple sensory modalities. Behavioral and neuronal mechanisms underlying multisensory stimulus detection are poorly understood, mainly because they have not been investigated with suitable behavioral paradigms. Such behavioral paradigms should (i) elicit a robust multisensory gain, (ii) incorporate systematic calibration of stimulus amplitude to the sensory capacities of the individual subject, (iii) yield a high trial count, and (iv) be easily compatible with a large variety of neurophysiological recording techniques. We developed an audiovisual stimulus detection task for head-fixed mice which meets all of these critical behavioral constraints. Behavioral data obtained with this task indicated a robust increase in detection performance of multisensory stimuli compared with unisensory cues, which was maximal when both stimulus constituents were presented at threshold intensity. The multisensory behavioral effect was associated with a change in the perceptual performance which consisted of two components. First, the visual and auditory perceptual systems increased their sensitivity meaning that low intensity stimuli were more often detected. Second, enhanced acuity enabled the systems to better classify whether there was a stimulus or not. Fitting our data to signal detection models revealed that the multisensory gain was more likely to be achieved by integration of sensory signals rather than by stimulus redundancy or competition. This validated behavioral paradigm can be exploited to reliably investigate the neuronal correlates of multisensory stimulus detection at the level of single neurons, microcircuits, and larger perceptual systems.

Neural Circuits for Goal-Directed Sensorimotor Transformations

Precisely wired neuronal circuits process sensory information in a learning- and context-dependent manner in order to govern behavior. Simple sensory decision-making tasks in rodents are now beginning to reveal the contributions of distinct cell types and brain regions participating in the conversion of sensory information into learned goal-directed motor output. Task learning is accompanied by target-specific routing of sensory information to specific downstream cortical regions, with higher-order cortical regions such as the posterior parietal cortex, medial prefrontal cortex, and hippocampus appearing to play important roles in learning- and context-dependent processing of sensory input. An important challenge for future research is to connect cell-type-specific activity in these brain regions with motor neurons responsible for action initiation.

Resting-state pulvinar-posterior parietal decoupling in PTSD and its dissociative subtype

Key evidence points toward alterations in the neurocircuitry of large-scale networks among patients with posttraumatic stress disorder (PTSD). The pulvinar is a thalamic region displaying reciprocal connectivity with the cortex and has been shown to modulate alpha synchrony to facilitate network communication. During rest, the pulvinar displays functional connectivity with the posterior parietal cortex (PPC), a heteromodal network of brain areas underlying multisensory integration and socioaffective functions that are shown at deficit in PTSD. Accordingly, this study seeks to reveal the resting-state functional connectivity (rsFC) patterns of individuals with PTSD, its dissociative subtype (PTSD + DS) and healthy controls. A whole-brain rsFC analysis was conducted using SPM12 and PickAtlas. Connectivity was analyzed for the left and right pulvinar across groups of individuals with PTSD (n = 81), PTSD + DS (n = 49), and controls (n = 51). As compared to PTSD, controls displayed significantly greater pulvinar rsFC with the superior parietal lobule and precuneus. Moreover, as compared to PTSD + DS, controls showed increased pulvinar connectivity with the superior parietal lobule, inferior parietal lobule and the precuneus. PTSD groups did not display stronger connectivity with any region as compared to controls. Last, PTSD had greater rsFC in the supramarginal gyrus relative to PTSD + DS. Reduced connectivity between the pulvinar and PPC may explain impairments to autobiographical memory, self-referential processing, and socioaffective domains in PTSD and PTSD + DS even at "rest." Critically, these alterations appear to be exacerbated in individuals with PTSD + DS, which may have important implications for treatment.

Sensory representation of an auditory cued tactile stimulus in the posterior parietal cortex of the mouse

Sensory association cortices receive diverse inputs with their role in representing and integrating multi-sensory content remaining unclear. Here we examined the neuronal correlates of an auditory-tactile stimulus sequence in the posterior parietal cortex (PPC) using 2-photon calcium imaging in awake mice. We find that neuronal subpopulations in layer 2/3 of PPC reliably represent texture-touch events, in addition to auditory cues that presage the incoming tactile stimulus. Notably, altering the flow of sensory events through omission of the cued texture touch elicited large responses in a subset of neurons hardly responsive to or even inhibited by the tactile stimuli. Hence, PPC neurons were able to discriminate not only tactile stimulus features (i.e., texture graininess) but also between the presence and omission of the texture stimulus. Whereas some of the neurons responsive to texture omission were driven by looming-like auditory sounds others became recruited only with tactile sensory experience. These findings indicate that layer 2/3 neuronal populations in PPC potentially encode correlates of expectancy in addition to auditory and tactile stimuli.

Training Rats Using Water Rewards Without Water Restriction

High-throughput behavioral training of rodents has been a transformative development for systems neuroscience. Water or food restriction is typically required to motivate task engagement. We hypothesized a gap between physiological water need and hedonic water satiety that could be leveraged to train rats for water rewards without water restriction. We show that when Citric Acid (CA) is added to water, female rats drink less, yet consume enough to maintain long term health. With 24 h/day access to a visual task with water rewards, rats with ad lib CA water performed 84% ± 18% as many trials as in the same task under water restriction. In 2-h daily sessions, rats with ad lib CA water performed 68% ± 13% as many trials as under water restriction. Using reward sizes <25 μl, rats with ad lib CA performed 804 ± 285 trials/day in live-in sessions or 364 ± 82 trials/day in limited duration daily sessions. The safety of CA water amendment was previously shown for male rats, and the gap between water need and satiety was similar to what we observed in females. Therefore, it is likely that this method will generalize to male rats, though this remains to be shown. We conclude that at least in some contexts rats can be trained using water rewards without water restriction, benefitting both animal welfare and scientific productivity.

Cortical Lifelogging: The Posterior Parietal Cortex as Sensory History Buffer

To compare information and reach decisions effectively, our brain uses multiple heuristics, which can, however, induce biases in behavior. An elegant study by Akrami et al. (2018) finds evidence for one such heuristic in a sensory-based comparison task and identifies its location to the posterior parietal cortex.

Supramodal agnosia for oblique mirror orientation in patients with periventricular leukomalacia

Periventricular leukomalacia (PVL) is characterized by focal necrosis at the level of the periventricular white matter, often observed in preterm infants. PVL is frequently associated with motor impairment and with visual deficits affecting primary stages of visual processes as well as higher visual cognitive abilities. Here we describe six PVL subjects, with normal verbal IQ, showing orientation perception deficits in both the haptic and visual domains. Subjects were asked to compare the orientation of two stimuli presented simultaneously or sequentially, using both a two alternative forced choice (2AFC) orientation-discrimination and a matching procedure. Visual stimuli were oriented gratings or bars or collinear short lines embedded within a random pattern. Haptic stimuli comprised two rotatable wooden sticks. PVL patients performed at chance in discriminating the oblique orientation, both for visual and haptic stimuli. Moreover when asked to reproduce the oblique orientation, they often oriented the stimulus along the symmetric mirror orientation. The deficit generalized to stimuli varying in many low level features, was invariant for spatiotopic object orientation, and also occurred for sequential presentations. The deficit was specific to oblique orientations, and not for horizontal or vertical stimuli. These findings show that PVL can affect a specific network involved with the supramodal perception of mirror symmetry orientation.