Cellular and synaptic architecture of multisensory integration in the mouse neocortex

The Visual Cortex in Context

In this article, we review the anatomical inputs and outputs to the mouse primary visual cortex, area V1. Our survey of data from the Allen Institute Mouse Connectivity project indicates that mouse V1 is highly interconnected with both cortical and subcortical brain areas. This pattern of innervation allows for computations that depend on the state of the animal and on behavioral goals, which contrasts with simple feedforward, hierarchical models of visual processing. Thus, to have an accurate description of the function of V1 during mouse behavior, its involvement with the rest of the brain circuitry has to be considered. Finally, it remains an open question whether the primary visual cortex of higher mammals displays the same degree of sensorimotor integration in the early visual system.

Excitatory Neuronal Hubs Configure Multisensory Integration of Slow Waves in Association Cortex

Multisensory integration (MSI) is a fundamental emergent property of the mammalian brain. During MSI, perceptual information encoded in patterned activity is processed in multimodal association cortex. The systems-level neuronal dynamics that coordinate MSI, however, are unknown. Here, we demonstrate intrinsic hub-like network activity in the association cortex that regulates MSI. We engineered calcium reporter mouse lines based on the fluorescence resonance energy transfer sensor yellow cameleon (YC2.60) expressed in excitatory or inhibitory neurons. In medial and parietal association cortex, we observed spontaneous slow waves that self-organized into hubs defined by long-range excitatory and local inhibitory circuits. Unlike directional source/sink-like flows in sensory areas, medial/parietal excitatory and inhibitory hubs had net-zero balanced inputs. Remarkably, multisensory stimulation triggered rapid phase-locking mainly of excitatory hub activity persisting for seconds after the stimulus offset. Therefore, association cortex tends to form balanced excitatory networks that configure slow-wave phase-locking for MSI. VIDEO ABSTRACT.

The Mouse Cortical Connectome, Characterized by an Ultra-Dense Cortical Graph, Maintains Specificity by Distinct Connectivity Profiles

The inter-areal wiring pattern of the mouse cerebral cortex was analyzed in relation to a refined parcellation of cortical areas. Twenty-seven retrograde tracer injections were made in 19 areas of a 47-area parcellation of the mouse neocortex. Flat mounts of the cortex and multiple histological markers enabled detailed counts of labeled neurons in individual areas. The observed log-normal distribution of connection weights to each cortical area spans 5 orders of magnitude and reveals a distinct connectivity profile for each area, analogous to that observed in macaques. The cortical network has a density of 97%, considerably higher than the 66% density reported in macaques. A weighted graph analysis reveals a similar global efficiency but weaker spatial clustering compared with that reported in macaques. The consistency, precision of the connectivity profile, density, and weighted graph analysis of the present data differ significantly from those obtained in earlier studies in the mouse.

Functional Architecture and Encoding of Tactile Sensorimotor Behavior in Rat Posterior Parietal Cortex

The posterior parietal cortex (PPC) in rodents is reciprocally connected to primary somatosensory and vibrissal motor cortices. The PPC neuronal circuitry could thus encode and potentially integrate incoming somatosensory information and whisker motor output. However, the information encoded across PPC layers during refined sensorimotor behavior remains largely unknown. To uncover the sensorimotor features represented in PPC during voluntary whisking and object touch, we performed loose-patch single-unit recordings and extracellular recordings of ensemble activity, covering all layers of PPC in anesthetized and awake, behaving male rats. First, using single-cell receptive field mapping, we revealed the presence of coarse somatotopy along the mediolateral axis in PPC. Second, we found that spiking activity was modulated during exploratory whisking in layers 2-4 and layer 6, but not in layer 5 of awake, behaving rats. Population spiking activity preceded actual movement, and whisker trajectory endpoints could be decoded by population spiking, suggesting that PPC is involved in movement planning. Finally, population spiking activity further increased in response to active whisker touch but only in PPC layers 2-4. Thus, we find layer-specific processing, which emphasizes the computational role of PPC during whisker sensorimotor behavior.SIGNIFICANCE STATEMENT The posterior parietal cortex (PPC) is thought to merge information on motor output and sensory input to orchestrate interaction with the environment, but the function of different PPC microcircuit components is poorly understood. We recorded neuronal activity in rat PPC during sensorimotor behavior involving motor and sensory pathways. We uncovered that PPC layers have dedicated function: motor and sensory information is merged in layers 2-4; layer 6 predominantly represents motor information. Collectively, PPC activity predicts future motor output, thus entailing a motor plan. Our results are important for understanding how PPC computationally processes motor output and sensory input. This understanding may facilitate decoding of brain activity when using brain-machine interfaces to overcome loss of function after, for instance, spinal cord injury.

Power-spectra and cross-frequency coupling changes in visual and Audio-visual acquired equivalence learning

The three phases of the applied acquired equivalence learning test, i.e. acquisition, retrieval and generalization, investigate the capabilities of humans in associative learning, working memory load and rule-transfer, respectively. Earlier findings denoted the role of different subcortical structures and cortical regions in the visual test. However, there is a lack of information about how multimodal cues modify the EEG-patterns during acquired equivalence learning. To test this we have recorded EEG from 18 healthy volunteers and analyzed the power spectra and the strength of cross-frequency coupling, comparing a unimodal visual-guided and a bimodal, audio-visual-guided paradigm. We found that the changes in the power of the different frequency band oscillations were more critical during the visual paradigm and they showed less synchronized activation compared to the audio-visual paradigm. These findings indicate that multimodal cues require less prominent, but more synchronized cortical contribution, which might be a possible biomarker of forming multimodal associations.

Corticocortical Systems Underlying High-Order Motor Control

Cortical networks are characterized by the origin, destination, and reciprocity of their connections, as well as by the diameter, conduction velocity, and synaptic efficacy of their axons. The network formed by parietal and frontal areas lies at the core of cognitive-motor control because the outflow of parietofrontal signaling is conveyed to the subcortical centers and spinal cord through different parallel pathways, whose orchestration determines, not only when and how movements will be generated, but also the nature of forthcoming actions. Despite intensive studies over the last 50 years, the role of corticocortical connections in motor control and the principles whereby selected cortical networks are recruited by different task demands remain elusive. Furthermore, the synaptic integration of different cortical signals, their modulation by transthalamic loops, and the effects of conduction delays remain challenging questions that must be tackled to understand the dynamical aspects of parietofrontal operations. In this article, we evaluate results from nonhuman primate and selected rodent experiments to offer a viewpoint on how corticocortical systems contribute to learning and producing skilled actions. Addressing this subject is not only of scientific interest but also essential for interpreting the devastating consequences for motor control of lesions at different nodes of this integrated circuit. In humans, the study of corticocortical motor networks is currently based on MRI-related methods, such as resting-state connectivity and diffusion tract-tracing, which both need to be contrasted with histological studies in nonhuman primates.

The development of synaptic transmission is time-locked to early social behaviors in rats

The development of functional synapses is a sequential process preserved across many brain areas. Here, we show that glutamatergic postsynaptic currents anticipated GABAergic currents in Layer II/III of the rat neocortex, in contrast to the pattern described for other brain areas. The frequencies of both glutamatergic and GABAergic currents increased abruptly at the beginning of the second postnatal week, supported by a serotonin upsurge. Integrative behaviors arose on postnatal day (P)9, while most motor and sensory behaviors, which are fundamental for pup survival, were already in place at approximately P7. A reduction in serotonin reuptake accelerated the development of functional synapses and integrative huddling behavior, while sparing motor and sensory function development. A decrease in synaptic transmission in Layer II/III induced by a chemogenetic approach only inhibited huddling. Thus, precise developmental sequences mediate early, socially directed behaviors for which neurotransmission and its modulation in supragranular cortical layers play key roles.

The development of functional synapses is a key milestone in neurodevelopment. Here, the authors show how serotonin signalling coordinates development of glutamatergic and GABAergic currents and triggers the emergence of integrative behavior (huddling) in rat pups.

Multisensory guided associative learning in healthy humans

Associative learning is a basic cognitive function by which discrete and often different percepts are linked together. The Rutgers Acquired Equivalence Test investigates a specific kind of associative learning, visually guided equivalence learning. The test consists of an acquisition (pair learning) and a test (rule transfer) phase, which are associated primarily with the function of the basal ganglia and the hippocampi, respectively. Earlier studies described that both fundamentally-involved brain structures in the visual associative learning, the basal ganglia and the hippocampi, receive not only visual but also multisensory information. However, no study has investigated whether there is a priority for multisensory guided equivalence learning compared to unimodal ones. Thus we had no data about the modality-dependence or independence of the equivalence learning. In the present study, we have therefore introduced the auditory- and multisensory (audiovisual)-guided equivalence learning paradigms and investigated the performance of 151 healthy volunteers in the visual as well as in the auditory and multisensory paradigms. Our results indicated that visual, auditory and multisensory guided associative learning is similarly effective in healthy humans, which suggest that the acquisition phase is fairly independent from the modality of the stimuli. On the other hand, in the test phase, where participants were presented with acquisitions that were learned earlier and associations that were until then not seen or heard but predictable, the multisensory stimuli elicited the best performance. The test phase, especially its generalization part, seems to be a harder cognitive task, where the multisensory information processing could improve the performance of the participants.

The circuit architecture of cortical multisensory processing: Distinct functions jointly operating within a common anatomical network

Our perceptual systems continuously process sensory inputs from different modalities and organize these streams of information such that our subjective representation of the outside world is a unified experience. By doing so, they also enable further cognitive processing and behavioral action. While cortical multisensory processing has been extensively investigated in terms of psychophysics and mesoscale neural correlates, an in depth understanding of the underlying circuit-level mechanisms is lacking. Previous studies on circuit-level mechanisms of multisensory processing have predominantly focused on cue integration, i.e. the mechanism by which sensory features from different modalities are combined to yield more reliable stimulus estimates than those obtained by using single sensory modalities. In this review, we expand the framework on the circuit-level mechanisms of cortical multisensory processing by highlighting that multisensory processing is a family of functions - rather than a single operation - which involves not only the integration but also the segregation of modalities. In addition, multisensory processing not only depends on stimulus features, but also on cognitive resources, such as attention and memory, as well as behavioral context, to determine the behavioral outcome. We focus on rodent models as a powerful instrument to study the circuit-level bases of multisensory processes, because they enable combining cell-type-specific recording and interventional techniques with complex behavioral paradigms. We conclude that distinct multisensory processes share overlapping anatomical substrates, are implemented by diverse neuronal micro-circuitries that operate in parallel, and are flexibly recruited based on factors such as stimulus features and behavioral constraints.

Auditory-induced response in the primary sensory cortex of rodents

The details of auditory response at the subthreshold level in the rodent primary somatosensory cortex, the barrel cortex, have not been studied extensively, although several phenomenological reports have been published. Multisensory features may act as neuronal representations of links between inputs from one sensory modality to other sensory modalities. Here, we examined the basic multisensory postsynaptic responses in the rodent barrel cortex using in vivo whole-cell recordings of neurons. We observed robust responses to acoustic stimuli in most barrel cortex neurons. Acoustically evoked responses were mediated by hearing and reached approximately 60% of the postsynaptic response amplitude elicited by strong somatosensory stimuli. Compared to tactile stimuli, auditory stimuli evoked postsynaptic potentials with a longer latency and longer duration. Specifically, auditory stimuli in barrel cortex neurons appeared to trigger "up states", episodes associated with membrane depolarization and increased synaptic activity. Taken together, our data suggest that barrel cortex neurons have multisensory properties, with distinct synaptic mechanisms underlying tactile and non-tactile responses.

Architecture and organization of mouse posterior parietal cortex relative to extrastriate areas

The posterior parietal cortex (PPC) is a multifaceted region of cortex, contributing to several cognitive processes, including sensorimotor integration and spatial navigation. Although recent years have seen a considerable rise in the use of rodents, particularly mice, to investigate PPC and related networks, a coherent anatomical definition of PPC in the mouse is still lacking. To address this, we delineated the mouse PPC, using cyto- and chemoarchitectural markers from Nissl-, parvalbumin-and muscarinic acetylcholine receptor M2-staining. Additionally, we performed bilateral triple anterograde tracer injections in primary visual cortex (V1) and prepared flattened tangential sections from one hemisphere and coronal sections from the other, allowing us to co-register the cytoarchitectural features of PPC with V1 projections. This revealed that extrastriate area A was largely contained within lateral PPC, that medial PPC overlapped with the anterior portion of area AM, and that anterior RL overlapped partially with area PtP. Furthermore, triple anterograde tracer injections in PPC showed strong projections to associative thalamic nuclei as well as higher visual areas, orbitofrontal, cingulate and secondary motor cortices. Retrograde circuit mapping with rabies virus further showed that all cortical connections were reciprocal. These combined approaches provide a coherent definition of mouse PPC that incorporates laminar architecture, extrastriate projections, thalamic, and cortico-cortical connections.

The mouse posterior parietal cortex: Anatomy and functions

In recent years, the number of studies on decision-making in mice has increased dramatically. Many of these studies focus on the posterior parietal cortex (PPC), an area that has been implicated in sensory and multisensory processing, navigation, motion planning, and decision-making. In this review we summarize recent anatomical and functional studies of mouse PPC. First, we make a note of the existing variability in the nomenclature and its anatomical localization. Based on the commonalities across different studies we then describe the connectivity of PPC and discuss its place within several functional brain networks. In view of the examined connectivity, we go on to discuss the role of PPC for the encoding of single-modality and multimodal stimuli as well as its role in navigation. Finally, we summarize the literature on the choice-related activity: we discuss the variety of behavioral protocols and sensory modalities used in these studies, and we note that the response properties of PPC and its causal involvement in decision-making may depend substantially on these conditions. We conclude that, although more research should be devoted to creating a more complete and consistent image of the mouse PPC, this area should rightfully be considered a convenient model system for a circuit-level understanding of the mammalian parietal cortex.

Integration of visual and whisker signals in rat superior colliculus

Multisensory integration is a process by which signals from different sensory modalities are combined to facilitate detection and localization of external events. One substrate for multisensory integration is the midbrain superior colliculus (SC) which plays an important role in orienting behavior. In rodent SC, visual and somatosensory (whisker) representations are in approximate registration, but whether and how these signals interact is unclear. We measured spiking activity in SC of anesthetized hooded rats, during presentation of visual- and whisker stimuli that were tested simultaneously or in isolation. Visual responses were found in all layers, but were primarily located in superficial layers. Whisker responsive sites were primarily found in intermediate layers. In single- and multi-unit recording sites, spiking activity was usually only sensitive to one modality, when stimuli were presented in isolation. By contrast, we observed robust and primarily suppressive interactions when stimuli were presented simultaneously to both modalities. We conclude that while visual and whisker representations in SC of rat are partially overlapping, there is limited excitatory convergence onto individual sites. Multimodal integration may instead rely on suppressive interactions between modalities.

Sensory Processing Across Conscious and Nonconscious Brain States: From Single Neurons to Distributed Networks for Inferential Representation

Neuronal activity is markedly different across brain states: it varies from desynchronized activity during wakefulness to the synchronous alternation between active and silent states characteristic of deep sleep. Surprisingly, limited attention has been paid to investigating how brain states affect sensory processing. While it was long assumed that the brain was mostly disconnected from external stimuli during sleep, an increasing number of studies indicates that sensory stimuli continue to be processed across all brain states-albeit differently. In this review article, we first discuss what constitutes a brain state. We argue that-next to global, behavioral states such as wakefulness and sleep-there is a concomitant need to distinguish bouts of oscillatory dynamics with specific global/local activity patterns and lasting for a few hundreds of milliseconds, as these can lead to the same sensory stimulus being either perceived or not. We define these short-lasting bouts as micro-states. We proceed to characterize how sensory-evoked neural responses vary between conscious and nonconscious states. We focus on two complementary aspects: neuronal ensembles and inter-areal communication. First, we review which features of ensemble activity are conducive to perception, and how these features vary across brain states. Properties such as heterogeneity, sparsity and synchronicity in neuronal ensembles will especially be considered as essential correlates of conscious processing. Second, we discuss how inter-areal communication varies across brain states and how this may affect brain operations and sensory processing. Finally, we discuss predictive coding (PC) and the concept of multi-level representations as a key framework for understanding conscious sensory processing. In this framework the brain implements conscious representations as inferences about world states across multiple representational levels. In this representational hierarchy, low-level inference may be carried out nonconsciously, whereas high levels integrate across different sensory modalities and larger spatial scales, correlating with conscious processing. This inferential framework is used to interpret several cellular and population-level findings in the context of brain states, and we briefly compare its implications to two other theories of consciousness. In conclusion, this review article, provides foundations to guide future studies aiming to uncover the mechanisms of sensory processing and perception across brain states.

Cortical signatures of wakeful somatosensory processing

Sensory inputs carry critical information for the survival of an organism. In mice, tactile information conveyed by the whiskers is of high behavioural relevance, and is broadcasted across cortical areas beyond the primary somatosensory cortex. Mesoscopic voltage sensitive dye imaging (VSDI) of cortical population response to whisker stimulations has shown that seemingly 'simple' sensory stimuli can have extended impact on cortical circuit dynamics. Here we took advantage of genetically encoded voltage indicators (GEVIs) that allow for cell type-specific monitoring of population voltage dynamics in a chronic dual-hemisphere transcranial windowed mouse preparation to directly compare the cortex-wide broadcasting of sensory information in wakening (lightly anesthetized to sedated) and awake mice. Somatosensory-evoked cortex-wide dynamics is altered across brain states, with anatomically sequential hyperpolarising activity observed in the awake cortex. GEVI imaging revealed cortical activity maps with increased specificity, high spatial coverage, and at the timescale of cortical information processing.

Auditory motion does not modulate spiking activity in the middle temporal and medial superior temporal visual areas

The integration of multiple sensory modalities is a key aspect of brain function, allowing animals to take advantage of concurrent sources of information to make more accurate perceptual judgments. For many years, multisensory integration in the cerebral cortex was deemed to occur only in high-level "polysensory" association areas. However, more recent studies have suggested that cross-modal stimulation can also influence neural activity in areas traditionally considered to be unimodal. In particular, several human neuroimaging studies have reported that extrastriate areas involved in visual motion perception are also activated by auditory motion, and may integrate audiovisual motion cues. However, the exact nature and extent of the effects of auditory motion on the visual cortex have not been studied at the single neuron level. We recorded the spiking activity of neurons in the middle temporal (MT) and medial superior temporal (MST) areas of anesthetized marmoset monkeys upon presentation of unimodal stimuli (moving auditory or visual patterns), as well as bimodal stimuli (concurrent audiovisual motion). Despite robust, direction selective responses to visual motion, none of the sampled neurons responded to auditory motion stimuli. Moreover, concurrent moving auditory stimuli had no significant effect on the ability of single MT and MST neurons, or populations of simultaneously recorded neurons, to discriminate the direction of motion of visual stimuli (moving random dot patterns with varying levels of motion noise). Our findings do not support the hypothesis that direct interactions between MT, MST and areas low in the hierarchy of auditory areas underlie audiovisual motion integration.

Multisensory enhancement of burst activity in an insect auditory neuron

Detecting predators is crucial for survival. In insects, a few sensory interneurons receiving sensory input from a distinct receptive organ extract specific features informing the animal about approaching predators and mediate avoidance behaviors. Although integration of multiple sensory cues relevant to the predator enhances sensitivity and precision, it has not been established whether the sensory interneurons that act as predator detectors integrate multiple modalities of sensory inputs elicited by predators. Using intracellular recording techniques, we found that the cricket auditory neuron AN2, which is sensitive to the ultrasound-like echolocation calls of bats, responds to airflow stimuli transduced by the cercal organ, a mechanoreceptor in the abdomen. AN2 enhanced spike outputs in response to cross-modal stimuli combining sound with airflow, and the linearity of the summation of multisensory integration depended on the magnitude of the evoked response. The enhanced AN2 activity contained bursts, triggering avoidance behavior. Moreover, cross-modal stimuli elicited larger and longer lasting excitatory postsynaptic potentials (EPSP) than unimodal stimuli, which would result from a sublinear summation of EPSPs evoked respectively by sound or airflow. The persistence of EPSPs was correlated with the occurrence and structure of burst activity. Our findings indicate that AN2 integrates bimodal signals and that multisensory integration rather than unimodal stimulation alone more reliably generates bursting activity. NEW & NOTEWORTHY Crickets detect ultrasound with their tympanum and airflow with their cercal organ and process them as alert signals of predators. These sensory signals are integrated by auditory neuron AN2 in the early stages of sensory processing. Multisensory inputs from different sensory channels enhanced excitatory postsynaptic potentials to facilitate burst firing, which could trigger avoidance steering in flying crickets. Our results highlight the cellular basis of multisensory integration in AN2 and possible effects on escape behavior.

Serotonergic Modulation of Sensory Representation in a Central Multisensory Circuit Is Pathway Specific

Many studies have explored how neuromodulators affect synaptic function, yet little is known about how they modify computations at the microcircuit level. In the dorsal cochlear nucleus (DCN), a region that integrates auditory and multisensory inputs from two distinct pathways, serotonin (5-HT) enhances excitability of principal cells, predicting a generalized reduction in sensory thresholds. Surprisingly, we found that when looked at from the circuit level, 5-HT enhances signaling only from the multisensory input, while decreasing input from auditory fibers. This effect is only partially explained by an action on auditory nerve terminals. Rather, 5-HT biases processing for one input pathway by simultaneously enhancing excitability in the principal cell and in a pathway-specific feed-forward inhibitory interneuron. Thus, by acting on multiple targets, 5-HT orchestrates a fundamental shift in representation of convergent auditory and multisensory pathways, enhancing the potency of non-auditory signals in a classical auditory pathway.

Bottom-up and top-down modulation of multisensory integration

Sensory perception in the real world requires proper integration of different modality inputs. Process of multisensory integration is not uniform. It varies from individual to individual and changes at different behavioral states of the animal. What factors affect multisensory integration? How does the mammalian brain reconstruct a multisensory world at different states? Here, we summarize recent findings on bottom-up and top-down factors that can modulate sensory processing and multisensory integration. We discuss cortical circuits that are responsible for modulation of multisensory processing based on recent rodent studies. We suggest that multisensory information is not a simple, fixed signal in the brain. Multisensory processing is dynamically modulated in the mammalian brain and leads to a unique and subjective experience of perception.

Sensory representation of an auditory cued tactile stimulus in the posterior parietal cortex of the mouse

Sensory association cortices receive diverse inputs with their role in representing and integrating multi-sensory content remaining unclear. Here we examined the neuronal correlates of an auditory-tactile stimulus sequence in the posterior parietal cortex (PPC) using 2-photon calcium imaging in awake mice. We find that neuronal subpopulations in layer 2/3 of PPC reliably represent texture-touch events, in addition to auditory cues that presage the incoming tactile stimulus. Notably, altering the flow of sensory events through omission of the cued texture touch elicited large responses in a subset of neurons hardly responsive to or even inhibited by the tactile stimuli. Hence, PPC neurons were able to discriminate not only tactile stimulus features (i.e., texture graininess) but also between the presence and omission of the texture stimulus. Whereas some of the neurons responsive to texture omission were driven by looming-like auditory sounds others became recruited only with tactile sensory experience. These findings indicate that layer 2/3 neuronal populations in PPC potentially encode correlates of expectancy in addition to auditory and tactile stimuli.

Diverse Long-Range Axonal Projections of Excitatory Layer 2/3 Neurons in Mouse Barrel Cortex

Excitatory projection neurons of the neocortex are thought to play important roles in perceptual and cognitive functions of the brain by directly connecting diverse cortical and subcortical areas. However, many aspects of the anatomical organization of these inter-areal connections are unknown. Here, we studied long-range axonal projections of excitatory layer 2/3 neurons with cell bodies located in mouse primary somatosensory barrel cortex (wS1). As a population, these neurons densely projected to secondary whisker somatosensory cortex (wS2) and primary/secondary whisker motor cortex (wM1/2), with additional axon in the dysgranular zone surrounding the barrel field, perirhinal temporal association cortex and striatum. In three-dimensional reconstructions of 6 individual wS2-projecting neurons and 9 individual wM1/2-projecting neurons, we found that both classes of neurons had extensive local axon in layers 2/3 and 5 of wS1. Neurons projecting to wS2 did not send axon to wM1/2, whereas a small subset of wM1/2-projecting neurons had relatively weak projections to wS2. A small fraction of projection neurons solely targeted wS2 or wM1/2. However, axon collaterals from wS2-projecting and wM1/2-projecting neurons were typically also found in subsets of various additional areas, including the dysgranular zone, perirhinal temporal association cortex and striatum. Our data suggest extensive diversity in the axonal targets selected by individual nearby cortical long-range projection neurons with somata located in layer 2/3 of wS1.

Cortical Lifelogging: The Posterior Parietal Cortex as Sensory History Buffer

To compare information and reach decisions effectively, our brain uses multiple heuristics, which can, however, induce biases in behavior. An elegant study by Akrami et al. (2018) finds evidence for one such heuristic in a sensory-based comparison task and identifies its location to the posterior parietal cortex.

Multisensory cortical processing and dysfunction across the neuropsychiatric spectrum

Sensory processing is affected in multiple neuropsychiatric disorders like schizophrenia and autism spectrum disorders. Genetic and environmental factors guide the formation and fine-tuning of brain circuitry necessary to receive, organize, and respond to sensory input in order to behave in a meaningful and consistent manner. During certain developmental stages the brain is sensitive to intrinsic and external factors. For example, disturbed expression levels of certain risk genes during critical neurodevelopmental periods may lead to exaggerated brain plasticity processes within the sensory circuits, and sensory stimulation immediately after birth contributes to fine-tuning of these circuits. Here, the neurodevelopmental trajectory of sensory circuit development will be described and related to some example risk gene mutations that are found in neuropsychiatric disorders. Subsequently, the flow of sensory information through these circuits and the relationship to synaptic plasticity will be described. Research focusing on the combined analyses of neural circuit development and functioning are necessary to expand our understanding of sensory processing and behavioral deficits that are relevant across the neuropsychiatric spectrum.

Supralinear and Supramodal Integration of Visual and Tactile Signals in Rats: Psychophysics and Neuronal Mechanisms

To better understand how object recognition can be triggered independently of the sensory channel through which information is acquired, we devised a task in which rats judged the orientation of a raised, black and white grating. They learned to recognize two categories of orientation: 0° ± 45° (“horizontal”) and 90° ± 45° (“vertical”). Each trial required a visual (V), a tactile (T), or a visual-tactile (VT) discrimination; VT performance was better than that predicted by optimal linear combination of V and T signals, indicating synergy between sensory channels. We examined posterior parietal cortex (PPC) and uncovered key neuronal correlates of the behavioral findings: PPC carried both graded information about object orientation and categorical information about the rat’s upcoming choice; single neurons exhibited identical responses under the three modality conditions. Finally, a linear classifier of neuronal population firing replicated the behavioral findings. Taken together, these findings suggest that PPC is involved in the supramodal processing of shape.

•

Rats combine vision and touch to distinguish two grating orientation categories

•

Performance with vision and touch together reveals synergy between the two channels

•

Posterior parietal cortex (PPC) neuronal responses are invariant to modality

•

PPC neurons carry information about object orientation and the rat’s categorization

Do the Different Sensory Areas Within the Cat Anterior Ectosylvian Sulcal Cortex Collectively Represent a Network Multisensory Hub?

Current theory supports that the numerous functional areas of the cerebral cortex are organized and function as a network. Using connectional databases and computational approaches, the cerebral network has been demonstrated to exhibit a hierarchical structure composed of areas, clusters and, ultimately, hubs. Hubs are highly connected, higher-order regions that also facilitate communication between different sensory modalities. One region computationally identified network hub is the visual area of the Anterior Ectosylvian Sulcal cortex (AESc) of the cat. The Anterior Ectosylvian Visual area (AEV) is but one component of the AESc that also includes the auditory (Field of the Anterior Ectosylvian Sulcus - FAES) and somatosensory (Fourth somatosensory representation - SIV). To better understand the nature of cortical network hubs, the present report reviews the biological features of the AESc. Within the AESc, each area has extensive external cortical connections as well as among one another. Each of these core representations is separated by a transition zone characterized by bimodal neurons that share sensory properties of both adjoining core areas. Finally, core and transition zones are underlain by a continuous sheet of layer 5 neurons that project to common output structures. Altogether, these shared properties suggest that the collective AESc region represents a multiple sensory/multisensory cortical network hub. Ultimately, such an interconnected, composite structure adds complexity and biological detail to the understanding of cortical network hubs and their function in cortical processing.

Functional Segregation and Development of Mouse Higher Visual Areas

Recent studies suggest that higher visual areas (HVAs) in the mouse visual cortex are segregated anatomically into two visual streams, likely analogous to the ventral and dorsal streams in primates. However, HVAs in mice have yet to be characterized functionally. Moreover, it is unknown when the functional segregation of HVAs occurs during development. Here, we investigated spatiotemporal selectivity of HVAs and their development using wide-field calcium imaging. We found that lateral HVAs in the anatomical ventral stream shared similar spatiotemporal selectivity, whereas the spatiotemporal selectivity of anterior and medial HVAs in the anatomical dorsal stream was not uniform and these areas were segregated functionally into multiple groups. This functional segregation of HVAs developed and reached an adult-like pattern ∼10 d after eye opening (EO). These results suggest, not only the functional segregation of ventral and dorsal streams, but also the presence of multiple substreams in the dorsal stream, and indicate that the functional segregation of visual streams occurs gradually after EO.SIGNIFICANCE STATEMENT Investigation of the spatiotemporal selectivity of nine higher visual areas (HVAs) in adult and developing mice revealed that lateral HVAs belonging to the putative ventral stream shared similar spatiotemporal selectivity, whereas the spatiotemporal selectivity of anterior and medial HVAs belonging to the putative dorsal stream was not uniform and these areas were segregated functionally into multiple groups. These results suggest the presence of multiple substreams within the putative dorsal stream for visuospatial processing. Furthermore, we found that initially immature functional segregation among HVAs developed to an adult-like pattern ∼10 d after eye opening. These results provide a foundation for using mouse HVAs as a model to understand parallel processing and its developmental mechanism.

Methodological Approach for Optogenetic Manipulation of Neonatal Neuronal Networks

Coordinated patterns of electrical activity are critical for the functional maturation of neuronal networks, yet their interrogation has proven difficult in the developing brain. Optogenetic manipulations strongly contributed to the mechanistic understanding of network activation in the adult brain, but difficulties to specifically and reliably express opsins at neonatal age hampered similar interrogation of developing circuits. Here, we introduce a protocol that enables to control the activity of specific neuronal populations by light, starting from early postnatal development. We show that brain area-, layer- and cell type-specific expression of opsins by in utero electroporation (IUE), as exemplified for the medial prefrontal cortex (PFC) and hippocampus (HP), permits the manipulation of neuronal activity in vitro and in vivo. Both individual and population responses to different patterns of light stimulation are monitored by extracellular multi-site recordings in the medial PFC of neonatal mice. The expression of opsins via IUE provides a flexible approach to disentangle the cellular mechanism underlying early rhythmic network activity, and to elucidate the role of early neuronal activity for brain maturation, as well as its contribution to neurodevelopmental disorders.

A Novel Multisensory Integration Task Reveals Robust Deficits in Rodent Models of Schizophrenia: Converging Evidence for Remediation via Nicotinic Receptor Stimulation of Inhibitory Transmission in the Prefrontal Cortex

Atypical multisensory integration is an understudied cognitive symptom in schizophrenia. Procedures to evaluate multisensory integration in rodent models are lacking. We developed a novel multisensory object oddity (MSO) task to assess multisensory integration in ketamine-treated rats, a well established model of schizophrenia. Ketamine-treated rats displayed a selective MSO task impairment with tactile-visual and olfactory-visual sensory combinations, whereas basic unisensory perception was unaffected. Orbitofrontal cortex (OFC) administration of nicotine or ABT-418, an α₄β₂ nicotinic acetylcholine receptor (nAChR) agonist, normalized MSO task performance in ketamine-treated rats and this effect was blocked by GABA_A receptor antagonism. GABAergic currents were also decreased in OFC of ketamine-treated rats and were normalized by activation of α₄β₂ nAChRs. Furthermore, parvalbumin (PV) immunoreactivity was decreased in the OFC of ketamine-treated rats. Accordingly, silencing of PV interneurons in OFC of PV-Cre mice using DREADDs (Designer Receptors Exclusively Activated by Designer Drugs) selectively impaired MSO task performance and this was reversed by ABT-418. Likewise, clozapine-N-oxide-induced inhibition of PV interneurons in brain slices was reversed by activation of α₄β₂ nAChRs. These findings strongly imply a role for prefrontal GABAergic transmission in the integration of multisensory object features, a cognitive process with relevance to schizophrenia. Accordingly, nAChR agonism, which improves various facets of cognition in schizophrenia, reversed the severe MSO task impairment in this study and appears to do so via a GABAergic mechanism. Interactions between GABAergic and nAChR receptor systems warrant further investigation for potential therapeutic applications. The novel behavioral procedure introduced in the current study is acutely sensitive to schizophrenia-relevant cognitive impairment and should prove highly valuable for such research.

SIGNIFICANCE STATEMENT

Adaptive behaviors are driven by integration of information from different sensory modalities. Multisensory integration is disrupted in patients with schizophrenia, but little is known about the neural basis of this cognitive symptom. Development and validation of multisensory integration tasks for animal models is essential given the strong link between functional outcome and cognitive impairment in schizophrenia. We present a novel multisensory object oddity procedure that detects selective multisensory integration deficits in a rat model of schizophrenia using various combinations of sensory modalities. Moreover, converging data are consistent with a nicotinic-GABAergic mechanism of multisensory integration in the prefrontal cortex, results with strong clinical relevance to the study of cognitive impairment and treatment in schizophrenia.

Spike-Based Functional Connectivity in Cerebral Cortex and Hippocampus: Loss of Global Connectivity Is Coupled to Preservation of Local Connectivity During Non-REM Sleep

Behavioral states are commonly considered global phenomena with homogeneous neural determinants. However, recent studies indicate that behavioral states modulate spiking activity with neuron-level specificity as a function of brain area, neuronal subtype, and preceding history. Although functional connectivity also strongly depends on behavioral state at a mesoscopic level and is globally weaker in non-REM (NREM) sleep and anesthesia than wakefulness, it is unknown how neuronal communication is modulated at the cellular level. We hypothesize that, as for neuronal activity, the influence of behavioral states on neuronal coupling strongly depends on type, location, and preceding history of involved neurons. Here, we applied nonlinear, information-theoretical measures of functional connectivity to ensemble recordings with single-cell resolution to quantify neuronal communication in the neocortex and hippocampus of rats during wakefulness and sleep. Although functional connectivity (measured in terms of coordination between firing rate fluctuations) was globally stronger in wakefulness than in NREM sleep (with distinct traits for cortical and hippocampal areas), the drop observed during NREM sleep was mainly determined by a loss of inter-areal connectivity between excitatory neurons. Conversely, local (intra-area) connectivity and long-range (inter-areal) coupling between interneurons were preserved during NREM sleep. Furthermore, neuronal networks that were either modulated or not by a behavioral task remained segregated during quiet wakefulness and NREM sleep. These results show that the drop in functional connectivity during wake-sleep transitions globally holds true at the cellular level, but confine this change mainly to long-range coupling between excitatory neurons.

SIGNIFICANCE STATEMENT

Studies performed at a mesoscopic level of analysis have shown that communication between cortical areas is disrupted in non-REM sleep and anesthesia. However, the neuronal determinants of this phenomenon are not known. Here, we applied nonlinear, information-theoretical measures of functional coupling to multi-area tetrode recordings from freely moving rats to investigate whether and how brain state modulates coordination between individual neurons. We found that the previously observed drop in functional connectivity during non-REM (NREM) sleep can be explained by a decrease in coupling between excitatory neurons located in distinct brain areas. Conversely, intra-area communication and coupling between interneurons are preserved. Our results provide significant new insights into the neuron-level mechanisms responsible for the loss of consciousness occurring in NREM sleep.

Mesoscale Mapping of Mouse Cortex Reveals Frequency-Dependent Cycling between Distinct Macroscale Functional Modules

Connectivity mapping based on resting-state activity in mice has revealed functional motifs of correlated activity. However, the rules by which motifs organize into larger functional modules that lead to hemisphere wide spatial-temporal activity sequences is not clear. We explore cortical activity parcellation in head-fixed, quiet awake GCaMP6 mice from both sexes by using mesoscopic calcium imaging. Spectral decomposition of spontaneous cortical activity revealed the presence of two dominant frequency modes (<1 and ∼3 Hz), each of them associated with a unique spatial signature of cortical macro-parcellation not predicted by classical cytoarchitectonic definitions of cortical areas. Based on assessment of 0.1-1 Hz activity, we define two macro-organizing principles: the first being a rotating polymodal-association pinwheel structure around which activity flows sequentially from visual to barrel then to hindlimb somatosensory; the second principle is correlated activity symmetry planes that exist on many levels within a single domain such as intrahemispheric reflections of sensory and motor cortices. In contrast, higher frequency activity >1 Hz yielded two larger clusters of coactivated areas with an enlarged default mode network-like posterior region. We suggest that the apparent constrained structure for intra-areal cortical activity flow could be exploited in future efforts to normalize activity in diseases of the nervous system.SIGNIFICANCE STATEMENT Increasingly, functional connectivity mapping of spontaneous activity is being used to reveal the organization of the brain. However, because the brain operates across multiple space and time domains a more detailed understanding of this organization is necessary. We used in vivo wide-field calcium imaging of the indicator GCaMP6 in head-fixed, awake mice to characterize the organization of spontaneous cortical activity at different spatiotemporal scales. Correlation analysis defines the presence of two to three superclusters of activity that span traditionally defined functional territories and were frequency dependent. This work helps define the rules for how different cortical areas interact in time and space. We provide a framework necessary for future studies that explore functional reorganization of brain circuits in disease models.

The posterior parietal cortex as integrative hub for whisker sensorimotor information

Our daily life consists of a continuous interplay between incoming sensory information and outgoing motor plans. Particularly during goal-directed behavior and active exploration of the sensory environment, brain circuits are merging sensory and motor signals. This is referred to as sensorimotor integration and is relevant for locomotion, vision or tactile exploration. The somatosensory (tactile) system is an attractive modality to study sensorimotor integration in health and disease, motivated by the need for revolutionary technology that builds upon conceptual understanding of sensorimotor integration, such as brain-machine-interfaces and neuro-prosthetics. In this perspective, we focus on the rat whisker system and put forward the posterior parietal cortex as a potential circuit where sensorimotor integration could occur during active somatosensation.

An autism-associated serotonin transporter variant disrupts multisensory processing

Altered sensory processing is observed in many children with autism spectrum disorder (ASD), with growing evidence that these impairments extend to the integration of information across the different senses (that is, multisensory function). The serotonin system has an important role in sensory development and function, and alterations of serotonergic signaling have been suggested to have a role in ASD. A gain-of-function coding variant in the serotonin transporter (SERT) associates with sensory aversion in humans, and when expressed in mice produces traits associated with ASD, including disruptions in social and communicative function and repetitive behaviors. The current study set out to test whether these mice also exhibit changes in multisensory function when compared with wild-type (WT) animals on the same genetic background. Mice were trained to respond to auditory and visual stimuli independently before being tested under visual, auditory and paired audiovisual (multisensory) conditions. WT mice exhibited significant gains in response accuracy under audiovisual conditions. In contrast, although the SERT mutant animals learned the auditory and visual tasks comparably to WT littermates, they failed to show behavioral gains under multisensory conditions. We believe these results provide the first behavioral evidence of multisensory deficits in a genetic mouse model related to ASD and implicate the serotonin system in multisensory processing and in the multisensory changes seen in ASD.

Segregated fronto-cortical and midbrain connections in the mouse and their relation to approach and avoidance orienting behaviors

The orchestration of orienting behaviors requires the interaction of many cortical and subcortical areas, for example the superior colliculus (SC), as well as prefrontal areas responsible for top–down control. Orienting involves different behaviors, such as approach and avoidance. In the rat, these behaviors are at least partially mapped onto different SC subdomains, the lateral (SCl) and medial (SCm), respectively. To delineate the circuitry involved in the two types of orienting behavior in mice, we injected retrograde tracer into the intermediate and deep layers of the SCm and SCl, and thereby determined the main input structures to these subdomains. Overall the SCm receives larger numbers of afferents compared to the SCl. The prefrontal cingulate area (Cg), visual, oculomotor, and auditory areas provide strong input to the SCm, while prefrontal motor area 2 (M2), and somatosensory areas provide strong input to the SCl. The prefrontal areas Cg and M2 in turn connect to different cortical and subcortical areas, as determined by anterograde tract tracing. Even though connectivity pattern often overlap, our labeling approaches identified segregated neural circuits involving SCm, Cg, secondary visual cortices, auditory areas, and the dysgranular retrospenial cortex likely to be involved in avoidance behaviors. Conversely, SCl, M2, somatosensory cortex, and the granular retrospenial cortex comprise a network likely involved in approach/appetitive behaviors.

Rate and Temporal Coding Convey Multisensory Information in Primary Sensory Cortices

Optimal behavior and survival result from integration of information across sensory systems. Modulation of network activity at the level of primary sensory cortices has been identified as a mechanism of cross-modal integration, yet its cellular substrate is still poorly understood. Here, we uncover the mechanisms by which individual neurons in primary somatosensory (S1) and visual (V1) cortices encode visual-tactile stimuli. For this, simultaneous extracellular recordings were performed from all layers of the S1 barrel field and V1 in Brown Norway rats in vivo and units were clustered and assigned to pyramidal neurons (PYRs) and interneurons (INs). We show that visual-tactile stimulation modulates the firing rate of a relatively low fraction of neurons throughout all cortical layers. Generally, it augments the firing of INs and decreases the activity of PYRs. Moreover, bimodal stimulation shapes the timing of neuronal firing by strengthening the phase-coupling between neuronal discharge and theta–beta band network oscillations as well as by modulating spiking onset. Sparse direct axonal projections between neurons in S1 and V1 seem to time the spike trains between the two cortical areas and, thus, may act as a substrate of cross-modal modulation. These results indicate that few cortical neurons mediate multisensory effects in primary sensory areas by directly encoding cross-modal information by their rate and timing of firing.

Layer-specific optogenetic activation of pyramidal neurons causes beta-gamma entrainment of neonatal networks

Coordinated activity patterns in the developing brain may contribute to the wiring of neuronal circuits underlying future behavioural requirements. However, causal evidence for this hypothesis has been difficult to obtain owing to the absence of tools for selective manipulation of oscillations during early development. We established a protocol that combines optogenetics with electrophysiological recordings from neonatal mice in vivo to elucidate the substrate of early network oscillations in the prefrontal cortex. We show that light-induced activation of layer II/III pyramidal neurons that are transfected by in utero electroporation with a high-efficiency channelrhodopsin drives frequency-specific spiking and boosts network oscillations within beta–gamma frequency range. By contrast, activation of layer V/VI pyramidal neurons causes nonspecific network activation. Thus, entrainment of neonatal prefrontal networks in fast rhythms relies on the activation of layer II/III pyramidal neurons. This approach used here may be useful for further interrogation of developing circuits, and their behavioural readout.

Oscillations in cortical activity during development are important for functional maturation. Here, the authors use optogenetics in neonatal mice to determine a causal role for pyramidal cell firing in different prelimbic cortex layers in generating beta–gamma range activity.

Auditory-visual integration in fields of the auditory cortex

While multimodal interactions have been known to exist in the early sensory cortices, the response properties and spatiotemporal organization of these interactions are poorly understood. To elucidate the characteristics of multimodal sensory interactions in the cerebral cortex, neuronal responses to visual stimuli with or without auditory stimuli were investigated in core and belt fields of guinea pig auditory cortex using real-time optical imaging with a voltage-sensitive dye. On average, visual responses consisted of short excitation followed by long inhibition. Although visual responses were observed in core and belt fields, there were regional and temporal differences in responses. The most salient visual responses were observed in the caudal belt fields, especially posterior (P) and dorsocaudal belt (DCB) fields. Visual responses emerged first in fields P and DCB and then spread rostroventrally to core and ventrocaudal belt (VCB) fields. Absolute values of positive and negative peak amplitudes of visual responses were both larger in fields P and DCB than in core and VCB fields. When combined visual and auditory stimuli were applied, fields P and DCB were more inhibited than core and VCB fields beginning approximately 110 ms after stimuli. Correspondingly, differences between responses to auditory stimuli alone and combined audiovisual stimuli became larger in fields P and DCB than in core and VCB fields after approximately 110 ms after stimuli. These data indicate that visual influences are most salient in fields P and DCB, which manifest mainly as inhibition, and that they enhance differences in auditory responses among fields.

An extended retinotopic map of mouse cortex

Visual perception and behavior are mediated by cortical areas that have been distinguished using architectonic and retinotopic criteria. We employed fluorescence imaging and GCaMP6 reporter mice to generate retinotopic maps, revealing additional regions of retinotopic organization that extend into barrel and retrosplenial cortices. Aligning retinotopic maps to architectonic borders, we found a mismatch in border location, indicating that architectonic borders are not aligned with the retinotopic transition at the vertical meridian. We also assessed the representation of visual space within each region, finding that four visual areas bordering V1 (LM, P, PM and RL) display complementary representations, with overlap primarily at the central hemifield. Our results extend our understanding of the organization of mouse cortex to include up to 16 distinct retinotopically organized regions.

Behavioural benefits of multisensory processing in ferrets

Enhanced detection and discrimination, along with faster reaction times, are the most typical behavioural manifestations of the brain's capacity to integrate multisensory signals arising from the same object. In this study, we examined whether multisensory behavioural gains are observable across different components of the localization response that are potentially under the command of distinct brain regions. We measured the ability of ferrets to localize unisensory (auditory or visual) and spatiotemporally coincident auditory-visual stimuli of different durations that were presented from one of seven locations spanning the frontal hemifield. During the localization task, we recorded the head movements made following stimulus presentation, as a metric for assessing the initial orienting response of the ferrets, as well as the subsequent choice of which target location to approach to receive a reward. Head-orienting responses to auditory-visual stimuli were more accurate and faster than those made to visual but not auditory targets, suggesting that these movements were guided principally by sound alone. In contrast, approach-to-target localization responses were more accurate and faster to spatially congruent auditory-visual stimuli throughout the frontal hemifield than to either visual or auditory stimuli alone. Race model inequality analysis of head-orienting reaction times and approach-to-target response times indicates that different processes, probability summation and neural integration, respectively, are likely to be responsible for the effects of multisensory stimulation on these two measures of localization behaviour.

Automated identification of mouse visual areas with intrinsic signal imaging

Intrinsic signal optical imaging (ISI) is a rapid and noninvasive method for observing brain activity in vivo over a large area of the cortex. Here we describe our protocol for mapping retinotopy to identify mouse visual cortical areas using ISI. First, surgery is performed to attach a head frame to the mouse skull (∼1 h). The next day, intrinsic activity across the visual cortex is recorded during the presentation of a full-field drifting bar in the horizontal and vertical directions (∼2 h). Horizontal and vertical retinotopic maps are generated by analyzing the response of each pixel during the period of the stimulus. Last, an algorithm uses these retinotopic maps to compute the visual field sign and coverage, and automatically construct visual borders without human input. Compared with conventional retinotopic mapping with episodic presentation of adjacent stimuli, a continuous, periodic stimulus is more resistant to biological artifacts. Furthermore, unlike manual hand-drawn approaches, we present a method for automatically segmenting visual areas, even in the small mouse cortex. This relatively simple procedure and accompanying open-source code can be implemented with minimal surgical and computational experience, and is useful to any laboratory wishing to target visual cortical areas in this increasingly valuable model system.

The neurogenesis of P1 and N1: A concurrent EEG/LFP study

It is generally recognised that event related potentials (ERPs) of electroencephalogram (EEG) primarily reflect summed post-synaptic activity of the local pyramidal neural population(s). However, it is still not understood how the positive and negative deflections (e.g. P1, N1 etc) observed in ERP recordings are related to the underlying excitatory and inhibitory post-synaptic activity. We investigated the neurogenesis of P1 and N1 in ERPs by pharmacologically manipulating inhibitory post-synaptic activity in the somatosensory cortex of rodent, and concurrently recording EEG and local field potentials (LFPs). We found that the P1 wave in the ERP and LFP of the supragranular layers is determined solely by the excitatory post-synaptic activity of the local pyramidal neural population, as is the initial segment of the N1 wave across cortical depth. The later part of the N1 wave was modulated by inhibitory post-synaptic activity, with its peak and the pulse width increasing as inhibition was reduced. These findings suggest that the temporal delay of inhibition with respect to excitation observed in intracellular recordings is also reflected in extracellular field potentials (FPs), resulting in a temporal window during which only excitatory post-synaptic activity and leak channel activity are recorded in the ERP and evoked LFP time series. Based on these findings, we provide clarification on the interpretation of P1 and N1 in terms of the excitatory and inhibitory post-synaptic activities of the local pyramidal neural population(s).

Convergence of visual and whisker responses in the primary somatosensory thalamus (ventral posterior medial region) of the mouse

Key points

Using in vivo electrophysiology, we find that a subset of whisker‐responsive neurons in the ventral posterior medial region (VPM) respond to visual stimuli.

These light‐responsive neurons in the VPM are particularly sensitive to optic flow.

Presentation of optic flow stimuli modulates the amplitude of concurrent whisker responses.

Visual information reaches the VPM via a circuit encompassing the visual cortex.

These data represent a new example of cross‐modal integration in the primary sensory thalamus.

Abstract

Sensory signals reach the cortex via sense‐specific thalamic nuclei. Here we report that neurons in the primary sensory thalamus of the mouse vibrissal system (the ventral posterior medial region; VPM) can be excited by visual as well as whisker stimuli. Using extracellular electrophysiological recordings from anaesthetized mice we first show that simple light steps can excite a subset of VPM neurons. We then test the ability of the VPM to respond to spatial patterns and show that many units are excited by visual motion in a direction‐selective manner. Coherent movement of multiple objects (an artificial recreation of ‘optic flow’ that would usually occur during head rotations or body movements) best engages this visual motion response. We next show that, when co‐applied with visual stimuli, the magnitude of responses to whisker deflections is highest in the presence of optic flow going in the opposite direction. Importantly, whisker response amplitude is also modulated by presentation of a movie recreating the mouse's visual experience during natural exploratory behaviour. We finally present functional and anatomical data indicating a functional connection (probably multisynaptic) from the primary visual cortex to VPM. These data provide a rare example of multisensory integration occurring at the level of the sensory thalamus, and provide evidence for dynamic regulation of whisker responses according to visual experience.

Using in vivo electrophysiology, we find that a subset of whisker‐responsive neurons in the ventral posterior medial region (VPM) respond to visual stimuli.

These light‐responsive neurons in the VPM are particularly sensitive to optic flow.

Presentation of optic flow stimuli modulates the amplitude of concurrent whisker responses.

Visual information reaches the VPM via a circuit encompassing the visual cortex.

These data represent a new example of cross‐modal integration in the primary sensory thalamus.

Associative learning changes cross-modal representations in the gustatory cortex

A growing body of literature has demonstrated that primary sensory cortices are not exclusively unimodal, but can respond to stimuli of different sensory modalities. However, several questions concerning the neural representation of cross-modal stimuli remain open. Indeed, it is poorly understood if cross-modal stimuli evoke unique or overlapping representations in a primary sensory cortex and whether learning can modulate these representations. Here we recorded single unit responses to auditory, visual, somatosensory, and olfactory stimuli in the gustatory cortex (GC) of alert rats before and after associative learning. We found that, in untrained rats, the majority of GC neurons were modulated by a single modality. Upon learning, both prevalence of cross-modal responsive neurons and their breadth of tuning increased, leading to a greater overlap of representations. Altogether, our results show that the gustatory cortex represents cross-modal stimuli according to their sensory identity, and that learning changes the overlap of cross-modal representations.

DOI:http://dx.doi.org/10.7554/eLife.16420.001

Imagine that you are waiting for a cappuccino at your favorite café. You hear the sound of the steamer, and shortly afterwards the barista calls your name and announces that your cappuccino is ready. As they hand it to you, you see the foam sprinkled with cocoa and the aroma of the cappuccino reaches your nose. You can almost taste it. When you finally take your first sip, the taste is hardly a surprise; it is just as your eyes and nose predicted.

How does the brain deal with such a rich and multisensory experience? How does it learn to associate the sight and smell of a cappuccino with its taste? Specialized regions of the brain called associative areas were traditionally thought to perform this task. These areas receive inputs from every sensory system and can link information from these different sources together. According to this view, the job of each individual sensory system is to pass along information relevant to one particular sense.

More recent results, however, challenge this strict division of labor and suggest that individual sensory systems may be able to combine information from multiple senses. Thus the sights, sounds and odors associated with our cappuccino may also activate the area of the brain in charge of processing taste: the gustatory cortex. To investigate this possibility, Vincis and Fontanini set out to determine whether neurons in the gustatory cortex of rats can process stimuli belonging to senses other than taste.

As predicted, neurons in the gustatory cortex did change their firing rates in response to odors, touch, sounds and light. However, more of the gustatory neurons responded to odors and touch than to sounds and light. In addition, of the four stimuli, the rats most easily learned to associate odors and touch with a sugary solution. This is consistent with the fact that rodents rely more upon their whiskers and their sense of smell to find food they do their eyes and ears. Finally, learning to associate a stimulus other than taste with a sugary solution increased the number of neurons in the gustatory cortex that subsequently responded to other senses and changed their response properties.

Further studies are now required to answer three questions. Why can some senses more effectively influence the activity of the gustatory cortex than others? Can gustatory neurons distinguish between different stimuli of the same type – different odors, for example? What are the neural pathways that convey multisensory information to the gustatory cortex? Answering these questions will help us to better understand how sensory systems link information from multiple senses.

DOI:http://dx.doi.org/10.7554/eLife.16420.002

Dissecting neural circuits for multisensory integration and crossmodal processing

We rely on rich and complex sensory information to perceive and understand our environment. Our multisensory experience of the world depends on the brain's remarkable ability to combine signals across sensory systems. Behavioural, neurophysiological and neuroimaging experiments have established principles of multisensory integration and candidate neural mechanisms. Here we review how targeted manipulation of neural activity using invasive and non-invasive neuromodulation techniques have advanced our understanding of multisensory processing. Neuromodulation studies have provided detailed characterizations of brain networks causally involved in multisensory integration. Despite substantial progress, important questions regarding multisensory networks remain unanswered. Critically, experimental approaches will need to be combined with theory in order to understand how distributed activity across multisensory networks collectively supports perception.

Large-scale imaging of cortical dynamics during sensory perception and behavior

Sensory-driven behaviors engage a cascade of cortical regions to process sensory input and generate motor output. To investigate the temporal dynamics of neural activity at this global scale, we have improved and integrated tools to perform functional imaging across large areas of cortex using a transgenic mouse expressing the genetically encoded calcium sensor GCaMP6s, together with a head-fixed visual discrimination behavior. This technique allows imaging of activity across the dorsal surface of cortex, with spatial resolution adequate to detect differential activity in local regions at least as small as 100 μm. Imaging during an orientation discrimination task reveals a progression of activity in different cortical regions associated with different phases of the task. After cortex-wide patterns of activity are determined, we demonstrate the ability to select a region that displayed conspicuous responses for two-photon microscopy and find that activity in populations of individual neurons in that region correlates with locomotion in trained mice. We expect that this paradigm will be a useful probe of information flow and network processing in brain-wide circuits involved in many sensory and cognitive processes.