Cellular and synaptic architecture of multisensory integration in the mouse neocortex

Rule-based modulation of a sensorimotor transformation across cortical areas

Flexible responses to sensory stimuli based on changing rules are critical for adapting to a dynamic environment. However, it remains unclear how the brain encodes and uses rule information to guide behavior. Here, we made single-unit recordings while head-fixed mice performed a cross-modal sensory selection task where they switched between two rules: licking in response to tactile stimuli while rejecting visual stimuli, or vice versa. Along a cortical sensorimotor processing stream including the primary (S1) and secondary (S2) somatosensory areas, and the medial (MM) and anterolateral (ALM) motor areas, single-neuron activity distinguished between the two rules both prior to and in response to the tactile stimulus. We hypothesized that neural populations in these areas would show rule-dependent preparatory states, which would shape the subsequent sensory processing and behavior. This hypothesis was supported for the motor cortical areas (MM and ALM) by findings that (1) the current task rule could be decoded from pre-stimulus population activity; (2) neural subspaces containing the population activity differed between the two rules; and (3) optogenetic disruption of pre-stimulus states impaired task performance. Our findings indicate that flexible action selection in response to sensory input can occur via configuration of preparatory states in the motor cortex.

Cortical cellular encoding of thermotactile integration

Recent evidence suggests that primary sensory cortical regions play a role in the integration of information from multiple sensory modalities. How primary cortical neurons integrate different sources of sensory information is unclear, partly because non-primary sensory input to a cortical sensory region is often weak or modulatory. To address this question, we take advantage of the robust representation of thermal (cooling) and tactile stimuli in mouse forelimb primary somatosensory cortex (fS1). Using a thermotactile detection task, we show that the perception of threshold-level cool or tactile information is enhanced when they are presented simultaneously, compared with presentation alone. To investigate the cortical cellular correlates of thermotactile integration, we performed in vivo extracellular recordings from fS1 in awake resting and anesthetized mice during unimodal and bimodal stimulation of the forepaw. Unimodal stimulation evoked thermal- or tactile- specific excitatory and inhibitory responses of fS1 neurons. The most prominent features of combined thermotactile stimulation are the recruitment of unimodally silent fS1 neurons, non-linear integration features, and response dynamics that favor longer response durations with additional spikes. Together, we identify quantitative and qualitative changes in cortical encoding that may underlie the improvement in perception of thermotactile surfaces during haptic exploration.

A primary sensory cortical interareal feedforward inhibitory circuit for tacto-visual integration

Tactile sensation and vision are often both utilized for the exploration of objects that are within reach though it is not known whether or how these two distinct sensory systems combine such information. Here in mice, we used a combination of stereo photogrammetry for 3D reconstruction of the whisker array, brain-wide anatomical tracing and functional connectivity analysis to explore the possibility of tacto-visual convergence in sensory space and within the circuitry of the primary visual cortex (VISp). Strikingly, we find that stimulation of the contralateral whisker array suppresses visually evoked activity in a tacto-visual sub-region of VISp whose visual space representation closely overlaps with the whisker search space. This suppression is mediated by local fast-spiking interneurons that receive a direct cortico-cortical input predominantly from layer 6 neurons located in the posterior primary somatosensory barrel cortex (SSp-bfd). These data demonstrate functional convergence within and between two primary sensory cortical areas for multisensory object detection and recognition.

Separation of bimodal fMRI responses in mouse somatosensory areas into V1 and non-V1 contributions

Multisensory integration is necessary for the animal to survive in the real world. While conventional methods have been extensively used to investigate the multisensory integration process in various brain areas, its long-range interactions remain less explored. In this study, our goal was to investigate interactions between visual and somatosensory networks on a whole-brain scale using 15.2-T BOLD fMRI. We compared unimodal to bimodal BOLD fMRI responses and dissected potential cross-modal pathways with silencing of primary visual cortex (V1) by optogenetic stimulation of local GABAergic neurons. Our data showed that the influence of visual stimulus on whisker activity is higher than the influence of whisker stimulus on visual activity. Optogenetic silencing of V1 revealed that visual information is conveyed to whisker processing via both V1 and non-V1 pathways. The first-order ventral posteromedial thalamic nucleus (VPM) was functionally affected by non-V1 sources, while the higher-order posterior medial thalamic nucleus (POm) was predominantly modulated by V1 but not non-V1 inputs. The primary somatosensory barrel field (S1BF) was influenced by both V1 and non-V1 inputs. These observations provide valuable insights for into the integration of whisker and visual sensory information.

Rule-based modulation of a sensorimotor transformation across cortical areas

Flexible responses to sensory stimuli based on changing rules are critical for adapting to a dynamic environment. However, it remains unclear how the brain encodes rule information and uses this information to guide behavioral responses to sensory stimuli. Here, we made single-unit recordings while head-fixed mice performed a cross-modal sensory selection task in which they switched between two rules in different blocks of trials: licking in response to tactile stimuli applied to a whisker while rejecting visual stimuli, or licking to visual stimuli while rejecting the tactile stimuli. Along a cortical sensorimotor processing stream including the primary (S1) and secondary (S2) somatosensory areas, and the medial (MM) and anterolateral (ALM) motor areas, the single-trial activity of individual neurons distinguished between the two rules both prior to and in response to the tactile stimulus. Variable rule-dependent responses to identical stimuli could in principle occur via appropriate configuration of pre-stimulus preparatory states of a neural population, which would shape the subsequent response. We hypothesized that neural populations in S1, S2, MM and ALM would show preparatory activity states that were set in a rule-dependent manner to cause processing of sensory information according to the current rule. This hypothesis was supported for the motor cortical areas by findings that (1) the current task rule could be decoded from pre-stimulus population activity in ALM and MM; (2) neural subspaces containing the population activity differed between the two rules; and (3) optogenetic disruption of pre-stimulus states within ALM and MM impaired task performance. Our findings indicate that flexible selection of an appropriate action in response to a sensory input can occur via configuration of preparatory states in the motor cortex.

Behavior-relevant top-down cross-modal predictions in mouse neocortex

Animals adapt to a constantly changing world by predicting their environment and the consequences of their actions. The predictive coding hypothesis proposes that the brain generates predictions and continuously compares them with sensory inputs to guide behavior. However, how the brain reconciles conflicting top-down predictions and bottom-up sensory information remains unclear. To address this question, we simultaneously imaged neuronal populations in the mouse somatosensory barrel cortex and posterior parietal cortex during an auditory-cued texture discrimination task. In mice that had learned the task with fixed tone-texture matching, the presentation of mismatched pairing induced conflicts between tone-based texture predictions and actual texture inputs. When decisions were based on the predicted rather than the actual texture, top-down information flow was dominant and texture representations in both areas were modified, whereas dominant bottom-up information flow led to correct representations and behavioral choice. Our findings provide evidence for hierarchical predictive coding in the mouse neocortex.

The Development of Multisensory Integration at the Neuronal Level

Multisensory integration is a fundamental function of the brain. In the typical adult, multisensory neurons' response to paired multisensory (e.g., audiovisual) cues is significantly more robust than the corresponding best unisensory response in many brain regions. Synthesizing sensory signals from multiple modalities can speed up sensory processing and improve the salience of outside events or objects. Despite its significance, multisensory integration is testified to be not a neonatal feature of the brain. Neurons' ability to effectively combine multisensory information does not occur rapidly but develops gradually during early postnatal life (for cats, 4-12 weeks required). Multisensory experience is critical for this developing process. If animals were restricted from sensing normal visual scenes or sounds (deprived of the relevant multisensory experience), the development of the corresponding integrative ability could be blocked until the appropriate multisensory experience is obtained. This section summarizes the extant literature on the development of multisensory integration (mainly using cat superior colliculus as a model), sensory-deprivation-induced cross-modal plasticity, and how sensory experience (sensory exposure and perceptual learning) leads to the plastic change and modification of neural circuits in cortical and subcortical areas.

Truly pattern: Nonlinear integration of motion signals is required to account for the responses of pattern cells in rat visual cortex

A key feature of advanced motion processing in the primate dorsal stream is the existence of pattern cells-specialized cortical neurons that integrate local motion signals into pattern-invariant representations of global direction. Pattern cells have also been reported in rodent visual cortex, but it is unknown whether the tuning of these neurons results from truly integrative, nonlinear mechanisms or trivially arises from linear receptive fields (RFs) with a peculiar geometry. Here, we show that pattern cells in rat primary (V1) and lateromedial (LM) visual cortex process motion direction in a way that cannot be explained by the linear spatiotemporal structure of their RFs. Instead, their tuning properties are consistent with and well explained by those of units in a state-of-the-art neural network model of the dorsal stream. This suggests that similar cortical processes underlay motion representation in primates and rodents. The latter could thus serve as powerful model systems to unravel the underlying circuit-level mechanisms.

Representations of tactile object location in the retrosplenial cortex

How animals use tactile sensation to detect important objects and remember their location in a world-based coordinate system is unclear. Here, we hypothesized that the retrosplenial cortex (RSC), a key network for contextual memory and spatial navigation, represents the location of objects based on tactile sensation. We studied mice palpating objects with their whiskers while navigating in a tactile virtual reality in darkness. Using two-photon Ca2+ imaging, we discovered that a population of neurons in the agranular RSC signal the location of objects. Responses to objects do not simply reflect the sensory stimulus. Instead, they are highly position, task, and context dependent and often predict the upcoming object before it is within reach. In addition, a large fraction of neurons encoding object location maintain a memory trace of the object's location. These data show that the RSC encodes the location and arrangement of tactile objects in a spatial reference frame.

Emerging computational motifs: Lessons from the retina

The retinal neuronal circuit is the first stage of visual processing in the central nervous system. The efforts of scientists over the last few decades indicate that the retina is not merely an array of photosensitive cells, but also a processor that performs various computations. Within a thickness of only ∼200 µm, the retina consists of diverse forms of neuronal circuits, each of which encodes different visual features. Since the discovery of direction-selective cells by Horace Barlow and Richard Hill, the mechanisms that generate direction selectivity in the retina have remained a fascinating research topic. This review provides an overview of recent advances in our understanding of direction-selectivity circuits. Beyond the conventional wisdom of direction selectivity, emerging findings indicate that the retina utilizes complicated and sophisticated mechanisms in which excitatory and inhibitory pathways are involved in the efficient encoding of motion information. As will become evident, the discovery of computational motifs in the retina facilitates an understanding of how sensory systems establish feature selectivity.

How 'visual' is the visual cortex? The interactions between the visual cortex and other sensory, motivational and motor systems as enabling factors for visual perception

The definition of the visual cortex is primarily based on the evidence that lesions of this area impair visual perception. However, this does not exclude that the visual cortex may process more information than of retinal origin alone, or that other brain structures contribute to vision. Indeed, research across the past decades has shown that non-visual information, such as neural activity related to reward expectation and value, locomotion, working memory and other sensory modalities, can modulate primary visual cortical responses to retinal inputs. Nevertheless, the function of this non-visual information is poorly understood. Here we review recent evidence, coming primarily from studies in rodents, arguing that non-visual and motor effects in visual cortex play a role in visual processing itself, for instance disentangling direct auditory effects on visual cortex from effects of sound-evoked orofacial movement. These findings are placed in a broader framework casting vision in terms of predictive processing under control of frontal, reward- and motor-related systems. In contrast to the prevalent notion that vision is exclusively constructed by the visual cortical system, we propose that visual percepts are generated by a larger network-the extended visual system-spanning other sensory cortices, supramodal areas and frontal systems. This article is part of the theme issue 'Decision and control processes in multisensory perception'.

Robust multisensory deviance detection in the mouse parietal associative area

Context modulates how information is processed in the mammalian brain. For example, brain responses are amplified to contextually unusual stimuli. This phenomenon, known as "deviance detection,"1,2 is well documented in early, primary sensory cortex, where large responses are generated to simple stimuli that deviate from their context in low-order properties, such as line orientation, size, or pitch.2,3,4,5 However, the extent to which neural deviance detection manifests (1) in broader cortical networks and (2) to simple versus complex stimuli, which deviate only in their higher-order, multisensory properties, is not known. Consistent with a predictive processing framework,6,7 we hypothesized that deviance detection manifests in a hierarchical manner across cortical networks,8,9 emerging later and further downstream when stimulus deviance is complex. To test this, we examined brain responses of awake mice to simple unisensory deviants (e.g., visual line gratings, deviating from context in their orientation alone) versus complex multisensory deviants (i.e., audiovisual pairs, deviating from context only in their audiovisual pairing but not visual or auditory content alone). We find that mouse parietal associative area-a higher cortical region-displays robust multisensory deviance detection. In contrast, primary visual cortex exhibits strong unisensory visual deviance detection but weaker multisensory deviance detection. These results suggest that deviance detection signals in the cortex may be conceptualized as "prediction errors," which are primarily fed forward-or downstream-in cortical networks.6,7.

Multimodal mismatch responses in associative but not primary visual cortex support hierarchical predictive coding in cortical networks

A key function of the mammalian neocortex is to process sensory data in the context of current and past stimuli. Primary sensory cortices, such as V1, respond weakly to stimuli that typical in their context but strongly to novel stimuli, an effect known as "deviance detection". How deviance detection occurs in associative cortical regions that are downstream of V1 is not well-understood. Here we investigated parietal associative area (PTLp) responses to auditory, visual, and audio-visual mismatches with two-photon calcium imaging and local field potential recordings. We employed basic unisensory auditory and visual oddball paradigms as well as a novel multisensory oddball paradigm, involving typical parings (VaAc or VbAd) presented at p=.88 with rare "deviant" pairings (e.g. VaAd or VbAc) presented at p=.12. We found that PTLp displayed robust deviance detection responses to auditory-visual mismatches, both in individual neurons and in population theta and gamma-band oscillations. In contrast, V1 neurons displayed deviance detection only to visual deviants in a unisensory context, but not to auditory or auditory-visual mismatches. Taken together, these results accord with a predictive processing framework for cortical responses, wherein modality specific prediction errors (i.e. deviance detection responses) are computed in functionally specified cortical areas and feed-forward to update higher brain regions.

Effects of developmental alcohol exposure on cortical multisensory integration

Fetal alcohol spectrum disorder (FASD) is one of the most common causes of mental disabilities in the world with a prevalence of 1%-6% of all births. Sensory processing deficits and cognitive problems are a major feature in this condition. Because developmental alcohol exposure can impair neuronal plasticity, and neuronal plasticity is crucial for the establishment of neuronal circuits in sensory areas, we predicted that exposure to alcohol during the third trimester equivalent of human gestation would disrupt the development of multisensory integration (MSI) in the rostral portion of the posterior parietal cortex (PPr), an integrative visual-tactile area. We conducted in vivo electrophysiology in 17 ferrets from four groups (saline/alcohol; infancy/adolescence). A total of 1157 neurons were recorded after visual, tactile and combined visual-tactile stimulation. A multisensory (MS) enhancement or suppression is characterized by a significantly increased or decreased number of elicited spikes after combined visual-tactile stimulation compared to the strongest unimodal (visual or tactile) response. At the neuronal level, those in infant animals were more prone to show MS suppression whereas adolescents were more prone to show MS enhancement. Although alcohol-treated animals showed similar developmental changes between infancy and adolescence, they always 'lagged behind' controls showing more MS suppression and less enhancement. Our findings suggest that alcohol exposure during the last months of human gestation would stunt the development of MSI, which could underlie sensory problems seen in FASD.

Cortical and thalamic modulation of auditory gating in the posterior parietal cortex of awake mice

Auditory gating (AG) is an adaptive mechanism for filtering out redundant acoustic stimuli to protect the brain against information overload. AG deficits have been found in many mental illnesses, including schizophrenia (SZ). However, the neural correlates of AG remain poorly understood. Here, we found that the posterior parietal cortex (PPC) shows an intermediate level of AG in auditory thalamocortical circuits, with a laminar profile in which the strongest AG is in the granular layer. Furthermore, AG of the PPC was decreased and increased by optogenetic inactivation of the medial dorsal thalamic nucleus (MD) and auditory cortex (AC), respectively. Optogenetically activating the axons from the MD and AC drove neural activities in the PPC without an obvious AG. These results indicated that AG in the PPC is determined by the integrated signal streams from the MD and AC in a bottom-up manner. We also found that a mouse model of SZ (postnatal administration of noncompetitive N-methyl-d-aspartate receptor antagonist) presented an AG deficit in the PPC, which may be inherited from the dysfunction of MD. Together, our findings reveal a neural circuit underlying the generation of AG in the PPC and its involvement in the AG deficit of SZ.

A comparison of multisensory features of two auditory cortical areas: primary (A1) and higher-order dorsal zone (DZ)

From myriads of ongoing stimuli, the brain creates a fused percept of the environment. This process, which culminates in perceptual binding, is presumed to occur through the operations of multisensory neurons that occur throughout the brain. However, because different brain areas receive different inputs and have different cytoarchitechtonics, it would be expected that local multisensory features would also vary across regions. The present study investigated that hypothesis using multiple single-unit recordings from anesthetized cats in response to controlled, electronically-generated separate and combined auditory, visual, and somatosensory stimulation. These results were used to compare the multisensory features of neurons in cat primary auditory cortex (A1) with those identified in the nearby higher-order auditory region, the Dorsal Zone (DZ). Both regions exhibited the same forms of multisensory neurons, albeit in different proportions. Multisensory neurons exhibiting excitatory or inhibitory properties occurred in similar proportions in both areas. Also, multisensory neurons in both areas expressed similar levels of multisensory integration. Because responses to auditory cues alone were so similar to those that included non-auditory stimuli, it is proposed that this effect represents a mechanism by which multisensory neurons subserve the process of perceptual binding.

Cell-type-specific integration of feedforward and feedback synaptic inputs in the posterior parietal cortex

The integration of feedforward (sensory) and feedback (top-down) neuronal signals is a principal function of the neocortex. Yet, we have limited insight into how these information streams are combined by individual neurons. Using a two-color optogenetic strategy, we found that layer 5 pyramidal neurons in the posterior parietal cortex receive monosynaptic dual innervation, combining sensory inputs with top-down signals. Subclasses of layer 5 pyramidal neurons integrated these synapses with distinct temporal dynamics. Specifically, regular spiking cells exhibited supralinear enhancement of delayed-but not coincident-inputs, while intrinsic burst-firing neurons selectively boosted coincident synaptic events. These subthreshold integration characteristics translated to a nonlinear summation of action potential firing. Complementing electrophysiology with computational modeling, we found that distinct integration profiles arose from a cell-type-specific interaction of ionic mechanisms and feedforward inhibition. These data provide insight into the cellular properties that guide the nonlinear interaction of distinct long-range afferents in the neocortex.

Excitatory Crossmodal Input to a Widespread Population of Primary Sensory Cortical Neurons

Crossmodal information processing in sensory cortices has been reported in sparsely distributed neurons under normal conditions and can undergo experience- or activity-induced plasticity. Given the potential role in brain function as indicated by previous reports, crossmodal connectivity in the sensory cortex needs to be further explored. Using perforated whole-cell recording in anesthetized adult rats, we found that almost all neurons recorded in the primary somatosensory, auditory, and visual cortices exhibited significant membrane-potential responses to crossmodal stimulation, as recorded when brain activity states were pharmacologically down-regulated in light anesthesia. These crossmodal cortical responses were excitatory and subthreshold, and further seemed to be relayed primarily by the sensory thalamus, but not the sensory cortex, of the stimulated modality. Our experiments indicate a sensory cortical presence of widespread excitatory crossmodal inputs, which might play roles in brain functions involving crossmodal information processing or plasticity.

Multisensory integration in neurons of the medial pulvinar of macaque monkey

The pulvinar is a heterogeneous thalamic nucleus, which is well developed in primates. One of its subdivisions, the medial pulvinar, is connected to many cortical areas, including the visual, auditory, and somatosensory cortices, as well as with multisensory areas and premotor areas. However, except for the visual modality, little is known about its sensory functions. A hypothesis is that, as a region of convergence of information from different sensory modalities, the medial pulvinar plays a role in multisensory integration. To test this hypothesis, 2 macaque monkeys were trained to a fixation task and the responses of single-units to visual, auditory, and auditory-visual stimuli were examined. Analysis revealed auditory, visual, and multisensory neurons in the medial pulvinar. It also revealed multisensory integration in this structure, mainly suppressive (the audiovisual response is less than the strongest unisensory response) and subadditive (the audiovisual response is less than the sum of the auditory and the visual responses). These findings suggest that the medial pulvinar is involved in multisensory integration.

Visual evoked feedforward-feedback traveling waves organize neural activity across the cortical hierarchy in mice

Sensory processing is distributed among many brain regions that interact via feedforward and feedback signaling. Neuronal oscillations have been shown to mediate intercortical feedforward and feedback interactions. Yet, the macroscopic structure of the multitude of such oscillations remains unclear. Here, we show that simple visual stimuli reliably evoke two traveling waves with spatial wavelengths that cover much of the cerebral hemisphere in awake mice. 30-50 Hz feedforward waves arise in primary visual cortex (V1) and propagate rostrally, while 3-6 Hz feedback waves originate in the association cortex and flow caudally. The phase of the feedback wave modulates the amplitude of the feedforward wave and synchronizes firing between V1 and parietal cortex. Altogether, these results provide direct experimental evidence that visual evoked traveling waves percolate through the cerebral cortex and coordinate neuronal activity across broadly distributed networks mediating visual processing.

Multisensory stimuli enhance the effectiveness of equivalence learning in healthy children and adolescents

It has been demonstrated earlier in healthy adult volunteers that visually and multisensory (audiovisual) guided equivalence learning are similarly effective. Thus, these processes seem to be independent of stimulus modality. The question arises as to whether this phenomenon can be observed also healthy children and adolescents. To assess this, visual and audiovisual equivalence learning was tested in 157 healthy participants younger than 18 years of age, in both a visual and an audiovisual paradigm consisting of acquisition, retrieval and generalization phases. Performance during the acquisition phase (building of associations), was significantly better in the multisensory paradigm, but there was no difference between the reaction times (RTs). Performance during the retrieval phase (where the previously learned associations are tested) was also significantly better in the multisensory paradigm, and RTs were significantly shorter. On the other hand, transfer (generalization) performance (where hitherto not learned but predictable associations are tested) was not significantly enhanced in the multisensory paradigm, while RTs were somewhat shorter. Linear regression analysis revealed that all the studied psychophysical parameters in both paradigms showed significant correlation with the age of the participants. Audiovisual stimulation enhanced acquisition and retrieval as compared to visual stimulation only, regardless of whether the subjects were above or below 12 years of age. Our results demonstrate that multisensory stimuli significantly enhance association learning and retrieval in the context of sensory guided equivalence learning in healthy children and adolescents. However, the audiovisual gain was significantly higher in the cohort below 12 years of age, which suggests that audiovisually guided equivalence learning is still in development in childhood.

Cross-Modal Plasticity in Brains Deprived of Visual Input Before Vision

Unimodal sensory loss leads to structural and functional changes in both deprived and nondeprived brain circuits. This process is broadly known as cross-modal plasticity. The evidence available indicates that cross-modal changes underlie the enhanced performances of the spared sensory modalities in deprived subjects. Sensory experience is a fundamental driver of cross-modal plasticity, yet there is evidence from early-visually deprived models supporting an additional role for experience-independent factors. These experience-independent factors are expected to act early in development and constrain neuronal plasticity at later stages. Here we review the cross-modal adaptations elicited by congenital or induced visual deprivation prior to vision. In most of these studies, cross-modal adaptations have been addressed at the structural and functional levels. Here, we also appraise recent data regarding behavioral performance in early-visually deprived models. However, further research is needed to explore how circuit reorganization affects their function and what brings about enhanced behavioral performance.

Advantages, Pitfalls, and Developments of All Optical Interrogation Strategies of Microcircuits in vivo

The holy grail for every neurophysiologist is to conclude a causal relationship between an elementary behaviour and the function of a specific brain area or circuit. Our effort to map elementary behaviours to specific brain loci and to further manipulate neural activity while observing the alterations in behaviour is in essence the goal for neuroscientists. Recent advancements in the area of experimental brain imaging in the form of longer wavelength near infrared (NIR) pulsed lasers with the development of highly efficient optogenetic actuators and reporters of neural activity, has endowed us with unprecedented resolution in spatiotemporal precision both in imaging neural activity as well as manipulating it with multiphoton microscopy. This readily available toolbox has introduced a so called all-optical physiology and interrogation of circuits and has opened new horizons when it comes to precisely, fast and non-invasively map and manipulate anatomically, molecularly or functionally identified mesoscopic brain circuits. The purpose of this review is to describe the advantages and possible pitfalls of all-optical approaches in system neuroscience, where by all-optical we mean use of multiphoton microscopy to image the functional response of neuron(s) in the network so to attain flexible choice of the cells to be also optogenetically photostimulated by holography, in absence of electrophysiology. Spatio-temporal constraints will be compared toward the classical reference of electrophysiology methods. When appropriate, in relation to current limitations of current optical approaches, we will make reference to latest works aimed to overcome these limitations, in order to highlight the most recent developments. We will also provide examples of types of experiments uniquely approachable all-optically. Finally, although mechanically non-invasive, all-optical electrophysiology exhibits potential off-target effects which can ambiguate and complicate the interpretation of the results. In summary, this review is an effort to exemplify how an all-optical experiment can be designed, conducted and interpreted from the point of view of the integrative neurophysiologist.

Multisensory task demands temporally extend the causal requirement for visual cortex in perception

Primary sensory areas constitute crucial nodes during perceptual decision making. However, it remains unclear to what extent they mainly constitute a feedforward processing step, or rather are continuously involved in a recurrent network together with higher-order areas. We found that the temporal window in which primary visual cortex is required for the detection of identical visual stimuli was extended when task demands were increased via an additional sensory modality that had to be monitored. Late-onset optogenetic inactivation preserved bottom-up, early-onset responses which faithfully encoded stimulus features, and was effective in impairing detection only if it preceded a late, report-related phase of the cortical response. Increasing task demands were marked by longer reaction times and the effect of late optogenetic inactivation scaled with reaction time. Thus, independently of visual stimulus complexity, multisensory task demands determine the temporal requirement for ongoing sensory-related activity in V1, which overlaps with report-related activity.

How primary sensory cortices contribute to decision making remains poorly understood. Here the authors report that increasing task demands extend the temporal window in which the primary visual cortex is required for detecting identical stimuli.

Bimodal sensory integration in migraine: A study of the effect of visual stimulation on somatosensory evoked cortical responses

BACKGROUND

Merging of sensory information is a crucial process for adapting the behaviour to the environment in all species. It is not known if this multisensory integration might be dysfunctioning interictally in migraine without aura, where sensory stimuli of various modalities are processed abnormally when delivered separately. To investigate this question, we compared the effects of a concomitant visual stimulation on conventional low-frequency somatosensory evoked potentials and embedded high-frequency oscillations between migraine patients and healthy volunteers.

METHODS

We recorded somatosensory evoked potentials in 19 healthy volunteers and in 19 interictal migraine without aura patients before, during, and 5 min after (T2) simultaneous synchronous pattern-reversal visual stimulation. At each time point, we measured amplitude and habituation of the N20-P25 low-frequency-somatosensory evoked potentials component and maximal peak-to-peak amplitude of early and late bursts of high-frequency oscillations.

RESULTS

In healthy volunteers, the bimodal stimulation significantly reduced low-frequency-somatosensory evoked potentials habituation and tended to reduce early high-frequency oscillations that reflect thalamocortical activity. By contrast, in migraine without aura patients, bimodal stimulation significantly increased low-frequency-somatosensory evoked potentials habituation and early high-frequency oscillations. At T2, all visual stimulation-induced changes of somatosensory processing had vanished.

CONCLUSION

These results suggest a malfunctioning multisensory integration process, which could be favoured by an abnormal excitability level of thalamo-cortical loops.

Hierarchical and nonhierarchical features of the mouse visual cortical network

Neocortical computations underlying vision are performed by a distributed network of functionally specialized areas. Mouse visual cortex, a dense interareal network that exhibits hierarchical properties, comprises subnetworks interconnecting distinct processing streams. To determine the layout of the mouse visual hierarchy, we have evaluated the laminar patterns formed by interareal axonal projections originating in each of ten areas. Reciprocally connected pairs of areas exhibit feedforward/feedback relationships consistent with a hierarchical organization. Beta regression analyses, which estimate a continuous hierarchical distance measure, indicate that the network comprises multiple nonhierarchical circuits embedded in a hierarchical organization of overlapping levels. Single-unit recordings in anaesthetized mice show that receptive field sizes are generally consistent with the hierarchy, with the ventral stream exhibiting a stricter hierarchy than the dorsal stream. Together, the results provide an anatomical metric for hierarchical distance, and reveal both hierarchical and nonhierarchical motifs in mouse visual cortex.

Mouse visual cortex is a dense, interconnected network of distinct areas. D’Souza et al. identify an anatomical index to quantify the hierarchical nature of pathways, and highlight the hierarchical and nonhierarchical features of the network.

Remote cortical perturbation dynamically changes the network solutions to given tactile inputs in neocortical neurons

The neocortex has a globally encompassing network structure, which for each given input constrains the possible combinations of neuronal activations across it. Hence, its network contains solutions. But in addition, the cortex has an ever-changing multidimensional internal state, causing each given input to result in a wide range of specific neuronal activations. Here we use intracellular recordings in somatosensory cortex (SI) neurons of anesthetized rats to show that remote, subthreshold intracortical electrical perturbation can impact such constraints on the responses to a set of spatiotemporal tactile input patterns. Whereas each given input pattern normally induces a wide set of preferred response states, when combined with cortical perturbation response states that did not otherwise occur were induced and consequently made other response states less likely. The findings indicate that the physiological network structure can dynamically change as the state of any given cortical region changes, thereby enabling a rich, multifactorial, perceptual capability.

•

Tactile sensory input patterns evoke multi-structure cortical neuron responses

•

Multi-structure responses are shown to be impacted by remote cortical regions

•

Highly dynamic neuron responses reflects global cortical information integration

•

Perception hence depends on globally distributed activity at the time of input

Higher Order Visual Areas Enhance Stimulus Responsiveness in Mouse Primary Visual Cortex

Over the past few years, the various areas that surround the primary visual cortex (V1) in the mouse have been associated with many functions, ranging from higher order visual processing to decision-making. Recently, some studies have shown that higher order visual areas influence the activity of the primary visual cortex, refining its processing capabilities. Here, we studied how in vivo optogenetic inactivation of two higher order visual areas with different functional properties affects responses evoked by moving bars in the primary visual cortex. In contrast with the prevailing view, our results demonstrate that distinct higher order visual areas similarly modulate early visual processing. In particular, these areas enhance stimulus responsiveness in the primary visual cortex, by more strongly amplifying weaker compared with stronger sensory-evoked responses (for instance specifically amplifying responses to stimuli not moving along the direction preferred by individual neurons) and by facilitating responses to stimuli entering the receptive field of single neurons. Such enhancement, however, comes at the expense of orientation and direction selectivity, which increased when the selected higher order visual areas were inactivated. Thus, feedback from higher order visual areas selectively amplifies weak sensory-evoked V1 responses, which may enable more robust processing of visual stimuli.

Multisensory-Guided Associative Learning Enhances Multisensory Representation in Primary Auditory Cortex

Sensory cortices, classically considered to represent modality-specific sensory information, are also found to engage in multisensory processing. However, how sensory processing in sensory cortices is cross-modally modulated remains an open question. Specifically, we understand little of cross-modal representation in sensory cortices in perceptual tasks and how perceptual learning modifies this process. Here, we recorded neural responses in primary auditory cortex (A1) both while freely moving rats discriminated stimuli in Go/No-Go tasks and when anesthetized. Our data show that cross-modal representation in auditory cortices varies with task contexts. In the task of an audiovisual cue being the target associating with water reward, a significantly higher proportion of auditory neurons showed a visually evoked response. The vast majority of auditory neurons, if processing auditory-visual interactions, exhibit significant multisensory enhancement. However, when the rats performed tasks with unisensory cues being the target, cross-modal inhibition, rather than enhancement, predominated. In addition, multisensory associational learning appeared to leave a trace of plastic change in A1, as a larger proportion of A1 neurons showed multisensory enhancement in anesthesia. These findings indicate that multisensory processing in principle sensory cortices is not static, and having cross-modal interaction in the task requirement can substantially enhance multisensory processing in sensory cortices.

The Role of the GABAergic System in Diseases of the Central Nervous System

It is well known that the central nervous system (CNS) is a complex neuronal network and its function depends on the balance between excitatory and inhibitory neurons. Disruption of the excitatory/inhibitory (E/I) balance is the main cause for the majority of the CNS diseases. In this review, we will discuss roles of the inhibitory system in the CNS diseases. The GABAergic system as the main inhibitory system, is essential for the appropriate functioning of the CNS, especially as it is engaged in the formation of learning and memory. Many researchers have reported that the GABAergic system is involved in regulating synaptic plasticity, cognition and long-term potentiation. Some clinical manifestations (such as cognitive dysfunctions, attention deficits, etc.) have also been shown to emerge after abnormalities in the GABAergic system accompanied with concomitant diseases, that include Alzheimer's disease (AD), Parkinson's disease (PD), Autism spectrum disorder (ASD), Schizophrenia, etc. The GABAergic system consists of GABA, GABA transporters, GABAergic receptors and GABAergic neurons. Changes in any of these components may contribute to the dysfunctions of the CNS. In this review, we will synthesize studies which demonstrate how the GABAergic system participates in the pathogenesis of the CNS disorders, which may provide a new idea that might be used to treat the CNS diseases.

Cortical and Subcortical Circuits for Cross-Modal Plasticity Induced by Loss of Vision

Cortical areas are highly interconnected both via cortical and subcortical pathways, and primary sensory cortices are not isolated from this general structure. In primary sensory cortical areas, these pre-existing functional connections serve to provide contextual information for sensory processing and can mediate adaptation when a sensory modality is lost. Cross-modal plasticity in broad terms refers to widespread plasticity across the brain in response to losing a sensory modality, and largely involves two distinct changes: cross-modal recruitment and compensatory plasticity. The former involves recruitment of the deprived sensory area, which includes the deprived primary sensory cortex, for processing the remaining senses. Compensatory plasticity refers to plasticity in the remaining sensory areas, including the spared primary sensory cortices, to enhance the processing of its own sensory inputs. Here, we will summarize potential cellular plasticity mechanisms involved in cross-modal recruitment and compensatory plasticity, and review cortical and subcortical circuits to the primary sensory cortices which can mediate cross-modal plasticity upon loss of vision.

Wiring of higher-order cortical areas: Spatiotemporal development of cortical hierarchy

A hierarchical development of cortical areas was suggested over a century ago, but the diversity and complexity of cortical hierarchy properties have so far prevented a formal demonstration. The aim of this review is to clarify the similarities and differences in the developmental processes underlying cortical development of primary and higher-order areas. We start by recapitulating the historical and recent advances underlying the biological principle of cortical hierarchy in adults. We then revisit the arguments for a hierarchical maturation of cortical areas, and further integrate the principles of cortical areas specification during embryonic and postnatal development. We highlight how the dramatic expansion in cortical size might have contributed to the increased number of association areas sustaining cognitive complexification in evolution. Finally, we summarize the recent observations of an alteration of cortical hierarchy in neuropsychiatric disorders and discuss their potential developmental origins.

Neural Correlates of Multisensory Detection Behavior: Comparison of Primary and Higher-Order Visual Cortex

We act upon stimuli in our surrounding environment by gathering the multisensory information they convey and by integrating this information to decide on a behavioral action. We hypothesized that the anterolateral secondary visual cortex (area AL) of the mouse brain may serve as a hub for sensorimotor transformation of audiovisual information. We imaged neuronal activity in primary visual cortex (V1) and AL of the mouse during a detection task using visual, auditory, and audiovisual stimuli. We found that AL neurons were more sensitive to weak uni- and multisensory stimuli compared to V1. Depending on contrast, different subsets of AL and V1 neurons showed cross-modal modulation of visual responses. During audiovisual stimulation, AL neurons showed stronger differentiation of behaviorally reported versus unreported stimuli compared to V1, whereas V1 showed this distinction during unisensory visual stimulation. Thus, neural population activity in area AL correlates more closely with multisensory detection behavior than V1.

Binocular integration of retinal motion information underlies optic flow processing by the cortex

Locomotion creates various patterns of optic flow on the retina, which provide the observer with information about their movement relative to the environment. However, it is unclear how these optic flow patterns are encoded by the cortex. Here, we use two-photon calcium imaging in awake mice to systematically map monocular and binocular responses to horizontal motion in four areas of the visual cortex. We find that neurons selective to translational or rotational optic flow are abundant in higher visual areas, whereas neurons suppressed by binocular motion are more common in the primary visual cortex. Disruption of retinal direction selectivity in Frmd7 mutant mice reduces the number of translation-selective neurons in the primary visual cortex and translation- and rotation-selective neurons as well as binocular direction-selective neurons in the rostrolateral and anterior visual cortex, blurring the functional distinction between primary and higher visual areas. Thus, optic flow representations in specific areas of the visual cortex rely on binocular integration of motion information from the retina.

•

Translation- and rotation-selective neurons are abundant in higher visual areas

•

Optic-flow-selective neurons in V1 and RL/A rely on retinal direction selectivity

•

Retinal direction selectivity controls functional segregation between V1 and RL/A

•

Binocular integration of retinal motion information underlies optic flow selectivity

Comprehensive Analysis of Long-Range Connectivity from and to the Posterior Parietal Cortex of the Mouse

The posterior parietal cortex (PPC) is a major multimodal association cortex implicated in a variety of higher order cognitive functions, such as visuospatial perception, spatial attention, categorization, and decision-making. The PPC is known to receive inputs from a collection of sensory cortices as well as various subcortical areas and integrate those inputs to facilitate the execution of functions that require diverse information. Although many recent works have been performed with the mouse as a model system, a comprehensive understanding of long-range connectivity of the mouse PPC is scarce, preventing integrative interpretation of the rapidly accumulating functional data. In this study, we conducted a detailed neuroanatomic and bioinformatic analysis of the Allen Mouse Brain Connectivity Atlas data to summarize afferent and efferent connections to/from the PPC. Then, we analyzed variability between subregions of the PPC, functional/anatomical modalities, and species, and summarized the organizational principle of the mouse PPC. Finally, we confirmed key results by using additional neurotracers. A comprehensive survey of the connectivity will provide an important future reference to comprehend the function of the PPC and allow effective paths forward to various studies using mice as a model system.

Reconsidering the Border between the Visual and Posterior Parietal Cortex of Mice

The posterior parietal cortex (PPC) contributes to multisensory and sensory-motor integration, as well as spatial navigation. Based on primate studies, the PPC is composed of several subdivisions with differing connection patterns, including areas that exhibit retinotopy. In mice the composition of the PPC is still under debate. We propose a revised anatomical delineation in which we classify the higher order visual areas rostrolateral area (RL), anteromedial area (AM), and Medio-Medial-Anterior cortex (MMA) as subregions of the mouse PPC. Retrograde and anterograde tracing revealed connectivity, characteristic for primate PPC, with sensory, retrosplenial, orbitofrontal, cingulate and motor cortex, as well as with several thalamic nuclei and the superior colliculus in the mouse. Regarding cortical input, RL receives major input from the somatosensory barrel field, while AM receives more input from the trunk, whereas MMA receives strong inputs from retrosplenial, cingulate, and orbitofrontal cortices. These input differences suggest that each posterior PPC subregion may have a distinct function. Summarized, we put forward a refined cortical map, including a mouse PPC that contains at least 6 subregions, RL, AM, MMA and PtP, MPta, LPta/A. These anatomical results set the stage for a more detailed understanding about the role that the PPC and its subdivisions play in multisensory integration-based behavior in mice.

Sensory and Behavioral Components of Neocortical Signal Flow in Discrimination Tasks with Short-Term Memory

In the neocortex, each sensory modality engages distinct sensory areas that route information to association areas. Where signal flow converges for maintaining information in short-term memory and how behavior may influence signal routing remain open questions. Using wide-field calcium imaging, we compared cortex-wide neuronal activity in layer 2/3 for mice trained in auditory and tactile tasks with delayed response. In both tasks, mice were either active or passive during stimulus presentation, moving their body or sitting quietly. Irrespective of behavioral strategy, auditory and tactile stimulation activated distinct subdivisions of the posterior parietal cortex, anterior area A and rostrolateral area RL, which held stimulus-related information necessary for the respective tasks. In the delay period, in contrast, behavioral strategy rather than sensory modality determined short-term memory location, with activity converging frontomedially in active trials and posterolaterally in passive trials. Our results suggest behavior-dependent routing of sensory-driven cortical signals flow from modality-specific posterior parietal cortex (PPC) subdivisions to higher association areas.

DNA Methylation-Dependent Dysregulation of GABAergic Interneuron Functionality in Neuropsychiatric Diseases

Neuropsychiatric diseases, such as mood disorders, schizophrenia, and autism, represent multifactorial disorders, differing in causes, disease onset, severity, and symptoms. A common feature of numerous neuropsychiatric conditions are defects in the cortical inhibitory GABAergic system. The balance of excitation and inhibition is fundamental for proper and efficient information processing in the cerebral cortex. Thus, altered inhibition is suggested to account for pathological symptoms like cognitive impairments and dysfunctional multisensory integration. While it became apparent that most of these diseases have a clear genetic component, environmental influences emerged as an impact of disease manifestation, onset, and severity. Epigenetic mechanisms of transcriptional control, such as DNA methylation, are known to be responsive to external stimuli, and are suspected to be implicated in the functional impairments of GABAergic interneurons, and hence, the pathophysiology of neuropsychiatric diseases. Here, we provide an overview about the multifaceted functional implications of DNA methylation and DNA methyltransferases in cortical interneuron development and function in health and disease. Apart from the regulation of gamma-aminobutyric acid-related genes and genes relevant for interneuron development, we discuss the role of DNA methylation-dependent regulation of synaptic transmission by the modulation of endocytosis-related genes as potential pathophysiological mechanisms underlying neuropsychiatric conditions. Deciphering the hierarchy and mechanisms of changes in epigenetic signatures is crucial to develop effective strategies for treatment and prevention.

Neuronal Encoding of Multisensory Motion Features in the Rat Associative Parietal Cortex

Motion perception is facilitated by the interplay of various sensory channels. In rodents, the cortical areas involved in multisensory motion coding remain to be identified. Using voltage-sensitive-dye imaging, we revealed a visuo-tactile convergent region that anatomically corresponds to the associative parietal cortex (APC). Single unit responses to moving visual gratings or whiskers deflections revealed a specific coding of motion characteristics strikingly found in both sensory modalities. The heteromodality of this region was further supported by a large proportion of bimodal neurons and by a classification procedure revealing that APC carries information about motion features, sensory origin and multisensory direction-congruency. Altogether, the results point to a central role of APC in multisensory integration for motion perception.

Approaches to Understanding Multisensory Dysfunction in Autism Spectrum Disorder

Abnormal sensory responses are a DSM-5 symptom of autism spectrum disorder (ASD), and research findings demonstrate altered sensory processing in ASD. Beyond difficulties with processing information within single sensory domains, including both hypersensitivity and hyposensitivity, difficulties in multisensory processing are becoming a core issue of focus in ASD. These difficulties may be targeted by treatment approaches such as "sensory integration," which is frequently applied in autism treatment but not yet based on clear evidence. Recently, psychophysical data have emerged to demonstrate multisensory deficits in some children with ASD. Unlike deficits in social communication, which are best understood in humans, sensory and multisensory changes offer a tractable marker of circuit dysfunction that is more easily translated into animal model systems to probe the underlying neurobiological mechanisms. Paralleling experimental paradigms that were previously applied in humans and larger mammals, we and others have demonstrated that multisensory function can also be examined behaviorally in rodents. Here, we review the sensory and multisensory difficulties commonly found in ASD, examining laboratory findings that relate these findings across species. Next, we discuss the known neurobiology of multisensory integration, drawing largely on experimental work in larger mammals, and extensions of these paradigms into rodents. Finally, we describe emerging investigations into multisensory processing in genetic mouse models related to autism risk. By detailing findings from humans to mice, we highlight the advantage of multisensory paradigms that can be easily translated across species, as well as the potential for rodent experimental systems to reveal opportunities for novel treatments. LAY SUMMARY: Sensory and multisensory deficits are commonly found in ASD and may result in cascading effects that impact social communication. By using similar experiments to those in humans, we discuss how studies in animal models may allow an understanding of the brain mechanisms that underlie difficulties in multisensory integration, with the ultimate goal of developing new treatments. Autism Res 2020, 13: 1430-1449. © 2020 International Society for Autism Research, Wiley Periodicals, Inc.

A segregated cortical stream for retinal direction selectivity

Visual features extracted by retinal circuits are streamed into higher visual areas (HVAs) after being processed along the visual hierarchy. However, how specialized neuronal representations of HVAs are built, based on retinal output channels, remained unclear. Here, we addressed this question by determining the effects of genetically disrupting retinal direction selectivity on motion-evoked responses in visual stages from the retina to HVAs in mice. Direction-selective (DS) cells in the rostrolateral (RL) area that prefer higher temporal frequencies, and that change direction tuning bias as the temporal frequency of a stimulus increases, are selectively reduced upon retinal manipulation. DS cells in the primary visual cortex projecting to area RL, but not to the posteromedial area, were similarly affected. Therefore, the specific connectivity of cortico-cortical projection neurons routes feedforward signaling originating from retinal DS cells preferentially to area RL. We thus identify a cortical processing stream for motion computed in the retina.

Visual features are streamed into higher visual areas (HVAs), but how representations in HVAs are built, based on retinal output channels, is unknown. Here, the authors show that specific connectivity of cortical neurons routes retina-originated direction-selective signaling into distinct HVAs.

Repeated Exposure to Multiple Concurrent Stresses Induce Circuit Specific Loss of Inputs to the Posterior Parietal Cortex

Severe loss of excitatory synapses in key brain regions is thought to be one of the major mechanisms underlying stress-induced cognitive impairment. To date, however, the identity of the affected circuits remains elusive. Here we examined the effect of exposure to repeated multiple concurrent stressors (RMS) on the connectivity of the posterior parietal cortex (PPC) in adolescent male mice. We found that RMS led to layer-specific elimination of excitatory synapses with the most pronounced loss observed in deeper cortical layers. Quantitative analysis of cortical projections to the PPC revealed a significant loss of sensory and retrosplenial inputs to the PPC while contralateral and frontal projections were preserved. These results were confirmed by decreased synaptic strength from sensory, but not from contralateral, projections in stress-exposed animals. Functionally, RMS disrupted visuospatial working memory performance, implicating disrupted higher-order visual processing. These effects were not observed in mice subjected to restraint-only stress for an identical period of time. The PPC is considered to be a cortical hub for multisensory integration, working memory, and perceptual decision-making. Our data suggest that sensory information streams targeting the PPC may be impacted by recurring stress, likely contributing to stress-induced cognitive impairment.SIGNIFICANCE STATEMENT Repeated exposure to stress profoundly impairs cognitive functions like memory, attention, or decision-making. There is emerging evidence that stress not only impacts high-order regions of the brain, but may affect earlier stages of cognitive processing. Our work focuses on the posterior parietal cortex, a brain region supporting short-term memory, multisensory integration, and decision-making. We show evidence that repeated stress specifically damages sensory inputs to this region. This disruption of synaptic connectivity is linked to working memory impairment and is specific to repeated exposure to multiple stressors. Altogether, our data provide a potential alternative explanation to ailments previously attributed to downstream, cognitive brain structures.

A large-scale standardized physiological survey reveals functional organization of the mouse visual cortex

To understand how the brain processes sensory information to guide behavior, we must know how stimulus representations are transformed throughout the visual cortex. Here we report an open, large-scale physiological survey of activity in the awake mouse visual cortex: the Allen Brain Observatory Visual Coding dataset. This publicly available dataset includes the cortical activity of nearly 60,000 neurons from six visual areas, four layers, and 12 transgenic mouse lines in a total of 243 adult mice, in response to a systematic set of visual stimuli. We classify neurons on the basis of joint reliabilities to multiple stimuli and validate this functional classification with models of visual responses. While most classes are characterized by responses to specific subsets of the stimuli, the largest class is not reliably responsive to any of the stimuli and becomes progressively larger in higher visual areas. These classes reveal a functional organization wherein putative dorsal areas show specialization for visual motion signals.

Functional determinants of enhanced and depressed interareal information flow in nonrapid eye movement sleep between neuronal ensembles in rat cortex and hippocampus

Compared with wakefulness, neuronal activity during nonrapid eye movement (NREM) sleep is characterized by a decreased ability to integrate information, but also by the reemergence of task-related information patterns. To investigate the mechanisms underlying these seemingly opposing phenomena, we measured directed information flow by computing transfer entropy between neuronal spiking activity in three cortical regions and the hippocampus of rats across brain states. State-dependent information flow was jointly determined by the anatomical distance between neurons and by their functional specialization. We distinguished two regimes, operating at short and long time scales, respectively. From wakefulness to NREM sleep, transfer entropy at short time scales increased for interareal connections between neurons showing behavioral task correlates. Conversely, transfer entropy at long time scales became stronger between nontask modulated neurons and weaker between task-modulated neurons. These results may explain how, during NREM sleep, a global interareal disconnection is compatible with highly specific task-related information transfer.

Leveraging Nonhuman Primate Multisensory Neurons and Circuits in Assessing Consciousness Theory

Both the global neuronal workspace (GNW) and integrated information theory (IIT) posit that highly complex and interconnected networks engender perceptual awareness. GNW specifies that activity recruiting frontoparietal networks will elicit a subjective experience, whereas IIT is more concerned with the functional architecture of networks than with activity within it. Here, we argue that according to IIT mathematics, circuits converging on integrative versus convergent yet non-integrative neurons should support a greater degree of consciousness. We test this hypothesis by analyzing a dataset of neuronal responses collected simultaneously from primary somatosensory cortex (S1) and ventral premotor cortex (vPM) in nonhuman primates presented with auditory, tactile, and audio-tactile stimuli as they are progressively anesthetized with propofol. We first describe the multisensory (audio-tactile) characteristics of S1 and vPM neurons (mean and dispersion tendencies, as well as noise-correlations), and functionally label these neurons as convergent or integrative according to their spiking responses. Then, we characterize how these different pools of neurons behave as a function of consciousness. At odds with the IIT mathematics, results suggest that convergent neurons more readily exhibit properties of consciousness (neural complexity and noise correlation) and are more impacted during the loss of consciousness than integrative neurons. Last, we provide support for the GNW by showing that neural ignition (i.e., same trial coactivation of S1 and vPM) was more frequent in conscious than unconscious states. Overall, we contrast GNW and IIT within the same single-unit activity dataset, and support the GNW.SIGNIFICANCE STATEMENT A number of prominent theories of consciousness exist, and a number of these share strong commonalities, such as the central role they ascribe to integration. Despite the important and far reaching consequences developing a better understanding of consciousness promises to bring, for instance in diagnosing disorders of consciousness (e.g., coma, vegetative-state, locked-in syndrome), these theories are seldom tested via invasive techniques (with high signal-to-noise ratios), and never directly confronted within a single dataset. Here, we first derive concrete and testable predictions from the global neuronal workspace and integrated information theory of consciousness. Then, we put these to the test by functionally labeling specific neurons as either convergent or integrative nodes, and examining the response of these neurons during anesthetic-induced loss of consciousness.

The Visual Cortex in Context

In this article, we review the anatomical inputs and outputs to the mouse primary visual cortex, area V1. Our survey of data from the Allen Institute Mouse Connectivity project indicates that mouse V1 is highly interconnected with both cortical and subcortical brain areas. This pattern of innervation allows for computations that depend on the state of the animal and on behavioral goals, which contrasts with simple feedforward, hierarchical models of visual processing. Thus, to have an accurate description of the function of V1 during mouse behavior, its involvement with the rest of the brain circuitry has to be considered. Finally, it remains an open question whether the primary visual cortex of higher mammals displays the same degree of sensorimotor integration in the early visual system.

Excitatory Neuronal Hubs Configure Multisensory Integration of Slow Waves in Association Cortex

Multisensory integration (MSI) is a fundamental emergent property of the mammalian brain. During MSI, perceptual information encoded in patterned activity is processed in multimodal association cortex. The systems-level neuronal dynamics that coordinate MSI, however, are unknown. Here, we demonstrate intrinsic hub-like network activity in the association cortex that regulates MSI. We engineered calcium reporter mouse lines based on the fluorescence resonance energy transfer sensor yellow cameleon (YC2.60) expressed in excitatory or inhibitory neurons. In medial and parietal association cortex, we observed spontaneous slow waves that self-organized into hubs defined by long-range excitatory and local inhibitory circuits. Unlike directional source/sink-like flows in sensory areas, medial/parietal excitatory and inhibitory hubs had net-zero balanced inputs. Remarkably, multisensory stimulation triggered rapid phase-locking mainly of excitatory hub activity persisting for seconds after the stimulus offset. Therefore, association cortex tends to form balanced excitatory networks that configure slow-wave phase-locking for MSI. VIDEO ABSTRACT.