Theta Phase Entrainment of Single-Cell Spiking in Rat Somatosensory Barrel Cortex and Secondary Visual Cortex Is Enhanced during Multisensory Discrimination Behavior

Phase entrainment of cells by theta oscillations is thought to globally coordinate the activity of cell assemblies across different structures, such as the hippocampus and neocortex. This coordination is likely required for optimal processing of sensory input during recognition and decision-making processes. In quadruple-area ensemble recordings from male rats engaged in a multisensory discrimination task, we investigated phase entrainment of cells by theta oscillations in areas along the corticohippocampal hierarchy: somatosensory barrel cortex (S1BF), secondary visual cortex (V2L), perirhinal cortex (PER), and dorsal hippocampus (dHC). Rats discriminated between two 3D objects presented in tactile-only, visual-only, or both tactile and visual modalities. During task engagement, S1BF, V2L, PER, and dHC LFP signals showed coherent theta-band activity. We found phase entrainment of single-cell spiking activity to locally recorded as well as hippocampal theta activity in S1BF, V2L, PER, and dHC. While phase entrainment of hippocampal spikes to local theta oscillations occurred during sustained epochs of task trials and was nonselective for behavior and modality, somatosensory and visual cortical cells were only phase entrained during stimulus presentation, mainly in their preferred modality (S1BF, tactile; V2L, visual), with subsets of cells selectively phase-entrained during cross-modal stimulus presentation (S1BF: visual; V2L: tactile). This effect could not be explained by modulations of firing rate or theta amplitude. Thus, hippocampal cells are phase entrained during prolonged epochs, while sensory and perirhinal neurons are selectively entrained during sensory stimulus presentation, providing a brief time window for coordination of activity.

Triple dissociation of visual, auditory and motor processing in mouse primary visual cortex

Primary sensory cortices respond to crossmodal stimuli-for example, auditory responses are found in primary visual cortex (V1). However, it remains unclear whether these responses reflect sensory inputs or behavioral modulation through sound-evoked body movement. We address this controversy by showing that sound-evoked activity in V1 of awake mice can be dissociated into auditory and behavioral components with distinct spatiotemporal profiles. The auditory component began at approximately 27 ms, was found in superficial and deep layers and originated from auditory cortex. Sound-evoked orofacial movements correlated with V1 neural activity starting at approximately 80-100 ms and explained auditory frequency tuning. Visual, auditory and motor activity were expressed by different laminar profiles and largely segregated subsets of neuronal populations. During simultaneous audiovisual stimulation, visual representations remained dissociable from auditory-related and motor-related activity. This three-fold dissociability of auditory, motor and visual processing is central to understanding how distinct inputs to visual cortex interact to support vision.

Assessing the commensurability of theories of consciousness: On the usefulness of common denominators in differentiating, integrating and testing hypotheses

How deep is the current diversity in the panoply of theories to define consciousness, and to what extent do these theories share common denominators? Here we first examine to what extent different theories are commensurable (or comparable) along particular dimensions. We posit logical (and, when applicable, empirical) commensurability as a necessary condition for identifying common denominators among different theories. By consequence, dimensions for inclusion in a set of logically and empirically commensurable theories of consciousness can be proposed. Next, we compare a limited subset of neuroscience-based theories in terms of commensurability. This analysis does not yield a denominator that might serve to define a minimally unifying model of consciousness. Theories that seem to be akin by one denominator can be remote by another. We suggest a methodology of comparing different theories via multiple probing questions, allowing to discern overall (dis)similarities between theories. Despite very different background definitions of consciousness, we conclude that, if attention is paid to the search for a common methological approach to brain-consciousness relationships, it should be possible in principle to overcome the current Babylonian confusion of tongues and eventually integrate and merge different theories.

An integrative, multiscale view on neural theories of consciousness

How is conscious experience related to material brain processes? A variety of theories aiming to answer this age-old question have emerged from the recent surge in consciousness research, and some are now hotly debated. Although most researchers have so far focused on the development and validation of their preferred theory in relative isolation, this article, written by a group of scientists representing different theories, takes an alternative approach. Noting that various theories often try to explain different aspects or mechanistic levels of consciousness, we argue that the theories do not necessarily contradict each other. Instead, several of them may converge on fundamental neuronal mechanisms and be partly compatible and complementary, so that multiple theories can simultaneously contribute to our understanding. Here, we consider unifying, integration-oriented approaches that have so far been largely neglected, seeking to combine valuable elements from various theories.

Deep brain stimulation of the central thalamus restores arousal and motivation in a zolpidem-responsive patient with akinetic mutism after severe brain injury

After severe brain injury, zolpidem is known to cause spectacular, often short-lived, restorations of brain functions in a small subgroup of patients. Previously, we showed that these zolpidem-induced neurological recoveries can be paralleled by significant changes in functional connectivity throughout the brain. Deep brain stimulation (DBS) is a neurosurgical intervention known to modulate functional connectivity in a wide variety of neurological disorders. In this study, we used DBS to restore arousal and motivation in a zolpidem-responsive patient with severe brain injury and a concomitant disorder of diminished motivation, more than 10 years after surviving hypoxic ischemia. We found that DBS of the central thalamus, targeted at the centromedian-parafascicular complex, immediately restored arousal and was able to transition the patient from a state of deep sleep to full wakefulness. Moreover, DBS was associated with temporary restoration of communication and ability to walk and eat in an otherwise wheelchair-bound and mute patient. With the use of magnetoencephalography (MEG), we revealed that DBS was generally associated with a marked decrease in aberrantly high levels of functional connectivity throughout the brain, mimicking the effects of zolpidem. These results imply that 'pathological hyperconnectivity' after severe brain injury can be associated with reduced arousal and behavioral performance and that DBS is able to modulate connectivity towards a 'healthier baseline' with lower synchronization, and, can restore functional brain networks long after severe brain injury. The presence of hyperconnectivity after brain injury may be a possible future marker for a patient's responsiveness for restorative interventions, such as DBS, and suggests that lower degrees of overall brain synchronization may be conducive to cognition and behavioral responsiveness.

Neural correlates of object identity and reward outcome in the sensory cortical-hippocampal hierarchy: coding of motivational information in perirhinal cortex

Neural circuits support behavioral adaptations by integrating sensory and motor information with reward and error-driven learning signals, but it remains poorly understood how these signals are distributed across different levels of the corticohippocampal hierarchy. We trained rats on a multisensory object-recognition task and compared visual and tactile responses of simultaneously recorded neuronal ensembles in somatosensory cortex, secondary visual cortex, perirhinal cortex, and hippocampus. The sensory regions primarily represented unisensory information, whereas hippocampus was modulated by both vision and touch. Surprisingly, the sensory cortices and the hippocampus coded object-specific information, whereas the perirhinal cortex did not. Instead, perirhinal cortical neurons signaled trial outcome upon reward-based feedback. A majority of outcome-related perirhinal cells responded to a negative outcome (reward omission), whereas a minority of other cells coded positive outcome (reward delivery). Our results highlight a distributed neural coding of multisensory variables in the cortico-hippocampal hierarchy. Notably, the perirhinal cortex emerges as a crucial region for conveying motivational outcomes, whereas distinct functions related to object identity are observed in the sensory cortices and hippocampus.

How deep is the brain? The shallow brain hypothesis

Deep learning and predictive coding architectures commonly assume that inference in neural networks is hierarchical. However, largely neglected in deep learning and predictive coding architectures is the neurobiological evidence that all hierarchical cortical areas, higher or lower, project to and receive signals directly from subcortical areas. Given these neuroanatomical facts, today's dominance of cortico-centric, hierarchical architectures in deep learning and predictive coding networks is highly questionable; such architectures are likely to be missing essential computational principles the brain uses. In this Perspective, we present the shallow brain hypothesis: hierarchical cortical processing is integrated with a massively parallel process to which subcortical areas substantially contribute. This shallow architecture exploits the computational capacity of cortical microcircuits and thalamo-cortical loops that are not included in typical hierarchical deep learning and predictive coding networks. We argue that the shallow brain architecture provides several critical benefits over deep hierarchical structures and a more complete depiction of how mammalian brains achieve fast and flexible computational capabilities.

How 'visual' is the visual cortex? The interactions between the visual cortex and other sensory, motivational and motor systems as enabling factors for visual perception

The definition of the visual cortex is primarily based on the evidence that lesions of this area impair visual perception. However, this does not exclude that the visual cortex may process more information than of retinal origin alone, or that other brain structures contribute to vision. Indeed, research across the past decades has shown that non-visual information, such as neural activity related to reward expectation and value, locomotion, working memory and other sensory modalities, can modulate primary visual cortical responses to retinal inputs. Nevertheless, the function of this non-visual information is poorly understood. Here we review recent evidence, coming primarily from studies in rodents, arguing that non-visual and motor effects in visual cortex play a role in visual processing itself, for instance disentangling direct auditory effects on visual cortex from effects of sound-evoked orofacial movement. These findings are placed in a broader framework casting vision in terms of predictive processing under control of frontal, reward- and motor-related systems. In contrast to the prevalent notion that vision is exclusively constructed by the visual cortical system, we propose that visual percepts are generated by a larger network-the extended visual system-spanning other sensory cortices, supramodal areas and frontal systems. This article is part of the theme issue 'Decision and control processes in multisensory perception'.

Local minimization of prediction errors drives learning of invariant object representations in a generative network model of visual perception

The ventral visual processing hierarchy of the cortex needs to fulfill at least two key functions: perceived objects must be mapped to high-level representations invariantly of the precise viewing conditions, and a generative model must be learned that allows, for instance, to fill in occluded information guided by visual experience. Here, we show how a multilayered predictive coding network can learn to recognize objects from the bottom up and to generate specific representations via a top-down pathway through a single learning rule: the local minimization of prediction errors. Trained on sequences of continuously transformed objects, neurons in the highest network area become tuned to object identity invariant of precise position, comparable to inferotemporal neurons in macaques. Drawing on this, the dynamic properties of invariant object representations reproduce experimentally observed hierarchies of timescales from low to high levels of the ventral processing stream. The predicted faster decorrelation of error-neuron activity compared to representation neurons is of relevance for the experimental search for neural correlates of prediction errors. Lastly, the generative capacity of the network is confirmed by reconstructing specific object images, robust to partial occlusion of the inputs. By learning invariance from temporal continuity within a generative model, the approach generalizes the predictive coding framework to dynamic inputs in a more biologically plausible way than self-supervised networks with non-local error-backpropagation. This was achieved simply by shifting the training paradigm to dynamic inputs, with little change in architecture and learning rule from static input-reconstructing Hebbian predictive coding networks.

Spike-based coupling between single neurons and populations across rat sensory cortices, perirhinal cortex, and hippocampus

Cortical computations require coordination of neuronal activity within and across multiple areas. We characterized spiking relationships within and between areas by quantifying coupling of single neurons to population firing patterns. Single-neuron population coupling (SNPC) was investigated using ensemble recordings from hippocampal CA1 region and somatosensory, visual, and perirhinal cortices. Within-area coupling was heterogeneous across structures, with area CA1 showing higher levels than neocortical regions. In contrast to known anatomical connectivity, between-area coupling showed strong firing coherence of sensory neocortices with CA1, but less with perirhinal cortex. Cells in sensory neocortices and CA1 showed positive correlations between within- and between-area coupling; these were weaker for perirhinal cortex. All four areas harbored broadcasting cells, connecting to multiple external areas, which was uncorrelated to within-area coupling strength. When examining correlations between SNPC and spatial coding, we found that, if such correlations were significant, they were negative. This result was consistent with an overall preservation of SNPC across different brain states, suggesting a strong dependence on intrinsic network connectivity. Overall, SNPC offers an important window on cell-to-population synchronization in multi-area networks. Instead of pointing to specific information-coding functions, our results indicate a primary function of SNPC in dynamically organizing communication in systems composed of multiple, interconnected areas.

Spontaneous variations in arousal modulate subsequent visual processing and local field potential dynamics in the ferret during quiet wakefulness

Behavioral states affect neuronal responses throughout the cortex and influence visual processing. Quiet wakefulness (QW) is a behavioral state during which subjects are quiescent but awake and connected to the environment. Here, we examined the effects of pre-stimulus arousal variability on post-stimulus neural activity in the primary visual cortex and posterior parietal cortex in awake ferrets, using pupil diameter as an indicator of arousal. We observed that the power of stimuli-induced alpha (8-12 Hz) decreases when the arousal level increases. The peak of alpha power shifts depending on arousal. High arousal increases inter- and intra-areal coherence. Using a simplified model of laminar circuits, we show that this connectivity pattern is compatible with feedback signals targeting infragranular layers in area posterior parietal cortex and supragranular layers in V1. During high arousal, neurons in V1 displayed higher firing rates at their preferred orientations. Broad-spiking cells in V1 are entrained to high-frequency oscillations (>80 Hz), whereas narrow-spiking neurons are phase-locked to low- (12-18 Hz) and high-frequency (>80 Hz) rhythms. These results indicate that the variability and sensitivity of post-stimulus cortical responses and coherence depend on the pre-stimulus behavioral state and account for the neuronal response variability observed during repeated stimulation.

Coherent mapping of position and head direction across auditory and visual cortex

Neurons in primary visual cortex (V1) may not only signal current visual input but also relevant contextual information such as reward expectancy and the subject’s spatial position. Such contextual representations need not be restricted to V1 but could participate in a coherent mapping throughout sensory cortices. Here, we show that spiking activity coherently represents a location-specific mapping across auditory cortex (AC) and lateral, secondary visual cortex (V2L) of freely moving rats engaged in a sensory detection task on a figure-8 maze. Single-unit activity of both areas showed extensive similarities in terms of spatial distribution, reliability, and position coding. Importantly, reconstructions of subject position based on spiking activity displayed decoding errors that were correlated between areas. Additionally, we found that head direction, but not locomotor speed or head angular velocity, was an important determinant of activity in AC and V2L. By contrast, variables related to the sensory task cues or to trial correctness and reward were not markedly encoded in AC and V2L. We conclude that sensory cortices participate in coherent, multimodal representations of the subject’s sensory-specific location. These may provide a common reference frame for distributed cortical sensory and motor processes and may support crossmodal predictive processing.

A novel task to investigate vibrotactile detection in mice

Throughout the last decades, understanding the neural mechanisms of sensory processing has been a key objective for neuroscientists. Many studies focused on uncovering the microcircuit-level architecture of somatosensation using the rodent whisker system as a model. Although these studies have significantly advanced our understanding of tactile processing, the question remains to what extent the whisker system can provide results translatable to the human somatosensory system. To address this, we developed a restrained vibrotactile detection task involving the limb system in mice. A vibrotactile stimulus was delivered to the hindlimb of head-fixed mice, who were trained to perform a Go/No-go detection task. Mice were able to learn this task with satisfactory performance and with reasonably short training times. In addition, the task we developed is versatile, as it can be combined with diverse neuroscience methods. Thus, this study introduces a novel task to study the neuron-level mechanisms of tactile processing in a system other than the more commonly studied whisker system.

Functional (ir)Relevance of Posterior Parietal Cortex during Audiovisual Change Detection

The posterior parietal cortex (PPC) plays a key role in integrating sensory inputs from different modalities to support adaptive behavior. Neuronal activity in PPC reflects perceptual decision-making across behavioral tasks, but the mechanistic involvement of PPC is unclear. In an audiovisual change detection task, we tested the hypothesis that PPC is required to arbitrate between the noisy inputs from the two different modalities and help decide in which modality a sensory change occurred. In trained male mice, we found extensive single-neuron and population-level encoding of task-relevant visual and auditory stimuli, trial history, as well as upcoming behavioral responses. However, despite these rich neural correlates, which would theoretically be sufficient to solve the task, optogenetic inactivation of PPC did not affect visual or auditory performance. Thus, despite neural correlates faithfully tracking sensory variables and predicting behavioral responses, PPC was not relevant for audiovisual change detection. This functional dissociation questions the role of sensory- and task-related activity in parietal associative circuits during audiovisual change detection. Furthermore, our results highlight the necessity to dissociate functional correlates from mechanistic involvement when exploring the neural basis of perception and behavior.SIGNIFICANCE STATEMENT The posterior parietal cortex (PPC) is active during many daily tasks, but capturing its function has remained challenging. Specifically, it is proposed to function as an integration hub for multisensory inputs. Here, we tested the hypothesis that, rather than classical cue integration, mouse PPC is involved in the segregation and discrimination of sensory modalities. Surprisingly, although neural activity tracked current and past sensory stimuli and reflected the ongoing decision-making process, optogenetic inactivation did not affect task performance. Thus, we show an apparent redundancy of sensory and task-related activity in mouse PPC. These results narrow down the function of parietal circuits, as well as direct the search for those neural dynamics that causally drive perceptual decision-making.

What is neurorepresentationalism? From neural activity and predictive processing to multi-level representations and consciousness

This review provides an update on Neurorepresentationalism, a theoretical framework that defines conscious experience as multimodal, situational survey and explains its neural basis from brain systems constructing best-guess representations of sensations originating in our environment and body [1]. It posits that conscious experience is characterized by five essential hallmarks: (i) multimodal richness, (ii) situatedness and immersion, (iii) unity and integration, (iv) dynamics and stability, and (v) intentionality. Consciousness is furthermore proposed to have a biological function, framed by the contrast between reflexes and habits (not requiring consciousness) versus goal-directed, planned behavior (requiring multimodal, situational survey). Conscious experience is therefore understood as a sensorily rich, spatially encompassing representation of body and environment, while we nevertheless have the impression of experiencing external reality directly. Contributions to understanding neural mechanisms underlying consciousness are derived from models for predictive processing, which are trained in an unsupervised manner, do not necessarily require overt action, and have been extended to deep neural networks. Even with predictive processing in place, however, the question remains why this type of neural network activity would give rise to phenomenal experience. Here, I propose to tackle the Hard Problem with the concept of multi-level representations which emergently give rise to multimodal, spatially wide superinferences corresponding to phenomenal experiences. Finally, Neurorepresentationalism is compared to other neural theories of consciousness, and its implications for defining indicators of consciousness in animals, artificial intelligence devices and immobile or unresponsive patients with disorders of consciousness are discussed.

Multisensory task demands temporally extend the causal requirement for visual cortex in perception

Primary sensory areas constitute crucial nodes during perceptual decision making. However, it remains unclear to what extent they mainly constitute a feedforward processing step, or rather are continuously involved in a recurrent network together with higher-order areas. We found that the temporal window in which primary visual cortex is required for the detection of identical visual stimuli was extended when task demands were increased via an additional sensory modality that had to be monitored. Late-onset optogenetic inactivation preserved bottom-up, early-onset responses which faithfully encoded stimulus features, and was effective in impairing detection only if it preceded a late, report-related phase of the cortical response. Increasing task demands were marked by longer reaction times and the effect of late optogenetic inactivation scaled with reaction time. Thus, independently of visual stimulus complexity, multisensory task demands determine the temporal requirement for ongoing sensory-related activity in V1, which overlaps with report-related activity.

How primary sensory cortices contribute to decision making remains poorly understood. Here the authors report that increasing task demands extend the temporal window in which the primary visual cortex is required for detecting identical stimuli.

Multimodal Representation Learning for Place Recognition Using Deep Hebbian Predictive Coding

Recognising familiar places is a competence required in many engineering applications that interact with the real world such as robot navigation. Combining information from different sensory sources promotes robustness and accuracy of place recognition. However, mismatch in data registration, dimensionality, and timing between modalities remain challenging problems in multisensory place recognition. Spurious data generated by sensor drop-out in multisensory environments is particularly problematic and often resolved through adhoc and brittle solutions. An effective approach to these problems is demonstrated by animals as they gracefully move through the world. Therefore, we take a neuro-ethological approach by adopting self-supervised representation learning based on a neuroscientific model of visual cortex known as predictive coding. We demonstrate how this parsimonious network algorithm which is trained using a local learning rule can be extended to combine visual and tactile sensory cues from a biomimetic robot as it naturally explores a visually aliased environment. The place recognition performance obtained using joint latent representations generated by the network is significantly better than contemporary representation learning techniques. Further, we see evidence of improved robustness at place recognition in face of unimodal sensor drop-out. The proposed multimodal deep predictive coding algorithm presented is also linearly extensible to accommodate more than two sensory modalities, thereby providing an intriguing example of the value of neuro-biologically plausible representation learning for multimodal navigation.

Higher Order Visual Areas Enhance Stimulus Responsiveness in Mouse Primary Visual Cortex

Over the past few years, the various areas that surround the primary visual cortex (V1) in the mouse have been associated with many functions, ranging from higher order visual processing to decision-making. Recently, some studies have shown that higher order visual areas influence the activity of the primary visual cortex, refining its processing capabilities. Here, we studied how in vivo optogenetic inactivation of two higher order visual areas with different functional properties affects responses evoked by moving bars in the primary visual cortex. In contrast with the prevailing view, our results demonstrate that distinct higher order visual areas similarly modulate early visual processing. In particular, these areas enhance stimulus responsiveness in the primary visual cortex, by more strongly amplifying weaker compared with stronger sensory-evoked responses (for instance specifically amplifying responses to stimuli not moving along the direction preferred by individual neurons) and by facilitating responses to stimuli entering the receptive field of single neurons. Such enhancement, however, comes at the expense of orientation and direction selectivity, which increased when the selected higher order visual areas were inactivated. Thus, feedback from higher order visual areas selectively amplifies weak sensory-evoked V1 responses, which may enable more robust processing of visual stimuli.

The continued need for animals to advance brain research

Policymakers aim to move toward animal-free alternatives for scientific research and have introduced very strict regulations for animal research. We argue that, for neuroscience research, until viable and translational alternatives become available and the value of these alternatives has been proven, the use of animals should not be compromised.

Deep Gated Hebbian Predictive Coding Accounts for Emergence of Complex Neural Response Properties Along the Visual Cortical Hierarchy

Predictive coding provides a computational paradigm for modeling perceptual processing as the construction of representations accounting for causes of sensory inputs. Here, we developed a scalable, deep network architecture for predictive coding that is trained using a gated Hebbian learning rule and mimics the feedforward and feedback connectivity of the cortex. After training on image datasets, the models formed latent representations in higher areas that allowed reconstruction of the original images. We analyzed low- and high-level properties such as orientation selectivity, object selectivity and sparseness of neuronal populations in the model. As reported experimentally, image selectivity increased systematically across ascending areas in the model hierarchy. Depending on the strength of regularization factors, sparseness also increased from lower to higher areas. The results suggest a rationale as to why experimental results on sparseness across the cortical hierarchy have been inconsistent. Finally, representations for different object classes became more distinguishable from lower to higher areas. Thus, deep neural networks trained using a gated Hebbian formulation of predictive coding can reproduce several properties associated with neuronal responses along the visual cortical hierarchy.

Reconciling the object and spatial processing views of the perirhinal cortex through task-relevant unitization

The perirhinal cortex is situated on the border between sensory association cortex and the hippocampal formation. It serves an important function as a transition area between the sensory neocortex and the medial temporal lobe. While the perirhinal cortex has traditionally been associated with object coding and the "what" pathway of the temporal lobe, current evidence suggests a broader function of the perirhinal cortex in solving feature ambiguity and processing complex stimuli. Besides fulfilling functions in object coding, recent neurophysiological findings in freely moving rodents indicate that the perirhinal cortex also contributes to spatial and contextual processing beyond individual sensory modalities. Here, we address how these two opposing views on perirhinal cortex-the object-centered and spatial-contextual processing hypotheses-may be reconciled. The perirhinal cortex is consistently recruited when different features can be merged perceptually or conceptually into a single entity. Features that are unitized in these entities include object information from multiple sensory domains, reward associations, semantic features and spatial/contextual associations. We propose that the same perirhinal network circuits can be flexibly deployed for multiple cognitive functions, such that the perirhinal cortex performs similar unitization operations on different types of information, depending on behavioral demands and ranging from the object-related domain to spatial, contextual and semantic information.

Neural Correlates of Multisensory Detection Behavior: Comparison of Primary and Higher-Order Visual Cortex

We act upon stimuli in our surrounding environment by gathering the multisensory information they convey and by integrating this information to decide on a behavioral action. We hypothesized that the anterolateral secondary visual cortex (area AL) of the mouse brain may serve as a hub for sensorimotor transformation of audiovisual information. We imaged neuronal activity in primary visual cortex (V1) and AL of the mouse during a detection task using visual, auditory, and audiovisual stimuli. We found that AL neurons were more sensitive to weak uni- and multisensory stimuli compared to V1. Depending on contrast, different subsets of AL and V1 neurons showed cross-modal modulation of visual responses. During audiovisual stimulation, AL neurons showed stronger differentiation of behaviorally reported versus unreported stimuli compared to V1, whereas V1 showed this distinction during unisensory visual stimulation. Thus, neural population activity in area AL correlates more closely with multisensory detection behavior than V1.

Awakening after a sleeping pill: Restoring functional brain networks after severe brain injury

Some patients with severe brain injury show short-term neurological improvements, such as recovery of consciousness, motor function, or speech after administering zolpidem, a GABA receptor agonist. The working mechanism of this paradoxical phenomenon remains unknown. In this study, we used electroencephalography and magnetoencephalography to investigate a spectacular zolpidem-induced awakening, including the recovery of functional communication and the ability to walk in a patient with severe hypoxic-ischemic brain injury. We show that cognitive deficits, speech loss, and motor impairments after severe brain injury are associated with stronger beta band connectivity throughout the brain and suggest that neurological recovery after zolpidem occurs with the restoration of beta band connectivity. This exploratory work proposes an essential role for beta rhythms in goal-directed behavior and cognition. It advocates further fundamental and clinical research on the role of increased beta band connectivity in the development of neurological deficits after severe brain injury.

Multiplexing of Information about Self and Others in Hippocampal Ensembles

In addition to coding a subject's location in space, the hippocampus has been suggested to code social information, including the spatial position of conspecifics. "Social place cells" have been reported for tasks in which an observer mimics the behavior of a demonstrator. We examine whether rat hippocampal neurons may encode the behavior of a minirobot, but without requiring the animal to mimic it. Rather than finding social place cells, we observe that robot behavioral patterns modulate place fields coding animal position. This modulation may be confounded by correlations between robot movement and changes in the animal's position. Although rat position indeed significantly predicts robot behavior, we find that hippocampal ensembles code additional information about robot movement patterns. Fast-spiking interneurons are particularly informative about robot position and global behavior. In conclusion, when the animal's own behavior is conditional on external agents, the hippocampus multiplexes information about self and others.

Learning, memory and consolidation mechanisms for behavioral control in hierarchically organized cortico-basal ganglia systems

This article aims to provide a synthesis on the question how brain structures cooperate to accomplish hierarchically organized behaviors, characterized by low‐level, habitual routines nested in larger sequences of planned, goal‐directed behavior. The functioning of a connected set of brain structures—prefrontal cortex, hippocampus, striatum, and dopaminergic mesencephalon—is reviewed in relation to two important distinctions: (a) goal‐directed as opposed to habitual behavior and (b) model‐based and model‐free learning. Recent evidence indicates that the orbitomedial prefrontal cortices not only subserve goal‐directed behavior and model‐based learning, but also code the “landscape” (task space) of behaviorally relevant variables. While the hippocampus stands out for its role in coding and memorizing world state representations, it is argued to function in model‐based learning but is not required for coding of action–outcome contingencies, illustrating that goal‐directed behavior is not congruent with model‐based learning. While the dorsolateral and dorsomedial striatum largely conform to the dichotomy between habitual versus goal‐directed behavior, ventral striatal functions go beyond this distinction. Next, we contextualize findings on coding of reward‐prediction errors by ventral tegmental dopamine neurons to suggest a broader role of mesencephalic dopamine cells, viz. in behavioral reactivity and signaling unexpected sensory changes. We hypothesize that goal‐directed behavior is hierarchically organized in interconnected cortico‐basal ganglia loops, where a limbic‐affective prefrontal‐ventral striatal loop controls action selection in a dorsomedial prefrontal–striatal loop, which in turn regulates activity in sensorimotor‐dorsolateral striatal circuits. This structure for behavioral organization requires alignment with mechanisms for memory formation and consolidation. We propose that frontal corticothalamic circuits form a high‐level loop for memory processing that initiates and temporally organizes nested activities in lower‐level loops, including the hippocampus and the ripple‐associated replay it generates. The evidence on hierarchically organized behavior converges with that on consolidation mechanisms in suggesting a frontal‐to‐caudal directionality in processing control.

Functional determinants of enhanced and depressed interareal information flow in nonrapid eye movement sleep between neuronal ensembles in rat cortex and hippocampus

Compared with wakefulness, neuronal activity during nonrapid eye movement (NREM) sleep is characterized by a decreased ability to integrate information, but also by the reemergence of task-related information patterns. To investigate the mechanisms underlying these seemingly opposing phenomena, we measured directed information flow by computing transfer entropy between neuronal spiking activity in three cortical regions and the hippocampus of rats across brain states. State-dependent information flow was jointly determined by the anatomical distance between neurons and by their functional specialization. We distinguished two regimes, operating at short and long time scales, respectively. From wakefulness to NREM sleep, transfer entropy at short time scales increased for interareal connections between neurons showing behavioral task correlates. Conversely, transfer entropy at long time scales became stronger between nontask modulated neurons and weaker between task-modulated neurons. These results may explain how, during NREM sleep, a global interareal disconnection is compatible with highly specific task-related information transfer.

Indicators and Criteria of Consciousness in Animals and Intelligent Machines: An Inside-Out Approach

In today's society, it becomes increasingly important to assess which non-human and non-verbal beings possess consciousness. This review article aims to delineate criteria for consciousness especially in animals, while also taking into account intelligent artifacts. First, we circumscribe what we mean with "consciousness" and describe key features of subjective experience: qualitative richness, situatedness, intentionality and interpretation, integration and the combination of dynamic and stabilizing properties. We argue that consciousness has a biological function, which is to present the subject with a multimodal, situational survey of the surrounding world and body, subserving complex decision-making and goal-directed behavior. This survey reflects the brain's capacity for internal modeling of external events underlying changes in sensory state. Next, we follow an inside-out approach: how can the features of conscious experience, correlating to mechanisms inside the brain, be logically coupled to externally observable ("outside") properties? Instead of proposing criteria that would each define a "hard" threshold for consciousness, we outline six indicators: (i) goal-directed behavior and model-based learning; (ii) anatomic and physiological substrates for generating integrative multimodal representations; (iii) psychometrics and meta-cognition; (iv) episodic memory; (v) susceptibility to illusions and multistable perception; and (vi) specific visuospatial behaviors. Rather than emphasizing a particular indicator as being decisive, we propose that the consistency amongst these indicators can serve to assess consciousness in particular species. The integration of scores on the various indicators yields an overall, graded criterion for consciousness, somewhat comparable to the Glasgow Coma Scale for unresponsive patients. When considering theoretically derived measures of consciousness, it is argued that their validity should not be assessed on the basis of a single quantifiable measure, but requires cross-examination across multiple pieces of evidence, including the indicators proposed here. Current intelligent machines, including deep learning neural networks (DLNNs) and agile robots, are not indicated to be conscious yet. Instead of assessing machine consciousness by a brief Turing-type of test, evidence for it may gradually accumulate when we study machines ethologically and across time, considering multiple behaviors that require flexibility, improvisation, spontaneous problem-solving and the situational conspectus typically associated with conscious experience.

The Human Brain Project-Synergy between neuroscience, computing, informatics, and brain-inspired technologies

The Human Brain Project (HBP) is a European flagship project with a 10-year horizon aiming to understand the human brain and to translate neuroscience knowledge into medicine and technology. To achieve such aims, the HBP explores the multilevel complexity of the brain in space and time; transfers the acquired knowledge to brain-derived applications in health, computing, and technology; and provides shared and open computing tools and data through the HBP European brain research infrastructure. We discuss how the HBP creates a transdisciplinary community of researchers united by the quest to understand the brain, with fascinating perspectives on societal benefits.

This Community Page article presents the Human Brain Project; a European Flagship project with a ten-year horizon aiming to understand the human brain and translate neuroscience knowledge into medicine and technology.

The circuit architecture of cortical multisensory processing: Distinct functions jointly operating within a common anatomical network

Our perceptual systems continuously process sensory inputs from different modalities and organize these streams of information such that our subjective representation of the outside world is a unified experience. By doing so, they also enable further cognitive processing and behavioral action. While cortical multisensory processing has been extensively investigated in terms of psychophysics and mesoscale neural correlates, an in depth understanding of the underlying circuit-level mechanisms is lacking. Previous studies on circuit-level mechanisms of multisensory processing have predominantly focused on cue integration, i.e. the mechanism by which sensory features from different modalities are combined to yield more reliable stimulus estimates than those obtained by using single sensory modalities. In this review, we expand the framework on the circuit-level mechanisms of cortical multisensory processing by highlighting that multisensory processing is a family of functions - rather than a single operation - which involves not only the integration but also the segregation of modalities. In addition, multisensory processing not only depends on stimulus features, but also on cognitive resources, such as attention and memory, as well as behavioral context, to determine the behavioral outcome. We focus on rodent models as a powerful instrument to study the circuit-level bases of multisensory processes, because they enable combining cell-type-specific recording and interventional techniques with complex behavioral paradigms. We conclude that distinct multisensory processes share overlapping anatomical substrates, are implemented by diverse neuronal micro-circuitries that operate in parallel, and are flexibly recruited based on factors such as stimulus features and behavioral constraints.

Sensory Processing Across Conscious and Nonconscious Brain States: From Single Neurons to Distributed Networks for Inferential Representation

Neuronal activity is markedly different across brain states: it varies from desynchronized activity during wakefulness to the synchronous alternation between active and silent states characteristic of deep sleep. Surprisingly, limited attention has been paid to investigating how brain states affect sensory processing. While it was long assumed that the brain was mostly disconnected from external stimuli during sleep, an increasing number of studies indicates that sensory stimuli continue to be processed across all brain states-albeit differently. In this review article, we first discuss what constitutes a brain state. We argue that-next to global, behavioral states such as wakefulness and sleep-there is a concomitant need to distinguish bouts of oscillatory dynamics with specific global/local activity patterns and lasting for a few hundreds of milliseconds, as these can lead to the same sensory stimulus being either perceived or not. We define these short-lasting bouts as micro-states. We proceed to characterize how sensory-evoked neural responses vary between conscious and nonconscious states. We focus on two complementary aspects: neuronal ensembles and inter-areal communication. First, we review which features of ensemble activity are conducive to perception, and how these features vary across brain states. Properties such as heterogeneity, sparsity and synchronicity in neuronal ensembles will especially be considered as essential correlates of conscious processing. Second, we discuss how inter-areal communication varies across brain states and how this may affect brain operations and sensory processing. Finally, we discuss predictive coding (PC) and the concept of multi-level representations as a key framework for understanding conscious sensory processing. In this framework the brain implements conscious representations as inferences about world states across multiple representational levels. In this representational hierarchy, low-level inference may be carried out nonconsciously, whereas high levels integrate across different sensory modalities and larger spatial scales, correlating with conscious processing. This inferential framework is used to interpret several cellular and population-level findings in the context of brain states, and we briefly compare its implications to two other theories of consciousness. In conclusion, this review article, provides foundations to guide future studies aiming to uncover the mechanisms of sensory processing and perception across brain states.

Audiovisual Integration Enhances Stimulus Detection Performance in Mice

The detection of objects in the external world improves when humans and animals integrate object features of multiple sensory modalities. Behavioral and neuronal mechanisms underlying multisensory stimulus detection are poorly understood, mainly because they have not been investigated with suitable behavioral paradigms. Such behavioral paradigms should (i) elicit a robust multisensory gain, (ii) incorporate systematic calibration of stimulus amplitude to the sensory capacities of the individual subject, (iii) yield a high trial count, and (iv) be easily compatible with a large variety of neurophysiological recording techniques. We developed an audiovisual stimulus detection task for head-fixed mice which meets all of these critical behavioral constraints. Behavioral data obtained with this task indicated a robust increase in detection performance of multisensory stimuli compared with unisensory cues, which was maximal when both stimulus constituents were presented at threshold intensity. The multisensory behavioral effect was associated with a change in the perceptual performance which consisted of two components. First, the visual and auditory perceptual systems increased their sensitivity meaning that low intensity stimuli were more often detected. Second, enhanced acuity enabled the systems to better classify whether there was a stimulus or not. Fitting our data to signal detection models revealed that the multisensory gain was more likely to be achieved by integration of sensory signals rather than by stimulus redundancy or competition. This validated behavioral paradigm can be exploited to reliably investigate the neuronal correlates of multisensory stimulus detection at the level of single neurons, microcircuits, and larger perceptual systems.

Model-based spatial navigation in the hippocampus-ventral striatum circuit: A computational analysis

While the neurobiology of simple and habitual choices is relatively well known, our current understanding of goal-directed choices and planning in the brain is still limited. Theoretical work suggests that goal-directed computations can be productively associated to model-based (reinforcement learning) computations, yet a detailed mapping between computational processes and neuronal circuits remains to be fully established. Here we report a computational analysis that aligns Bayesian nonparametrics and model-based reinforcement learning (MB-RL) to the functioning of the hippocampus (HC) and the ventral striatum (vStr)-a neuronal circuit that increasingly recognized to be an appropriate model system to understand goal-directed (spatial) decisions and planning mechanisms in the brain. We test the MB-RL agent in a contextual conditioning task that depends on intact hippocampus and ventral striatal (shell) function and show that it solves the task while showing key behavioral and neuronal signatures of the HC-vStr circuit. Our simulations also explore the benefits of biological forms of look-ahead prediction (forward sweeps) during both learning and control. This article thus contributes to fill the gap between our current understanding of computational algorithms and biological realizations of (model-based) reinforcement learning.

Impaired hippocampal representation of place in the Fmr1-knockout mouse model of fragile X syndrome

Fragile X syndrome (FXS) is an X-chromosome linked intellectual disability and the most common known inherited single gene cause of autism spectrum disorder (ASD). Building upon demonstrated deficits in neuronal plasticity and spatial memory in FXS, we investigated how spatial information processing is affected in vivo in an FXS mouse model (Fmr1-KO). Healthy hippocampal neurons (so-called place cells) exhibit place-related activity during spatial exploration, and their firing fields tend to remain stable over time. In contrast, we find impaired stability and reduced specificity of Fmr1-KO spatial representations. This is a potential biomarker for the cognitive dysfunction observed in FXS, informative on the ability to integrate sensory information into an abstract representation and successfully retain this conceptual memory. Our results provide key insight into the biological mechanisms underlying cognitive disabilities in FXS and ASD, paving the way for a targeted approach to remedy these.

Data integration through brain atlasing: Human Brain Project tools and strategies

The Human Brain Project (HBP), an EU Flagship Initiative, is currently building an infrastructure that will allow integration of large amounts of heterogeneous neuroscience data. The ultimate goal of the project is to develop a unified multi-level understanding of the brain and its diseases, and beyond this to emulate the computational capabilities of the brain. Reference atlases of the brain are one of the key components in this infrastructure. Based on a new generation of three-dimensional (3D) reference atlases, new solutions for analyzing and integrating brain data are being developed. HBP will build services for spatial query and analysis of brain data comparable to current online services for geospatial data. The services will provide interactive access to a wide range of data types that have information about anatomical location tied to them. The 3D volumetric nature of the brain, however, introduces a new level of complexity that requires a range of tools for making use of and interacting with the atlases. With such new tools, neuroscience research groups will be able to connect their data to atlas space, share their data through online data systems, and search and find other relevant data through the same systems. This new approach partly replaces earlier attempts to organize research data based only on a set of semantic terminologies describing the brain and its subdivisions.

Abnormal hippocampal theta and gamma hypersynchrony produces network and spike timing disturbances in the Fmr1-KO mouse model of Fragile X syndrome

Neuronal networks can synchronize their activity through excitatory and inhibitory connections, which is conducive to synaptic plasticity. This synchronization is reflected in rhythmic fluctuations of the extracellular field. In the hippocampus, theta and gamma band LFP oscillations are a hallmark of the processing of spatial information and memory. Fragile X syndrome (FXS) is an intellectual disability and the most common genetic cause of autism spectrum disorder (Belmonte and Bourgeron, 2006). Here, we investigated how neuronal network synchronization in the mouse hippocampus is compromised by the Fmr1 mutation that causes FXS (Santos et al., 2014), relating recently observed single-cell level impairments (Arbab et al., 2017) to neuronal network aberrations. We implanted tetrodes in hippocampus of freely moving Fmr1-KO and littermate wildtype (WT) mice (Mientjes et al., 2006), to record spike trains from multiple, isolated neurons as well as LFPs in a spatial exploration paradigm. Compared to wild type mice, Fmr1-KO mice displayed greater power of hippocampal theta oscillations, and higher coherence in the slow gamma band. Additionally, spike trains of Fmr1-KO interneurons show decreased spike-count correlations and they are hypersynchronized with theta and slow gamma oscillations. The hypersynchronization of Fmr1-KO oscillations and spike timing reflects functional deficits in local networks. This network hypersynchronization pathologically decreases the heterogeneity of spike-LFP phase coupling, compromising information processing within the hippocampal circuit. These findings may reflect a pathophysiological mechanism explaining cognitive impairments in FXS and autism, in which there is anomalous processing of social and environmental cues and associated deficits in memory and cognition.

Consciousness, Representation, Action: The Importance of Being Goal-Directed

Recent years have witnessed fierce debates on the dependence of consciousness on interactions between a subject and the environment. Reviewing neuroscientific, computational, and clinical evidence, I will address three questions. First, does conscious experience necessarily depend on acute interactions between a subject and the environment? Second, does it depend on specific perception-action loops in the longer run? Third, which types of action does consciousness cohere with, if not with all of them? I argue that conscious contents do not necessarily depend on acute or long-term brain-environment interactions. Instead, consciousness is proposed to be specifically associated with, and subserve, deliberate, goal-directed behavior (GDB). Brain systems implied in conscious representation are highly connected to, but distinct from, neural substrates mediating GDB and declarative memory.

Perirhinal firing patterns are sustained across large spatial segments of the task environment

Spatial navigation and memory depend on the neural coding of an organism's location. Fine-grained coding of location is thought to depend on the hippocampus. Likewise, animals benefit from knowledge parsing their environment into larger spatial segments, which are relevant for task performance. Here we investigate how such knowledge may be coded, and whether this occurs in structures in the temporal lobe, supplying cortical inputs to the hippocampus. We found that neurons in the perirhinal cortex of rats generate sustained firing patterns that discriminate large segments of the task environment. This contrasted to transient firing in hippocampus and sensory neocortex. These spatially extended patterns were not explained by task variables or temporally discrete sensory stimuli. Previously it has been suggested that the perirhinal cortex is part of a pathway processing object, but not spatial information. Our results indicate a greater complexity of neural coding than captured by this dichotomy.

Effects of Arc/Arg3.1 gene deletion on rhythmic synchronization of hippocampal CA1 neurons during locomotor activity and sleep

The activity-regulated cytoskeletal-associated protein/activity regulated gene (Arc/Arg3.1) is crucial for long-term synaptic plasticity and memory formation. However, the neurophysiological substrates of memory deficits occurring in the absence of Arc/Arg3.1 are unknown. We compared hippocampal CA1 single-unit and local field potential (LFP) activity in Arc/Arg3.1 knockout and wild-type mice during track running and flanking sleep periods. Locomotor activity, basic firing and spatial coding properties of CA1 cells in knockout mice were not different from wild-type mice. During active behavior, however, knockout animals showed a significantly shifted balance in LFP power, with a relative loss in high-frequency (beta-2 and gamma) bands compared to low-frequency bands. Moreover, during track-running, knockout mice showed a decrease in phase locking of spiking activity to LFP oscillations in theta, beta and gamma bands. Sleep architecture in knockout mice was not grossly abnormal. Sharp-wave ripples, which have been associated with memory consolidation and replay, showed only minor differences in dynamics and amplitude. Altogether, these findings suggest that Arc/Arg3.1 effects on memory formation are not only manifested at the level of molecular pathways regulating synaptic plasticity, but also at the systems level. The disrupted power balance in theta, beta and gamma rhythmicity and concomitant loss of spike-field phase locking may affect memory encoding during initial storage and memory consolidation stages.

Membrane Potential Dynamics of Spontaneous and Visually Evoked Gamma Activity in V1 of Awake Mice

Cortical gamma activity (30–80 Hz) is believed to play important functions in neural computation and arises from the interplay of parvalbumin-expressing interneurons (PV) and pyramidal cells (PYRs). However, the subthreshold dynamics underlying its emergence in the cortex of awake animals remain unclear. Here, we characterized the intracellular dynamics of PVs and PYRs during spontaneous and visually evoked gamma activity in layers 2/3 of V1 of awake mice using targeted patch-clamp recordings and synchronous local field potentials (LFPs). Strong gamma activity patterned in short bouts (one to three cycles), occurred when PVs and PYRs were depolarizing and entrained their membrane potential dynamics regardless of the presence of visual stimulation. PV firing phase locked unconditionally to gamma activity. However, PYRs only phase locked to visually evoked gamma bouts. Taken together, our results indicate that gamma activity corresponds to short pulses of correlated background synaptic activity synchronizing the output of cortical neurons depending on external sensory drive.

Gamma activity, an important component of brain dynamics, is driven by synaptic background activity and synchronizes distinct cortical cell types differently depending on visual input.

The neocortex is the main substrate of cognitive activity of the mammalian brain. During active wakefulness, it exhibits an oscillatory activity in the gamma range (30–80Hz), which is believed to play an important functional role and is altered in schizophrenic patients. Experimental studies have shown that gamma activity arises from the interaction of excitatory pyramidal neurons, the main neuronal type of the cortex, and local inhibitory neurons expressing the protein parvalbumin (PV). However, how these neuronal types behave during gamma activity remains largely unknown. Here, we recorded the intracellular activity of pyramidal and PV-expressing neurons in the visual cortex of awake mice while acquiring Local Field Potentials (LFPs)—extracellular voltage fluctuations within a small volume of the cortex—to monitor gamma activity. We found that gamma activity arises when PV-expressing neurons synchronize their output in response to a correlated input, reflecting the general activation of the local cortical network. This happens even in the absence of visual input. On the other hand, the output of pyramidal neurons only becomes entrained to gamma activity when the mice are exposed to visual stimulation. Thus, our results suggest that gamma activity synchronizes pyramidal neurons specifically when the cortex is engaged in processing external inputs.

Cell-Type and State-Dependent Synchronization among Rodent Somatosensory, Visual, Perirhinal Cortex, and Hippocampus CA1

Beta and gamma rhythms have been hypothesized to be involved in global and local coordination of neuronal activity, respectively. Here, we investigated how cells in rodent area S1BF are entrained by rhythmic fluctuations at various frequencies within the local area and in connected areas, and how this depends on behavioral state and cell type. We performed simultaneous extracellular field and unit recordings in four connected areas of the freely moving rat (S1BF, V1M, perirhinal cortex, CA1). S1BF spiking activity was strongly entrained by both beta and gamma S1BF oscillations, which were associated with deactivations and activations, respectively. We identified multiple classes of fast spiking and excitatory cells in S1BF, which showed prominent differences in rhythmic entrainment and in the extent to which phase locking was modulated by behavioral state. Using an additional dataset acquired by whole-cell recordings in head-fixed mice, these cell classes could be compared with identified phenotypes showing gamma rhythmicity in their membrane potential. We next examined how S1BF cells were entrained by rhythmic fluctuations in connected brain areas. Gamma-synchronization was detected in all four areas, however we did not detect significant gamma coherence among these areas. Instead, we only found long-range coherence in the theta-beta range among these areas. In contrast to local S1BF synchronization, we found long-range S1BF-spike to CA1–LFP synchronization to be homogeneous across inhibitory and excitatory cell types. These findings suggest distinct, cell-type contributions of low and high-frequency synchronization to intra- and inter-areal neuronal interactions.

Mouse V1 population correlates of visual detection rely on heterogeneity within neuronal response patterns

Previous studies have demonstrated the importance of the primary sensory cortex for the detection, discrimination, and awareness of visual stimuli, but it is unknown how neuronal populations in this area process detected and undetected stimuli differently. Critical differences may reside in the mean strength of responses to visual stimuli, as reflected in bulk signals detectable in functional magnetic resonance imaging, electro-encephalogram, or magnetoencephalography studies, or may be more subtly composed of differentiated activity of individual sensory neurons. Quantifying single-cell Ca²⁺ responses to visual stimuli recorded with in vivo two-photon imaging, we found that visual detection correlates more strongly with population response heterogeneity rather than overall response strength. Moreover, neuronal populations showed consistencies in activation patterns across temporally spaced trials in association with hit responses, but not during nondetections. Contrary to models relying on temporally stable networks or bulk signaling, these results suggest that detection depends on transient differentiation in neuronal activity within cortical populations.

DOI:http://dx.doi.org/10.7554/eLife.10163.001

Seeing is not the same as perceiving, where an object is recognized and information about it is interpreted by the brain. Things might be in your field of view, but not actively perceived; for example, when daydreaming with your eyes open. Many researchers have investigated how the brain responds differently to a perceived object compared with something that is seen but not perceived. However, using relatively coarse techniques, only small differences in brain activity have been found.

Many of the techniques used to investigate brain activity only look at the average activity of a group of neurons – the cells in the brain that process information. This raises the possibility that the perception of an object relies on more subtle or complex interactions in brain activity. To investigate this, Montijn et al. trained mice to lick a reward spout that gave out sugar water when they perceived a particular image. A technique called two-photon calcium imaging was then used to simultaneously record the activity of tens to hundreds of neurons in part of the brain called the visual cortex as the mice performed the perception task.

This revealed that the average activation of a group of neurons was only weakly related to whether a mouse had perceived the image. However, differences in the strength of the responses of the individual neurons in the group reflected perception more strongly: when a mouse perceived the image and licked in response, a heterogeneous (non-uniform) set of neuronal responses occurred. The diversity of the neuronal responses could also be used to predict how quickly a mouse would respond to an image. These activity differences would not be picked up by techniques that detect the average activity of many neurons, explaining why these effects had not previously been seen.

These findings shed light on which patterns of activity in the visual region of the brain lead to objects being perceived or not. Whether similar mechanisms operate in different regions of the brain remains to be investigated.

DOI:http://dx.doi.org/10.7554/eLife.10163.002

Effects of isoflurane anesthesia on ensemble patterns of Ca2+ activity in mouse v1: reduced direction selectivity independent of increased correlations in cellular activity

Anesthesia affects brain activity at the molecular, neuronal and network level, but it is not well-understood how tuning properties of sensory neurons and network connectivity change under its influence. Using in vivo two-photon calcium imaging we matched neuron identity across episodes of wakefulness and anesthesia in the same mouse and recorded spontaneous and visually evoked activity patterns of neuronal ensembles in these two states. Correlations in spontaneous patterns of calcium activity between pairs of neurons were increased under anesthesia. While orientation selectivity remained unaffected by anesthesia, this treatment reduced direction selectivity, which was attributable to an increased response to the null-direction. As compared to anesthesia, populations of V1 neurons coded more mutual information on opposite stimulus directions during wakefulness, whereas information on stimulus orientation differences was lower. Increases in correlations of calcium activity during visual stimulation were correlated with poorer population coding, which raised the hypothesis that the anesthesia-induced increase in correlations may be causal to degrading directional coding. Visual stimulation under anesthesia, however, decorrelated ongoing activity patterns to a level comparable to wakefulness. Because visual stimulation thus appears to 'break' the strength of pairwise correlations normally found in spontaneous activity under anesthesia, the changes in correlational structure cannot explain the awake-anesthesia difference in direction coding. The population-wide decrease in coding for stimulus direction thus occurs independently of anesthesia-induced increments in correlations of spontaneous activity.

The why, what, where, when and how of goal-directed choice: neuronal and computational principles

The central problems that goal-directed animals must solve are: 'What do I need and Why, Where and When can this be obtained, and How do I get it?' or the H4W problem. Here, we elucidate the principles underlying the neuronal solutions to H4W using a combination of neurobiological and neurorobotic approaches. First, we analyse H4W from a system-level perspective by mapping its objectives onto the Distributed Adaptive Control embodied cognitive architecture which sees the generation of adaptive action in the real world as the primary task of the brain rather than optimally solving abstract problems. We next map this functional decomposition to the architecture of the rodent brain to test its consistency. Following this approach, we propose that the mammalian brain solves the H4W problem on the basis of multiple kinds of outcome predictions, integrating central representations of needs and drives (e.g. hypothalamus), valence (e.g. amygdala), world, self and task state spaces (e.g. neocortex, hippocampus and prefrontal cortex, respectively) combined with multi-modal selection (e.g. basal ganglia). In our analysis, goal-directed behaviour results from a well-structured architecture in which goals are bootstrapped on the basis of predefined needs, valence and multiple learning, memory and planning mechanisms rather than being generated by a singular computation.

Internally generated sequences in learning and executing goal-directed behavior

A network of brain structures including hippocampus (HC), prefrontal cortex, and striatum controls goal-directed behavior and decision making. However, the neural mechanisms underlying these functions are unknown. Here, we review the role of 'internally generated sequences': structured, multi-neuron firing patterns in the network that are not confined to signaling the current state or location of an agent, but are generated on the basis of internal brain dynamics. Neurophysiological studies suggest that such sequences fulfill functions in memory consolidation, augmentation of representations, internal simulation, and recombination of acquired information. Using computational modeling, we propose that internally generated sequences may be productively considered a component of goal-directed decision systems, implementing a sampling-based inference engine that optimizes goal acquisition at multiple timescales of on-line choice, action control, and learning.

Population coding in mouse visual cortex: response reliability and dissociability of stimulus tuning and noise correlation

The primary visual cortex is an excellent model system for investigating how neuronal populations encode information, because of well-documented relationships between stimulus characteristics and neuronal activation patterns. We used two-photon calcium imaging data to relate the performance of different methods for studying population coding (population vectors, template matching, and Bayesian decoding algorithms) to their underlying assumptions. We show that the variability of neuronal responses may hamper the decoding of population activity, and that a normalization to correct for this variability may be of critical importance for correct decoding of population activity. Second, by comparing noise correlations and stimulus tuning we find that these properties have dissociated anatomical correlates, even though noise correlations have been previously hypothesized to reflect common synaptic input. We hypothesize that noise correlations arise from large non-specific increases in spiking activity acting on many weak synapses simultaneously, while neuronal stimulus response properties are dependent on more reliable connections. Finally, this paper provides practical guidelines for further research on population coding and shows that population coding cannot be approximated by a simple summation of inputs, but is heavily influenced by factors such as input reliability and noise correlation structure.

Functions of gamma-band synchronization in cognition: from single circuits to functional diversity across cortical and subcortical systems

Gamma-band activity (30-90 Hz) and the synchronization of neural activity in the gamma-frequency range have been observed in different cortical and subcortical structures and have been associated with different cognitive functions. However, it is still unknown whether gamma-band synchronization subserves a single universal function or a diversity of functions across the full spectrum of cognitive processes. Here, we address this question reviewing the mechanisms of gamma-band oscillation generation and the functions associated with gamma-band activity across several cortical and subcortical structures. Additionally, we raise a plausible explanation of why gamma rhythms are found so ubiquitously across brain structures. Gamma band activity originates from the interplay between inhibition and excitation. We stress that gamma oscillations, associated with this interplay, originate from basic functional motifs that conferred advantages for low-level system processing and multiple cognitive functions throughout evolution. We illustrate the multifunctionality of gamma-band activity by considering its role in neural systems for perception, selective attention, memory, motivation and behavioral control. We conclude that gamma-band oscillations support multiple cognitive processes, rather than a single one, which, however, can be traced back to a limited set of circuit motifs which are found universally across species and brain structures.

Respiration phase-locks to fast stimulus presentations: implications for the interpretation of posterior midline "deactivations"

The posterior midline region (PMR)-considered a core of the default mode network-is deactivated during successful performance in different cognitive tasks. The extent of PMR-deactivations is correlated with task-demands and associated with successful performance in various cognitive domains. In the domain of episodic memory, functional MRI (fMRI) studies found that PMR-deactivations reliably predict learning (successful encoding). Yet it is unclear what explains this relation. One intriguing possibility is that PMR-deactivations are partially mediated by respiratory artifacts. There is evidence that the fMRI signal in PMR is particularly prone to respiratory artifacts, because of its large surrounding blood vessels. As respiratory fluctuations have been shown to track changes in attention, it is critical for the general interpretation of fMRI results to clarify the relation between respiratory fluctuations, cognitive performance, and fMRI signal. Here, we investigated this issue by measuring respiration during word encoding, together with a breath-holding condition during fMRI-scanning. Stimulus-locked respiratory analyses showed that respiratory fluctuations predicted successful encoding via a respiratory phase-locking mechanism. At the same time, the fMRI analyses showed that PMR-deactivations associated with learning were reduced during breath-holding and correlated with individual differences in the respiratory phase-locking effect during normal breathing. A left frontal region--used as a control region--did not show these effects. These findings indicate that respiration is a critical factor in explaining the link between PMR-deactivation and successful cognitive performance. Further research is necessary to demonstrate whether our findings are restricted to episodic memory encoding, or also extend to other cognitive domains.

Oscillatory dynamics and place field maps reflect hippocampal ensemble processing of sequence and place memory under NMDA receptor control

Place coding in the hippocampus requires flexible combination of sensory inputs (e.g., environmental and self-motion information) with memory of past events. We show that mouse CA1 hippocampal spatial representations may either be anchored to external landmarks (place memory) or reflect memorized sequences of cell assemblies depending on the behavioral strategy spontaneously selected. These computational modalities correspond to different CA1 dynamical states, as expressed by theta and low- and high-frequency gamma oscillations, when switching from place to sequence memory-based processing. These changes are consistent with a shift from entorhinal to CA3 input dominance on CA1. In mice with a deletion of forebrain NMDA receptors, the ability of place cells to maintain a map based on sequence memory is selectively impaired and oscillatory dynamics are correspondingly altered, suggesting that oscillations contribute to selecting behaviorally appropriate computations in the hippocampus and that NMDA receptors are crucial for this function.